{"id":9525,"date":"2021-12-20T13:40:06","date_gmt":"2021-12-20T13:40:06","guid":{"rendered":"https:\/\/blog.cloudthat.com\/?p=9525"},"modified":"2024-06-25T11:06:02","modified_gmt":"2024-06-25T11:06:02","slug":"strategizing-effective-cloud-migrations-with-an-example-case-study","status":"publish","type":"blog","link":"https:\/\/www.cloudthat.com\/resources\/blog\/strategizing-effective-cloud-migrations-with-an-example-case-study","title":{"rendered":"Strategizing Effective Cloud Migrations with an Example Case Study"},"content":{"rendered":"<p>According to Gartner, by the end of 2021, 70% of organizations worldwide have migrated at least some workloads to the public cloud. Also, Gartner has identified 6 important factors that can derail cloud migration strategies of companies have been identified and they are: Choosing a wrong cloud migration ally, rushed application assessments, setting the wrong emphasis, poor landing zone designs, dependency bottlenecks, and hidden indirect costs. This blog post decodes how <strong><a href=\"https:\/\/www.cloudthat.com\/about-us\/\">CloudThat<\/a><\/strong>\u00a0has helped its clients to ensure a seamless and cost-effective cloud migration and helped them to meet their business objectives.<\/p>\n<table style=\"height: 248px;\" border=\"3\" width=\"272\">\n<tbody>\n<tr>\n<td><span style=\"color: #000080;\"><strong>TABLE OF CONTENT<\/strong><\/span><\/td>\n<\/tr>\n<tr>\n<td><a href=\"#Introduction\">Introduction<\/a><\/td>\n<\/tr>\n<tr>\n<td><a href=\"#Customer Challenge\">Customer Challenge<\/a><\/td>\n<\/tr>\n<tr>\n<td><a href=\"#Assessment Process Employed\">Assessment Process Employed<\/a><\/td>\n<\/tr>\n<tr>\n<td><a href=\"#Business Objectives Identified\">Business Objectives Identified<\/a><\/td>\n<\/tr>\n<tr>\n<td><a href=\"#Our Proposed Solution\">Our Proposed Solution<\/a><\/td>\n<\/tr>\n<tr>\n<td><a href=\"#Role of AWS in the Proposed Solution\">Role of AWS in the Proposed Solution<\/a><\/td>\n<\/tr>\n<tr>\n<td><a href=\"#The Project Outcomes\">The Project Outcomes<\/a><\/td>\n<\/tr>\n<tr>\n<td><a href=\"#Architecture Diagram and Design Used\">Architecture Diagram and Design Used<\/a><\/td>\n<\/tr>\n<tr>\n<td><a href=\"#Conclusion\">Conclusion<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h1>Introduction<\/h1>\n<p><span data-contrast=\"auto\">As\u00a0organizations scale, customer demand increases rapidly. To meet the increasing demands, organizations tend to opt for newer and advanced cloud technologies. Cloud Service providers are competing today to provide improved reliability and customer experience through their software applications. While adopting new cloud technologies is a challenge, adhering to the budget without compromising the security posture can prove to be next to impossible without an expert.\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:360}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">CloudThat offers consulting and system integration services to our clients along with cloud migration manages services, and Well-Architected Review (WAR). CloudThat\u00a0<\/span><span data-contrast=\"auto\">ensures\u00a0cloud-delivered systems\u202fadhere to the security\u202frequirements and compliance standards\u202fexpected by the\u202fcustomers\u202fin a multi-cloud environment<\/span><span data-contrast=\"none\">.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:360}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"auto\">Among our various global clients,\u00a0 A\u00a0 client who offers a data platform for digital publishers approached\u00a0us\u00a0to migrate their infrastructure along with data from Google Cloud Platform (GCP) to Amazon Web Services (AWS).\u00a0Let us dive deep into the details about the customer challenges, migration process, proposed solutions, outcomes, and architectural diagram description.<\/span><\/p>\n<h1 id=\"Devising Cloud Migration Strategy: A Case Study Approach\"><\/h1>\n<h1 id=\"Customer Background\">Customer Background<\/h1>\n<p><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\" data-ccp-charstyle-defn=\"{&quot;ObjectId&quot;:&quot;72383845-0730-44b4-99c3-61ea2a1e5649|57&quot;,&quot;ClassId&quot;:1073872969,&quot;Properties&quot;:[134233614,&quot;true&quot;,201340122,&quot;1&quot;,469775450,&quot;normaltextrun1&quot;,469778129,&quot;normaltextrun1&quot;,469778324,&quot;Default Paragraph Font&quot;]}\">Our client is a performance data platform\u00a0<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">for digital publishers\u00a0<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">that helps marquee publishers like\u00a0<\/span><span class=\"NormalTextRun SpellingErrorV2 SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">Futbol<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">\u00a0Sites\/<\/span><span class=\"NormalTextRun SpellingErrorV2 SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">BolaVIP<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">,\u00a0<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">Carousell<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">, TSM Games\/<\/span><span class=\"NormalTextRun SpellingErrorV2 SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">BlitZ<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">,\u00a0<\/span><span class=\"NormalTextRun SpellingErrorV2 SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">LaOpinion<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">,\u00a0<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">ElDiario<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">, 1Weather, Times Internet &#8211;\u00a0<\/span><span class=\"NormalTextRun SpellingErrorV2 SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">Gaana<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">,\u00a0<\/span><span class=\"NormalTextRun SpellingErrorV2 SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">InMobi<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">,\u00a0<\/span><span class=\"NormalTextRun SpellingErrorV2 SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">FrontStory<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">,\u00a0<\/span><span class=\"NormalTextRun SpellingErrorV2 SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">SonyLIV<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">, Zee5, Digit &amp; eBay with use cases around analytics &amp; optimization to help them manage &amp; boost their ad-revenues.<\/span><span class=\"NormalTextRun SCXW218410300 BCX0\" data-ccp-charstyle=\"normaltextrun1\">\u00a0They equip their customers with real-time data and insights to manage and accelerate revenue growth.<\/span><\/p>\n<h1 id=\"Customer Challenge\">Customer Challenge<\/h1>\n<p><span class=\"TextRun SCXW23177088 BCX0\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\" data-ccp-charstyle-defn=\"{&quot;ObjectId&quot;:&quot;72383845-0730-44b4-99c3-61ea2a1e5649|57&quot;,&quot;ClassId&quot;:1073872969,&quot;Properties&quot;:[134233614,&quot;true&quot;,201340122,&quot;1&quot;,469775450,&quot;normaltextrun1&quot;,469778129,&quot;normaltextrun1&quot;,469778324,&quot;Default Paragraph Font&quot;]}\">The client&#8217;s<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">\u00a0requirements were to migrate their Infrastructure along with data from G<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">oogle Cloud\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">P<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">latform<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">\u00a0to AWS<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">.\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">All the applications and services which belong\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">to\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">GCP should be migrated\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">to AWS<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">.\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">To meet the increasing customer demand, the client<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">\u00a0wanted to migrate their application\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">running on GCP\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">to\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">the AWS\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">cloud and\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">manage the\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">infrastructure<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">\u00a0efficiently<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">.<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-parastyle=\"paragraph\" data-ccp-parastyle-defn=\"{&quot;ObjectId&quot;:&quot;72383845-0730-44b4-99c3-61ea2a1e5649|56&quot;,&quot;ClassId&quot;:1073872969,&quot;Properties&quot;:[134233614,&quot;true&quot;,201340122,&quot;2&quot;,201341983,&quot;0&quot;,268442635,&quot;24&quot;,335559705,&quot;16393&quot;,335559739,&quot;0&quot;,335559740,&quot;240&quot;,469769226,&quot;Times New Roman&quot;,469775450,&quot;paragraph&quot;,469777841,&quot;Times New Roman&quot;,469777842,&quot;Times New Roman&quot;,469777843,&quot;Times New Roman&quot;,469777844,&quot;Times New Roman&quot;,469778129,&quot;paragraph&quot;,469778324,&quot;Normal&quot;]}\">\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">The client required a robust and world-class infrastructure deployed on the AWS cloud platform to mitigate\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">the major\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">challenges.<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">\u00a0Managing the current AWS resources and creating new resources with standard practices was a significant challenge for the client. The entire engineering process needed to be changed to improve reliability and customer experience.\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">The focus was on\u00a0<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">cost optimization,<\/span><span class=\"NormalTextRun SCXW23177088 BCX0\" data-ccp-charstyle=\"normaltextrun1\">\u00a0fault-tolerant, and HA (highly available) applications hosted on AWS cloud for a successful IT transformation for the client&#8217;s business environment.\u00a0<\/span><\/span><span class=\"EOP SCXW23177088 BCX0\" data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/p>\n<h1 id=\"Assessment Process Employed\">Assessment Process Employed<\/h1>\n<p><span data-contrast=\"none\">Our client was keen on building a robust cloud migration methodology\u00a0to improve reliability and performance, operate more securely, optimize costs,\u00a0and\u00a0automate security and thus improve the overall security posture.\u00a0\u00a0Their existing\u00a0used\u00a0Dataflow for Batch and Streaming\u00a0jobs\u00a0where Batch jobs\u00a0were\u00a0infrequent running day by day in Dataflow and Streaming job\u00a0was running for\u00a0previous\u00a0160 days.\u00a0They\u00a0inserted\u00a0data streams\u00a0during\u00a0the transformation from Cloud Pub\/Sub to Big Query\u00a0streaming jobs.\u00a0We\u00a0assessed and\u00a0suggested to\u00a0them\u00a0to\u00a0use the service from the Kinesis data family\u00a0for\u00a0data streaming and batch jobs.\u00a0<\/span><span data-ccp-props=\"{&quot;134233117&quot;:true,&quot;134233118&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:360}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"none\">They employed\u00a0BigQuery\u00a0for\u00a0querying on 50 TB of their data and\u00a0for\u00a0performing streaming inserts\u00a0coming from Dataflow. And then that data\u00a0was\u00a0queried on the basis\u00a0of\u00a0business logic required from\u00a0Big\u00a0Query and sent to the application.\u00a0<\/span><span data-ccp-props=\"{&quot;134233117&quot;:true,&quot;134233118&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:360}\">\u00a0<\/span><\/p>\n<p><span data-contrast=\"none\">Though\u00a0for\u00a0BigQuery\u00a0we\u00a0have\u00a0two options\u00a0Athena or Redshift in AWS\u00a0as\u00a0per the\u00a0processing requirements.\u00a0Eventually, we zeroed down on\u00a0Athena\u00a0as\u00a0it\u00a0will be cheaper than Redshift providing cost optimization benefits.<\/span><\/p>\n<h1 id=\"Business Objectives Identified\">Business Objectives Identified<\/h1>\n<ul style=\"font-weight: 400;\">\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">By migrating from GCP to AWS cloud, the customer will be able to avail the value benefits of AWS services and have a secure and reliable cloud computing platform<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">Use\u00a0of\u00a0AWS\u00a0Cloud services for their Analytics and Application requirements<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Reduce data storage cost<\/span><span data-ccp-props=\"{&quot;134233279&quot;:true,&quot;201341983&quot;:0,&quot;335559739&quot;:160,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Optimize\u00a0the\u00a0performance of data analytics.<\/span><\/li>\n<\/ul>\n<h1 id=\"Our Proposed Solution\">Our Proposed Solution<\/h1>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">Setup of\u00a0highly available and scalable application\u00a0for serving the\u00a0massive traffic with\u00a0the\u00a0help of EC2, ALB, CloudFront<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">Setup\u00a0of WordPress application on AWS LightSail<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Setup of RDS DB<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Configure\u00a0SNS\u00a0and SQS\u00a0for all the topics and subscriptions that belong to Google Pub-Sub.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">Migrated GCS data to AWS S3.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">Configure\u00a0Glue Crawlers\u00a0on S3\u00a0to create the\u00a0databases and\u00a0tables for Athena.<\/span><\/li>\n<\/ul>\n<h1 id=\"Role of AWS in the Proposed Solution\">Role of AWS in the Proposed Solution<\/h1>\n<p>We extensively used employed AWS features and services in deploying the solution. Important ones include:\u00a0<span data-contrast=\"auto\">Amazon Athena,\u00a0<\/span><span data-contrast=\"auto\">AWS Glue<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559685&quot;:390,&quot;335559731&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">,\u00a0<\/span><span data-contrast=\"auto\">Amazon S3,\u00a0<\/span><span data-contrast=\"auto\">Amazon SNS,\u00a0<\/span><span data-contrast=\"auto\">Amazon SQS<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559685&quot;:390,&quot;335559731&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">,\u00a0<\/span><span data-contrast=\"auto\">Amazon EC2<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559685&quot;:390,&quot;335559731&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">,\u00a0<\/span><span data-contrast=\"auto\">AWS Elastic Load Balancing<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559685&quot;:390,&quot;335559731&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">,\u00a0<\/span><span data-contrast=\"auto\">Amazon CloudFront<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559685&quot;:390,&quot;335559731&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">,\u00a0<\/span><span data-contrast=\"auto\">AWS CloudWatch,\u00a0<\/span><span data-contrast=\"auto\">Amazon RDS, and,\u00a0<\/span><span data-contrast=\"auto\">Amazon\u00a0QuickSight<\/span><\/p>\n<h1 id=\"The Project Outcomes\">The Project Outcomes<\/h1>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"none\">Cost optimization is achieved\u00a0by minimizing\u00a0the\u00a0service bill\u00a0that was\u00a0expensive prior to\u00a0migration \u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"none\">The Core Application is Highly Scalable and Available running on an EC2 server with Load balancing and CDN in place<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"none\">We have migrated GCS buckets to Amazon S3 and used AWS Glue and Athena to work seamlessly<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"none\">The client has started using AWS services for their analytics, such as Amazon Athena, AWS Glue\u00a0<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"5\" data-aria-level=\"1\"><span data-contrast=\"none\">The database\u00a0tables\u00a0get\u00a0updated\u00a0on an hourly basis<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"none\">The Client application\u00a0querying on S3 using Amazon Athena,\u00a0thus\u00a0helping\u00a0for\u00a0cost and performance\u00a0optimization<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:360}\">\u00a0<\/span><\/li>\n<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"6\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"none\">All the data is archived\u00a0and stored as backup.\u00a0<\/span><\/li>\n<\/ul>\n<h1 id=\"Architecture Diagram and Design Used\">Architecture Diagram and Design Used<\/h1>\n<ol>\n<li><strong>AWS Architecture Diagram and Design<\/strong><\/li>\n<\/ol>\n<p>AWS EC2 instances were used to run and serve the application using the public-facing Application Load balancers and CloudFront as a caching layer. Amazon S3 was used for storing static data and serving that data to Glue Crawlers which is then queried by AWS Athena service. Amazon SNS is used as a publisher to send messages according to the required topics and Amazon SQS is used as a subscriber to send and process data as per the requirements by different application services. We employed Amazon QuickSight to provide BI dashboards and analytics.<\/p>\n<p><a href=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/Picture126.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-9538\" src=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/Picture126-300x214.png\" alt=\"\" width=\"559\" height=\"399\" \/><\/a><\/p>\n<p><strong>2. AWS Architecture Diagram<\/strong><\/p>\n<p>AWS Lambda is employed to run cron tasks on the tables (AWS Athena) which stores the resultant data on S3. Those S3 insights were processed and served using an Application Load balancer with CloudFront caching.<\/p>\n<p><a href=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/Picture210.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-9539\" src=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/Picture210-283x300.png\" alt=\"\" width=\"558\" height=\"592\" \/><\/a><\/p>\n<p><strong>3. Automation of serving Athena tables with data of previous 30 days from S3<\/strong><\/p>\n<ol>\n<li>Deleting partition from the tables which are older than 30 days<\/li>\n<li>Moving the data files that are deleted from the table to different S3 bucket<\/li>\n<\/ol>\n<p><a href=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/Picture37.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-9540\" src=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/Picture37-238x300.png\" alt=\"\" width=\"553\" height=\"697\" \/><\/a><\/p>\n<p><strong>4. Highly available and Scalable Architecture and Automation of Athena table Updating Process:<\/strong><\/p>\n<ol>\n<li>The web layer is exposed to the internet via the CloudFront caching layer and public-facing internal LoadBalancer. Internal applications run on the EC2 server fleets which are highly scalable and highly available.<\/li>\n<li>AWS EC2: Serving and writing logs data to S3 every hour.<\/li>\n<li>Lambda function 1 : XYZ-Production-Job.<\/li>\n<li>Triggered on S3 push event.<\/li>\n<li>Start Glue Crawlers according to the name of the table.<\/li>\n<\/ol>\n<p><a href=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/Picture46.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-9541 alignnone\" src=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/Picture46-300x173.png\" alt=\"\" width=\"555\" height=\"320\" \/><\/a><\/p>\n<p style=\"text-align: left;\">Automation Architecture Diagram<\/p>\n<p><strong>5. Automation of Table Deletion from the Temp Database<\/strong><\/p>\n<ol>\n<li>CloudWatch Event Rule: trigger the Lambda function daily at 11:30<\/li>\n<li>Lambda function 1: Delete-Temp-Tables<\/li>\n<li>Delete and recreate the temp database<\/li>\n<\/ol>\n<p><a href=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/MicrosoftTeams-image-21.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-9585\" src=\"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2022\/11\/MicrosoftTeams-image-21-300x44.png\" alt=\"\" width=\"573\" height=\"84\" \/><\/a><\/p>\n<p><em>Serverless<\/em> <em>Automation for deleting temporary database <\/em><\/p>\n<h1 id=\"Conclusion\">Conclusion<\/h1>\n<p>Cloud migration involves capital risks, budget issues, disaster recovery strategy, and many other aspects. During the process, the security posture can be vulnerable and unstable which could lead to potential adversaries. It is recommended to choose an expert third-party vendor to manage your data migration requirements.<\/p>\n<p><a href=\"https:\/\/cloudthat.com\/?utm_source=blog-website&amp;utm-medium=text-link&amp;utm_campaign=cloudthat.com\/\"><strong>CloudThat\u00a0<\/strong><\/a>is Microsoft Gold Partner, AWS Advanced Consulting Partner, and a Google Cloud Partner and has successfully led many migration projects for our esteemed clients. Get in touch with us for quick results.<br \/>\nFeel free to drop a comment or any queries that you have regarding cloud migration, and we will get back to you quickly. To get started, go through <strong>our\u00a0<\/strong><a href=\"https:\/\/www.cloudthat.com\/expert-advisory\/?utm_source=blog-website&amp;utm-medium=text-link&amp;utm_campaign=expert-advisory\"><strong>Expert Advisory\u00a0<\/strong><\/a><strong>page\u00a0<\/strong>and\u00a0<a href=\"https:\/\/www.cloudthat.com\/managed-services-packages\/\"><strong>Managed Services Package<\/strong><\/a>\u00a0that is\u00a0<a href=\"https:\/\/cloudthat.com\/?utm_source=blog-website&amp;utm-medium=text-link&amp;utm_campaign=cloudthat.com\/\">CloudThat<\/a><strong>\u2019s\u00a0<\/strong>offerings. You can easily get in touch with our highly accomplished team of experts to carry out your migration needs.<\/p>\n<p>Learn more about Cloud Migration Methodology and implementation here: <a href=\"https:\/\/blog.cloudthat.com\/5-key-cloud-migration-challenges-and-their-proven-solutions\/?utm_source=blog-website&amp;utm-medium=text-link&amp;utm_campaign=5-key-cloud-migration-challenges-and-their-proven-solutions\/\" target=\"_blank\" rel=\"noopener\"><strong>5 Key Cloud Migration Challenges and Their Proven Solutions<\/strong><\/a><\/p>\n<p>Feel free to drop a comment or any queries that you have regarding cloud migration, and we will get back to you quickly.<\/p>\n","protected":false},"author":219,"featured_media":9588,"parent":0,"comment_status":"open","ping_status":"open","template":"","blog_category":[3607,5495],"user_email":"prarthitm@cloudthat.com","published_by":"324","primary-authors":"","secondary-authors":"","acf":[],"_links":{"self":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog\/9525"}],"collection":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/users\/219"}],"replies":[{"embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/comments?post=9525"}],"version-history":[{"count":1,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog\/9525\/revisions"}],"predecessor-version":[{"id":46141,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog\/9525\/revisions\/46141"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/"}],"wp:attachment":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/media?parent=9525"}],"wp:term":[{"taxonomy":"blog_category","embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/blog_category?post=9525"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}