{"id":49042,"date":"2023-12-12T12:50:18","date_gmt":"2023-12-12T12:50:18","guid":{"rendered":"https:\/\/www.cloudthat.com\/resources\/?post_type=resources&#038;p=49042"},"modified":"2023-12-15T10:48:30","modified_gmt":"2023-12-15T10:48:30","slug":"overcoming-operational-challenges-through-data-optimization-and-real-time-insights","status":"publish","type":"resources","link":"https:\/\/www.cloudthat.com\/resources\/case-study\/overcoming-operational-challenges-through-data-optimization-and-real-time-insights","title":{"rendered":"Overcoming Operational Challenges Through Data Optimization and Real-time Insights"},"content":{"rendered":"<p><span class=\"TextRun SCXW13345040 BCX8\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun SpellingErrorV2Themed SCXW13345040 BCX8\">Line Clear<\/span><span class=\"NormalTextRun SCXW13345040 BCX8\"> Express &amp; Logistics <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW13345040 BCX8\">Sdn<\/span> <span class=\"NormalTextRun SCXW13345040 BCX8\">Bhd<\/span><span class=\"NormalTextRun SCXW13345040 BCX8\"> is a subsidiary of MMAG Holdings <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW13345040 BCX8\">Berhad<\/span><span class=\"NormalTextRun SCXW13345040 BCX8\"> since 2015 <\/span><span class=\"NormalTextRun SCXW13345040 BCX8\">and <\/span><span class=\"NormalTextRun SCXW13345040 BCX8\">is a top supply chain management specialist in Malaysia, offering reliable delivery services, warehousing, last-mile delivery, and international options. With a broad network, they are a preferred choice for diverse business needs.<\/span><\/span><span class=\"EOP SCXW13345040 BCX8\" data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/p>\n","protected":false},"author":1291,"featured_media":49045,"parent":0,"template":"","cat_resources":[6],"technology":[32],"published_by":"1291","primary-authors":"","secondary-authors":"","acf":{"banner_image":49047,"resources_label":"","download_url":"https:\/\/content.cloudthat.com\/resources\/wp-content\/uploads\/2023\/12\/Line-Clear-Express_Case-Study.pdf","client_logo":49048,"highlights":{"first_part":{"icon":336,"title":"15 minutes ","subtitle":"Real-time Insights"},"second_part":{"icon":335,"title":"250 GB + ","subtitle":"Daily Data Processing Capacity"},"third_part":{"icon":334,"title":"Dashboards and Reports  ","subtitle":"Structured User Hierarchy"}},"the_challenge":"<span class=\"TextRun SCXW68044118 BCX8\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"auto\"><span class=\"NormalTextRun SCXW68044118 BCX8\">The client handles thousands of daily packages at various stages, generating a substantial amount of data collected by multiple applications. They faced challenges, including the lack of access to key metrics, real-time package information, manual processes, and the inability to process this data effectively for decision-making, leading to operational inefficiencies and hindered customer satisfaction.<\/span><\/span><span class=\"EOP SCXW68044118 BCX8\" data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span>","client_testimonial":{"image":"","description":"","author":""},"solutions":"<ul style=\"font-weight: 400;\">\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"1\" data-aria-level=\"1\"><span data-contrast=\"auto\">Importing data from client applications, including tabular data from Amazon Aurora RDS and manual CSV data.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"2\" data-aria-level=\"1\"><span data-contrast=\"auto\">Data is imported from Amazon Aurora RDS using Amazon Database Migration Service.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"3\" data-aria-level=\"1\"><span data-contrast=\"auto\">Continuous data changes are replicated from Amazon RDS to Amazon S3 using Replication Tasks.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"4\" data-aria-level=\"1\"><span data-contrast=\"auto\">Manual CSV data is collected and uploaded to an Amazon S3 bucket, serving as the Data Lake.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"5\" data-aria-level=\"1\"><span data-contrast=\"auto\">Data is processed in Databricks Workspace, which utilizes Amazon S3 as a Data Lake.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"6\" data-aria-level=\"1\"><span data-contrast=\"auto\">Delta Tables are created in Databricks for real-time data updates, handled by CDC jobs.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"7\" data-aria-level=\"1\"><span data-contrast=\"auto\">Reports are generated based on client requirements, including exploratory data analysis and data transformation.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"8\" data-aria-level=\"1\"><span data-contrast=\"auto\">Reports are stored in Amazon S3 as CSV files.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"9\" data-aria-level=\"1\"><span data-contrast=\"auto\">Amazon QuickSight (Enterprise Edition) is used for data visualization.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"10\" data-aria-level=\"1\"><span data-contrast=\"auto\">Amazon S3 is the data source for Amazon QuickSight, refreshed multiple times daily.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"11\" data-aria-level=\"1\"><span data-contrast=\"auto\">A manifest folder with Amazon S3 URLs of Manifest files is created for QuickSight.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559739&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n \t<li data-leveltext=\"\uf0b7\" data-font=\"Symbol\" data-listid=\"1\" data-list-defn-props=\"{&quot;335552541&quot;:1,&quot;335559684&quot;:-2,&quot;335559685&quot;:360,&quot;335559991&quot;:360,&quot;469769226&quot;:&quot;Symbol&quot;,&quot;469769242&quot;:[8226],&quot;469777803&quot;:&quot;left&quot;,&quot;469777804&quot;:&quot;\uf0b7&quot;,&quot;469777815&quot;:&quot;hybridMultilevel&quot;}\" aria-setsize=\"-1\" data-aria-posinset=\"12\" data-aria-level=\"1\"><span data-contrast=\"auto\">Row-level security is applied based on the Branch column for region-specific access with multiple user roles.<\/span><span data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span><\/li>\r\n<\/ul>","the_results":"<span class=\"TextRun SCXW48997451 BCX8\" lang=\"EN-US\" xml:lang=\"EN-US\" data-contrast=\"none\"><span class=\"NormalTextRun SCXW48997451 BCX8\">D<\/span><span class=\"NormalTextRun SCXW48997451 BCX8\">ecisions with 15-min real-time analytics, structured user hierarchy, daily 250 GB processing, and Amazon <\/span><span class=\"NormalTextRun SpellingErrorV2Themed SCXW48997451 BCX8\">Quick Sight<\/span><span class=\"NormalTextRun SCXW48997451 BCX8\"> dashboards delivering key metrics in 15 <\/span><span class=\"NormalTextRun SCXW48997451 BCX8\">minutes<\/span><span class=\"NormalTextRun SCXW48997451 BCX8\">, with interactive user management and filters<\/span><span class=\"NormalTextRun SCXW48997451 BCX8\">.<\/span><\/span><span class=\"EOP SCXW48997451 BCX8\" data-ccp-props=\"{&quot;201341983&quot;:0,&quot;335559740&quot;:259}\">\u00a0<\/span>","about_client_left_side":[{"field_63315a4dc06e1":"15085","field_63315a5bc06e2":"Industry\u00a0","field_63315a61c06e3":"Logistics and Supply Chain"},{"field_63315a4dc06e1":"15083","field_63315a5bc06e2":"Expertise\u00a0","field_63315a61c06e3":"AWS IAM, Amazon CloudWatch, AWS CloudTrail, AWS Support, Amazon S3, Amazon RDS, Amazon EC2 "},{"field_63315a4dc06e1":"15084","field_63315a5bc06e2":"Offerings\/solutions\u00a0","field_63315a61c06e3":"Business decisions with real-time analytics, structured user hierarchy, and Amazon QuickSight dashboards processing 250 GB daily, offering key metrics for comprehensive business evaluation in just 15 minutes. "}]},"_links":{"self":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/resources\/49042"}],"collection":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/resources"}],"about":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/types\/resources"}],"author":[{"embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/users\/1291"}],"version-history":[{"count":2,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/resources\/49042\/revisions"}],"predecessor-version":[{"id":49051,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/resources\/49042\/revisions\/49051"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/media\/49045"}],"wp:attachment":[{"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/media?parent=49042"}],"wp:term":[{"taxonomy":"cat_resources","embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/cat_resources?post=49042"},{"taxonomy":"technology","embeddable":true,"href":"https:\/\/www.cloudthat.com\/resources\/wp-json\/wp\/v2\/technology?post=49042"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}