Course Overview of Build Batch Data Pipelines on Google Cloud:
This Course has been retired. A new version of this exam, Data Engineering on Google Cloud is available. Do visit this course page for more details.
This instructor-led course focuses on designing and implementing robust batch data pipelines on Google Cloud. Participants will explore large-scale data ingestion, transformation, and workflow orchestration using modern tools such as Dataflow and Serverless for Apache Spark.
Through hands-on labs and real-world scenarios, learners will gain practical experience in ensuring data quality, optimizing performance, and implementing monitoring and alerting mechanisms for reliable batch processing systems.
After completing Build Batch Data Pipelines on Google Cloud, participants will be able to:
- Identify when to use batch data pipelines for business use cases
- Design scalable pipelines for large-scale data processing
- Implement data ingestion and transformation workflows
- Use Dataflow and Dataproc Serverless for pipeline execution
- Apply data quality validation and cleansing techniques
- Handle schema evolution and data deduplication
- Orchestrate workflows using Cloud Composer
- Monitor pipelines using logging, alerts, and observability tools