Apache Beam | A Hands-On course to build Big data Pipelines
What you will learn
Learn Apache Beam - A portable programming model whose pipelines can be deployed on Spark, Flink, GCP (Google Cloud Dataflow) etc.
Understand the working of each and every component of Apache Beam with HANDS-ON examples.
Learn Apache Beam fundamentals including its Architecture, Programming model, Pcollections, Pipelines etc.
Multiple PTransforms to Read, Transform and Write the processed data.
Advance concepts of Windowing, Triggers, Watermarks, Late elements, Type Hints and many more.
Load data to Google BigQuery Tables from Apache Beam pipeline.
Build Real-Time business's Big data processing pipelines using Apache Beam.
Data-sets and Beam codes used in lectures are available in resources tab.
Course Gallery
Charts
Comidoc Review
Our Verdict
This 5.5-hour course on building Big Data pipelines with Apache Beam excels at providing an overview of its main features and real-world examples—making it a good starting point for newcomers to the framework. Despite some unanswered support questions, lackluster assistance, and occasional typos, most students will benefit from learning the fundamentals through hands-on exercises, even if they'll have to modify or install additional components in some code examples.\nWhile the course does not cover every detail of Apache Beam, it serves as an excellent guide for getting started with writing pipeline transformations and executing them using various Runners, such as Spark, Flink, or Google Cloud Dataflow. Additionally, architects looking to grasp basic concepts before diving into official documentation will find this course particularly useful.\nHowever, those expecting in-depth coverage and professional production insights may be mildly disappointed due to the limited scope of specific topics and relatively few advanced insights.
What We Liked
- Covers all main features of Apache Beam with a focus on running pipelines through selected Runners
- High-quality course with practical examples providing a strong foundation for beginners in Apache Beam
- Instructor effectively conveys concepts, and code examples are useful for hands-on practice
- Real-world examples and insights help architects adapt solutions to business requirements
Potential Drawbacks
- Lack of support, with unanswered questions and limited assistance within the course scope
- Some code examples need modifications or additional components for successful execution
- Occasional typos and unprofessional-sounding statements found throughout the course
- Not structured for beginners; assumes existing knowledge of Apache Beam