Chevron Left
返回到 Serverless Data Processing with Dataflow: Develop Pipelines

学生对 Google 云端平台 提供的 Serverless Data Processing with Dataflow: Develop Pipelines 的评价和反馈

23 个评分
8 条评论


In this second installment of the Dataflow course series, we are going to be diving deeper on developing pipelines using the Beam SDK. We start with a review of Apache Beam concepts. Next, we discuss processing streaming data using windows, watermarks and triggers. We then cover options for sources and sinks in your pipelines, schemas to express your structured data, and how to do stateful transformations using State and Timer APIs. We move onto reviewing best practices that help maximize your pipeline performance. Towards the end of the course, we introduce SQL and Dataframes to represent your business logic in Beam and how to iteratively develop pipelines using Beam notebooks....



1 - Serverless Data Processing with Dataflow: Develop Pipelines 的 8 个评论(共 8 个)

创建者 Silviu D E

May 2, 2021

I really appreciate the knowledge and time that your team has put into these courses. Also looking forward to the 3th course on Dataflow/Beam (meanwhile, I still have some articles/documentation to read). Related on this course, my favorite part: - Windows, watermarks, and triggers; - Sources and Sinks; - Schemas; - Best practices; - SQL (for people that already are using BigQuery this will be a game changer). Also I've noted that Java it's the way to go for full features in Beam/Dataflow (although for me the syntax of python looks way prettier). Also I have a question: with "dataflow sql" you have less features than using java or python ?! Also Google have plans to bootstrap "Dataflow SQL" with more features? Also in 3th course, I hope that we will see more demos/code/case studies/git repos.

创建者 RLee

Jun 13, 2022

B​etter than earlier courses offered by Google Cloud. A bit more explanations for doing each task. But still, lots of problems running through the tasks and those problems had to be resolved by some configurations not mentioned in the guideline. Qwiklabs customer service or the course staff did not offer much help.

创建者 Abhishek V

Jun 24, 2021

Found this course very helpful while learning developing pipelines in gcp using dataflow-beam.

创建者 Trung N H

Jan 4, 2022

Excellent course focus on Batch and Streaming Pipelines using Google Dataflow

创建者 Mengyang C

Dec 31, 2021

Good for an advance engineers

创建者 Dmitry B

Apr 18, 2021

This course gives a great overview of the basic building blocks of Apache Beam as well as offers an opportunity to get your hands dirty and use these building blocks to build real data pipelines. I wish there was a continuation of this course to dive deeper into various topics e.g. GroupBy optimizations and advanced streaming.

创建者 Tomasz K

Jun 10, 2022

+ people from India (not native english speakers) often speak illegibly and it is difficult (sometimes impossible) to understand them. + subtitles don't help, because they are generated by AI and AI can't understand them either. + Sometimes it is also visible that they read what they need to say from the screen and it looks unprofessional + some code examples are in java only + sometimes we hear noices like drilling from the background

创建者 Steve V

Jun 9, 2021

Too hard, insufficient signposting