The two key components of any data pipeline are data lakes and warehouses. This course highlights use-cases for each type of storage and dives into the available data lake and warehouse solutions on Google Cloud Platform in technical detail. Also, this course describes the role of a data engineer, the benefits of a successful data pipeline to business operations, and examines why data engineering should be done in a cloud environment. Learners will get hands-on experience with data lakes and warehouses on Google Cloud Platform using QwikLabs.
提供方
Google 云端平台
课程信息
109,369 次近期查看
100% 在线
立即开始，按照自己的计划学习。
可灵活调整截止日期
根据您的日程表重置截止日期。
中级
完成时间大约为12 小时
建议：22 hours/week
英语（English）
字幕：英语（English）
提供方
Google 云端平台
We help millions of organizations empower their employees, serve their customers, and build what’s next for their businesses with innovative technology created in—and for—the cloud. Our products are engineered for security, reliability, and scalability, running the full stack from infrastructure to applications to devices and hardware. Our teams are dedicated to helping customers apply our technologies to create success.
教学大纲 - 您将从这门课程中学到什么
完成时间为 7 分钟
Introduction
This module gives an introduction of the Data Engineering specialization and the course.
完成时间为 7 分钟
2 个视频 （总计 7 分钟）
完成时间为 2 小时
Introduction to Data Engineering
This module describes the role of a data engineer and motivates the claim why data engineering should be done in the Cloud
完成时间为 2 小时
13 个视频 （总计 55 分钟）
13 个视频
Analyze data engineering challenges8分钟
Intro to BigQuery3分钟
Data Lakes and Data Warehouses5分钟
Demo: Federated Queries with BigQuery6分钟
Transactional Databases vs Data Warehouses4分钟
Partner effectively with other data teams6分钟
Manage data access and governance2分钟
Demo: Finding PII in your dataset with DLP API1分钟
Build production-ready pipelines2分钟
Review GCP customer case study3分钟
Recap1分钟
Lab Intro: Using BigQuery to do Analysis17
1 个练习
Introduction to Data Engineering30分钟
完成时间为 2 小时
Building a Data Lake
In this module, we describe what data lake is and how to use Google Cloud Storage as you data lake on GCP
完成时间为 2 小时
10 个视频 （总计 58 分钟）
10 个视频
Data Storage and ETL options on GCP4分钟
Building a Data Lake using Cloud Storage10分钟
Demo: Optimizing cost with Google Cloud Storage classes and Cloud Functions7分钟
Securing Cloud Storage5分钟
Storing All Sorts of Data Types5分钟
Demo: Running federated queries on Parquet and ORC files in BigQuery4分钟
Storing Relational Data in the Cloud1分钟
Cloud SQL as a relational Data Lake7分钟
Lab: Loading Taxi Data into Cloud SQL27
1 个练习
Building a Data Lake4分钟
完成时间为 4 小时
Building a data warehouse
In this module, we talk about BigQuery as a data warehousing option on GCP
完成时间为 4 小时
17 个视频 （总计 93 分钟）
17 个视频
Intro to BigQuery1分钟
Demo: Querying TB of Data in seconds7分钟
Getting Started9分钟
Loading Data11分钟
Lab Intro: Loading Data into BigQuery21
Exploring Schemas24
Demo: Exploring Schemas10分钟
Schema Design3分钟
Nested and Repeated Fields8分钟
Demo: Nested and Repeated Fields15分钟
Lab Intro: Working with JSON and Array Data in BigQuery13
Optimizing with Partitioning and Clustering5分钟
Demo: Creating Partitioned Tables7分钟
Demo: Partitioning and Clustering6分钟
Preview: Transforming Batch and Streaming Data2分钟
Recap1分钟
1 个练习
Building a Data Warehouse4分钟
完成时间为 2 分钟
Summary
This module reviews all the topics covered in the course
完成时间为 2 分钟
1 个视频 （总计 2 分钟）
1 个视频
审阅
4.7
来自 MODERNIZING DATA LAKES AND DATA WAREHOUSES WITH GCP的热门评论
由 AA 提供Feb 14, 2020
Good introduction and overview of the field of data engineering, data lakes and modern data warehouses and a hands-on walkthrough of all the technologies related to solving these problems on GCP.
由 BA 提供Feb 8, 2020
The course offers a nice description of what modern DWH means, which are the differences between classic DWH and cloud DWH. You have the chance to work with the new cloud concept on GCP.
由 TG 提供Feb 4, 2020
Course material spends a little too much time promoting the benefits of GCP when it could be focusing on the technical aspects of using GCP
由 PU 提供Mar 18, 2020
Really good course for beginners this will help them to understand about Data Lakes, Data Warehouses, BigQuery,Google Storage & Cloud SQL.
由 SM 提供Mar 21, 2020
Very detailed course on using BigQuery. Gives clarity on different services offered in GCP. Need to attend this for detailed understanding
由 SB 提供Feb 15, 2020
Very valuable information about data lakes, data warehouses, using Arrays and Structs to store data in BigQuery. Loved the course.
由 DZ 提供Mar 29, 2020
Very informative and good level of detail as I progress through the specialization. The hands-on learning is very appreciated.
由 TT 提供Feb 17, 2020
Simply Extraordinary !! The way course took made me finish entire course with a continuous flow.Kudos to course faculty.
由 VS 提供Apr 1, 2020
Some of the labs were repetition from the first course, but one had to go thru it, to get completion status
由 AG 提供Mar 1, 2020
Muy bueno, creo que el se puede mejorar los laboratorios, aveces parecen no tener relación con el tema.
由 JW 提供Jan 22, 2020
Good class and a great intro to data lakes. Nice explanations on how data lakes and warehouses differ.
由 HK 提供Jan 14, 2020
Excellent presentation, demos and labs. The last lab needs to have a little more time allocated.
常见问题
我能否在注册前预览课程？
是的，您可以在注册之前预览第一个视频和查看授课大纲。您必须购买课程，才能访问预览不包括的内容。
我什么时候能够访问课程视频和作业？
如果您决定在班次开始日期之前注册课程，那么您将可以访问课程的所有课程视频和阅读材料。班次开始之后，您便可以提交作业。
我注册之后会得到什么？
在您注册且班次开课之后，您将可以访问所有视频和其他资源，包括阅读材料内容和课程论坛。您将能够查看和提交练习作业，并完成所需的评分作业以获得成绩和课程证书。
我什么时候会收到课程证书？
如果您成功完成课程，您的电子课程证书将添加到您的成就页中，您可以通过该页打印您的课程证书或将其添加到您的领英档案中。
我为什么不能旁听此课程？
该课程是 Coursera 上提供的为数不多的课程之一，目前只对已购买课程或已获得助学金的学生开放。
退款政策是如何规定的？
还有其他问题吗？请访问 学生帮助中心。
