The two key components of any data pipeline are data lakes and warehouses. This course highlights use-cases for each type of storage and dives into the available data lake and warehouse solutions on Google Cloud Platform in technical detail. Also, this course describes the role of a data engineer, the benefits of a successful data pipeline to business operations, and examines why data engineering should be done in a cloud environment. Learners will get hands-on experience with data lakes and warehouses on Google Cloud Platform using QwikLabs.
Google 云端平台课程信息
98,348 次近期查看
可分享的证书
完成后获得证书
100% 在线
立即开始，按照自己的计划学习。
可灵活调整截止日期
根据您的日程表重置截止日期。
中级
完成时间大约为9 小时
英语（English）
字幕：英语（English）, 西班牙语（Spanish）
可分享的证书
完成后获得证书
100% 在线
立即开始，按照自己的计划学习。
可灵活调整截止日期
根据您的日程表重置截止日期。
中级
完成时间大约为9 小时
英语（English）
字幕：英语（English）, 西班牙语（Spanish）
提供方
Google 云端平台
We help millions of organizations empower their employees, serve their customers, and build what’s next for their businesses with innovative technology created in—and for—the cloud. Our products are engineered for security, reliability, and scalability, running the full stack from infrastructure to applications to devices and hardware. Our teams are dedicated to helping customers apply our technologies to create success.
教学大纲 - 您将从这门课程中学到什么
完成时间为 7 分钟
Introduction
This module gives an introduction of the Data Engineering specialization and the course.
完成时间为 7 分钟
2 个视频 （总计 7 分钟）
完成时间为 2 小时
Introduction to Data Engineering
This module describes the role of a data engineer and motivates the claim why data engineering should be done in the Cloud
完成时间为 2 小时
13 个视频 （总计 55 分钟）
13 个视频
Analyze data engineering challenges8分钟
Intro to BigQuery3分钟
Data Lakes and Data Warehouses5分钟
Demo: Federated Queries with BigQuery6分钟
Transactional Databases vs Data Warehouses4分钟
Partner effectively with other data teams6分钟
Manage data access and governance2分钟
Demo: Finding PII in your dataset with DLP API1分钟
Build production-ready pipelines2分钟
Review GCP customer case study3分钟
Recap1分钟
Lab Intro: Using BigQuery to do Analysis17
1 个练习
Introduction to Data Engineering30分钟
完成时间为 2 小时
Building a Data Lake
In this module, we describe what data lake is and how to use Google Cloud Storage as you data lake on GCP
完成时间为 2 小时
10 个视频 （总计 58 分钟）
10 个视频
Data Storage and ETL options on GCP4分钟
Building a Data Lake using Cloud Storage10分钟
Demo: Optimizing cost with Google Cloud Storage classes and Cloud Functions7分钟
Securing Cloud Storage5分钟
Storing All Sorts of Data Types5分钟
Demo: Running federated queries on Parquet and ORC files in BigQuery4分钟
Storing Relational Data in the Cloud1分钟
Cloud SQL as a relational Data Lake7分钟
Lab: Loading Taxi Data into Cloud SQL27
1 个练习
Building a Data Lake4分钟
完成时间为 4 小时
Building a data warehouse
In this module, we talk about BigQuery as a data warehousing option on GCP
完成时间为 4 小时
20 个视频 （总计 112 分钟）, 1 个阅读材料, 3 个测验
20 个视频
Intro to BigQuery1分钟
Demo: Querying TB of Data in seconds7分钟
Getting Started9分钟
Loading Data11分钟
Lab Intro: Loading Data into BigQuery21
Exploring Schemas24
Demo: Exploring Schemas10分钟
Schema Design3分钟
Nested and Repeated Fields8分钟
Demo: Nested and Repeated Fields15分钟
Lab Intro: Working with JSON and Array Data in BigQuery13
Optimizing with Partitioning and Clustering5分钟
Demo: Creating Partitioned Tables7分钟
Demo: Partitioning and Clustering6分钟
Preview: Transforming Batch and Streaming Data2分钟
Recap1分钟
Monitoring BigQuery usage and reservations5分钟
Intro to BigQuery System Table Reports6分钟
Demo: BigQuery System Tables with Data Studio7分钟
1 个阅读材料
BigQuery Pricing 10分钟
1 个练习
Building a Data Warehouse4分钟
完成时间为 2 分钟
Summary
This module reviews all the topics covered in the course
完成时间为 2 分钟
1 个视频 （总计 2 分钟）
1 个视频
审阅
来自 MODERNIZING DATA LAKES AND DATA WAREHOUSES WITH GCP的热门评论
由 AA 提供Feb 14, 2020
Good introduction and overview of the field of data engineering, data lakes and modern data warehouses and a hands-on walkthrough of all the technologies related to solving these problems on GCP.
由 FM 提供Apr 16, 2020
A better understanding of BigQuery starts here. A vital resource for consultants, data analysts, and product managers, and an important reference source for engineers and data scientists.
由 BA 提供Feb 8, 2020
The course offers a nice description of what modern DWH means, which are the differences between classic DWH and cloud DWH. You have the chance to work with the new cloud concept on GCP.
由 ME 提供Aug 29, 2020
I really like how the Google courses do not overwhelm the learner with too much information. The information was presented well and the labs were very practical with clear instructions.
常见问题
我能否在注册前预览课程？
是的，您可以在注册之前预览第一个视频和查看授课大纲。您必须购买课程，才能访问预览不包括的内容。
我注册之后会得到什么？
在您注册且班次开课之后，您将可以访问所有视频和其他资源，包括阅读材料内容和课程论坛。您将能够查看和提交练习作业，并完成所需的评分作业以获得成绩和课程证书。
我什么时候会收到课程证书？
如果您成功完成课程，您的电子课程证书将添加到您的成就页中，您可以通过该页打印您的课程证书或将其添加到您的领英档案中。
我为什么不能旁听此课程？
该课程是 Coursera 上提供的为数不多的课程之一，目前只对已购买课程或已获得助学金的学生开放。
完成课程后，我会获得大学学分吗？
此课程不提供大学学分，但部分大学可能会选择接受课程证书作为学分。查看您的合作院校，了解详情。Coursera 上的在线学位和 Mastertrack™ 证书提供获得大学学分的机会。
还有其他问题吗？请访问 学生帮助中心。
