The two key components of any data pipeline are data lakes and warehouses. This course highlights use-cases for each type of storage and dives into the available data lake and warehouse solutions on Google Cloud Platform in technical detail. Also, this course describes the role of a data engineer, the benefits of a successful data pipeline to business operations, and examines why data engineering should be done in a cloud environment. Learners will get hands-on experience with data lakes and warehouses on Google Cloud Platform using QwikLabs.
Google 云端平台课程信息
143,935 次近期查看
可分享的证书
完成后获得证书
100% 在线
立即开始，按照自己的计划学习。
可灵活调整截止日期
根据您的日程表重置截止日期。
中级
完成时间大约为8 小时
英语（English）
字幕：英语（English）, 西班牙语（Spanish）
可分享的证书
完成后获得证书
100% 在线
立即开始，按照自己的计划学习。
可灵活调整截止日期
根据您的日程表重置截止日期。
中级
完成时间大约为8 小时
英语（English）
字幕：英语（English）, 西班牙语（Spanish）
提供方
Google 云端平台
We help millions of organizations empower their employees, serve their customers, and build what’s next for their businesses with innovative technology created in—and for—the cloud. Our products are engineered for security, reliability, and scalability, running the full stack from infrastructure to applications to devices and hardware. Our teams are dedicated to helping customers apply our technologies to create success.
教学大纲 - 您将从这门课程中学到什么
完成时间为 7 分钟
Introduction
This module gives an introduction of the Data Engineering specialization and the course.
完成时间为 7 分钟
2 个视频 （总计 7 分钟）
完成时间为 2 小时
Introduction to Data Engineering
This module describes the role of a data engineer and motivates the claim why data engineering should be done in the Cloud
完成时间为 2 小时
13 个视频 （总计 55 分钟）
13 个视频
Analyze data engineering challenges8分钟
Intro to BigQuery3分钟
Data Lakes and Data Warehouses5分钟
Demo: Federated Queries with BigQuery6分钟
Transactional Databases vs Data Warehouses4分钟
Partner effectively with other data teams6分钟
Manage data access and governance2分钟
Demo: Finding PII in your dataset with DLP API1分钟
Build production-ready pipelines2分钟
Review GCP customer case study3分钟
Recap1分钟
Lab Intro: Using BigQuery to do Analysis17
1 个练习
Introduction to Data Engineering30分钟
完成时间为 2 小时
Building a Data Lake
In this module, we describe what data lake is and how to use Google Cloud Storage as you data lake on GCP
完成时间为 2 小时
10 个视频 （总计 58 分钟）
10 个视频
Data Storage and ETL options on GCP4分钟
Building a Data Lake using Cloud Storage10分钟
Demo: Optimizing cost with Google Cloud Storage classes and Cloud Functions7分钟
Securing Cloud Storage5分钟
Storing All Sorts of Data Types5分钟
Demo: Running federated queries on Parquet and ORC files in BigQuery4分钟
Storing Relational Data in the Cloud1分钟
Cloud SQL as a relational Data Lake7分钟
Lab: Loading Taxi Data into Cloud SQL27
1 个练习
Building a Data Lake4分钟
完成时间为 4 小时
Building a data warehouse
In this module, we talk about BigQuery as a data warehousing option on GCP
完成时间为 4 小时
17 个视频 （总计 93 分钟）
17 个视频
Intro to BigQuery1分钟
Demo: Querying TB of Data in seconds7分钟
Getting Started9分钟
Loading Data11分钟
Lab Intro: Loading Data into BigQuery21
Exploring Schemas24
Demo: Exploring Schemas10分钟
Schema Design3分钟
Nested and Repeated Fields8分钟
Demo: Nested and Repeated Fields15分钟
Lab Intro: Working with JSON and Array Data in BigQuery13
Optimizing with Partitioning and Clustering5分钟
Demo: Creating Partitioned Tables7分钟
Demo: Partitioning and Clustering6分钟
Preview: Transforming Batch and Streaming Data2分钟
Recap1分钟
1 个练习
Building a Data Warehouse4分钟
完成时间为 2 分钟
Summary
This module reviews all the topics covered in the course
完成时间为 2 分钟
1 个视频 （总计 2 分钟）
1 个视频
审阅
来自 MODERNIZING DATA LAKES AND DATA WAREHOUSES WITH GCP的热门评论
由 AA 提供Feb 14, 2020
Good introduction and overview of the field of data engineering, data lakes and modern data warehouses and a hands-on walkthrough of all the technologies related to solving these problems on GCP.
由 FM 提供Apr 16, 2020
A better understanding of BigQuery starts here. A vital resource for consultants, data analysts, and product managers, and an important reference source for engineers and data scientists.
由 BA 提供Feb 8, 2020
The course offers a nice description of what modern DWH means, which are the differences between classic DWH and cloud DWH. You have the chance to work with the new cloud concept on GCP.
由 AG 提供May 11, 2020
Very detailed explanation on Data Lake and Data Ware house and use cases. Concepts of the Data types such as STRUCT and ARRAYS are explained very well and beneficial in Data modeling.
常见问题
Can I preview a course before enrolling?
Yes, you can preview the first video and view the syllabus before you enroll. You must purchase the course to access content not included in the preview.
When will I have access to the lectures and assignments?
If you decide to enroll in the course before the session start date, you will have access to all of the lecture videos and readings for the course. You’ll be able to submit assignments once the session starts.
What will I get when I enroll?
Once you enroll and your session begins, you will have access to all videos and other resources, including reading items and the course discussion forum. You’ll be able to view and submit practice assessments, and complete required graded assignments to earn a grade and a Course Certificate.
When will I receive my Course Certificate?
If you complete the course successfully, your electronic Course Certificate will be added to your Accomplishments page - from there, you can print your Course Certificate or add it to your LinkedIn profile.
Why can’t I audit this course?
This course is one of a few offered on Coursera that are currently available only to learners who have paid or received financial aid, when available.
What is the refund policy?
If you subscribed, you get a 7-day free trial during which you can cancel at no penalty. After that, we don’t give refunds, but you can cancel your subscription at any time. See our full refund policy.
还有其他问题吗？请访问 学生帮助中心。
© 2020 Coursera Inc.保留所有权利。
