Data analysis has replaced data acquisition as the bottleneck to evidence-based decision making --- we are drowning in it. Extracting knowledge from large, heterogeneous, and noisy datasets requires not only powerful computing resources, but the programming abstractions to use them effectively. The abstractions that emerged in the last decade blend ideas from parallel databases, distributed systems, and programming languages to create a new class of scalable data analytics platforms that form the foundation for data science at realistic scales.
提供方
大规模数据科学 专项课程华盛顿大学课程信息
16,715 次近期查看
可分享的证书
完成后获得证书
100% 在线
立即开始，按照自己的计划学习。
第 1 门课程（共 4 门）
可灵活调整截止日期
根据您的日程表重置截止日期。
完成时间大约为20 小时
英语（English）
字幕：英语（English）
您将获得的技能
Relational AlgebraPython ProgrammingMapreduceSQL
可分享的证书
完成后获得证书
100% 在线
立即开始，按照自己的计划学习。
第 1 门课程（共 4 门）
可灵活调整截止日期
根据您的日程表重置截止日期。
完成时间大约为20 小时
英语（English）
字幕：英语（English）
提供方
华盛顿大学
Founded in 1861, the University of Washington is one of the oldest state-supported institutions of higher education on the West Coast and is one of the preeminent research universities in the world.
教学大纲 - 您将从这门课程中学到什么
完成时间为 6 小时
Data Science Context and Concepts
Understand the terminology and recurring principles associated with data science, and understand the structure of data science projects and emerging methodologies to approach them. Why does this emerging field exist? How does it relate to other fields? How does this course distinguish itself? What do data science projects look like, and how should they be approached? What are some examples of data science projects?
完成时间为 6 小时
22 个视频 （总计 125 分钟）, 4 个阅读材料, 1 个测验
22 个视频
Appetite Whetting: Extreme Weather2分钟
Appetite Whetting: Digital Humanities8分钟
Appetite Whetting: Bibliometrics4分钟
Appetite Whetting: Food, Music, Public Health5分钟
Appetite Whetting: Public Health cont'd, Earthquakes, Legal4分钟
Characterizing Data Science5分钟
Characterizing Data Science, cont'd5分钟
Distinguishing Data Science from Related Topics4分钟
Four Dimensions of Data Science6分钟
Tools vs. Abstractions7分钟
Desktop Scale vs. Cloud Scale5分钟
Hackers vs. Analysts2分钟
Structs vs. Stats5分钟
Structs vs. Stats cont'd5分钟
A Fourth Paradigm of Science3分钟
Data-Intensive Science Examples6分钟
Big Data and the 3 Vs5分钟
Big Data Definitions4分钟
Big Data Sources6分钟
Course Logistics7分钟
Twitter Assignment: Getting Started14分钟
4 个阅读材料
Supplementary: Three-Course Reading List10分钟
Supplementary: Resources for Learning Python10分钟
Supplementary: Class Virtual Machine10分钟
Supplementary: Github Instructions10分钟
完成时间为 5 小时
Relational Databases and the Relational Algebra
Relational Databases are the workhouse of large-scale data management. Although originally motivated by problems in enterprise operations, they have proven remarkably capable for analytics as well. But most importantly, the principles underlying relational databases are universal in managing, manipulating, and analyzing data at scale. Even as the landscape of large-scale data systems has expanded dramatically in the last decade, relational models and languages have remained a unifying concept. For working with large-scale data, there is no more important programming model to learn.
完成时间为 5 小时
24 个视频 （总计 122 分钟）
24 个视频
From Data Models to Databases4分钟
Pre-Relational Databases5分钟
Motivating Relational Databases3分钟
Relational Databases: Key Ideas4分钟
Algebraic Optimization Overview6分钟
Relational Algebra Overview4分钟
Relational Algebra Operators: Union, Difference, Selection6分钟
Relational Algebra Operators: Projection, Cross Product4分钟
Relational Algebra Operators: Cross Product cont'd, Join6分钟
Relational Algebra Operators: Outer Join4分钟
Relational Algebra Operators: Theta-Join4分钟
From SQL to RA6分钟
Thinking in RA: Logical Query Plans4分钟
Practical SQL: Binning Timeseries5分钟
Practical SQL: Genomic Intervals6分钟
User-Defined Functions3分钟
Support for User-Defined Functions4分钟
Optimization: Physical Query Plans5分钟
Optimization: Choosing Physical Plans4分钟
Declarative Languages5分钟
Declarative Languages: More Examples4分钟
Views: Logical Data Independence5分钟
Indexes6分钟
完成时间为 5 小时
MapReduce and Parallel Dataflow Programming
The MapReduce programming model (as distinct from its implementations) was proposed as a simplifying abstraction for parallel manipulation of massive datasets, and remains an important concept to know when using and evaluating modern big data platforms.
完成时间为 5 小时
26 个视频 （总计 122 分钟）
26 个视频
A Sketch of Algorithmic Complexity5分钟
A Sketch of Data-Parallel Algorithms5分钟
"Pleasingly Parallel" Algorithms4分钟
More General Distributed Algorithms4分钟
MapReduce Abstraction4分钟
MapReduce Data Model3分钟
Map and Reduce Functions2分钟
MapReduce Simple Example3分钟
MapReduce Simple Example cont'd3分钟
MapReduce Example: Word Length Histogram2分钟
MapReduce Examples: Inverted Index, Join6分钟
Relational Join: Map Phase4分钟
Relational Join: Reduce Phase4分钟
Simple Social Network Analysis: Counting Friends3分钟
Matrix Multiply Overview5分钟
Matrix Multiply Illustrated4分钟
Shared Nothing Computing4分钟
MapReduce Implementation5分钟
MapReduce Phases6分钟
A Design Space for Large-Scale Data Systems4分钟
Parallel and Distributed Query Processing5分钟
Teradata Example, MR Extensions5分钟
RDBMS vs. MapReduce: Features6分钟
RDBMS vs. Hadoop: Grep5分钟
RDBMS vs. Hadoop: Select, Aggregate, Join3分钟
完成时间为 3 小时
NoSQL: Systems and Concepts
NoSQL systems are purely about scale rather than analytics, and are arguably less relevant for the practicing data scientist. However, they occupy an important place in many practical big data platform architectures, and data scientists need to understand their limitations and strengths to use them effectively.
完成时间为 3 小时
36 个视频 （总计 166 分钟）
36 个视频
NoSQL Roundup4分钟
Relaxing Consistency Guarantees3分钟
Two-Phase Commit and Consensus Protocols5分钟
Eventual Consistency4分钟
CAP Theorem4分钟
Types of NoSQL Systems4分钟
ACID, Major Impact Systems4分钟
Memcached: Consistent Hashing2分钟
Consistent Hashing, cont'd4分钟
DynamoDB: Vector Clocks5分钟
Vector Clocks, cont'd5分钟
CouchDB Overview4分钟
CouchB Views3分钟
BigTable Overview5分钟
BigTable Implementation5分钟
HBase, Megastore3分钟
Spanner5分钟
Spanner cont'd, Google Systems6分钟
MapReduce-based Systems5分钟
Bringing Back Joins4分钟
NoSQL Rebuttal4分钟
Almost SQL: Pig4分钟
Pig Architecture and Performance3分钟
Data Model3分钟
Load, Filter, Group5分钟
Group, Distinct, Foreach, Flatten5分钟
CoGroup, Join3分钟
Join Algorithms3分钟
Skew5分钟
Other Commands3分钟
Evaluation Walkthrough3分钟
Review6分钟
Context3分钟
Spark Examples5分钟
RDDs, Benefits6分钟
完成时间为 2 小时
Graph Analytics
Graph-structured data are increasingly common in data science contexts due to their ubiquity in modeling the communication between entities: people (social networks), computers (Internet communication), cities and countries (transportation networks), or corporations (financial transactions). Learn the common algorithms for extracting information from graph data and how to scale them up.
完成时间为 2 小时
21 个视频 （总计 91 分钟）
21 个视频
Structural Analysis4分钟
Degree Histograms, Structure of the Web4分钟
Connectivity and Centrality4分钟
PageRank3分钟
PageRank in more Detail3分钟
Traversal Tasks: Spanning Trees and Circuits5分钟
Traversal Tasks: Maximum Flow1分钟
Pattern Matching6分钟
Querying Edge Tables4分钟
Relational Algebra and Datalog for Graphs4分钟
Querying Hybrid Graph/Relational Data3分钟
Graph Query Example: NSA6分钟
Graph Query Example: Recursion4分钟
Evaluation of Recursive Programs3分钟
Recursive Queries in MapReduce4分钟
The End-Game Problem3分钟
Representation: Edge Table, Adjacency List4分钟
Representation: Adjacency Matrix2分钟
PageRank in MapReduce5分钟
PageRank in Pregel5分钟
审阅
来自大规模数据处理：系统与算法的热门评论
由 HA 提供Jan 10, 2016
Great course that strikes a balance between teaching general principles and concepts, and providing hands-on technical skills and practice. The lessons are well designed and clearly conveyed.
由 SL 提供May 27, 2016
I like the breadth of coverage of this class. Each of the exercise is a gem in that I get to learn something new also. I would highly recommend this even to experience practitioner also.
由 DK 提供Jan 23, 2016
Good! I like the final (optional) project on running on a large dataset through EC2. The lectures aren't as polished and compact as they could be but certainly a very valuable course.
由 AD 提供Jul 19, 2020
Well structured and nice overview of data manipulation. But the assignments should really be updated in order to use python 3.x instead of 2.7, which is not maintained anymore...
关于 大规模数据科学 专项课程
Learn scalable data management, evaluate big data technologies, and design effective visualizations.
This Specialization covers intermediate topics in data science. You will gain hands-on experience with scalable SQL and NoSQL data management solutions, data mining algorithms, and practical statistical and machine learning concepts. You will also learn to visualize data and communicate results, and you’ll explore legal and ethical issues that arise in working with big data. In the final Capstone Project, developed in partnership with the digital internship platform Coursolve, you’ll apply your new skills to a real-world data science project.
常见问题
我什么时候能够访问课程视频和作业？
讲座和作业的访问权限取决于您的注册类型。如果您以旁听模式参加课程，则可以免费查看大多数课程资料。要访问评分作业并获得证书，您需要在旁听期间或之后购买证书体验。如果看不到旁听选项：
- 课程可能不提供旁听选项。您可以尝试免费试用，也可以申请助学金。
- 课程可能会改为提供'完整课程，没有证书'。通过此选项，您可以查看所有课程材料、提交所要求的作业，以及获得最终成绩。这也意味着您将无法购买证书体验。
我订阅此专项课程后会得到什么？
您注册课程后，将有权访问专项课程中的所有课程，并且会在完成课程后获得证书。您的电子课程证书将添加到您的成就页中，您可以通过该页打印您的课程证书或将其添加到您的领英档案中。如果您只想阅读和查看课程内容，可以免费旁听课程。
退款政策是如何规定的？
如果订阅，您可以获得 7 天免费试听，在此期间，您可以取消课程，无需支付任何罚金。在此之后，我们不会退款，但您可以随时取消订阅。请阅读我们完整的退款政策。
有助学金吗？
是的，Coursera 可以为无法承担费用的学生提供助学金。通过点击左侧“注册”按钮下的“助学金”链接可以申请助学金。您可以根据屏幕提示完成申请，申请获批后会收到通知。您需要针对专项课程中的每一门课程完成上述步骤，包括毕业项目。了解更多。
还有其他问题吗？请访问 学生帮助中心。
