Chevron Left
返回到 大规模数据处理:系统与算法

大规模数据处理:系统与算法, 华盛顿大学

667 个评分
143 个审阅


Data analysis has replaced data acquisition as the bottleneck to evidence-based decision making --- we are drowning in it. Extracting knowledge from large, heterogeneous, and noisy datasets requires not only powerful computing resources, but the programming abstractions to use them effectively. The abstractions that emerged in the last decade blend ideas from parallel databases, distributed systems, and programming languages to create a new class of scalable data analytics platforms that form the foundation for data science at realistic scales. In this course, you will learn the landscape of relevant systems, the principles on which they rely, their tradeoffs, and how to evaluate their utility against your requirements. You will learn how practical systems were derived from the frontier of research in computer science and what systems are coming on the horizon. Cloud computing, SQL and NoSQL databases, MapReduce and the ecosystem it spawned, Spark and its contemporaries, and specialized systems for graphs and arrays will be covered. You will also learn the history and context of data science, the skills, challenges, and methodologies the term implies, and how to structure a data science project. At the end of this course, you will be able to: Learning Goals: 1. Describe common patterns, challenges, and approaches associated with data science projects, and what makes them different from projects in related fields. 2. Identify and use the programming models associated with scalable data manipulation, including relational algebra, mapreduce, and other data flow models. 3. Use database technology adapted for large-scale analytics, including the concepts driving parallel databases, parallel query processing, and in-database analytics 4. Evaluate key-value stores and NoSQL systems, describe their tradeoffs with comparable systems, the details of important examples in the space, and future trends. 5. “Think” in MapReduce to effectively write algorithms for systems including Hadoop and Spark. You will understand their limitations, design details, their relationship to databases, and their associated ecosystem of algorithms, extensions, and languages. write programs in Spark 6. Describe the landscape of specialized Big Data systems for graphs, arrays, and streams...


创建者 HA

Jan 11, 2016

Great course that strikes a balance between teaching general principles and concepts, and providing hands-on technical skills and practice.\n\nThe lessons are well designed and clearly conveyed.

创建者 SL

May 28, 2016

I like the breadth of coverage of this class. Each of the exercise is a gem in that I get to learn something new also. I would highly recommend this even to experience practitioner also.


139 个审阅

创建者 Dongying Zhou

Feb 09, 2019

Pros: The content of the course is great. It introduces fundamentals of big data technologies to those who are new to this field, with some hands-on practices.

Cons: The instructions of assignments are not always clear - they are corrected in the discussion forum but why not updating in the assignment page? Usage of Python 2.7 is also somewhat out of date since it's 2019.

Biggest con: The way the lecturer talks is more than annoying. Full of stop words like 'fine', 'ok', with occasionally correcting mistakes on slides or diverging to other topics - there are only a few minutes each video and how much time did the lecturer wasted on talking nonsense? It's fine if he talks like that on some 90-min-long classes but it's on Coursera. Sometimes I just skimmed the slides rather than listen to him.

创建者 Yu-Heng Hung

Nov 25, 2018

It's pretty tough in assignments especially when there are mistakes in the given description, but I do learn the basic concepts of relational algorithm and MapReduce from them.

创建者 Max Ettelson

Nov 12, 2018

Assignments need to be updated, but the material is solid!

创建者 Guruswamy Srikanth

May 29, 2018

Very wide and fundamentally robust introduction.

创建者 Batt Jimmy

Apr 14, 2018

Very good course for understanding the underlying logic behind emerging big data technologies

创建者 Dwayne Benefield

Apr 13, 2018

Good information but lectures were poorly produced and unedited and exercise instructions were blatantly incorrect several times.

创建者 Achal Kathuria

Feb 05, 2018

A very good introduction to skills needed for applying data science ideas on large scale data problems.

创建者 Anish Chandran

Jan 17, 2018

Thanks for this course.True Parallel computing example would have made it even more awesome .

创建者 James Sheldon

Jan 07, 2018

The material is good. If you can get past the instructor's mumbling and rapid speaking then you'll be okay.

创建者 Jana Endemann

Dec 07, 2017

Quite interesting subjects, but video material is not of high quality and many mistakes are not changed in later sessions but altered via a text in the screen of a note on the next sheet.