How is Sound Useful?

Loading...

来自 University of London 的课程

3D Models for Virtual Reality

73 个评分

University of London

3D Models for Virtual Reality

73 个评分

课程 2（共 5 门，Specialization Virtual Reality）

This course will begin your journey to creating Virtual Reality experiences. A Virtual Reality experience is a new world that you step into and are entirely immersed in. Creating a VR experience means creating that world and all the objects in it. In this course you will learn the basics of 3D graphics: how we create objects and how to lay them out to create an environment. You will learn techniques like materials and texturing that make your objects appear realistic. You will also learn about audio techniques to ensure that your experiences sound great as well as looking great. In all of these topics we will pay attention to the particular requirements of Virtual Reality, including pitfalls and performance issues: making sure your environment runs fast enough in VR. You will learn all of this using the professional game and VR engine, Unity3D. Unity is one of the most used game engine and is a relatively easy, but fully featured, introduction to 3D development. The course will culminate in a project in which you will create your own VR scene. VR development is something you can only learn by doing it yourself, so working on your project will be the best way to learn.

从本节课中

VR Audio

In this week you will learn about using sound in Virtual Reality and how you can use advanced 3D Audio techniques to enhance your experience.

Introduction to Audio in VR1:10

What is Sound?8:19

How Do Humans Perceive Sound?8:38

What is Digital Audio?8:30

How is Sound Useful?3:19

How Do We Use Sound in VR?6:04

General Guidance for Using Sound2:04

How Do We Use Filters in VR?3:08

Audio Formats, Sources and Listeners in Unity6:32

Audio Effects in Unity4:16

Unity Audio Clips and Files3:49

Audio Mixers in Unity7:35

Audio in Unity | Additional Resources1:56

与讲师见面

Dr Sylvia Xueni Pan
Lecturer, Department of Computing
Goldsmiths, University of London
Dr Marco Gillies
Senior Lecturer
Computing Department, Goldsmiths, University of London

[MUSIC]

By now you should have a pretty good understanding of the technical

requirements around sound.

What it is, how we measure it, how you perceive it, and also how it's stored.

But how do we use it?

What's it useful for?

So the first thing I would say is that sound is much

more useful than many people think.

When you're making a game or a VR world or

even other kinds of media like film, often people think about sound at the end.

This is a mistake, you should think about sound in the same way that you think about

images, graphics, and all forms of visual representation.

A really bad sound can make a really good image look terrible.

Likewise, a really really good sound can make a really really bad image look great.

Now this happens because of lots of cognitive illusions that occur when people

combine sounds and images the way that sounds and images combine in the brain,

changes the way that you perceive images and sound.

And there's lots of evidence for this.

What this means practically for you is that the more

time you put into considering how sound is affecting your environment and

people's perception of it, the better your work's going to be.

It's good to think about the kinds of things you can do with sound creatively,

so that's what we're going to do.

Let's imagine that we want to affect the way people perceive the size of something

using a sound.

You can use the frequency content of the sound to change how people perceive

the physical properties of an object.

For example, a very very large firework will make a big, loud, low frequency bang

[SOUND], and a really really really small firework is going to go [SOUND].

Even if it's the same size on the screen,

that sound will fool you into making decisions or

convince you about decisions that lead you to understand where the object is,

how big it is, how much it might weigh, things like that.

If I kick a metal bucket, for example, and that metal bucket doesn't move and

has dull thud, I assume it's very heavy and has something in it.

If I kick a metal bucket and it makes a tiny, tiny ping noise, right?

And as it rattle,

even if it doesn't move, the brain might assume that it's very light.

So the way that we use sound effects colors our perception of the size and

the weight of objects even when they look exactly the same on the screen.

As I've already indicated, the speed of sound and

also the way that a particular sound source is traveling and

also the ambience of the environment, have a big impact on what you can do.

So Doppler effect will indicate that something is going very quickly

towards you.

And also reverberation can make you think that you're in one environment or another.

For example, you might suddenly want to make people feel like they're underwater.

Now it can be very very expensive to create a computer graphic effect that

places you underwater, also the lighting may be very dark, but

if you just use the sound to dull the high frequencies,

you can create the effect of an underwater sound.

[MUSIC]

探索我们的目录

免费加入并获得个性化推荐、更新和优惠。

Coursera 致力于普及全世界最好的教育，它与全球一流大学和机构合作提供在线课程。

© 2018 Coursera Inc. 保留所有权利。

通过 App Store 下载

通过 Google Play 获取