lecture 18 cd, dvd storage audio compression digital music synthesis final exam review instructor:...

24
Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby ([email protected])

Upload: kevon-haston

Post on 29-Mar-2015

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Lecture 18CD, DVD StorageAudio CompressionDigital Music SynthesisFinal Exam Review

Instructor: David Kirkby ([email protected])

                                                                                 

Page 2: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 2

MiscellaneousI will be traveling Fri-Wed. Office hours will beWed (Dec 11) 3:15-5:15pm during exam week.

Page 3: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 3

Compact DiscsCompact discs record digital signals as pits in a plastic surface. The features on a CD are much smaller than on a vinyl record:

http://www.mta.ca/~jehrman/demos.htm

CD pits (or bumps) are about 0.5m wide. Information on adisc is recorded along a spiral track starting from thecenter, with tracks spaced 1.6m apart. (Human hairs are40-300m thick).

                                     

    

Page 4: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 4

A CD player reads the pattern of pits on a disc using a laser. The laser is reflected from a shiny metal layer on one side of the disc.

Pits disrupt the reflected laser beam, but where there is no pit, the reflected laser light bounces back towards the laser where it can be monitored electronically.

Page 5: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 5

Digital Versatile Disc (DVD)DVD is similar to CD, but stores 26 times more data (up to 17 Gb instead of 650 Mb).

This increased storage capacity is made possible by 3 main innovations:

•Narrower tracks of pits (0.74 m instead of 1.6 m)

•A shorter-wavelength laser (green instead of infrared)

•Up to 4 layers instead of 1.DVD was originally targeted at video storage, but in 1999 a DVD-Audio format was announced with up to 6 channels sampled up to 192 kHz with up to 24 bits.

Page 6: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 6

Audio CompressionSo far, we have only talked about digital music storage.

Compression is the process of packing the “same information” into less space.

There are two types of compression, corresponding to different definitions of the “same information”:

•Lossless compression stores an exact replica of the original digital signal in less space.

•Lossy compression stores an almost equivalent replica of the original digital signal in less space.

Lossy compression is more powerful, but means some degradation of the original signal. MP3 is a lossy compression scheme.

Page 7: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 7

There are three general ways in which we can pack the “same information” into fewer bytes:

•Reduce the quality (sampling rate, number of amplitude levels) of the digital encoding.

•Exploit any redundancy (predictability) in the original signal.

•Exploit the limitations of human hearing by eliminating components of the signal that will not be perceived by most listeners.

Page 8: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 8

MPEG / Audio Layer III (MP3)The Motion Pictures Experts Group (MPEG) is a large consortium that has developed standards for video compression. One of these standards (Audio Layer III) is for compressing a video soundtrack.

MP3 is a lossy compression scheme that exploits redundancy as well as the limitations of human hearing. For example:

•Some sounds cannot be heard at all,•Some sounds appear louder than others,•A loud sound will mask quiet sounds.

We call this perceptual compression.

Page 9: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 9

An MP3 encoder first divides an input sample into small chunks, and then breaks each chunk into 32 frequency bands that are approximately a critical bandwidth in size:

                                 

         

Page 10: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 10

The final stage is to budget how many bytes to allocate for each frequency band, based on how much that band will contribute to your perception of the overall sound in that time chunk. For example:

http://www.howstuffworks.com/mp31.htm

Page 11: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 11

Compare these MP3 versions of our original test sample:

•Original 100%•128 kbits/sec 18%•64 kbits/sec 9%•32 kbits/sec 4.5%•16 kbits/sec 2.3%•8 kbits/sec 1.1%

One refinement to the algorithm is to allow more complex chunks to use more bits than simpler chunks, as long as as the average bit rate is kept on target. The second set of samples above use this Automatic Bit Rate (ABR) method, instead of the usual Constant Bit Rate (CBR) method.

Compare with thesereduced-quality 5%samples (p.23):

Page 12: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 12

Stereo vs Mono SignalsSo far, we have focused on a mono digital sample. Stereo samples require twice as much space when uncompressed, but MP3 can significantly reduce this overhead when the left and right channels are sufficiently similar to each other.

Page 13: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 13

Digital Music SynthesisComputer generated music is a vast subject.

We will briefly discuss techniques for creating virtual musical instruments (sysnthesis) on a computer. We will not have time to cover other aspects of this subject such as algorithmic score generation or human-computer performance interfaces.

The computer could be either a general-purpose PC or a special-purpose synthesizer:

Page 14: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 14

Synthesis MethodsHere is a basic classification of some popular synthesis methods:

FourierSynthesis

GranularSynthesis

AM/FMSynthesis

AdditiveSynthesis

SubtractiveSynthesis

LinearSynthesis

Non-linearSynthesis

http://www.sfu.ca/sonic-studio/handbook/Sound_Synthesis.html

PhysicalModeling

Page 15: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 15

Fourier SynthesisFourier synthesis involves building an instrument’s sound out of its pure-tone components. Fourier Analysis tells us that this is always possible and how to do it.In principle, this approach can generate arbitrarily good approximations to any sound.

In practice, the large amount of information required to specify an interesting sound is a limitation of this method.

Page 16: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 16

Granular SynthesisGranular synthesis also builds a sound up from its components. The components of granular synthesis are short (<50ms) “grains” of sound that can be overlaid to build a rich texture.

<50 ms

The inspiration for granular synthesis are sounds like these:

• carding wool

• guiro

Page 17: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 17

Granular synthesis usually uses small fragments of a recorded sound for its grains.

Here is an example ( ) of granular synthesis using this fog horn sound ( ). Here is another example ( ).

Granular synthesis is especially efficient at generating many environmental sounds.

It is also useful for changing the timing of a recorded sound without altering its frequency.

Page 18: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 18

Subtractive SynthesisSubtractive synthesis takes the opposite approach to additive synthesis: instead of starting from nothing and adding together simple components, subtractive synthesis starts from a complex sound and removes specific components.

The starting point for subtractive synthesis is usually some form of noise, which contains a broad range of frequencies:

•White noise•Compare with the sound of the Athabasca River

Page 19: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 19

The main tool for subtraction is a frequency filter:

Subtractive synthesis is particularly efficient at generating transients and breath sounds.

Page 20: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 20

Frequency-Modulation SynthesisFM synthesis is non-linear and so does not obey the principal of superposition: the frequencies coming out are not just the sum of the frequencies going in.

FM synthesis consists of adjusting the frequency of a carrier wave using the amplitude of a modulation wave:

Page 21: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 21

FM synthesis is a particularly efficient method for generating a complex timbre with a simple recipe.

The technique was discovered accidentally by John Chowning in the late 1960s, working at Stanford. By the early 1980’s, Chowning’s work was the basis for a new generation of electronic synthesizers (eg, Yamaha DX7) that revolutionized the industry.

Page 22: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 22

Physical Modeling SynthesisThe basic idea of this technique is to generate sound with a physically realistic acoustical simulation of an instrument (real or imagined).

This technique is not particularly efficient, but can generate extremely realistic sounds and gives the composer/performer control over many physically meaningful aspects of the sound production (eg, string tension, bowing speed and location) that influence the subtle nuances of a realistic sound.

Page 23: Lecture 18 CD, DVD Storage Audio Compression Digital Music Synthesis Final Exam Review Instructor: David Kirkby (dkirkby@uci.edu)

Physics of Music, Lecture 18, D. Kirkby 23

Here are some examples from the Yamaha Virtual Lead (VL) synthesizer:

•Oboe and bassoon•Shakuhachi•Trumpet•Saxophone