lec01, overview, v1.05.ppt -...

Multimedia Systems

Overview of the Course

Mahdi Amiri

September 2015

Sharif University of Technology

Course Presentation

Multimedia Systems, Overview

Course Syllabus

http://ce.sharif.edu/courses/94-95/1/ce342-1/

Website


Course Syllabus

Mahdi Amiri

E-mail 1: m_amiri [-at-] ce.sharif.edu

E-mail 2: yashil1 [-at-] yahoo.com

URL: ce.sharif.edu/~m_amiri

Tel.: (+98 21) 6616 5169-74, ext. 109

Cell Phone: +98 9

Current Address:Sharif University of Technology, No 3, Golestan Alley, Salehi St.,

Akbari Blvd., Azadi Ave., Tehran, Iran.

Instructor, Contact Info.


Course Syllabus

Z-N. Li, M.S. Drew, and J. Liu,

Fundamentals of Multimedia, 2nd

Ed., Springer, Switzerland, 2014.*

* We will mostly use class handouts

and lectures. Therefore, text books

could be used as a reference.

Textbook

https://www.springer.com/gp/book/9783319052892

Simon Fraser University, Vancouver, BC, Canada.


Course Syllabus

P. Havaldar, G. Medioni, Multimedia Systems:

Algorithms, Standards, and Industry Practices,

Cengage Learning, 2010.

R. Steinmetz and K. Nahrstedt, Multimedia

Fundamentals: Media Coding and Content

Processing, Prentice Hall, 2002.

K. R. Rao, Z. S. Bojkovic and D. A. Milanovic,

Multimedia Communication Systems, Prentice Hall,

2002.

Other Reference Books

… and Wikipedia

http://books.google.com/books/about/Multimedia_Systems.html?id=k83m5inkjXwC


Course Syllabus

Quiz: Saturday, Lowest quiz will be dropped.

HW: Monday, Due: 2 Weeks, Req. MATLAB or Octave.

Grading Policy


Course Syllabus

Examples:

Traffic control using mobile phones,

Multimedia systems in schools,

Human computer interfacing,

Video chat over LAN network,

Intelligent transportation systems,

Web application development tools (Horde, …),

Telemedicine, TeleCollaboration, etc.

* We will review the examples in a session.

Report structure

Literature survey.

Pros. and Cons. of the existing methods.

Definition of new proposals.

Critical Reading


Course Syllabus

TA(s) and session time

See the course website.

Integral component of the course

Tools:

MATLAB

GNU Octave

Problem Solving Classes

www.gnu.org/software/octave/

www.mathworks.com/products/matlab/


Course Outline

What is Multimedia?

Components of Multimedia

Multimedia Research Topics and Projects

Processing: e.g. content-based retrievalGeneration, Representation, Storage, Search and retrieval.

Networking: e.g. QoSTransmission, Delivery.

End-Systems: e.g. User Interfaces

Interaction: e.g. “ubiquity“ devices

Introduction to Multimedia


Course Outline

What is “signal”!?

Discrete-time signals and systems

Sampling theorem

Quantization (Scalar Q., Vector Q.)

Transform domain analysis

FFT, STFT, Wavelet

Review of Signals and Systems


Course Outline

Audio representations

Formats and standards

Frequency Masking vs. Temporal Masking

Speech processing

Synthesis, recognition, …

Audio Compression

DPCM, ADPCM, LPC, CELP

Audio


Course Outline

Data storage

Data redundancyLossy and lossless compression

Entropy encoder

Predictive coding

Huffman Coding

Lempel-Ziv-Welch

Arithmatic Coding

Entropy Coding


Course Outline

Physics of Color

Human Eye

Additive and subtractive color mixing

Color space Models

YUV, RGB, HSV, …

Gamma correction

Image, Color Space


Course Outline

Color Depth

Palette, Halftone

Image Resolution

Histogram, Contrast

High-Dynamic-Range (HDR)

Bracketing

Image, Acquisition and Representation


Course Outline

Image Noise

Gaussian Smoothing

Mean and Median Filter

Sharpening

Edge Detection

Despeckle

Image, Enhancement


Course Outline

JPEG

Encoder Diagram

Decoder Diagram

Color Space Transformation

Subsampling in color space

Discrete Cosine Transform (DCT)

Quantization Matrix

Compression Ratio

Blocking Artifact

Image, Compression


Course Outline

Video Display

Progressive, Interlaced

Analog Broadcast TV Systems

NTSC, PAL

Analog Color Video

Composite video, S-Video, Component video

Digital Video (HDTV)

DVI, HDMI, DisplayPort

Video, Analog and Digital Video


Course Outline

Interframe and intraframe coding

Motion Estimation and Motion Compensation

(MEMC)

Picture Types

I-frames, B-frames, P-frames

Video Codecs

MPEG-1, MPEG-2, MPEG-4

, h.261, h.263

, h.264, h.265 (HEVC), …

Video Coding


Course Outline

Standalone vs. Networked

Live vs. Orchestrated

Multimedia system building blocks

Real-time multimedia system

architecture

Multimedia (Networking) Systems


Course Outline

Quality of Service (QoS)

Error concealment

Prioritized Encoding

Overlay networks

Packet-loss, Congestion

Unicasting and Multicasting

Streaming protocols

Multimedia Networking


Course Outline

DVB

Interactive TV, Internet-TV, IPTV

E-Learning

Human Computer Interface

Multimedia Home Platform (MHP)

Multimedia Information Retrieval System

3D Technologies

Multimedia Applications


Thank You

1. http://ce.sharif.edu/~m_amiri/

2. http://www.aictc.ir/

FIND OUT MORE AT...

Multimedia Systems

Overview of the Course

Next Session: Introduction to Multimedia Systems

lec01, overview, v1.05.ppt -...

Documents