Multimedia Systems [ KMI/MUSY ]

The course gives the basics of digital image, video and audio, their compression and distribution over data network.

In the course representations and formats of digital image, video and audio are taught, their acquisition, processing, compression and distribution over data network and also the preparation of DVD. The problematics of DRM will also be noted. Practices consist in practical manipulation with image, video and audio material from its acquisition, through editing and compression so far to its distribution - students try prepare a DVD and run a streaming server.

Prerequisities: Basic knowledge of computer networks.

Lectures

Intro: History, multimedia data and systems, classification.
Content acquisition: Digitalization of analog signal (sampling and quantization), Fourier transform, Sampling theorem, filtration.
Representation and formats, colors: Representation and formats of image, video, audio and graphics, problem of colors, color spaces (models).
Content processing (authoring): Authoring and tools, DVD authoring.
Compression: Basic notions from information theory, coding and compression, basic lossless compression methods.
Basic lossy compression methods: DPCM, transform (DCT, DFT) and subband (wavelet) coding.
Compression of image: Lossless (GIF, PNG, TIFF), JPEG, wavelet, fractal, WebP.
Compression of video: Lossless (M-JPEG, DV), motion prediction, MPEG/H.26*, VP*, Theora, AV1, containers (MPEG, Ogg, WebM, AVI).
Compression of audio: Prediction (PCM), psychoacoustics, synthetization, MPEG (MP3, AAC), Dolby (AC-3), Vorbis, Speex, FLAC, MIDI.
Compression of graphics: Representation (polygonal meshes), topological surgery, progresive meshes, wavelet compression, MPEG.
Distribution: Streaming, webcasting, video on demand, Quality of Service, VOIP, internet television (IPTV).
Digital Rights Management (watermark, encryption)

Literature

Havaldar P., Medioni G.: Multimedia Systems: Algorithms, Standards, and Industry Practices. Course Technology, 2009. ISBN 978-1418835941
Li Z.-N., Drew M. S., Liu J.: Fundamentals of Multimedia, 3rd ed.‎ Springer, 2021. ISBN 978-3030621230
Shi Y.-Q., Sun H.: Image and Video Compression for Multimedia Engineering: Fundamentals, Algorithms, and Standards, 3rd ed. CRC Press, 2019. ISBN 978-1138299597
Costello V.: Multimedia Foundations: Core Concepts for Digital Design, 2nd Edition. Routledge, 2016
Hwang J.-N.: Multimedia Networking: From Theory to Practice. Cambridge University Press, 2009. ISBN 978-0521882040
Taylor J., Johnson M. R., Crawford Ch. G.: Velký průvodce DVD. Grada, 2007. ISBN 978-80-247-1721-0
Savage T. M., Vogel K. E.: An Introduction to Digital Multimedia. Jones & Bartlett Publishers, 2008. ISBN 978-0763750527