Centre for Quantifiable Quality of Service in Communication Systems, Centre of Excellence" is appointed by The Research Council of Norway, and funded by the Research Council, NTNU and UNINETT. Opportunities with new digital media Professor Andrew Perkis, Dr. Techn. Department of Electronics and telecommunications Norwegian University of Science and Technology, Trondheim, Norway Manager: Multimedia over IP Networks Q2S, Centre for Quantifiable Quality of Service in Communication Systems Norwegian University of Science and Technology, Trondheim, Norway Midgard media Lab Norwegian University of Science and Technology, Trondheim, Norway 1 REN møte 31. august Copyright: Andrew Perkis, NTNU
Andrew Perkis Professor, Department of Electronics and Telecommunications, NTNU Manager: Multimedia over IP Networks, Q2S Leader: Steering committee Midgard Media Lab 2 REN møte 31. august Copyright: Andrew Perkis, NTNU Speech coding, GSM Error resilience Information Theory, Joint source and channel coding Image compression, JPEG2000 MPEG-4 and MPEG-21 Media Technology, Digital Cinema
Digital multimedia presentations The tools: Multimedia signal processing Digital communications The results: Multimedia (audiovisual) presentations The processes: Modelling acquisition (speech, audio, image, video, natural and synthetic) Digitisation Sampling and reconstruction Quantisation/compression Manipulation (interactivity) Storage/Delivery Presentation 3 REN møte 31. august Copyright: Andrew Perkis, NTNU
Trends Mega trend Media codecs Mega hype MPEG-4/H.264/VC1 Windows Media 10 series Mega trend Mobile multimedia Mega hype 3G Mega trend HD Mega hype Formats and conversions 4 REN møte 31. august Copyright: Andrew Perkis, NTNU
Today's trends Mobile: 2G to 3G (low, low, low) Fixed: Broadband Convergence: The extended vision (4G) The multimedia portal Digital broadcasting: Terrestrial Cinema: 35mm film to digital (high, high, high) New Media New richer and more accessible content and experience is appearing Smart media (cross media) Evolution/Revolution Content democratization Universal Multimedia Access MPEG-21: The multimedia framework 5 REN møte 31. august Copyright: Andrew Perkis, NTNU
Today's systems what do we expect Digital cinema 2K HD SR 2K Digital Intermediate (post production) D-cinema 2K or 4K Broadcasting Digital (interactive) TV (DVB) Digital Audio (DAB) Digital Multimedia Broadcast (DMB) HDTV Video Commercial (DVD) Consumer (DV, HDV) WMHDV Multimedia Internet (Download, streaming) Mobile and wireless (3G, mobile TV) CD (Quicktime, ) Synthetic (VRML) Telecommunications Videoconferencing All very predictable! 6 REN møte 31. august Copyright: Andrew Perkis, NTNU
Universal Multimedia Access - UMA Configuration tools Transmoding tools UMA Network tools Codec tools 7 REN møte 31. august Copyright: Andrew Perkis, NTNU
Tomorrow? A view from NTT DoCoMo 3DTV 8 REN møte 31. august Copyright: Andrew Perkis, NTNU
9 REN møte 31. august Copyright: Andrew Perkis, NTNU
10 REN møte 31. august Copyright: Andrew Perkis, NTNU
Tomorrow? A view from NTT DoCoMo 3DTV Is it predictable? 11 REN møte 31. august Copyright: Andrew Perkis, NTNU
Which media codec to choose? MPEG-1-1st generation coding, Compression, CD JPEG, Motion JPEG MPEG-2 - Refined, optimised and extended to higher bit rates, targeted broadcasting sector MPEG-4 Part 2 (profile/level) - 2nd generation, Interaction, Object based. Internet and mobile sector JPEG2000, Motion JPEG2000 MPEG-4 Part 10 (profile/level) H.261, H.262 (MPEG-2), H.263, H.264 (MPEG-4, AVC, JVT) VC1 QuickTime, Windows Media, Real???? 12 REN møte 31. august Copyright: Andrew Perkis, NTNU
High Definition 4K 13 REN møte 31. august Copyright: Andrew Perkis, NTNU
Worlds first 4K screening SONY 4K projector Verdens første 4K-projektor Oppløsning: 4096 X 2160 piksler, dvs 8.850,000 piksler i hvert bilde. Lysstyrke: 10.000 ANSI lumens. Stor, effektiv billedbrikke øker refleksjonsraten og lysstyrken - med 65-70 pst. Kontrast: 4000:1 (500:1 regnes idag for å være meget bra med vanlig utstyr) Fleksibel: 2K kan kjøres i 4K. Serial number 000001 in Trondheim World premier April 14 in Nova 1 Quality out of this world 14 REN møte 31. august Copyright: Andrew Perkis, NTNU
Research directions and results Influence of the UMA concept NTNU Research and Teaching Q2S Basic research National Centre of Excellence hosted by NTNU, Midgard Media Lab Applied research and services Creation - artist Digitization - automatic Editing - studio/producer/editor Encoding/representation - technical Distribution/networks - business/technical Access - artist/business/technical Terminals/interaction - user Presentation - viewers 15 REN møte 31. august Copyright: Andrew Perkis, NTNU
Centre for Quantifiable Quality of Service in Communication Systems Centre of Excellence (Q2S) Vision Main Goals Have an internationally recognized Centre of Excellence in quantifiable Quality of Service, which also can provide Norwegian industry, network and service providers with well educated experts and technology for the benefit of the society at large Audio over IP networks Multimedia over IP Networks Intradomain Networks Interdomain and Overlay Networks Trustworthy Multiparty Interactions in Dynamic Networking Environments Centre for Quantifiable Quality of Service in Communication Systems, Centre of Excellence" is appointed by The Research Council of Norway, and funded by the Research Council, NTNU and UNINETT. 16 REN møte 31. august Copyright: Andrew Perkis, NTNU
Key Figures for Q2S Total yearly budget MNOK 30 (EUR 4.1 million) Personnel Today 39 persons 6 professors 21 doctoral students 10 postdocs 1 visiting professors/scholars support personnel 17 REN møte 31. august Copyright: Andrew Perkis, NTNU
Industrial Collaborators Midgard Media Lab NTNU New Media Network Apple 18 REN møte 31. august Copyright: Andrew Perkis, NTNU
Mobile multimedia The objective of Universal Multimedia Access enabled systems to create adapted presentations based on a single resource-base, automatically suited to different devices, networks and user interests MPEG-21 standardizes parts of the UMA concept enabling system implementations New digital media MPEG-4, H.264 3GPP mobile media. Playback using.3gp- file encapsulating MPEG-4 Simple Visual Profile (level 0) video and AAC audio. Total bit rate approx 60kbps. ADACTUS is a spin off company from NTNU implementing MPEG-21 for mobile multimedia, digital broadcast and asset management. Demonstration 19 REN møte 31. august Copyright: Andrew Perkis, NTNU