Sistemi Distribuiti Corso di Laurea in Ingegneria



Similar documents
Intellectual Property Management and Protection in MPEG Standards

M3039 MPEG 97/ January 1998

A Metadata Model for Peer-to-Peer Media Distribution

Adaptive HTTP streaming and HTML5. 1 Introduction. 1.1 Netflix background. 1.2 The need for standards. W3C Web and TV Workshop, 8-9 February 2011

high-quality surround sound at stereo bit-rates

Windows Embedded Compact 7 Multimedia Features 1

Digital Video Architectures Compared: QuickTime, Real System, and Windows Media

Prof. Paolo Nesi. Lab: DISIT, Sistemi Distribuiti e Tecnologie Internet

Best Practices for Role Based Video Streams (RBVS) in SIP. IMTC SIP Parity Group. Version 33. July 13, 2011

Content management and protection using Trusted Computing and MPEG-21 technologies

Video Encoding Best Practices

The Advantages of Using NCL 2.3

MPEG-4. The new standard for multimedia on the Internet, powered by QuickTime. What Is MPEG-4?

Digital Audio and Video Data

Career Tracks- Information Technology Family

Workflow description of digital rights management systems

Integration of Hotel Property Management Systems (HPMS) with Global Internet Reservation Systems

E-book Tutorial: MPEG-4 and OpenDocument

Content Protection in Silverlight. Microsoft Corporation

Building Web-based Infrastructures for Smart Meters

Multimedia Applications. Mono-media Document Example: Hypertext. Multimedia Documents

STANDARDS FOR AGENTS AND AGENT BASED SYSTEMS (FIPA)

Introduction to Service Oriented Architectures (SOA)

Step into the Future: HTML5 and its Impact on SSL VPNs

CHAPTER 6: GRAPHICS, DIGITAL MEDIA, AND MULTIMEDIA

DLNA for HD Video Streaming in Home Networking Environments

Creating Content for ipod + itunes

DASH-IF Implementation Guidelines: Content Protection Information Exchange Format (CPIX)

Dynamic Adaptive Streaming over HTTP Design Principles and Standards

Recording/Archiving in IBM Lotus Sametime based Collaborative Environment

ATSC Standard: ATSC Security and Service Protection Standard

Demonstration of Internet Protocol Television(IPTV) Khai T. Vuong, Dept. of Engineering, Oslo University College.

1 Introduction. 2 Background

IFS-8000 V2.0 INFORMATION FUSION SYSTEM

Classes of multimedia Applications

Digital Asset Management. Content Control for Valuable Media Assets

CONDIS. IT Service Management and CMDB

Concepts of Database Management Seventh Edition. Chapter 9 Database Management Approaches

Cisco Videoscape Media Suite

APPLICATION BULLETIN AAC Transport Formats

Alcatel-Lucent Multiscreen Video Platform RELEASE 2.2

E-Business Technologies for the Future

Dolby Digital Plus in HbbTV

Sample Project List. Software Reverse Engineering

MART-MAF: Media file format for AR tour guide service

SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Infrastructure of audiovisual services Communication procedures

Multimedia Environment for Technology Enhanced Music Education and Composition and Performance

Chapter 10: Multimedia and the Web

AN ENVIRONMENT FOR EFFICIENT HANDLING OF DIGITAL ASSETS

Automatic Configuration and Service Discovery for Networked Smart Devices

Windows Media Technologies

Need for Signaling and Call Control

Mobile Operating Systems Lesson 05 Windows CE Part 1

Service Oriented Architecture

QuickTime Streaming. End-to-end solutions for live broadcasting and on-demand streaming of digital media. Features

MPEG-H Audio System for Broadcasting

Cisco TelePresence Content Server

Information Technology Career Field Pathways and Course Structure

bbc Overview Adobe Flash Media Rights Management Server September 2008 Version 1.5

XBMC Architecture Overview

Data Grids. Lidan Wang April 5, 2007

Fragmented MPEG-4 Technology Overview

Course Description for the Bachelors Degree in Library and Information Science

M2M. Machine-to-Machine Intelligence Corporation. M2M Intelligence. Architecture Overview

XML Document Management Architecture

Secure Semantic Web Service Using SAML

Collaborative editing using an XML protocol

HL7 and DICOM based integration of radiology departments with healthcare enterprise information systems

VIA CONNECT PRO Deployment Guide

How to Integrate Camera Live View into Web Application?

Web-based Multimedia Content Management System for Effective News Personalization on Interactive Broadcasting

IIS Media Services 3.0 Overview. Microsoft Corporation

5.1 audio. How to get on-air with. Broadcasting in stereo. the Dolby "5.1 Cookbook" for broadcasters. Tony Spath Dolby Laboratories, Inc.

3GPP TS V8.1.0 ( )

EUROPEAN COMPUTER DRIVING LICENCE. Multimedia Publishing. Syllabus

Chapter 6: Broadcast Systems. Mobile Communications. Unidirectional distribution systems DVB DAB. High-speed Internet. architecture Container

Enterprise Application Designs In Relation to ERP and SOA

Multimedia Systems: Database Support

ERMS Solution BUILT ON SHAREPOINT 2013

Lightweight Data Integration using the WebComposition Data Grid Service

How to select the right Marketing Cloud Edition

Applications that Benefit from IPv6

CHANGE REQUEST. Work item code: MMS6-Codec Date: 15/03/2005

Master Kurs Rechnernetze Computer Networks IN2097

Cisco ROSA Video Service Manager (VSM) Version 05.03

Service-Oriented Architectures

Mobile TV with DVB-H. Markus Lindqvist Director, Server & Network Solutions Multimedia, Nokia Nokia Nseries

Oct 15, Internet : the vast collection of interconnected networks that all use the TCP/IP protocols

Serving Media with NGINX Plus

EV-8000S. Features & Technical Specifications. EV-8000S Major Features & Specifications 1

DIGITAL MEDIA MEASUREMENT FRAMEWORK SUMMARY Last updated April 2015

VIA COLLAGE Deployment Guide

IP Data Over Satellite To Cable Headends And A New Operation Model With Digital Store And Forward Multi-Media Systems

ADS Tech Solutions for the Digital Home Entertainment Ecology

reach a younger audience and to attract the next-generation PEG broadcasters.

FRAFOS GmbH Windscheidstr. 18 Ahoi Berlin Germany

Introduction to Digital Video

ATSC Standard: 3D-TV Terrestrial Broadcasting, Part 2 Service Compatible Hybrid Coding Using Real-Time Delivery

Transcription:

1 Sistemi Distribuiti Corso di Laurea in Ingegneria Dr. Andrea Vallotti, Prof. Paolo Nesi Parte 13: MPEG-21 Introduzione Department of Systems and Informatics University of Florence Via S. Marta 3, 50139, Firenze, Italy tel: +39-055-4796523, fax: +39-055-4796363 Lab: DISIT, Sistemi Distribuiti e Tecnologie Internet nesi@dsi.unifi.it, paolo.nesi@unifi.it www: http://www.dsi.unifi.it/~nesi Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 1 What is MPEG-21? An open framework for multimedia delivery and consumption many elements exist to build an infrastructure for the production, delivery and consumption of multimedia content. The aim for MPEG-21 is to describe how these various elements fit together. Focal points: Content creators Content consumers Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 2

2 MPEG MPEG is a working group of ISO ISO/IEC JTC 1/SC 29/WG 11 Coding of moving pictures and audio Development of international standards for compression, decompression, processing and coded representation of moving pictures, audio, and their combination, in order to satisfy a wide variety of applications Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 3 MPEG standards application examples Video CD, MP3, DVD Satellite TV, digital cable, HDTV Video on demand PC video streaming Apple QuickTime Microsoft Windows Media Player RealNetworks Helix and RealPlayer Do-it it-yourself Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 4

3 The MPEG family MPEG-1 1 and MPEG-2 2 provide interoperable ways of representing audiovisual content, commonly used on digital media and on the air MPEG-4 4 defines how to represent content MPEG-7 7 specifies how to describe content MPEG-21 provides a truly interoperable multimedia framework Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 5 MPEG-1 ISO/IEC 11172 Coding of moving pictures and associated audio for digital storage media Video and audio at 1.5M bit/s for CD-ROM Five parts: Part 1 (systems): multiplexing & synchronization Part 2 (video): ~VHS quality at 1.15M bit/s Part 3 (audio): stereo at 384K, 256K, 192K bit/s Part 4 (conformance testing): references for decoder Part 5 (reference software): C implementation Applications: Video CD, MP3 Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 6

4 MPEG-2 ISO/IEC 13818 Generic coding of moving pictures and associated audio Digital Storage Media Command and Control (DSM- CC) for session set up and remote control of a server, used in set top boxes for satellite and cable TV Advanced Audio Coding (AAC) for multi-channel audio 4:2:2 profile for TV production studios Provisions for Intellectual Property Management and Protection (IPMP) Applications: digital TV set top boxes, DVD Transport Stream version Patent issues Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 7 MPEG-4 ISO/IEC 14496 Coding of audiovisual objects MPEG-4 4 defines how to represent content ancestry: VRML interoperability of content structure AFX Animation Framework extension XMT textual XML format for SMIL, Web3D, etc. adapt transparently to device capabilities FSG Fine Granularity Scalability Extensions of AAC and IPMP, Studio Profile MP4 and AVC file formats, multi-user user environment Patent issues Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 8

5 MPEG-7 ISO/IEC 15938 Multimedia content description interface MPEG-7 7 specifies how to describe content describe content way beyond metadata facilitate content management, in particular searching Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 9 MPEG-21 ISO/IEC (18034) 21000 Define the technology needed to support Users to exchange, access, consume, trade and otherwise manipulate Digital Items in an efficient, transparent and interoperable way Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 10

6 Current situation Situation: No complete solutions exist that allow different communities (content, financial, communications etc.), each with their own models, rules, procedures and content formats to interact efficiently. The multimedia content delivery chain encompasses different players (content creation, production, delivery etc.). To support this, the content has to be identified, described, managed and protected. Purpose: MPEG-21 MM-Framework shall enable interoperability in this situation. Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 11 MPEG-21 77 Elements (1/2) Digital Item Declaration A uniform and flexible abstraction and interoperable schema for declaring Digital Items Digital Item Identification and Description A framework for identification and description of any entity regardless of its nature, type or granularity Content Handling and Usage Provide interfaces and protocols that enable creation, manipulation, search, access, storage, delivery, and reuse of content across the content distribution and consumption value chain Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 12

7 MPEG-21 77 Elements (2/2) Intellectual Property Management and Protection The means to enable content to be persistently and reliably managed and protected across a wide range of networks and devices Terminals and Networks The ability to provide interoperable and transparent access to content across network and terminal Content Representation How the media resources are represented Event Reporting The metrics and interfaces that enable Users to understand precisely the performance of all reportable events within the framework Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 13 MPEG-21 scope User Application metadata processing resource processing IPMP DIA MPEG-2 MPEG-4 application level protocols HTTP RSTP RTP SOAP transport & network level protocols TCP IP UDP MPEG-2 TS Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 14

8 MPEG-21 Digital Item Structured digital objects, including a standard representation and identification, and metadata Fundamental unit of distribution and transaction within the MPEG-21 framework No further technical meaning Digital Item Resource Metadata Resource Digital Item Digital Item Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 15 Example of Digital Item Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 16

9 MPEG-21 User A User is any entity that interacts in the MPEG-21 environment or makes use of a Digital Item Users include individuals, consumers, communities, organisations, corporations, consortia, governments and other standards bodies and initiatives around the world. Users are identified specifically by their relationship to another User for a certain interaction MPEG-21 makes no distinction between a content provider and a consumer both are Users A single entity may use content in many ways however, a User may assume specific or even unique rights and responsibilities according to their interaction with other Users within MPEG-21 Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 17 Specification parts of MPEG-21 (1/6) 1. Vision, technologies and strategies describes the multimedia framework and its architectural elements 2. Digital Item Declaration provides a uniform and flexible abstraction and interoperable schema for declaring Digital Items 3. Digital Item Identification defines the framework for identifying any entity regardless of its nature, type, or granularity Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 18

10 Specification parts of MPEG-21 (2/6) 4. Intellectual Property Management and Protection (IPMP) provides the means to reliably manage and protect content across networks and devices 5. Rights Expression Language specifies a machine-readable language that can declare rights and permissions using the terms as defined in the Rights Data Dictionary 6. Rights Data Dictionary specifies a dictionary of key terms required to describe users rights Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 19 Specification parts of MPEG-21 (3/6) 7. Digital Item Adaptation defines description tools for usage environment and content format features that might influence the transparent access to the multimedia content 8. Reference Software includes software that implements the tools specified in the MPEG-21 Spec. 9. File Format defines a file format for storing and distributing Digital Items. Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 20

11 Specification parts of MPEG-21 (4/6) 10. Digital Item Processing defines mechanisms for standardized and interoperable processing of the information in Digital Item. 11. Evaluation Methods for Persistent Association Tools This Technical Report documents best practice in the evaluation of persistent association technologies, i.e., technologies that link information to identify and describe content using the content itself. 12. Test Bed for MPEG-21 Resource Delivery provides a software-based test bed for delivering scalable media and testing/evaluating this scalable media delivery in streaming environments. Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 21 Specification parts of MPEG-21 (4/6) 13. Scalable Video Coding 13. A video coding technology providing flexible scalability of a single bit-stream allows seamless integration of servers, heterogeneous networks, terminals, acquisition and storage devices which have different characteristics in the MPEG-21 multimedia framework 14. Conformance 14. Provide suitable criteria to evaluate conformance to MPEG-21 parts of a complaint system 15. Event Reporting 15. Specifies how to express ER-Request Request and Event Report and how they are represented as digital item Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 22

12 Specification parts of MPEG-21 (4/6) 16. Binary Format Specifies the MPEG-21 binary format which is an alternative serialization format of MPEG-21 descriptions as specified within other MPEG-21 parts 17. Fragment Identification for MPEG Media Types Specifies a normative syntax for URI Fragment Identifiers to be used for addressing parts of any resource of given Internet Media Types Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 23 MPEG-21Part 1 Vision Define a multimedia framework to enable transparent and augmented use of multimedia resources across a wide range of networks and devices 1. Provide a vision 2. Facilitate integration and harmonization of technologies 3. Provide a strategy for achieving a framework through collaboration Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 24

13 Users and content MPEG-21 Part 1 sets out the User requirements in the multimedia framework A user is any entity that interacts with the MPEG-21 environment, regardless of the intent and function. The dual is that MPEG-21 mediates between Users to allow transaction related to Digital Items The granularity spans domains of several orders of magnitude, from terminals on a backbone to devices on slow wireless links, from digital cinema theatre screens to mobile phone displays, from valuable boxing matches to pragmatic MRI scans, etc. Ease of use is a condition sine qua non for adoption of the general public; this is a requirement for interoperability and transparent interfaces, indicated by the dashed line Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 25 The need for harmonization Unlike previous MPEG-1 1 and 2 standards, which where mostly about codecs,, a framework spans a very wide area, which no single player can own, control, or even just design Each player has intellectual assets or knowledge in a small number of fields MPEG-21 is not about who has the best technology, rather it is about owners of a field negotiating on interfaces that allow interoperability transparent to the User but leaving sufficient room for owners to deploy differentiating technologies that allow them to realize a profit. This process is called harmonization Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 26

14 MPEG-21 Part 2 Digital Item Declaration Index a Digital Item Purpose: describe a set of abstract terms and concepts to form a useful model for defining Digital Items Three normative sections: Model set of abstract terms and concepts Representation normative description of syntax & semantics of DID elements Schema normative XML schema comprising the entire grammar of DID Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 27 Digital Item Declaration in detail Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 28

15 Digital Item Declaration example Item Descriptor Component Descriptor Resource Component Descriptor Resource Container Item Descriptor Component Descriptor Resource Item Descriptor Component Descriptor Resource Item Component Descriptor Resource Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 29 MPEG-21 Part 3 Digital Item Identification The scope of the Digital Item Identification (DII) specification includes: How to uniquely identify Digital Items and parts thereof (including resources) How to uniquely identify IP related to the Digital Items (and parts thereof), for example abstractions How to uniquely identify Description Schemes How to use identifiers to link Digital Items with related information such as descriptive metadata How to identify different types if Digital Items Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 30

16 DII example: MPEG-21 music album Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 31 DII and DID relation DID DII Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 32

17 MPEG-21 Part 4 IPMP Improvements over MPEG-4 4 IPMP: Internetworking IPMP tool retrieval & authentication Integration of Rights Expressions (RDD & REL) Intellectual Property Management and Protection involves the enforcement of REL permissions IPMP shall consult REL before any actions are taken in the User s s system REL: What is protected? What right applies? IPMP: How is it protected? Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 33 IPMP using hooks approach IPMP in MPEG 2 and 4 (version 1) used the hooks approach Plug-in a proprietary IPMP system Embed information into content streams that informs the terminal which proprietary IPMP system to use The reason was cost/benefit trade-off, one size did not fit all (e.g. TV and PDA) Downside: Limits interoperability, heavier terminal environment, risk many similar MPEG devices being built without inter-working Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 34

18 New IPMP approach (1/2) More generalized architecture Provider lists authentication methods, recipient selects one Terminal can get IPMP Tools embedded in content or by downloading g it Still based on hooking but uses Message Routing Service to simplify ify Audit agencies can provide Trust and Security metadata Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 35 New IPMP approach (2/2) Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 36

19 MPEG-21 Part 5 REL Rights Expression Language A machine-readable language Can declare rights and permissions Uses terms defined in the Rights Data Dictionary Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 37 MPEG-21 Part 5 REL The Rights Expression Language consists of licenses and grants that give specific permissions to Users to perform certain actions on certain resources, given that certain conditions are met Grants can also allow Users to delegate authority to others User s s system shall parse and validate the RE User s s system shall check permissions before any further action is done DID parser is responsible for discovering and identifying where to gather licenses REL licenses are wrapped in Digital Items Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 38

20 REL data model issued to principal right associated with resource subject to condition REL grant consist of principal to whom grant is issued rights the grant specifies resource to which right in grant applies condition to be met before grant can be exercised Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 39 REL Principal A principal denotes the party that it identifies by information unique to that individual. Usefully, this is information that has some associated authentication mechanism by which the principal can prove its identity. The Principal type supports the following identification technologies: A principal that must present multiple credentials, all of which must be simultaneously valid, to be authenticated. A keyholder,, meaning someone identified as possessing a secret key such as the private key of a public / private key pair. Other identification technologies that may be invented by others. Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 40

21 REL Right A right is the "verb" that a principal can be granted to exercise against some resource under some condition. Typically, a right specifies an action (or activity) or a class of actions that a principal may perform on or using the associated resource. MPEG REL provides a right element to encapsulate information about rights and provides a set of commonly used, specific rights, notably rights relating to other rights, such as issue, revoke and obtain. Extensions to MPEG REL could define rights appropriate to using specific types of resource. For instance, the MPEG REL content extension defines rights appropriate to using digital works (e.g., play and print) Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 41 Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 42

22 MPEG-21 Part 6 Rights Data Dictionary Set of clear, consistent, structured, integrated and uniquely identified Terms to support REL Specification of dictionary structure and methodology to create dictionary Dictionary is prescriptive, inclusive, and has audit provisions Legal definitions are mapped from other Authorities Supports mapping & transformation of metadata from terminology of one namespace (or Authority) into that of another namespace in automated or partially-automated automated way Dictionary is based on a logical model, the Context Model, which is the basis of the dictionary ontology Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 43 MPEG-21 Part 7 Digital Item Adaptation Goal: achieve transparent interoperable access to distributed multimedia content Enable ad hoc formation of User communities in which contents is shared with agreed or contracted Quality Reliability Flexibility Diversity Guaranteed user experience Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 44

23 Examples for Videos Temporal scaling Reduce number of VOPs in the video resource Spatial scaling Reduce the number of pixels in an image Frequency scaling Reduce the number of DCT coefficients Color Scaling Reduce the number of colors available Modality Translation conversion of the modality (e.g., image, text, audio, graphics) of the source resource Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 45 Concept of Digital Item Adaptation Digital Item Digital Item Adaptation Engine Resource Adaptation Engine Description Adaptation Engine Adapted Digital Item DIA Descriptions Scope of standardization DIA Tools Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 46

24 Relation between DIA and other MPEG- 21parts Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 47 Scope of standardization User Characteristics Terminal Capabilities Network Characteristics Natural Environment Characteristics Resource Adaptability Session Mobility Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 48

25 Overview of DIA Tools Usage Environment Description Tools User Characteristics Terminal Capabilities Network Characteristics Natural Environment Characteristics Digital ItemResource Adaptation Tools BitstreamSyntax Description Terminal and Network QoS BitstreamSyntax Description Link Metadata Adaptability Digital ItemDeclaration Adaptation Tools Session Mobility DIA Configuration BSDL (Bitstream Syntax Description Language) gbs Schema (generic Bitstream Syntax Schema) AdaptationQoS MetadataAdaptationHint Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 49 Bitstream Syntax Description A BSD describes the syntax (high level structure) of a binary media resource BSDL: XML schema based language to design specific bitstream syntax schemas for particular media formats gbs schema: generic schema enabling the construction of resource format independent bitstream syntax descriptions Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 50

26 Adaptation architecture AdaptationQoS MetadataAdaptationHint adaptation strategy optimal adaptation decisions... reduced complexity adapting the metadata Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 51 Terminal and Network Quality of Service AdaptationQoS specifies the relationship between constraints and feasible adaptation operations Constraints: BandwidthInkbps, ComputationTimeInMillisecs Utilities (qualities): PSNRIndB Adaptation Methods: framedroppingandorcoefficientdropping, requantization, finegranularscalability, waveletreduction, spatialsizereduction UtilityFunction: describes possible adaptation operators and associated qualities using a set of constraint points as indexes Linear interpolation is assumed between constraint points LookUpTable: additional multi-dimensional sets of data to support more elaborate adaptation scenarios StackFunction tool for describing the data in numerical function format Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 52

27 Metadata Adaptability MetadataAdaptationHint describes adaptation hint information pertaining to metadata within a digital item Hint: a set of syntactical elements with prior knowledge about the metadata that is useful for reducing the complexity of the metadata adaptation process Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 53 AdaptationQoS - BSD Link In some cases it is convenient to specify intrinsic operations based on a universal model for scalable bit-streams. A specified operation can be seen as a link that is composed of a mapping condition between identified parameters and an operation, which is conducted if this mapping is fulfilled Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 54

28 (g)bsd, AdaptationQoS,, and Link Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 55 MPEG-21 Part 8 Reference Software Success of a standard depends on the availability of reference software Plan to use the software developed in Core Experiments (CE) as a basis Platform independence Future repository (requires membership) http://mpeg.nist.gov/cvsweb/mpeg-21/ Temporary repository http://www.titr.uow.edu.au/cgi-bin/mpeg- ref-sw.pl Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 56

29 MPEG-21 Part 9 File Format An MPEG-21 file format shall be capable of storing MPEG-21 Digital Items all components of the DI within a single file The MPEG-21 file format will inherit several concepts from MP4, in order to make multi-purpose files possible Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 57 MPEG-21 Part 10 Digital Item Processing Digital Items act as a structure for organizing resources and its descriptions Need a mechanism for defining a set of operations by which a terminal can process a DI or DID Currently considering to specify a set of operations that can be used to process DIs: : Digital Item Method A DIM defines an intended method for configuring, manipulating and/or validating a DI Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 58

30 Methods vs. processing Interoperability of Digital Items means that terminals must handle the DIs in a consistent manner Digital Item Methods provide a way to specify a selection of preferred procedures by which the DI should be handled at the DI level a menu of user interaction possibilities Digital Item Processing encompasses all aspects of processing a DI from an application perspective Applications build DIP environments around a fundamental DIME Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 59 Digital Item processing terminology CDI Content Digital Item a DID containing the actual content DIBO Digital Item Base Operation DIM Digital Item Method method that can by applied to a DID DIME DIM Engine part of the terminal responsible for executing the DIM DIML DIM Language DIP Digital Item Processing MI Method Item PI Processing Item XDI Context Digital Item Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 60

31 Digital Item Processing Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 61 DIP flow control Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 62

32 MPEG-21 Part 15 Event Reporting Standardise metrics and interfaces for performance of all reportable events in MPEG-21; Provide a means of capturing and containing these metrics and interfaces that refers to identified Digital Items, environments, processes, transactions and Users. Such metrics and interfaces will enable Users to understand precisely the performance of all reportable events within the framework. Event Reporting must provide Users a means of acting on specific interactions, as well as enabling a vast set of out-of of-scope processes, frameworks and models to interoperate with MPEG-21. Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 63 MPEG-21 Part 17 Fragment Identification for MPEG Media Types Fragment Identification can be used to address the following media type: audio/mpeg [RFC3003] video/mpeg [RFC2045,RFC2046] video/mp4 [draft-lim lim-mpeg4-mime-02] audio/mp4 [draft-lim lim-mpeg4-mime-02] application/mp4 [draft-lim lim-mpeg4-mime-02] video/mpeg4-visual visual [draft-lim lim-mpeg4-mime-02] application/mp21 The syntax for URI Fragment Identifiers defined in this specification is based on the W3C XPointer Framework Recommendation and adds the ability to address: Temporal, spatial and spatio-temporal temporal locations Logical unit(s) ) of a resource according to a given Logical Model A byte range of a resource Items or Tracks of an ISO Base Media File Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 64

33 Pro MPEG-21 Pros and Cons International standard Broad commercial support for earlier MPEG specs Packages any type of complex digital object per OAIS Powerful and flexible means to express descriptive, structural, administrative, and other metadata Con Complex and highly technical Few tools currently exist Unclear now the extent to which spec will be adopted Strong emphasis on commercial rights protection? Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 65 Conclusions Rights Holder Process Author Publish Deliver Playback End User Visual Content VIDEO 2D 3D SEMANTICS CONTENTS METADATA CONTENT MANAGEMENT DIGITAL RIGHTS MANAGEMENT SUBSCRIBER MANAGEMENT SATELLITE PC SET-TOP BOX ANIMATION Audio Content DIALOG TEXT MPEG-4 SOUND EFFECTS SOUNDTRACK MPEG-7 SECURE MPEG-21 WIRELESS CABLE DVD PLAYER GAME CONSOLE Scene Information MUSIC LAYOUT INTERACTION PULL PUSH UNIVERSAL MM ACCESS TARGETED INTEGRATED AD SERVING ECOMMERCE ACCOUNTING & BILLING DSL CD/DVD INTERNET DEVICE PDA CELLPHONE Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 66

34 Acknowledgment Thanks to all MPEG-21 Contributors for these slides and related material Sistemi Distribuiti, Univ. Firenze, Paolo Nesi 2005-2006 67