Annie Chang VP, Post-Production Technology The Walt Disney Studios

Annie Chang VP, Post-Production Technology The Walt Disney Studios

Annie Chang VP, Post-Production Technology The Walt Disney Studios

What s the Problem? What is IMF and what s in it? SMPTE Standards Update What Do YOU Think?

H.264 2M Mb/s MP2 3 Mb/s AS-02

H.264 2M Mb/s MP2 3 Mb/s AS-02

Masters for Content Owners The Problem Multiple file formats for the master Different Versions / Edits Theatrical Cut, Director s Cut, Airline Edits, TV Censor Edits, etc. Different Resolution / Frame Rates 1080P, 720P, NTSC, PAL, QVGA, etc. Different Aspect Ratios Original Aspect Ratio, 1.78, 1.33 Different Languages 42 languages (subtitled and dubbed) Long-play versions of each Distribution to many companies Asset management nightmare Broadcast/Satellite/Cable, Blu-ray, VOD, Pay Per View, itunes, etc. H.264 2M Mb/s MP2 3 Mb/s AS-02

International Monetary Fund? Interoperable Master Format! Single, interchangeable master file format Minimizes storage Can use mezzanine level compression Store differences between versions, not flattened long-play versions Allows for flexible versioning Allows for automation for downstream file transcoding Do not reinvent the wheel Re-use existing standards where possible! Loosely based on Digital Cinema SMPTE standards proven track record Interoperability through constrained standards

2007 Studios talked about the need for a distribution file format 2008 USC ETC was a safe home room for 5 (and later 6) Hollywood Studios Originally called, Digital Video Package or DVP February 2011 USC ETC published IMF Specification v1.0 March 2011 SMPTE started work on IMF

Working Group at SMPTE Society of Motion Picture & Television Engineers Annie Chang, Chair of 35PM50 Ad Hoc Groups drafting certain parts of the standards document Image, Audio, Data, CPL/OPL, Wrapping Lots of Involvement from other companies Major Studios and Broadcasters (Fox, WB, Sony, NBC-Universal, Disney) Manufacturers (DVS, AVID, Amberfin, Digital Rapids, etc.) Vendors (Technicolor, Deluxe, Fotokem, etc.) Over 200 members from 122 different companies plus consultants Within 1.5 years, had documents ballots & ready for publishing!

Business-to-Business (not meant for Consumer) High quality file-based FINAL master Image Audio Subtitling/Captioning Technical Metadata Playlists for the content Original intent: Grand Master and its different cuts/versions, including all language versions Standardized and well-documented

Not meant as an origination format or for live-to-air production Not used for camera output, dailies or editorial ORIGINALLY, not meant to be a final delivery package to a distribution Always assumed smaller files would be derived/transcoded from IMF Could be a final delivery if downstream vendor wants it ORIGINALLY, not meant for long-term archive Archival elements have other requirements Error correction, how data is written, etc. No reason why you can t archive it if you want to

Essence Wrapped into Track Files Essence (Image & Audio) Data Essence (Subtitles & Captioning) Dynamic Metadata (Metadata changes over time) Compositions and Composition Play Lists (CPL) Creates versioning Flexible hierarchy for combining and synchronizing Track Files Output Profile Lists (global output parameters) Transcoding parameters Packages Security

Must be a standard to be IN a standard! Image can be compressed or uncompressed, any size, resolution, frame rate, etc. Audio is 24-bit uncompressed Any number of channels and soundfields Uses Multi-Channel Audio Labeling Subtitling & Captioning (Data Essence) uses SMPTE-TT (ST2052-1)

Essence & Metadata wrapped with MXF OP1a / AS-02 Adopted AMWA s AS-02 with some slight modifications Creates Track Files from the Essence Wrapping holds pertinent metadata MXF Wrapping allows for other compression schemes to be included Like MPEG-2, MPEG-4, etc. MXF wraps all audio channels into one file

Similar to an EDL ties everything together Provides synchronization of all Essence & Dynamic Metadata Track Files Human readable as XML Uses UUIDs instead of directory paths Composition contains at least: Composition Playlist (CPL) One or more Track Files <?xml version="1.0" encoding="utf-8"?> <CompositionPlaylist xmlns="http://www.smpte -ra.org/schemas/2065-3/xxxx" xmlns:xsi="http://www.w3.org/2001/xmlschemainstance"> <Id>urn:uuid:0c265b6a- 1123-4649-ae18-8a51a7dff0f0</Id> <Annotation>IMF sample OV YUV HPA 2012</Annotation> <IssueDate>2012-01- 19T11:18:12-00:00</IssueDate> <Issuer>DVS Digital Video Systems GmbH</Issuer> <<ContentTitle>IMF sample OV YUV HPA 2012</ContentTitle> <ContentKind>Test</Cont entkind> Composition ion Play List Image Track File Audio Track File Data Essence Track File Metadata Track File Complete self-contained digital media program Ex: feature, episode, trailer, ad, etc. Composition

Set of global information or instructions to specify certain output preferences to a downstream device Human readable as XML OPL is linked to CPL Many OPLs for one CPL One OPL for many CPLs Types of OPL Simple OPL ( play CPL ) Complex OPL Output Parameters Pre-processing Parameters Color Space Conversion Parameters Encoding/Transcoding Parameters

Metadata that changes on a periodic basis Usually occurs on specific frames SMPTE 12M timecode Color correction data 3D-related data Pan and scan Descriptive metadata Pan and scan Uses one full aperture image to create different pan/scan versions (2.35, 1.78, 1.33) Tilt (up/down) Pan (left/right) Zoom in, zoom out Squeezes, horizontally and vertically Can have multiple pan and scan metadata tracks in an IMF

Packaging AKA IMP Composition Output Profile List Packing List Asset Map Security Digital Signature for CPL and OPL Encryption TBD

Composition Play List Like an Edit Decision List or recipe Points to various Track Files to synchronize and create the proper playback of content Track Files Image, Audio, Subs/CC, Metadata Wrapped in MXF - AS02 Subset (includes metadata) Output Profile List Transcoding/conversion instructions Asset Map Packing List <?xml version="1.0" encoding="utf-8"?> <CompositionPlaylist xmlns="http://www.smptera.org/schemas/2065-3/xxxx" xmlns:xsi="http://www.w3.org/20 01/XMLSchema-instance"> <Id>urn:uuid:0c265b6a-1123-4649-ae18-8a51a7dff0f0</Id> <Annotation>IMF sample OV YUV HPA 2012</Annotation> <IssueDate>2012-01-19T11:18:12-2- 00:00</IssueDate> <Issuer>DVS Digital Video Systems GmbH</Issuer> <Creator>Clipster 4.7.0.0 Alpha/horst/IMF_HPA2012</Creaa tor> <ContentOriginator>Disney</Co ntentoriginator> <ContentTitle>IMF sample OV YUV HPA 2012</ContentTitle> <ContentKind>Test</ContentKinn d> Composition Play List <?xml version="1.0" encoding="utf- 8"?> <CompositionPlaylist xmlns="http://www.smptera.org/schemas/2065-3/xxxx" xmlns:xsi="http://www.w3.org/2001/ XMLSchema-instance"> <Id>urn:uuid:0c265b6a-1123-4649- ae18-8a51a7dff0f0</id> <Annotation>IMF sample OV YUV HPA 2012</Annotation> <IssueDate>2012-01-19T11:18:12-00:00</IssueDate> <Issuer>DVS Digital Video Systems GmbH</Issuer> <Creator>Clipster 4.7.0.0 Alpha/horst/IMF_HPA2012</Creator > <ContentOriginator>Disney</Conte ntoriginator> <ContentTitle>IMF sample OV YUV HPA 2012</ContentTitle> <ContentKind>Test</ContentKind> Output Profile List Image Track File Audio Track File Data Essence Track File Metadata Track File Composition <?xml version="1.0" encoding="utf- <?xml version="1.0" encoding="utf- 8"?> 8"?> <CompositionPlaylist <CompositionPlaylist xmlns="http://www.smptera.org/schemas/2065-3/xxxxra.org/schemas/2065-3/xxxx" xmlns="http://www.smpte- xmlns:xsi="http://www.w3.org/2001/ xmlns:xsi="http://www.w3.org/2001/ XMLSchema-instance"> XMLSchema-instance"> <Id>urn:uuid:0c265b6a-1123-4649- <Id>urn:uuid:0c265b6a-1123-4649- ae18-8a51a7dff0f0</id> ae18-8a51a7dff0f0</id> <Annotation>IMF sample OV YUV <Annotation>IMF sample OV YUV HPA 2012</Annotation> HPA 2012</Annotation> <IssueDate>2012-01-19T11:18:12- <IssueDate>2012-01-19T11:18:12-00:00</IssueDate> 00:00</IssueDate> <Issuer>DVS Digital Video Systems <Issuer>DVS Digital Video Systems GmbH</Issuer> GmbH</Issuer> <Creator>Clipster 4.7.0.0 <Creator>Clipster 4.7.0.0 Alpha/horst/IMF_HPA2012</Creator Alpha/horst/IMF_HPA2012</Creator > > <ContentOriginator>Disney</Conte <ContentOriginator>Disney</Conte ntoriginator> ntoriginator> <ContentTitle>IMF sample OV YUV <ContentTitle>IMF sample OV YUV HPA 2012</ContentTitle> HPA 2012</ContentTitle> <ContentKind>Test</ContentKind> <ContentKind>Test</ContentKind> Asset Map Packing List Package

Property of The Walt Disney Studios Property of The Walt Disney Studios

Property of The Walt Disney Studios Property of The Walt Disney Studios

Property of The Walt Disney Studios Property of The Walt Disney Studios

English Title Main Video English End Credits CPL English Audio & CC Simple OPL Play CPL English 2.0 Audio English CC English IMP

English Title Main Video English End Credits English 2.0 Audio English IMP English Audio/French Subs IMP English CC French Subtitles CPL English Audio & French Subs Simple OPL Play CPL

English French Title Main Video French English French End Dub Credits Cards English 2.0 Audio French 2.0 Audio CPL French Titles & French Dub Simple OPL Play CPL English CC English IMP French Dub IMP

English French Title Main Video French English French End Dub Credits Cards CPL English Audio & CC Simple OPL Play CPL English 2.0 Audio French 2.0 Audio English CC French Subtitles CPL French Titles & French Dub CPL English Audio & French Subs Complex OPL SD MP4 LC & AAC IMP

English IMP English Title Main Main Video Edit Main Video English End Credits English 2.0 Audio X- Fade Edit English 2.0 Audio CPL Censor English Audio Simple OPL Play CPL English Censored Version Supplemental IMP

Flexible versioning Full packages Supplemental or Partial Packages But what about flexibility with multiple CODECS?

Core Framework Composition Play Lists MXF Wrapping Major Constraints General Image, Audio and Subtitling Parameters Core Framework Modular Applications Plug-in to framework Allow for specific functionality Higher compressed CODECs Specific resolutions or frame rates Allows for different problems to be solved Interchange within an Application Application #2 JPEG2000 HD Application #3 MPEG-4 SStP 4K Application #n Your App Here

Document Not Started In Progress In Ballot Process Done CPL Published MXF Wrapping Published Core Constraints * PCM Audio & Soundfields Application #2 * Application #3 * Interchange Testing OPL Pan/Scan Metadata Color Metadata Descriptive Metadata SMPTE-TT (2052) is also being updated by W3C and SMPTE * Held at publishing due to dependencies on two documents under revision being balloted now

IMF is a suite of documents Image and Audio for Application #2 and #3 are complete Application #2 JPEG2000, HD & SD Application #3 MPEG-4 SStP, up to 4K Subtitles waiting on W3C Timed Text updates Implementation Now! Current SMPTE Work: Output Profile Lists Audio Routing - Draft Image Crop and Fill - Draft Image Resize Overlay Extended Application #2 JPEG2000, up to 8K, XYZ, HDR, etc. Work in other groups outside SMPTE

Software/Hardware Manufacturer support is key for IMF adoption Editing, transcoding and playback software & hardware needed Many companies are interested already (AVID, Harmonic, DVS, Amberfin, Digital Rapids, etc.) Content owners are actively talking to others Plug-Fests during standards effort (within SMPTE) Manufacturers (who are SMPTE members) create an IMF/IMP from the draft documents Interchange with each other Anything subject to interpretation can be clarified before documents become final Currently working with Application #2 (JPEG2000)

Is IMF right for you? High-quality master for store & forward Versioning, basic edits / cuts Interchange with different vendors IMF is just a file format for the actual media IMF does not address Key art, descriptive metadata (plot, cast & crew), etc. Time tailoring More image compression* (Current Applications are larger files 60GB/hr) Needs systems to utilize IMF FIMS Asset Management Systems *right now

IMF started as a need for a standardized file format for distribution masters IMF is loosely based on the Digital Cinema standards but includes added functionality for Television and futureproofing IMF allows for flexible versioning and different CODECs using Applications IMF is a suite of documents that are both published and soon-to-be published at SMPTE

annie.chang@disney.com Join the SMPTE effort! 35PM50 IMF Working Group Under the 35PM Media Packaging & Interchange Technology Committee

What do you need in order for IMF to work for you?