Copyright 2006 TeleMídia
Agenda ISDB-T Reference Model and ITU-T Reference Model overview Middleware requirements Ginga Final Remarks 2 Copyright 2006 TeleMídia
DTV Reference Model Copyright 2006 TeleMídia
Interactive Channel Other Data Other Data Interactive Applications Video Audio Video Audio Source Signal Coding DataStream Middleware Source Signal Decoding MUX TS Channel coding / Modulation DEMUX TS Channel decoding / Demodulation Broadcasting Transmission Reception Receiver 4 Copyright 2006 TeleMídia 4
Interactive Channel Application s Contents Application Other Data Specification Application s Other Data Contents Interactive Applications Video Audio Video Audio Source Signal Coding DataStream Middleware Source Signal Decoding MUX TS Channel coding / Modulation DEMUX TS Channel decoding / Demodulation Broadcasting Transmission Reception Receiver 5 Copyright 2006 TeleMídia 5
Reference Model Video Coding Audio Coding Transport System Physical Layer 6 Copyright 2006 TeleMídia
Reference Model Audio MPEG2 BC MPEG2 AAC DOLBY AC3 Video MPEG2 - SDTV MPEG2 - HDTV MPEG-2 System 8-VSB COFDM 7 Copyright 2006 TeleMídia
Reference Model Áudio MPEG - 4 HE-AAC@L4 MPEG - 4 HE-AAC@L3 Vídeo H.264 HP@L4.0 H.264 BP@L1.3 MPEG-2 System 8-VSB COFDM 8 Copyright 2006 TeleMídia
Reference Model Video Coding Audio Coding Transport System Physical Layer 9 Copyright 2006 TeleMídia
Reference Model Audio MPEG2 BC MPEG2 AAC DOLBY AC3 Video MPEG2 - SDTV MPEG2 - HDTV MPEG-2 System 8-VSB COFDM 10 Copyright 2006 TeleMídia
Reference Model Áudio MPEG - 4 HE-AAC@L4 MPEG - 4 HE-AAC@L3 Vídeo H.264 HP@L4.0 H.264 BP@L1.3 MPEG-2 System 8-VSB COFDM 11 Copyright 2006 TeleMídia
Transport Stream specification language GINGA Real-Time Operating System Device Drivers Hardware Conditional Access Audio Video Data MPEG SBTVD specification interpreter application specification 12 Copyright 2006 TeleMídia
MPEG-2 System Component_tag elementary streams (video/ audio/data) Program_number PCR- Program Clock Reference program stream transport stream PMT (Program map table) program stream 1 n PAT (Program association table) 13 Copyright 2006 TeleMídia
Reference Model Video Coding Audio Coding Transport System Physical Layer 14 Copyright 2006 TeleMídia
Reference Model Audio MPEG2 BC MPEG2 AAC DOLBY AC3 Video MPEG2 - SDTV MPEG2 - HDTV MPEG-2 System 8-VSB COFDM 15 Copyright 2006 TeleMídia
Reference Model Áudio MPEG - 4 HE-AAC@L4 MPEG - 4 HE-AAC@L3 Vídeo H.264 HP@L4.0 H.264 BP@L1.3 MPEG-2 System BST-OFDM 16 Copyright 2006 TeleMídia
ISDB CODEC S-Video MPEG-2 Modulation Editing 17 Copyright 2006 TeleMídia
Internet Net ISDB CODEC S-Video MPEG-2 Modulation Editing PSTN 18 Copyright 2006 TeleMídia
API SO Rede Externa Video Decoding Audio Decoding Transport System Physical Layer Memória RF in Demodulador Decod. do Canal CPU Dec. Vídeo Dec. Áudio VC IR CR RF RF out Audio out Audio Surround Video out 19 Copyright 2006 TeleMídia
APPL1 APPL2... APPLn API SO Rede Externa Video Coding Audio Coding Transport System Physical Layer Memória RF in Demodulador Decod. do Canal CPU Dec. Vídeo Dec. Áudio VC IR CR RF RF out Audio out Audio Surround Video out 20 Copyright 2006 TeleMídia
APPL1 APPL2... APPLn Middleware API SO Rede Externa Video Coding Audio Coding Transport System Physical Layer Memória RF in Demodulador Decod. do Canal CPU Dec. Vídeo Dec. Áudio VC IR CR RF RF out Audio out Audio Surround Video out 21 Copyright 2006 TeleMídia
APPL1 APPL2... APPLn Ginga API SO Rede Externa Video Coding Audio Coding Transport System Physical Layer Memória RF in Demodulador Decod. do Canal CPU Dec. Vídeo Dec. Áudio VC IR CR RF RF out Audio out Audio Surround Video out 22 Copyright 2006 TeleMídia
APPL1 APPL2... APPLn Ginga Runtime Environments Common Core API SO Rede Externa Video Coding Audio Coding Transport System Physical Layer Memória RF in Demodulador Decod. do Canal CPU Dec. Vídeo Dec. Áudio VC IR CR RF RF out Audio out Audio Surround Video out 23 Copyright 2006 TeleMídia
APPL1 APPL2... APPLn Ginga Ginga-NCL Ginga-J Ginga-CC API SO Rede Externa Video Coding Audio Coding Transport System Physical Layer Memória RF in Demodulador Decod. do Canal CPU Dec. Vídeo Dec. Áudio VC IR CR RF RF out Audio out Audio Surround Video out 24 Copyright 2006 TeleMídia
APPL1 APPL2... APPLn Ginga Ginga-NCL Ginga-J Ginga-CC API SO Rede Externa Video Coding Audio Coding Transport System Physical Layer Memória RF in Demodulador Decod. do Canal CPU Dec. Vídeo Dec. Áudio VC IR CR RF RF out Audio out Audio Surround Video out 25 Copyright 2006 TeleMídia
APPL1 APPL2... APPLn Ginga Ginga-NCL Ginga-CC API SO Rede Externa Video Coding Audio Coding Transport System Physical Layer Memória RF in Demodulador Decod. do Canal CPU Dec. Vídeo Dec. Áudio VC IR CR RF RF out Audio out Audio Surround Video out 26 Copyright 2006 TeleMídia
Middleware Requirements Copyright 2006 TeleMídia
TV TV (cable) Mob. + Tel. Fixed Mobile Inter net Computer Computer + Internet Has never used a Computer Have never used the Internet TOTAL 97% 6% 36% 72% 21% 25% 18% 53% 61% Urbain Area 98% 7% 40% 76% 23% 28% 20% 49% 57% Rural Area 91% 1% 15% 72% 9% 8% 4% 75% 82% 28
TV TV (cable) Mob. + Tel. Fixed Mobile Inter net Computer Computer + Internet Has never used a Computer Have never used the Internet TOTAL 97% 6% 36% 72% 21% 25% 18% 53% 61% Urbain Area 98% 7% 40% 76% 23% 28% 20% 49% 57% Rural Area 91% 1% 15% 72% 9% 8% 4% 75% 82% Class A > R$ 4.151,00 100% 53% 90% 97% 58% 95% 91% 7% 10% Class B 100% 19% 75% 94% 41% 70% 58% 20% 25% Class C 99% 5% 40% 81% 23% 25% 16% 47% 55% Class DE < R$ 1.245,00 92% 1% 13% 51% 8% 3% 1% 77% 84% Data from 2008, published in 2009 by CGI.br 29 Copyright 2006 TeleMídia
Specification Language Simple to be understood and learned Lightweight Powerful Declarative DSL language 30 Copyright 2006 TeleMídia
Programming Paradigms Imperative (procedural) algorithm specification: how to do more expressiveness Declarative specification: final intention highest level specification 31 Copyright 2006 TeleMídia
NCL Nested Context Language The Brazilian innovation in the ISDB System: NCL (Nested Context Language) declarative language Its script NCLua language Its engine: Ginga-NCL middleware. ITU-T H.761 Recommendation for IPTV services ITU-R BT 1691-1 Recommendation for Terrestrial DTV 32 Copyright 2006 TeleMídia
Synchronization 33 Copyright 2006 TeleMídia
Synchronization 34 Copyright 2006 TeleMídia
Interactivity 35 Copyright 2006 TeleMídia
Interactivity 36 Copyright 2006 TeleMídia
TV is not a Computer Broadcast transmission Viewers are usually far from the screen and interact via remote control devices Usually more than one viewer Viewer interaction must be treated as just an example of temporal synchronization 37 Copyright 2006 TeleMídia
TV is not a Computer Broadcast transmission Viewers are usually far from the screen and interact via remote control devices Usually more than one viewer Video based applications Structure-based synchronization 38 Copyright 2006 TeleMídia
39 Copyright 2006 TeleMídia
40 Copyright 2006 TeleMídia
41 Copyright 2006 TeleMídia
42 Copyright 2006 TeleMídia
43 Copyright 2006 TeleMídia
44 Copyright 2006 TeleMídia
45 Copyright 2006 TeleMídia
46 Copyright 2006 TeleMídia
47 Copyright 2006 TeleMídia
48 Copyright 2006 TeleMídia
49 Copyright 2006 TeleMídia
50 Copyright 2006 TeleMídia
51 Copyright 2006 TeleMídia
52 Copyright 2006 TeleMídia
Middleware Requirements Copyright 2006 TeleMídia
TV is not a Computer Broadcast transmission Viewers are usually far from the screen and interact via remote control devices Usually more than one viewer Video based applications Multiple Exhibition Devices 54 Copyright 2006 TeleMídia
Single Exhibition Device 55 Copyright 2006 TeleMídia
Single Exhibition Device Tira Teima 56 Copyright 2006 TeleMídia
Single Exhibition Device 57 Copyright 2006 TeleMídia
Multiple Exhibition Devices Tira Teima 58 Copyright 2006 TeleMídia
Multiple Exhibition Devices 59 Copyright 2006 TeleMídia
60 Copyright 2006 TeleMídia 4
61 Copyright 2006 TeleMídia
62 Copyright 2006 TeleMídia
63 Copyright 2006 TeleMídia
64 Copyright 2006 TeleMídia
65 Copyright 2006 TeleMídia
Adaptation 66 Copyright 2006 TeleMídia
Adaptation 67 Copyright 2006 TeleMídia
Adaptation Beba Cerveza 68 Copyright 2006 TeleMídia
Adaptation Beba Guaraná 69 Copyright 2006 TeleMídia
Content and Presentation Adaptation Presentation device User profile User location Adaptability 70 Copyright 2006 TeleMídia
Programming Paradigms Imperative (procedural) algorithm specification: how to do more expressiviness Declarative specification: final intention highest level specification Media synchronization Adaptability Multiple devices 71 Copyright 2006 TeleMídia
Declarative: NCL HTML MHEG Imperative: Lua ECMAScript Java 72 Copyright 2006 TeleMídia
Imperative Declarative + efficient + easy to use + general 73 Copyright 2006 TeleMídia
Declarative X Imperative Declarative Imperative 74 Copyright 2006 TeleMídia
Declarative X Imperative Declarative Imperative 75 Copyright 2006 TeleMídia
Declarative X Imperative Declarative Imperative 76 Copyright 2006 TeleMídia
State of the art Declarative Middleware Focus on interactivity Synchronization and adaptability by using scripts (procedural) 77 Copyright 2006 TeleMídia
DTV Middlewares EE PE MHP 1.1 Europe (DVB) USA (ATSC) MHP 1.0 ACAP-J DVB - HTML ACAP-X J.200: Worldwide common core Application environment for digital interactive television services Japan (ARIB) Brasil (SBTVD) ARIB-AE (STD-B23) Ginga-J BML (STD-B24) Ginga-NCL J.201: Harmonization of declarative content format for interactive TV applications ITU ITU-T J.202 ITU-T J.201 GEM ITU-T J.200 J.202: Harmonization of procedural content formats for interactive TV applications Arquitetura do Sistema 78 Copyright 2006 TeleMídia
Declarative X Imperative Declarative Imperative HTML 79 Copyright 2006 TeleMídia
Why NCL? 80 Copyright 2006 TeleMídia
NCL Nested Context Language Synchronization support Structure-based synchronization Interactive channel support Multiple device facilities Support for content and presentation adaptation Live editing support NCL is free software 81 Copyright 2006 TeleMídia
Declarative X Imperative Declarative Imperative NCL 82 Copyright 2006 TeleMídia
Declarative X Imperative Declarative Imperative Scripting languages ECMAScript Lua System languages Java C 83 Copyright 2006 TeleMídia
Script + easy to use System Efficiency? Footprint? 84 Copyright 2006 TeleMídia
Script X System Script System 85 Copyright 2006 TeleMídia
Script X System Script System 86 Copyright 2006 TeleMídia
Script X System Script System 87 Copyright 2006 TeleMídia
Ginga Options Lua Java Small to medium complex tasks: Lua High complex tasks: Java 88 Copyright 2006 TeleMídia
Why Lua? 89 Copyright 2006 TeleMídia
Why Lua? Lua is Simple and Powerful Lua is Portable Lua is Embeddable Lua is Fast Lua is Robust Lua is Free Software 90 Copyright 2006 TeleMídia
http://shootout.alioth.debian.org / Lua vs JS LuaJIT vs JS JavaScript SpiderMonkey = 936 Kbytes Lua = 120 Kbytes LuaJIT = 150 Kbytes 91 Copyright 2006 TeleMídia
NCL java onbegin Start Start Start onbegin onend Stop Stop Start Start onbegin onselection Stop Set size Set size onend Start 92 Copyright 2006 TeleMídia
NCL java onbegin Start Start Start onbegin onend Stop Stop Start Start onbegin onselection Stop Set size Set size onend Start Smil 93 Copyright 2006 TeleMídia
java Start onbegin onbegin onend Start Stop Start Stop Start Start onend onbegin onselection Stop Set size Start Set size Smil 94 TV interactiva se hace con Ginga Copyright 2006 TeleMídia
Final Remarks Copyright 2006 TeleMídia
Composer 1.0 97 Copyright 2006 TeleMídia
NCL Eclipse 98 Copyright 2006 TeleMídia
R&D Ginga at the Content Producer Composer 2.0 Composer 1.0 + NCL Eclipse facilities Keeps the functional requirements of Composer 1.0 and adds non-functional requirements Integrated with the transmission system Optimized data carousel generation Support to live content production 99 Copyright 2006 TeleMídia
R&D Ginga at the Content Producer Composer 2.0 Based on a micro-kernel that may be extended with plug-ins Each authoring views acts as a plug-in Open-source development, from the first step thought to be extended 100 Copyright 2006 TeleMídia
Internet Rede PULL PUSH SBTVD Rede Externa API SO Audio Video Data MPEG TS IR RF in Demodulador Decod. do Canal CR Demux. CPU Dec. Vídeo Dec. Áudio VC Memória RF RF out Audio out Audio Surround Video out 101 Copyright 2006 TeleMídia
R&D Ginga Authoring in the Client Side Composer 2.0 Composer 1 + NCL Eclipse facilities Context aware Visions for cooperative authoring 102 Copyright 2006 TeleMídia
Ginga-NCL Reference Implementation C++ Language Linux platform High performance Hard to embed 103 Copyright 2006 TeleMídia
Ginga-NCL Virtual Set-top Box 104 Copyright 2006 TeleMídia
Ginga -NCL Live CD 105 Copyright 2006 TeleMídia
106 Copyright 2006 TeleMídia
SAGGA Project SAGGA: Suport for Automatic Generation of Ginga-NCL Applications Definition of several templates for application authoring Applications with dynamic content Widgets NCLua lib 107 Copyright 2006 TeleMídia
Ginga NCL for IPTV IPTV: Recommendation H.761 Symbian Android Ready for ISDB-T 108 Copyright 2006 TeleMídia
Ginga NCL for USB ISDB 1-seg/ Full-seg USB-SBTVD: PlayTv PixelView, Intera Linux Windows Your PC with Ginga-NCL interactivity 109 Copyright 2006 TeleMídia
Ginga NCL for Windows 1-seg/ Full-seg USB-SBTVD IPTV Broadband TV: plug-in Firefox 110 Copyright 2006 TeleMídia
Multiple devices iphone (passive) Android (passive e active) 111 Copyright 2006 TeleMídia
NCL Evolution Copyright 2006 TeleMídia
NCL 3.1 Raw Profile A new profile closer to the Ginga-NCL internal data structure Completely compatible with NCL 3.1 EDTV profile, but without any syntactic sugar Player much more simple, efficient and less error-prone Player more simple, converter more fancy Application much more difficult to be understood and cloned It is not an authoring language, but a transitional language, close to the NCL engine 113 Copyright 2006 TeleMídia
NCL Evolution TAL 1.0: Template authoring language NCL 4.0 Better context aware support 3D objects Multiple devices Social networks 114 Copyright 2006 TeleMídia
NCL Evolution TAL 1.0: Template authoring language NCL 4.0 Better context aware support 3D objects Multiple devices Social networks 115 Copyright 2006 TeleMídia
http://www.ncl.org.br http://www.softwarepublico.gov.br http://clube.ncl.org.br/ http://www.ginga.org.br http://www.telemidia.puc-rio.br 116 Copyright 2006 TeleMídia