CENTRALIZED WORKFLOW PROCESS FOR MULTILANGUAGE SUBTITLING OF LIVE EVENTS Speakers: Inmaculada Requena de la Riva Salud Madrid Maria Sonsoles Sastre Páez Salud Madrid Jesús Martínez Barbero Technical Univ. Of Madrid
CONTENT INTRODUCTION PROPOSED METHODS SOCCER EXAMPLE FUTURE WORKS
INTRODUCTION The Nurse and persons with disabilities. Recommendations TV subtitling Problems for TV subtitling in live events Multilanguage subtitling Live TV contribution Objective
INTRODUCTION The Nurse and persons with disabilities. Recommendations TV subtitling Problems for TV subtitling in live events multilanguage subtitling Live TV contribution Objective
INTRODUCTION The Nurse and persons with disabilities A Privileged position Detect problems in the day-to-day in the persons with disabilities We present an example of how nurses can detect and provide solutions Interdisciplinary work
INTRODUCTION The Nurse and persons with disabilities Recommendations TV subtitling Problems for TV subtitling in live events multilanguage subtitling Live TV contribution Objective
INTRODUCTION Recommendations File subtitling formats: Advanced SubStation Alpha (.ASS) AQ Title (.AQT) DKS Subtitle Format (.DKS) MicroDVD (.SUB) Sami Captioning (.SMI) SubStation Alpha (.SSA) SubRip (.SRT) WEBVTT (.VTT) Subviewer (.SUB)
INTRODUCTION Recommendations Examples SUBVIEWER (.SUB)
INTRODUCTION Recommendations Examples AQ TITLE (.AQT)
INTRODUCTION Recommendations Examples ADVANCED SUBSTATION ALPHA (.ASS)
INTRODUCTION Recommendations File subtitling formats: Timed Text Markup Language TTML) Last version: 24 September 2013
Editor A Editor C Editor B Editor D Transcod. 1 TTML Compilator Transcod. 2 Transcod. n MHP HTML 5 GEM New Media type DVB-H, DVB-C, DVB-T, DVB-S, DCB-H IPTV, Web TV, 3G IPTV, Blue-ray, New Formats
INTRODUCTION Recommendations File subtitling formats: Timed Text Markup Language TTML) Structure <tt xml:lang="" xmlns="http://www.w3.org/ns/ttml"> <head> <metadata/> <styling/> <layout/> </head> <body/> </tt> Source : W3C
INTRODUCTION Recommendations File subtitling formats: Timed Text Markup Language TTML) Styling <style xml:id="s1" tts:color="white" tts:fontfamily="proportionalsansserif" tts:fontsize="22px" tts:textalign="center" /> Source : W3C
INTRODUCTION Recommendations File subtitling formats: Timed Text Markup Language TTML) Layout <layout xmlns:tts="http://www.w3.org/ns/ttml#styling"> <region xml:id="subtitlearea" style="s1" tts:extent="560px 62px" tts:padding="5px 3px" tts:backgroundcolor="black" tts:displayalign="after" /> </layout> Source : W3C
INTRODUCTION Recommendations File subtitling formats: Timed Text Markup Language TTML) Body <body region="subtitlearea"> <div> <p xml:id="subtitle1" begin="0.76s" end="3.45s"> It seems a paradox, does it not, </p> <p xml:id="subtitle2" begin="5.0s" end="10.0s"> that the image formed on<br/> the Retina should be inverted? </p> <p xml:id="subtitle3" begin="10.0s" end="16.0s" style="s2"> It is puzzling, why is it<br/> we do not see things upside-down? </p> </div> </body> Source : W3C
Source : W3C
INTRODUCTION The Nurse and persons with disabilities Recommendations TV subtitling Problems for TV subtitling in live events multilanguage subtitling Live TV contribution Objective
TV Subtitling (Introduction) Pre-recorded Programs Live Programs
TV Subtitling (Introduction) Pre-recorded Programs Content Distribution
TV Subtitling (Introduction) Pre-recorded Programs Subtitling broadcast Distributo r Film BROADCASTER DAM broadcast copy Playout System Video + audio Data MPEG2/4 TS Browse copy Subtitle data file TV TV monitor Subtitle editor Generate Closed Caption file User SUBTITLING COMPANY
Live Programs TV Subtitling Programs with scripts (text) Eg: Opera, news Without script Eg:Soccer match
TV Subtitling Programs with scripts (text) Teleprompter Newsroom Systems TV Playout Close Caption System
TV Subtitling Programs without script (without text) Subtitle generation: Speech recognition Stenography
INTRODUCTION The Nurse and persons with disabilities Recommendations TV subtitling Problems for TV subtitling in live events multilanguage subtitling Live TV contribution Objective
Problems for TV subtitling in live events Speech recognition Delay Errors Stenography Production cost A person need 2 years of experience.
INTRODUCTION The Nurse and persons with disabilities Recommendations TV subtitling Problems for TV subtitling in live events multilanguage subtitling Live TV contribution Objective
MULTILANGUAGE SUBTITLING IN LIVE EVENTS Several efforts have been made in specific areas. Problems:» Delay» Errors» Computer resources
INTRODUCTION The Nurse and persons with disabilities Recommendations TV subtitling Problems for TV subtitling in live events multilanguage subtitling Live TV contribution Objective
Live TV Contribution Event Producer Video+Audio Decoder Decoder Decoder TV CHANNEL 1 Play out TV CHANNEL 2 Play out TV CHANNEL N Play out Output Output Output
INTRODUCTION The Nurse and persons with disabilities Recommendations TV subtitling Problems for TV subtitling in live events multilanguage subtitling Live TV contribution Objective
Objective Subtitle of Live events Program with scripts» multilanguage subtitling Program without scripts (SPORTS)» Cheaper and faster Subtitling» multilanguage subtitling
CONTENT INTRODUCTION PROPOSED METHODS SOCCER EXAMPLE FUTURE WORKS
PROPOSED METHODS Multilanguage subtitling Live event with script Live event without script (SPORTS)
PROPOSED METHODS Multilanguage subtitling Live event with script Live event without script(sports)
What is best? Good morning. With signer or subtitle?
Let me show you a detail.. Teleprompter Text Usually We have the text. Why don t use it?
LIVE EVENT WITH SCRIPT Remember We can subtitle all programs We don t need special or complicated technology Why don t use it instead signer? Why don t subtitled all this types of programs as default production process?
LIVE EVENT WITH SCRIPT Why don t add subtitles with the video and audio data as normal procedure?
LIVE EVENT WITH SCRIPT Why don t add subtitles with the video and audio data as normal procedure? Producer Subtitle Data Video+Audio Sub. System Subtitle Data TV CHANNEL 1 Output Decoder Play out Sub. System Subtitle Data TV CHANNEL 2 Output Decoder Play out Sub. System Subtitle Data TV CHANNEL N Output Decoder Play out
LIVE EVENT WITH SCRIPT Multilanguage subtitling Paper: Multilanguage Opera Subtitling Exchange Between Production and Broadcaster Companies, Jesús Martínez Barbero, Manuel Bollaín Pérez. 2009. Book 14 - New Trends in Intelligent Technologies Preproduction Each phrase has a code The entire text is translated to all languages desired It could be don by producer or broadcaster Language 1 Original Data Broadcasters Translation Language n
LIVE EVENT WITH SCRIPT Multilanguage subtitling Paper: Multilanguage Opera Subtitling Exchange Between Production and Broadcaster Companies, Jesús Martínez Barbero, Manuel Bollaín Pérez. 2009. Book 14 - New Trends in Intelligent Technologies Production Producer Subtitle Data Video+Audio Code data Sub. System Subtitle Data TV CHANNEL 1 Output Decoder Play out Sub. System Subtitle Data TV CHANNEL 2 Output Decoder Play out Sub. System Subtitle Data TV CHANNEL N Output Decoder Play out
PROPOSED METHODS Multilanguage subtitling Live event with script Live event without script (SPORTS)
LIVE EVENT WITHOUT SCRIPT (SPORTS) Basis: Sport has a set of phrases: We use Predefined phrases in Controlled Natural Language (CNL) Producer send the identification number + [variables] The system generates the phrases in all the languages suported
LIVE EVENT WITHOUT SCRIPT (SPORTS) Server Cloud Platform Web Services Web Services Http Http Customization Several languages Language selection Video + Audio + Subtitles Video + Audio + Subtitles Commentators Mux Mux Phones Web Tablets DVB DVB
LIVE EVENT WITHOUT SCRIPT (SPORTS) Commentator terminal [Soccer] Scenarios Phrases types Team management
Event Detection Change situation Phrase selection Player selection Team selection No Need Player Yes Yes Waiting Title waiting No Send Title Sow Title Yes Change Situat. Load Sentences No No Change team. Yes Load Players Wait Event
LIVE EVENT WITHOUT SCRIPT (SPORTS) For one match Server Languages 1..K Languages 1..K 1 Language K Languages Comment. 1..N TV Channels 1..M Web Platforms 1..L
LIVE EVENT WITHOUT SCRIPT (SPORTS) Server Flowchart Msgfrom commetator program Phrase_ID(Var_1, Var_2,, VarN Inbox Data Extractor Set El arboldel ahorcado Ve peligrar su suerte El mecenaxfo El arboldel ahorcado De lo valido u no válido Ve peligrar Para un juego de pelota vasa Phrase Set su suerte El mecenaxfo 1 De lo valido u no válido Para un juego de pelota vasa Phrases 1 Id Phrase Selector N Phrase Conf. LANGUAJE module 1 Send msg WS clients HTTP clients WS msg HTTML PAGE Set El arboldel ahorcado Ve peligrar su suerte El mecenaxfo El arboldel ahorcado De lo valido u no válido Ve peligrar Para un juego de pelota vasa Phrase Set su suerte El mecenaxfo 1 De lo valido u no válido Para un juego de pelota vasa Phrases 1 Id Phrase Selector N Phrase Conf. LANGUAJE module M Send msg WS clients HTTP clients WS msg HTTML PAGE
LIVE EVENT WITHOUT SCRIPT (SPORTS) Entire system (for several matches) Matches 1..O
CONTENT INTRODUCTION PROPOSED METHODS SOCCER EXAMPLE FUTURE WORKS
CONTENT INTRODUCTION PROPOSED METHODS SOCCER EXAMPLE FUTURE WORKS
CONTENT INTRODUCTION PROPOSED METHODS SOCCER EXAMPLE FUTURE WORKS
FUTURE WORKS Refine the phrase types Aggregate more phrases to phrase types Create Levels of subtitling Aggregate languajes Aggregate sports
INTRODUCTION PROPOSED METHODS SOCCER EXAMPLE FUTURE WORKS CONTENT Thank you????????