Enabling accessibility in a connected world HBB4ALL Demos

Enabling accessibility in a connected world HBB4ALL Demos Lisbon, 26-02-2016

HBB4ALL Hybrid Broadcast Broadband for All Co-funded by the European Commission under the Competitiveness and Innovation Framework Programme (CIP). Project running time: 3 years (December 2013 November 2016). Pilot. Deployment of services as a first experience for an actual exploitation in the future. Deployment of access services based on HbbTV and on other technologies in the current broadcast-broadband convergence paradigm. CIP-ICT-PSP-621014 - HBB4ALL 2

Introduction to HBB4ALL List of pilots Pilot A - Multi-Platform Subtitle Services Pilot B - Alternative audio production and distribution Pilot C - Automatic UI adaptation - accessible SmartTV application Pilot D - Sign Language Translation Services CIP-ICT-PSP-621014 - HBB4ALL 3

List of demos Customised HbbTV Subtitles for VoD, Remo Vogel, Rbb Customizable Subtitling Service, Francesc Mas, TVC Multiplatform subtitles in web environments, Carlos Alberto Martín Edo / Mario Sequeira UPM/RTP Automated Multilingual Broadcast Subtitles, Mikel Zorrilla, Vicomtech MPEG-DASH streaming and EBU-TT subtitles as part of HbbTV2.0 Showcase, Andreas Tai, IRT Subtitle format conversion, Andreas Tai, IRT Subtitle Database, Andreas Tai, IRT Clean Audio, Ronald Mies, IRT Alternative audio, Francesc Mas, TVC Audiodescription, Pilar Orero, UAB Personalized UI adaptation and subtitling in a web based learning application. Volker Hahn, VSonix HbbTV Signer Application, Remo Vogel, Rbb CIP-ICT-PSP-621014 - HBB4ALL 4

Customisable HbbTV Subtitles for VoD Carried out by Customisable subtitles have been introduced into RBB HbbTV Mediathek service IRT s STL-to-EBU-TT-D transcoding framework integrated into subtitle production chain CMS extension to assign subtitle files to video items and automatically export to the VoD infrastructure Functional testing of transcoding, ingest and export of subtitle files was conducted. Front end of HbbTV Mediathek adapted to offer subtitles and customisation features User trial planned in close cooperation with local user associations Tester recruiting and technical vetting and/or equipping CIP-ICT-PSP-621014 - HBB4ALL 6

TVC EBU-TT-D Subtitles on HbbTV TVC commitment to EBU-TT-D subtitling standard. HbbTV Versions 1.1 & 1.5 do not support EBU-TT-D natively. Developed solution allows subtitles to be rendered over the video as an html object using JavaScript code to parse EBU-TT-D file and generate html and css subtitles. Improved with customized subtitling: allows user to change font size, position and font background. Customizable EBU-TT-D subtitling is nowadays available on TV3alacarta catchup service. CIP-ICT-PSP-621014 - HBB4ALL 8

Wide focus multi-platform Subtitles Carried out by RTP and UPM Re-definition of sub-pilot based on JW player currently used for online content in RTPplay Large-scale deployment and delivery of accessible content on a variety of devices. REST API created to provide UPM access to content, subtitle files and metadata Plug-in for JW player used in RTPplay developed and tested by UPM Methodology to test and evaluate service jointly designed by RTP and UPM CIP-ICT-PSP-621014 - HBB4ALL 10

Dialogue intelligibility as an Access Service Intelligibility TV programs inadequate Especially hearing impaired and elderly HBB4ALL survey: almost every type of TV content Automatic Clean Audio generation Suitable for integration in existing production workflows Improve readily produced audio mix with respect to dialogue intelligibility Use 5.1 or stereo input signals for signal processing Output: stereo signal (support all TV receivers) Results HBB4ALL user tests: 5.1 input signal preferable Users wearing a hearing aid / without hearing aid Intelligibility problems CIP-ICT-PSP-621014 - HBB4ALL 12

Demo: automatic Clean Audio generation Comparison of dialogue intelligibility in original sound track and Clean Audio versions Material as used in German listening tests 5.1 (basic mode) versions: 1. original 2. L /R lowered by 12dB 3. L /R lowered by 60dB Stereo (advanced mode) versions: 1. original 2. Frequency processing: Center Cut -18dB / non-speech frequencies -9dB 3. Dialogue (Center Cut result) panned left CIP-ICT-PSP-621014 - HBB4ALL 13

CCMA HbbTV Alternative Audio CCMA s targets in Alternative Audio Definition and planning of alternative audio services using HbbTV and MPEG-DASH technologies, incorporating multiple audio tracks in a single asset. MPEG-DASH is an standard for both live and on-demand adaptive bitrate streaming Using the live-profile defined in Spanish Recommendation ( Foro Técnico de la Televisión Digital en España ) Explore the production and distribution aspects of the aimed alternative audio services from the broadcaster perspective in order to implement appropriate workflows, both for live and on demand content. Preparation of assets with audiodescription, clean audio and multi-language audio (VO) in addition to the Catalan audio. Testing of MPEG-DASH Streaming Tools (Wowza, GPAC, USP ) Development of HbbTV application to allow end-user to play content with the desired alternative audio, and test this application over the different TV sets. CIP-ICT-PSP-621014 - HBB4ALL 15

CCMA HbbTV Alternative Audio Development of HbbTV Test application Allows to play MPEG-DASH assets over real HbbTV 1.5 TV sets. Testing of Live and VoD content in a single interface User can select the desired alternative audio while playing video. The audio switching is performed internally by the application using OIPF/HbbTV API. CIP-ICT-PSP-621014 - HBB4ALL 16

CCMA HbbTV Alternative Audio Testing results of playing multi-audio content over TV sets (October 2015) TV set VoD Live A MODEL 1 A MODEL 2 B MODEL 1 B MODEL 2 B MODEL 3 C MODEL 1 D MODEL 1 D MODEL 2 D MODEL 3 F MODEL 1 Works Ok Black/freeze and jump on audio switching Audio switching not supported Play fails CIP-ICT-PSP-621014 - HBB4ALL 17

CCMA HbbTV Alternative Audio Problems and solutions Some HbbTV1.5 TV sets do not support live MPEG-DASH. Some HbbTV1.5 TV sets do not support audio switching. Solution adopted : HTTP Progressive Download for VoD CIP-ICT-PSP-621014 - HBB4ALL 18

CCMA HbbTV Alternative Audio HTTP Progressive Download Advantages: Full compatibility with HbbTV 1.0 and HbbTV 1.5. Disadvantages: Needs one separate video asset for every alternative audio. Need a restart play to switch audio. TV3alaCarta catch up uses HTTP Progressive Download for Audio-description Configuration is cached for future uses. Prepared to support original version audio. In production since February 2016. CIP-ICT-PSP-621014 - HBB4ALL 19

Sound Mix in Official Recommendations ICT 2000, UK When a descriptive commentary is inserted into a programme, the background level of programme audio needs to be reduced so that the description can be clearly heard. BCI, Ireland 2005 Generally the narration should be fixed at a constant level. The narrative voice is fixed at a constant level at the start of the recording, while the degree of fading the main sound level at the appropriate junctures can be predetermined by the work station. France 2008 When mixing, the audio description must be perfectly audible, but in no case must it take over from the film. DD/MM/2014 CIP-ICT-PSP-621014 - HBB4ALL 21

Audio Description No standard available for loudness, or AD mix, etc. Some ADs can t be heard because VO background sound, such as a car chase, or guns or helicopters. Some ADs can t be heard because of environment noise, and AD track doesn t not have volume. Opera, theatre, cinema. Also with smartphone apps. DD/MM/2014 CIP-ICT-PSP-621014 - HBB4ALL 22

Audio Description Audio Mix 1-AD is inserted not touching other levels 2-Original soundtrack is lowered when necessary 3- AD track is adjusted every time CIP-ICT-PSP-621014 - HBB4ALL 23

Online Course on Media Accessibility MOOC content addressing topics on media accessibility Lectures on accessibility incl. subtitling, audio description, sign language Available in English with English, German and Spanish subtitles via Hbb4All website from April 2016 CIP-ICT-PSP-621014 - HBB4ALL 25

AccessGUIDE accessibility service AccessGUIDE service for accessibility personalisation on PC, mobile and HBBTV platform Adaptation of UI elements, screen reader, subtitles Customizable white label service for online application developers Includes personalized online TTS service for screen reading and spoken subtitles CIP-ICT-PSP-621014 - HBB4ALL 26

German subpilot. HbbTV signing application Carried out by RBB Berlin and Brandenburg regions in Germany. Picture-in-picture ("All-in-one") solution for catch-up content Status: the sub-pilot is deployed; the operational phase is started Panel of 30 deaf users at home, playing the service on HbbTV devices Different parameters or combinations of parameters to test customization options: Sizes Positions Layout Genres One parameter / combination per week Online questionnaires with snapshots CIP-ICT-PSP-621014 - HBB4ALL 28