Translator Cloud (Speech Enabled Domain-Oriented Translator Cloud)

Transcription

1 Technical University of Košice Faculty of Electrical Engineering and Informatics Department of electronics and multimedia telecommunications Laboratory of speech and mobile technologies - LSMT Translator Cloud (Speech Enabled Domain-Oriented Translator Cloud) Matúš Pleva - Matus.Pleva@tuke.sk Senior researcher JRC Annual Event on the Scientific Support to the Danube Strategy October 2015, Maritim Hotel Ulm

2 Needs for Danube region Many ongoing projects for major European languages for Machine translation (MT) A few national funding for Automatic Speech recognition for small languages as Hungarian, Romanian, Serbian, Czech, Croatian, Slovenian and Slovak; NO integrated system available of these language technologies for Speech to Speech translation, because of small target users comparing to other EU regions

3 Needs for Danube region For H2020 it is not a topic, because the target group is small comparing the western EU countries and ASR and MT technology is already financed/developed for them The medium and low educated citizens (with few or no foreign language capability) needs to communicate when visiting other country or consult their needs with foreign health institutions, communicate with labor & immigration office or policeman

4 Solution proposed Speech to speech translation service on the cloud for Danube region languages Possibility to communicate without knowledge of modern ICT using telephone IVR (Interactive voice response system) could provide the basic information about public services in foreign country or provide a telephone number or directly connect the foreign language provider/office using speech to speech translation service online

5 Tasks planned WP 0 Management (Lead: Lead partner) WP 1 Communication activities (Univ. of Maribor) WP 2 Automatic Speech Recognition (Uni. of Novi Sad) 690k WP 3 Speech synthesis (TUKE Univ. of Kosice) 690k WP 4 Dialog management and Machine Translation (Belux)- 690k WP 5 Integration of the cloud solution including mobile platforms (GAMO a.s.) 690k WP 6 End user and Evaluation (Univ of Zagreb) 830k Summary , planns for Interreg Danube (85% cofin.)

6 Searched partners All Danube region countries are already joined or we are waiting for their approval still place to discuss possible partners/end users, the budget is not final, depends on partners and number of languages, trials, clouds Currently not enough experienced administrative resources to coordinate the project but we are able to deliver everything on time to the lead partner, currently waiting for approval from German/Bulgaria partner Montenegro, B&H already contacted

7 Current consortium TECHNICKÁ UNIVERZITA KOŠICE, Slovakia (ASR/TTS/IVR), TECHNICAL UNIVERSITY KOSICE,; Gamo a.s., Slovakia (cloud, mobile apps, SME) UNIVERZITA KARLOVA, Charles University in Prague, Czech Republic, (MT, ASR.TTS) UNIVERSITATEA POLITEHNICA DIN TIMISOARA, Romania, THE "POLITEHNICA" UNIVERSITY OF TIMISOARA (ASR,TTS) UNIVERZITET U NOVOM SADU FAKULTET TEHNICKIH NAUKA, Serbia, University of Novi Sad (ASR,TTS,MT) UNIVERZA V MARIBORU, Slovenia, University of Maribor (ASR,TTS, IVR, MT), Amebis, (TTS, MT, SME) SVEUČILIŠTE U ZAGREBU Croatia University of Zagreb (MT) LTE-Soft Nonprofit Kft, Hungary (ASR, MT, IVR); Belux Csoport Kft., Hungary (cloud, SME) Université Joseph Fourier,Grenoble, France, (MT, ASP)

8 Challenges for discussion Find out scenarios covering for one or two domains as much as possible target users Medical, local government, e-commerce, police Other possible funding schemes, how relevant it is for Interreg Danube and Danube strategy for better explanation for reviewers H2020 relevant calls, Interreg Danube relevancy, supply chain, S3 relevancy How maintain the cloud after the project, more providers? One/two target languages? (all to DE/EN?)

9 Laboratory of speech and mobile technologies - LSMT THANK YOU FOR YOUR ATTENTION QUESTIONS? Matus.Pleva@tuke.sk take a leaflet or bussines card Jozef.Juhar@tuke.sk - head of the Lab