How To Communicate With A Computer Via A Phone Or A Computer (For Seniors)

Transcription

1 KopAN Speech Based Communication via MANETs, K. Rebensburg, B. Schnor Institut für Informatik - University of Potsdam WCI 2009

2 University Potsdam - PALI Potsdam Assisted Living Initiative Technical Assistance Systems Smart Home Orientation system for dementia patients 2

3 Orientation System System supports Dementia patient Orientation in space and time Self determined living Caretaker Overview of patients Faster response in emergency cases Speech based user interaction! 3

4 Orientation System Appointment reminder Patients are reminded on events/appointments (lunch, ) thereby can attend autonomously Frequently appointments readout depending on grade of dementia Caretaker manage appointments via web interface 4

5 Orientation System Emergency call In emergency case patients can call the appropriate caretaker via VoIP by pressing emergency button Leads to a POTs phone call on caretaker site Direct speech communication between caretaker and patient 5

6 Orientation System Hardware Mobile nodes for patients (N810, Openmoko) Static relay stations Central server with gateway functionality Software KopAN MANETSip User- / Appointmentmanagement via Webfrontend 6

7 Speech Synthesis Speech based Speech synthesis on the devices Caretakers POTS phone Upon patients mobile device Speech synthesis for event and alarm notification 7

8 Speech Synthesis 8

9 Speech Synthesis 9

10 Speech Synthesis Regular asynchronous update of appointment-lists between mobile devices and central database via wireless channels Text based generation of audio file (once) Frequent play-out for occurring events or warnings 10

11 Speech Synthesis Hallo Herr Trautmann, es ist Zeit für das Mittagessen espeak Textinput can be transformed to Audio streams based on included voices Phonemdata as input representation Mbrola - Multi Band Resynthesis Overlap and Add Speech output created for available voices from phonem- and prosodydata (as input) Ported to ARM processor architecture h a l o:

12 Speech Synthesis Hallo Herr Trautmann, es ist Zeit für das Mittagessen. Heute gibt es ein Schnitzel mit Kartoffeln und als Dessert Rote Grütze mit Vanilleeis MBROLA - espeak 12

13 Speech Synthesis Evaluation of the applicability of synthesis systems Cooperation with Prof. Stede Institut für Linguistik,Universität Potsdam Humanly German voice Fast and ressource saving Open Source Analysed: IMS-Festival, MARY TTS, Bonn Open Synthesis System Mary TTS Client-Server-Architecture Voice synthesis via Non-Uniform-Unit-Selection and Hidden-Markov- Models General Markup support, but not for Bits and HMM-Bits voices Version 3.5: Mainly opensource except Mbrola German synthese core Version 4.0: beta plain java & open source 13

14 Speech Synthesis Hallo Herr Trautmann, es ist Zeit für das Mittagessen. Heute gibt es ein Schnitzel mit Kartoffeln und als Dessert Rote Grütze mit Vanilleeis MBROLA - espeak Mary TTS V 3.5 Mary TTS V

15 VoIP VoIP 15

16 VoIP VoIP communication between caretakers and patients 16

17 VoIP Voice communication via IP networks G.729 voice codec Audio record / playback On device via GStreamer On gateway via Asterisk Session establishment ManetSIP Decentralized SIP network KopAN & Asterisk (SIP Clients) VoIP Stream 17

18 Outlook Outlook Increasing performance of Mary TTs 4 Increasing the VoIP audio quality via connection aware codec switching Finishing porting orientation system on Openmoko Security Sensor networks Hardware Routing / dependability.. 18

19 Thank you for your attention M.Sc. Sebastian Fudickar