Pointing to Gestures Research Training Course 1

Transcription

1 6- } Graduate School of Linguistics, Philosophy and Semiotics } Institute of Computer Science } Institute of Estonian and General Linguistics } Faculty of Philosophy } The ETIS project MINT (ETF8958) Pointing to Gestures Research Training Course 1

2 6- Thursday :30-09:00 Registration 09:00-09:15 Welcome 09:15-10:15 Invited speaker I (chair: Silvi Tenjes) 10:15-10:45 Coffee Alan Cienki: The dynamic scope of relevant behaviors in talk: A look at repetitions, restarts, and elaborations 10:45-12:45 Paper session (chair: Patrizia Paggio) 10:45-11:15 Catherine T. Bolly: Facing Nadine s speech. Multimodal annotation of emotions in the elderly 11:15-11:45 Gustaf Lindblad and Jens Allwood: An Overview of Multimodal Feedback in Swedish 11:45-12:15 Bhim Regmi and Jens Allwood: Nepali feedback - Shake your head to say yes or to show belief or happiness 12:15-12:45 Dage Särg and Kristiina Jokinen: Nodding in Estonian First Encounters 12:45-14:00 Lunch 14:00-15:30 Paper session (chair: Graham Wilcock) 14:00-14:30 Florian Nothdurft and Wolfgang Minker: Finding Appropriate Turn-Taking Strategies for Pro-Active Dialogue Systems - An Open Quest 14:30-15:00 Marcin Wlodarczak, Mattias Heldner and Jens Edlund: Breathing in conversation: an unwritten story 15:00-15:30 Pihel Saatmann: Experiments With Hand-tracking Algorithm in Video Conversations 15:30-16:00 Coffee Paper session (chair: Jens Allwood) 16:00-16:30 Elisabeth Ahlsén: Gestures used in word search episodes - by persons with and without aphaasia 16:30-17:00 Ozge Alacam, Christopher Habel and Cengiz Acarturk: Verbally Assisted Haptic Graph Comprehension: The Role of Taking Initiative in a Joint Activity Conference dinner Friday :30-10:30 Invited speaker II (chair: Kristiina Jokinen) 10:30-11:00 Coffee Kirsten Bergmann Gesture Use - From Virtual Humans and Back 11:00-12:30 Demonstrations (chair: Wolfgang Minker) 11:00-11:30 Demonstration introductions (3 x 10min) 11:30-12:30 Imre Purret and Kristiina Jokinen: Speech-based Interactive Location Guide for Liivi 2 12:30-14:00 Lunch Martin Vels and Kristiina Jokinen: Recognition of Human Body Movements for Studying Engagement in Conversational Video Files Graham Wilcock and Kristiina Jokinen: Multimodal Interaction with the Nao-robot in Finnish 14:00-15:30 Short paper session (chair: Elisabeth Ahlsen) 15:30-16:00 Coffee Nataliya Berbyuk Lindström, Jens Allwood and Margareta Håkanson: Multimodal human-horse communication in therapy and leisure riding Eva Ingerpuu-Rümmel: Teacher and learners constructing meaning for vocabulary items in foreign language class Elnaz Jalilian: Spatial References in Multimodal Communication Stefano Lanzini and Jens Allwood: On the attribution of affective-epistemic states to some communicative behaviors in different modes of recording 16:00-17:00 Closing panel Pointing to Gestures Research Training Course 2

3 6- } Communicative behaviour } Important to get our message through } Coordinate activities with other community members } Observer vs performer Multimodal elements in understanding Production of multimodal elements } Theory and Methodology: What to study vs. how to study it Semiotic, Cognitive, Statistic, Constructive } Theory and Practise: Provide better understanding of the world Christopher Cherniak (1986): Minimal Rationality Build different application } Relation between gesture and speech: Can we really say that gestures are words Words are gestures! } Definition and identification of gesture/feedback/topic unit a holistic perceptive meaning? feature-based recurrent patterns? time span? circular reflection: from a top-down approach with a first identification of "potential feedbacks" to a more bottom-up approach with features and then to a top-down one with the interpretation? } Meanings potentials are gestures polysemic by nature? how to be integrated into the semiotic model of Jens and cognitive model of Alan much focus on nouns, how about verbs (active verbs, passive verbs) activities conceptual cloud - activation => focus of attention Pointing to Gestures Research Training Course 3

4 6- } Beat gestures intentionality, self-adpator metadiscursive or metacommunicative conventionalized meaning } Virtual agents and robot interaction Human resemblance? Applications: companions, e.g. with older people? Ethics? Naturalness, coordination of different modalities How do different modalities fit to presenting different types of information } Which theory to use to backup machine learning experiments which theory to use for producing input data for ML & interpreting the results Photo: A.Cienki Pointing to Gestures Research Training Course 4

5 6- } Post-proceedings in Linköping Electronic Conference Proceedings Series } University of Linköping Electronic Press } } Deadline: October 31, 2014 } Then a short review period (with the same reviewers as the orginal papers) } Final versions: December 1, 2014 } Publication out early 2015 Pointing to Gestures Research Training Course 5

6 6- } Possible further publication(s) Special issue (Gesture) Book (Cambridge Scholars Publishing) We are looking for possibilities and discussing different options } The 3rd International Symposium on Multimodal Communication } Most likely in September 2015 Any clashes please let us know e.g. Interspeech September 6-10, 2015 (Dresden) SIGDIAL September 2-4, 2015 (Prague) ICMI IWSDS ACL-IJCNLP 2015, August Others: Gesture studies conference ISGS } Proposed organisers: Emer Gilmartin, Loredana Cerrato, Nick Campbell } Location: Dublin Pointing to Gestures Research Training Course 6

7 6- } Tänan, nägemist! } Tack, vi ses igen! } Kiitos, nähdään taas! } Danke, auf Wiedersehen! } Merci, a bientôt! } Dziękuję, do zobaczenia! } Dank je wel, tot ziens! } Grazie, arrivederci! } Spasibo, do svidaniya! } Mamnoon, khodahafez! } Tesekkurler, Hoscakalin! } Go raibh mile maith agaibh, slan abhaile libh! } Diakuju, dopobachennia! Pointing to Gestures Research Training Course 7