Curriculum Vitae Lisette Mol

Transcription

1 Curriculum Vitae Lisette Mol Education Personal Details Name: Elisabeth Margaretha Maria (Lisette) Mol Work Address: CITEC 2.045, Bielefeld University, PO Box , Bielefeld, Germany Phone: +49 (0) Website: Academic Degrees May 2014 November 2011 January 2005 June 2002 University Teaching Qualification (BKO), Tilburg University. Ph.D. Tilburg University (cum laude). Thesis: Language in the hands (2nd prize Tilburg University Dissertation Award). Promotores: Alfons Maes, Emiel Krahmer, Marc Swerts. Master of Science in Artificial Intelligence (cum laude), University of Groningen. Specializations: Language and Speech Technology, Knowledge Engineering. Degree Certificate (first-year certificate) Physics and Astronomy, University of Groningen. Extracurricular Courses June 2010 October 2009 January 2008 July 2007 July 2004 LOT Summer School courses Applied electrophysiology by Doug Davidson and Meaning from micro to macro by Nick Enfield at Radboud University, Nijmegen. Workshop Methods of Gesture Analysis by Cornelia Müller & Irene Mittelberg, at RWTH, Aachen University. LOT Winter School course Language in our hands: From gesture to sign language by Asli Özyürek at Tilburg University. Linguistic Society of America Summer School at Stanford University. Main Courses: Language and body: The material side of language by Herbert. H. Clark & Daniel Casasanto (completed, A), Using free-view eye-tracking to study spoken language by Michael Tanenhaus & John Trueswell (completed, A), Introduction to simulation as a tool for the study of language by Andy Wedel (completed, A), Experimental phonology by Keith Johnson & John Ohala (audited). ACT-R Summer School by John Anderson, Niels Taatgen, & Dan Bothell, Carnegie Mellon University, Pittsburgh. Research Positions From October 2013 Visiting Researcher (NWO Veni project) Center of Excellence in "Cognitive Interaction Technology", Bielefeld University (Germany) As of June 2011 Assistant Professor Tilburg center for Cognition and Communication, Tilburg University (The Netherlands) November 2005 June 2011 Doctoral Candidate, Junior Researcher Communication and Cognition group, Tilburg University (The Netherlands) Supervisors: Prof. Dr. Alfons Maes, Prof. Dr. Emiel Krahmer, Prof. Dr. Marc Swerts Together with Prof. Dr.-Ing. Stefan Kopp and Prof. Dr. Jan de Ruiter, I work on a (computational) model of gesture and speech perception and production. My focus is on adaptation in gesture and speech. I study the cognitive underpinnings of hand gesture and speech comprehension and production. I co-supervise Karin van Nispen in her PhD project on gesture and aphasia. I co-supervise Yan Gu in his PhD project on gesture and second language acquisition. To reveal more about the cognitive processes involved in hand gesture production, I studied how gesturing is affected by: a speaker s mental model of the addressee, computer mediation, the difficulty of a task, the perception of gestures (adaptation), and aphasia. CV Lisette Mol, Page 1 of 5

2 February September 2005 Research programmer and learning member of the ACT-R research team Prof. Dr. John Anderson's lab, Psychology Department, Carnegie Mellon University (USA) May December 2004 Master student (final project) University of Groningen (The Netherlands) 2003 Trainee, short project Sound Intelligence (a Dutch company) I conducted research on strategy development in multitasking, with a focus on individual differences in the employment of bottom-up and top-down strategies. I combined computational cognitive modeling, in ACT-R and Common Lisp, with experimental research. I studied how theory of mind use affects the interpretation and production of scalar terms. I studied the effect of monaural differences in phase on perception and implemented resynthesis of speech in Matlab. Teaching Positions From June 2011 Assistant Professor Tilburg University 2007 June 2011 Doctoral Candidate Tilburg University 2004 Lab Assistant University of Groningen Current courses: Methodology (Dutch, Bachelor, 225 students) Previous courses: Research Workshop Business Communication and Digital Media (Dutch, Bachelor, 125 students in groups of five); Nonverbal Communication (English, Master, 50 students); Research Skills Module: Laboratory Research (English, Master, 80/120 students, including lab sessions in pairs and groups of four, taught twice a year). Supervision: I supervise two PhD-students. I have so far supervised 14 Master and 13 Bachelor students. I co-taught the Research Master course Communication Theory for two years (English, 12 students). I co-taught the Master course Nonverbal Communication in 2010 (English, 70 students). I advised two students for their Master thesis projects and I introduced many students to gesture analysis. For the course Architectures of Intelligence by Niels Taatgen (Master, English), I taught students how to write models of human cognition in ACT-R and graded their assignments. Fellowships and Awards 2013 NWO Veni grant. This grant covers my three-year individual research project 'Modeling interpersonal adaptation in gesture and speech', 225,000 Euro Second prize Tilburg University dissertation award for the best doctoral dissertation defended at Tilburg University in the academic year , 2000 Euro Fellowship from the Linguistic Society of America (LSA) to cover the tuition for the 2007 Summer School at Stanford University, 1300 US Dollar Travel grant from the organization of the Sixth International Conference on Cognitive Science, Kaliningrad, covering conference fee, hotel, and flight (partially) Travel grant from the organization of the Third International Conference on Cognitive Science, Moscow, 200 Euro Travel grant from the Association Francophone de la Communication Parleé (AFCP) for the Speech and Face-to-Face Communication workshop dedicated to the memory of Christian Benoît, 190 Euro. CV Lisette Mol, Page 2 of 5

3 List of Publications Journal publications van Nispen, K., van de Sandt-Koenderman, M., Mol, L., Krahmer, E. (In Press). Should pantomime and gesticulation be assessed separately for their comprehensibility in aphasia? A case study. International Journal of Language and Communication Disorders. [IF 1.946; 5y-IF 1.858] Mol, L., Krahmer, E. & Van de Sandt-Koenderman, W. M. E. (2013). Gesturing by speakers with aphasia: How does it compare? Journal of Speech, Language and Hearing Research, 56, [IF 1.875; 5y-IF 2.562] Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2012). Adaptation in gesture: Converging hands or converging minds? Journal of Memory and Language 66(1), [IF 2.802; 5y-IF 4.778] Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2011). Seeing and Being Seen: The effects on gesture production. Journal of Computer-Mediated Communication 17(1), [IF 2.170; 5y-IF 4.748] Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2009). The communicative import of gestures: Evidence from a comparative analysis of human-human and human-machine interactions. Gesture, 9(1), [IF.538, 5y-IF NA] Verbrugge, R. & Mol, L. (2008). Learning to apply Theory of Mind. Journal of Logic, Language and Information, 17(4), [IF.630, 5y-IF NA] Working papers Mol, L., Kita, S. (In Preparation). Gesture structure affects syntactic structure in verbal descriptions of motion events. Mol, L., Althof, M. (In Preparation). Speaker-gaze affects the degree of adaptation to gestures. Papers in conference proceedings (peer reviewed) Mol, L., Althof, M. (Accepted). Speaker-gaze Modulates the Inter-personal Repetition of Hand Gestures. In P. Bello, M. Guarini, M. McShane, & B. Scassellati (Eds.), Proceedings of the 36th Annual Conference of the Cognitive Science Society (pp.). Austin, TX: Cognitive Science Society. Mol, L. (Accepted). Adaptation of Information Structure in Gesture and Speech. In Proceedings of the 6th international conference on cognitive science. Kaliningrad. Gu, Y., Mol, L., Hoetjes, M., Swerts, M. (Accepted). Does Language Shape the Production and Perception of Gestures? A Study on late Chinese-English Bilinguals Conceptions about Time. In P. Bello, M. Guarini, M. McShane, & B. Scassellati (Eds.), Proceedings of the 36th Annual Conference of the Cognitive Science Society (pp.). Austin, TX: Cognitive Science Society. van Nispen, K., van de Sandt-Koenderman, M., Mol, L., & Krahmer, E.. (Accepted). Pantomime Strategies: On Regularities in How People Translate Mental Representations into the Gesture Modality. In P. Bello, M. Guarini, M. McShane, & B. Scassellati (Eds.), Proceedings of the 36th Annual Conference of the Cognitive Science Society (pp.). Austin, TX: Cognitive Science Society. Postma-Nilsenová, M., Mol, L., & Kamoen, N. (2013). If you repeat your interlocutor s syntactic structure, you are likely to repeat her pronunciation, too. In R. Fernández & A. Isard (Eds.), Proceedings of the 17 th Workshop on the Semantics and Pragmatics of Dialogue, pp Amsterdam: University of Amsterdam. Mol, L., Kuhlen. A. K. (2013). Beliefs about a speaker affect feeling of another's knowing. In M. Knauff, M. Pauen, N. Sebanz, & I. Wachsmuth (Eds.), Proceedings of the 35th Annual Conference of the Cognitive Science Society (pp ). Austin, TX: Cognitive Science Society. Mol, L., Gu, Y., & Postma-Nilsenová, M. (2013). Structural adaptation in gesture and speech. In Online Proceedings of TiGeR 2013: The combined meeting of the 10th international Gesture Workshop (GW) and the 3rd Gesture and Speech in Interaction (GESPIN) conference. van Nispen, K., van de Sandt-Koenderman, M., Mol, L., & Krahmer, E. (2013). Differences in the communicative use of gesticulation and pantomime in a case of aphasia. In Online Proceedings of TiGeR 2013: The combined meeting of the 10th international Gesture Workshop (GW) and the 3rd Gesture and Speech in Interaction (GESPIN) conference. Gu, Y., Mol, L., Hoetjes, M., Swerts, M. (2013). What can Chinese speakers' temporal gestures reveal about their thinking about time? In Online Proceedings of TiGeR 2013: The combined meeting of the 10th international Gesture Workshop (GW) and the 3rd Gesture and Speech in Interaction (GESPIN) conference. Postma-Nilsenová, M., Postma, E., Balsters, M., Krahmer, E., Schaafsma, J., & Mol, L. (2013). Automatic detection of hand/upper body movement and facial expressions as cues to feelings of exclusion. In Online Proceedings of TiGeR 2013: The combined meeting of the 10th international Gesture Workshop (GW) and the 3rd Gesture and Speech in Interaction (GESPIN) conference. Mol, L. & Kita, S. (2012). Gesture structure affects syntactic structure in speech. In N. Miyake, D. Peebles, & R. P. Cooper (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society (pp ). Austin, TX: Cognitive Science Society. CV Lisette Mol, Page 3 of 5

4 Mol, L., Bogers, R. & Bouwens, T. (2012). Automated and partner-specific factors influencing lexical entrainment. In N. Miyake, D. Peebles, & R. P. Cooper (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society (pp ). Austin, TX: Cognitive Science Society. Mol, L., Krahmer, E. & Van de Sandt-Koenderman, W. M. E. (2011). Gesturing by aphasic speakers, how does it compare? In L. Carlson, C. Hölscher, & T. Shipley (Eds.), Proceedings of the 33 rd Annual Conference of the Cognitive Science Society (pp ). Austin, TX: Cognitive Science Society. Mol, L., Krahmer, E. (2010). Handling what the other sees: The effects of seeing and being seen on gesture production. In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32 nd Annual Conference of the Cognitive Science Society (pp ). Austin, TX: Cognitive Science Society. Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2010). Converging hands or converging minds? In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32 nd Annual Conference of the Cognitive Science Society (pp ). Austin, TX: Cognitive Science Society. Mol, L., Krahmer, E. & Swerts, M. (2009). Alignment in iconic gestures: Does it make sense? In B-J. Theobald & R. Harvey (Eds.), Proceedings of the 8th International Conference on Auditory-Visual Speech Processing (AVSP 2009) (pp. 3-8). Norwich, UK: School of Computing Sciences. Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2009). Communicative gestures and memory load. In N.A. Taatgen & H. van Rijn (Eds.), Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp ). Austin, TX: Cognitive Science Society. Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2008). Gesticulation and audience design. In Proceedings of the 3 rd international conference on cognitive science ( ). Moscow: Art and Publishing Center. Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2007). The communicative import of gestures: Evidence from a comparative analysis of human-human and human-machine interactions. In J. Vroomen, E. J. Krahmer, & M. Swerts (Eds.), Proceedings of the 6th International Conference on Auditory-Visual Speech Processing (AVSP 2007) (pp ). Tilburg: Tilburg University. Mol, L., Taatgen, N., Verbrugge, R. & Hendriks, P. (2005). Reflective Cognition as a Secondary Task. In: B.G. Bara, L. Barsalou, and M. Bucciarelli (Eds), Proceedings of the 27th Annual Meeting of the Cognitive Science Society (pp ). Mahwah, NJ: Erlbaum. Mol, L., Verbrugge, R. & Hendriks, P. (2005). Learning to reason about other people's minds. In Proceedings of the Joint Symposium on Virtual Social Agents, SSAISB 2005 (pp ). Hatfield, UK: The Society for the Study of Artificial Intelligence and the Simulation of Behaviour. Abstracts in conference proceedings (peer reviewed) Gu Y., Mol, L., Hoetjes, M., Swerts, M. (Accepted). Language shapes the production of gestures: Evidence from Chinese vertical spatial metaphors. In Proceedings of The 6th international conference of the International Society for Gesture Studies (ISGS), San Diego, USA. Mol, L., & Althof, M. (Accepted). Speaker-gaze modulates gestural adaptation. In Proceedings of The 6th international conference of the International Society for Gesture Studies (ISGS), San Diego, USA. van Nispen, K., van de Sandt-Koenderman, M., Mol, L., & Krahmer, E. (Accepted). Pantomime strategies: What happens in aphasia? In Proceedings of The 6th international conference of the International Society for Gesture Studies (ISGS), San Diego, USA. Mol, L. (2012). Meaning is copied across interlocutors and gesture types. In Proceedings of The 5th Conference of the International Society for Gesture Studies. Lund Sweden. van Nispen, K., van de Sandt-Koenderman, M. W. M. E., Mol, L., & Krahmer, E. (2012). Gesturing in aphasia, compensatory with or without speech. In Proceedings of the 13th International Science of Aphasia Conference, September 2012 (Vol. 17, Supplement 2, pp ). Groningen: Groningen University Press. van Nispen, K., van de Sandt-Koenderman, M. W. M. E., Mol, L., & Krahmer, E. (2012). How to pantomime an igloo : A study on the different modes of representation used to depict iconicity in pantomime. In Proceedings of the EPS Workshop. What if The study of language started from the investigation of signed, rather than spoken languages? London, United Kingdom. van Nispen, K., van de Sandt-Koenderman, M. W. M. E., Mol, L., & Krahmer, E. (2012). Pantomiming what you cannot say. A study on the influence of a semantic disorder on the ability to compensate for speech loss with the use of pantomimes. In Proceedings of the NeuroPsychoLinguistic Perspectives on Aphasia. (pp. 55). Toulouse, France. van Nispen, K., van de Sandt-Koenderman, M. W. M. E., Mol, L., & Krahmer, E. (2012). Specific pantomimes for specific objects: A study on the different modes of representation used in pantomime. In Proceedings of The 5th Conference of the International Society for Gesture Studies. Lund Sweden. Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2010). Converging Hands or Converging Minds? In Proceedings of The 4 th international conference of the International Society for Gesture Studies (ISGS), Frankfurt (Oder), Germany. Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2008). Audience Design en Handgebaren. In Proceedings of VIOT, Amsterdam, The Netherlands. CV Lisette Mol, Page 4 of 5

5 Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2008). Cognitive Effort and Gesturing. In Proceedings of The Workshop on Speech and Face-to-Face Communication dedicated to the memory of Christian Benoît, Grenoble, France. Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2008). Look who s being talked to. In Proceedings of Language, Communication, and Cognition (LCC), Brighton, United Kingdom. Mol, L., Krahmer, E., Maes, A. & Swerts, M. (2007). The communicative import of gestures: Evidence from a comparative analysis of human-human and human-machine interactions. In Proceedings of The 3 rd international conference of the International Society for Gesture Studies (ISGS), Evanston, IL, USA. Mol, L., Taatgen, N. & Anderson, J. (2005). Individual Differences in Multi-Tasking. In Proceedings of The 12 th Annual ACT-R Workshop, Trieste, Italy. Invited talks Converging Hands or Converging Minds? (2011). Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands. Converging Hands or Converging Minds? (2011). Special Focus Group Alignment in Communication, Bielefeld University, Germany. The communicative import of gestures: Evidence from production experiments. (2010). Invited speaker at Donders Discussions, a PhD conference in neuroscience at the Donders Institute, Nijmegen, The Netherlands. Does mimicry of hand gestures result from alignment of representations? (2010). Research Colloquium at Deutsche Telekom Laboratories, Technische Universität Berlin, Germany. Does mimicry of co-speech gestures result from alignment in mental representations? (2009). Guest speaker at Sotaro Kita s lab at the University of Birmingham, United Kingdom. Does mimicry of co-speech gestures result from alignment in mental representations? (2009). Guest colloquium at the Gesture Focus Group of Susan E. Brennan s lab, Stony Brook University, NY, USA. Reflective Cognition as a Secondary Task (2006). Invited talk at the Belgium Netherlands Artificial Intelligence Symposium (BNAIS), Radboud University Nijmegen, The Netherlands. Scientific Community Conference Organization I was in the program and organization committee of TiGeR This international conference, hosted by the Tilburg center for Cognition and Communication (TiCC), was the combined meeting of the 10th international Gesture Workshop (GW) and the 3rd Gesture and Speech in Interaction conference (GESPIN). Among others, I organized a symposium on theoretical and computational models of gesture and speech production. Reviewing I reviewed for the journals: Cognitive Science; IEEE Transactions on Audio, Speech and Language Processing; International Journal of Language and Communication Disorders; International Journal of Social Robotics; Journal of Speech, Language, and Hearing Research; Language and Speech. Memberships International Society for Gesture Studies (ISGS) Cognitive Science Society (CogSci) CV Lisette Mol, Page 5 of 5