Laboratoriet for Naturligt Interaktive Systemer (NISLab) Professor, dr.phil. Niels Ole Bernsen Professor, Ph.D. Laila Dybkjær Forskningslektor Mykola Kolodnytsky (fondslønnet) Forskningsadjunkt Andrea Corradini (fondslønnet) Forskningsadjunkt Marcela Charfuelán Oliva (fra 1. maj, 1. februar-30. april forskningsassistent, fondslønnet) Forskningsassistent Thomas K. Hansen (til 31. marts, fondslønnet) Forskningsassistent Dmytro Kupkin (fondslønnet) Forskningsassistent Manish Mehta (fondslønnet) Sekretær, korrespondent Birgit Davidsen (fra 10. juni, delvist fondslønnet) Fuldmægtig Svend Kiilerich (fondslønnet) Projektmedarbejder Torben Kruchov Madsen (fondslønnet) Sekretær, korrespondent Marianne Rundin Worm (1. marts 31. juli, delvist fondslønnet) Gæsteforsker, professor Costin Pribeanu (27. august-17. september, Similar, ICI Bucuresti) Ph.D.-studerende pr. 31. december: Holmer Hemsen Thomas K. Hansen Gæsteforelæsninger afholdt af instituttet Professor Costin Pribeanu, ICI Bucuresti, From task and domain models to user interface design patterns (13. september). Andre arrangementer afholdt af instituttet NISLab var i 2004 vært for ni workshops i udtaletrænerprojektet (13. januar, 30. januar, 12. marts, 23. april, 29. september, 27. oktober, 26. november, 3. december, 11. december). NISLab gennemførte brugertest af første prototype på H.C. Andersen systemet med deltagelse af Dr. Stephanie Buisine, LIMSI, Paris, Frankrig (20.-23. januar). NISLab var vært for review af det af NISLab ledede EU Telematics/Language Engineering projekt Natural Interactive Communication for Edutainment (14. maj). Direktør Niels Aalbæk, Zentropa, besøgte NISLab (3. september). Hannu Eskola og Tuomo Lethovirta fra Tampere University of Technology besøgte NISLab (22. september). Projektlederne Lia Leffland og Niels Olsen, Akademiet for de Tekniske Videnskaber, besøgte NISLab (18. oktober). Dr. Jean-Claude Martin, LIMSI, Paris, Frankrig, besøgte NISLab (22. oktober). Henrik Kjeldsen og Mikkel Nørgaard, InterActive Vision, besøgte NISLab for at diskutere samarbejde (29. oktober). NISLab havde besøg af et hold studerende fra Aalborg Universitet (2. november). Lene Mølgaard, Københavns Universitet, besøgte NISLab for at diskutere samarbejde (12. november). Medarbejdernes videnskabelige aktiviteter uden for instituttet N.O. Bernsen deltog sammen med L. Dybkjær i kick-off mødet i EU Network of Excellence SIMILAR (The European taskforce creating human-machine interfaces SIMILAR to humanhuman communication), Louvain-la-Neuve, Belgien (26.-28. januar). Han var inviteret deltager i seminar om Evaluating Embodied Conversational Agents, Dagstuhl, Tyskland (14.-19. marts) og holdt foredraget NICE System Evaluation. Han deltog i møde med Gitte Østergaard Nielsen, Integrationsministeriet (19. maj). Han deltog i Workshop on Multimodal Corpora, Lissabon, 122
Portugal, med foredraget Measuring relative target user group success in spoken conversation for edutainment (25. maj). Han deltog i Fourth International Conference on Language Resources and Evaluation (LREC 04), Lissabon, Portugal (26.-28. maj) med foredraget Evaluating conversation with Hans Christian Andersen. Han deltog i Tutorial and Research Workshop on Affective Dialogue Systems (ADS04), Kloster Irsee, Tyskland med foredraget Domain-oriented conversation with H.C. Andersen (14.-16. juni). Han holdt sammen med L. Dybkjær foredraget Managing domain-oriented spoken conversation præsenteret ved Workshop on Embodied Conversational Agents: Balanced Perception and Action,Third International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2004), Columbia University, New York City, USA (20. juli). Han deltog sammen med L. Dybkjær i International Conference for Spoken Language Processing (ICSLP 2004), Sydkorea, med posteren Structured Interview-based Evaluation of Spoken Multimodal Conversation with H.C. Andersen (4.-8. oktober). Han deltog i International Conference on Multimodal Interfaces (ICMI 2004), Penn State University, State College, PA, USA, med foredraget Domain-Oriented Conversation with Hans Christian Andersen (14.-15. oktober). Han ledede det første møde i Akademiet for de Tekniske Videnskabers arbejdsgruppe om Ny Teknologi Nye Oplevelser (13. december). Vidensudveksling med det omgivende samfund Bidrag i medierne: 21.07. Virtuel H.C. Andersen. Indslag fra De sprøde Heste, DR, P3. 23.07. Talende maskine. Indslag fra Nyhederne, TV2/Fyn. A. Corradini deltog i International Working Conference on Advanced Visual Interfaces (AVI 2004), Gallipoli (Lecce), Italien, med foredraget First prototype of conversational H.C. Andersen (25.-28. maj). Han deltog i Workshop on Interactive Visualisation and Interaction Technologies, IV&IT 2004, Krakow, Polen, med foredraget Towards believable behavior generation for embodied conversational agents (7.-9. juni). Han deltog i SIMILAR Joint WP6- WP9 Meeting, Nice, Frankrig (8.-9. november). L. Dybkjær deltog med foredraget Europæiske taleprojekter i Danmark i taleteknologisk seminar i IT-byen Katrinebjerg i Aarhus (23. januar). Hun deltog i planlægningsmøde i det nordiske projekt Multimodal Interfaces (MUMIN) på Københavns Universitet om juni 2004 annotation workshop i Stockholm, Sverige (2. april). Hun deltog i Workshop on Multimodal Corpora, Lissabon, Portugal, med foredraget Recommendations for Natural Interactivity and Multimodal Annotation Schemes (25. maj). Hun deltog i Fourth International Conference on Language Resources and Evaluation (LREC 04), Lissabon, Portugal (26.-28. maj), med foredragene Towards General-Purpose Annotation Tools How far are we today?, Usability Evaluation of Multimodal and Conversational Spoken Language Dialogue Systems og From Acts and Topics to Transactions and Dialogue Smoothness. Hun var medarrangør af og deltog i Tutorial and Research Workshop on Affective Dialogue Systems (ADS04), Kloster Irsee, Tyskland, med foredragene Conversational H. C. Andersen. First prototype description og Design and First Tests of a Chatter (14.-16. juni). Hun deltog sammen med N.O. Bernsen i MUMIN Annotation Workshop, Stockholm, Sverige, med foredraget What Didn t We Cover? (21.-22. juni). Hun deltog sammen med N.O. Bernsen i International Conference for Spoken Language Processing (ICSLP 2004), Sydkorea, med foredraget New Challenges in Usability Evaluation Beyond Task-Oriented Spoken Dialogue Systems (4.-8. oktober). Hun deltog sammen med N.O. Bernsen i SIMILAR Industrial Liaison Meeting, Louvain-la-Neuve, Belgien (8. december) og præsenterede arbejdet i den af NISLab ledede Special Interest Group on Usability på SIMILARs General Assembly, Louvain-la-Neuve, Belgien (9.-10. december). T.K. Hansen deltog i InSTIL/ICALL Symposium 2004: NLP and Speech Technologies in Advanced Language Learning Systems, Venedig (17.-19. juni). Han gav foredrag ved EuroCALL konferencen om Computer Assisted Language Learning i Wien (1.-4. september). 123
Vidensudveksling med det omgivende samfund Bidrag i medierne: 03.06. Lettere at få det sagt. Indslag fra TV-avisen, DR1. 05.06. Digital udtaletræner. Indslag fra Harddisken, DR, P1. H. Hemsen deltog i Fourth International Conference on Language Resources and Evaluation (LREC 04), Lissabon, Portugal (26.-28. maj) med foredraget Evaluation of a Multimodal Dialogue System for Small-screen Devices. Han deltog i møde på Danfoss (5. oktober). M. Kolodnytsky deltog i International Working Conference on Advanced Visual Interfaces (AVI 2004), Gallipoli (Lecce), Italien, med foredraget A visual interface for a multimodal interactivity annotation tool (25.-28. maj). Han deltog i MUMIN Annotation Workshop, Stockholm, med foredraget The NITE WorkBench for multimodal data annotation (21.-22. juni). M. Mehta deltog i 3D Conference 2004 i Bella Centeret, København (3.-6. maj). Eksterne bevillinger og donationer NISLab har modtaget 200.000 kroner fra Ministeriet for Flygtninge og Indvandrere til fortsat udvikling af prototype på en digital udtaletræner, som skal bruges til hurtig optræning af blandt andre nydanskere i dansk udtale. Publikationer André E, Dybkjær L, Minker W, Heisterkamp P, red. Affective Dialogue Systems. Proceedings of the Irsee Tutorial and Research Workshop on Affective Dialogue Systems, LNAI 3068, Heidelberg: Springer Verlag, 2004. Bernsen NO. Measuring relative target user group success in spoken conversation for edutainment. I: Martin J-C et al., red. Proceedings of the LREC 2004 Satellite Workshop on Multimodal Corpora: Models of Human Behaviour for the Specification and Evaluation of Multimodal Input and Output Interfaces. Lissabon, Portugal, 25. maj 2004. Paris: European Language Resources Association (ELRA): 17-20. Bernsen NO, Charfuelàn M, Corradini A, Dybkjær L, Hansen T, Kiilerich S, Kolodnytsky M, Kupkin D, Mehta M. First prototype of conversational H.C. Andersen. I: Costabile MF, red. Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI 2004), Gallipoli, Italien, 25.-28. maj 2004. New York: Association for Computing Machinery (ACM): 458-461. Bernsen NO, Charfuelàn M, Corradini A, Dybkjær L, Hansen T, Kiilerich S, Kolodnytsky M, Kupkin D, Mehta M. Conversational H. C. Andersen. First prototype description. I: André E, Dybkjær L, Minker W, Heisterkamp P, red. Proceedings of the Tutorial and Research Workshop on Affective Dialogue Systems (ADS04), Kloster Irsee, Tyskland, 14.-16. juni 2004. Heidelberg: Springer Verlag: Lecture Notes in Artificial Intelligence, bd. 3068: 305-308. Bernsen NO, Dybkjær L. Domain-oriented conversation with H.C. Andersen. I: André E, Dybkjær L, Minker W, Heisterkamp P, red. Proceedings of the Tutorial and Research Workshop on Affective Dialogue Systems (ADS04), Kloster Irsee, Tyskland, 14.-16. juni 2004. Heidelberg: Springer Verlag: Lecture Notes in Artificial Intelligence, bd. 3068: 142-153. Bernsen NO, Dybkjær L. Managing domain-oriented spoken conversation. I: Pelachaud C, Ruttkay Z, Thórisson K, red. Proceedings of the Third International Joint Conference on Autonomous Agents and Multi-Agent Systems (AMAAS, Conference Workshop on Embodied Conversational Agents: Balanced Perception and Action, New York, USA, 20. juli 2004. New York: ACM: 9-17. 124
Bernsen NO, Dybkjær L. Structured interview-based evaluation of spoken multimodal conversation with H.C. Andersen. I: Kim SH, Youn DH, red. Proceedings of The International Conference for Spoken Language Processing, ICSLP 2004, Sydkorea, oktober 2004. Jeju Island: International Speech Communication Association (ISCA) 2004, bd. 1: 277-280. Bernsen NO, Dybkjær L. Evaluation of Spoken Multimodal Conversation. Proceedings of The Sixth International Conference on Multimodal Interaction, ICMI 2004, Pennsylvania, USA, oktober 2004. New York: Association for Computing Machinery (ACM) 2004: 38-45. Bernsen NO, Dybkjær L, Kiilerich S. Evaluating conversation with Hans Christian Andersen. I: Lino MT et al., red. Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 04), Lissabon, Portugal, 25.-28. maj 2004. Paris: European Language Resources Association (ELRA), bd. 3: 1011-1014. Corradini A, Fredriksson M, Mehta M, Königsmann J, Bernsen NO, Johanneson L. Towards believable behavior generation for embodied conversational agents. I: Bubak M, Albada GDv, Sloot PMA, Dongarra J, red. Proceedings of the International Conference on Computational Science (ICCS 2004), Workshop on Interactive Visualisation and Interaction Technologies, IV&IT 2004, Krakow, Polen, 7.-9. juni 2004. Heidelberg: Springer Verlag: Lecture Notes in Computer Science, bd. 3038, 2004, 946-953. Dybkjær H, Dybkjær L. Modeling Complex Spoken Dialog. IEEE Computer, august 2004: 32-40. Dybkjær H, Dybkjær L. From Acts and Topics to Transactions and Dialogue Smoothness. I: Lino MT, Xavier MF, Ferreira F, Costa R, Silva R, red. Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004), Lissabon, Portugal, maj 2004. Paris: European Language Resources Association (ELRA), bd. 5: 1691-1694. Dybkjær H, Dybkjær L. Design and First Tests of a Chatter. I: André E, Dybkjær L, Minker W, Heisterkamp P, red. Proceedings of the Workshop on Affective Dialogue Systems, Kloster Irsee, LNAI 3068, Heidelberg: Springer Verlag, Tyskland, juni 2004: 166-177. Dybkjær H, Dybkjær L. Representing Act-Topic-Based Dialogue Phenomena. I: Christiansen H, Skadhauge PR, Villadsen J, red. Proceedings of Workshop on Constraint Solving and Language Processing (CSLP), Roskilde Universitet, september 2004: 154-159. Dybkjær L, Bernsen NO. Towards General-Purpose Annotation Tools How far are we today? I: Lino MT et al., red. Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 04), Lissabon, Portugal, 2004. Paris: European Language Resources Association (ELRA), bd. 1: 197-200. Bernsen NO, Dybkjær L. Evaluation of Spoken Multimodal Conversation. Proceedings of The Sixth International Conference on Multimodal Interaction, ICMI 2004, Pennsylvania, USA, oktober 2004. New York: Association for Computing Machinery (ACM), 2004: 38-45. Bernsen NO, Dybkjær L, Kiilerich S. Evaluating conversation with Hans Christian Andersen. I: Lino MT m.fl., red. Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 04), Lissabon, Portugal, 25.-28. maj 2004. Paris: European Language Resources Association (ELRA), 2004; 3: 1011-1014. Corradini A, Fredriksson M, Mehta M, Königsmann J, Bernsen NO, Johanneson L. Towards believable behavior generation for embodied conversational agents. I: Proceedings of the International Conference on Computational Science (ICCS 2004), Workshop on Interactive Visualisation and Interaction Technologies, IV&IT 2004, Krakow, Polen, 7.-9. juni 2004. Heidelberg: Springer Verlag: Lecture Notes in Computer Science, 2004; 3038: 946-953. Dybkjær L, Bernsen NO. Towards General-Purpose Annotation Tools How far are we today? I: Lino MT m.fl., red. Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 04), Lissabon, Portugal, 2004. Paris: European Language Resources Association (ELRA), 2004; 1: 197-200. Dybkjær L, Bernsen NO. Recommendations for Natural Interactivity and Multimodal Annotation Schemes. I: Martin J-C m.fl., red. Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 04), Satellite Workshop on Multimodal Corpora: 125
Models of Human Behaviour for the Specification and Evaluation of Multimodal Input and Output Interfaces. Lissabon, Portugal, 25. maj 2004. Paris: European Language Resources Association (ELRA), 2004: 5-8. Dybkjær L, Bernsen NO, Minker W. Evaluation and Usability of Multimodal Spoken Language Dialogue Systems. Speech Communication, bd. 43/1-2, Elsevier, 2004: 33-54. Dybkjær L, Bernsen NO, Minker W. Usability Evaluation of Multimodal and Conversational Spoken Language Dialogue Systems. I: Lino MT m.fl., red. Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 04), Lissabon, Portugal, 2004. Paris: European Language Resources Association (ELRA), 2004; 5: 1695-1698. Dybkjær L, Bernsen NO, Minker W. New challenges in usability evaluation. Beyond taskoriented spoken dialogue systems. Proceedings of The International Conference for Spoken Language Processing, ICSLP 2004, Sydkorea, oktober 2004. International Speech Communication Association (ISCA) 2004; 3: 2261-2264. Dybkjær H, Dybkjær L. Modeling Complex Spoken Dialog. IEEE Computer 2004: 32-40. Dybkjær H, Dybkjær L. From Acts and Topics to Transactions and Dialogue Smoothness. Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC 2004), bd. V, Lissabon, Portugal, maj 2004: 1691-1694. Dybkjær H, Dybkjær L. Design and First Tests of a Chatter. Proceedings of the Workshop on Affective Dialogue Systems, Kloster Irsee, LNAI 3068. Springer Verlag, 2004: 166-177. Dybkjær H, Dybkjær L. Representing Act-Topic-Based Dialogue Phenomena. Proceedings of Workshop on Constraint Solving and Language Processing (CSLP), Roskilde Universitet, september 2004: 154-159. Hemsen H. Evaluation of a Multimodal Dialogue System for Small-screen Devices. I: Lino MT, Xavier MF, Ferreira F, Costa R, Silva R, red. Proceedings of LREC 2004, Lissabon, Portugal, 26.-28. maj 2004: 1703-1706. Kolodnytsky M, Bernsen NO, Dybkjær L. A visual interface for a multimodal interactivity annotation tool. Design issues and implementation solutions. I: Costabile MF, red. Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2004), Gallipoli, Italien, 25.-28. maj 2004. New York: Association for Computing Machinery (ACM), 2004: 407-410. 126