Print Univis Search
FAU-Logo
Techn. Fakultät Willkommen am Institut für Informatik FAU-Logo

HUMAINE (Human-Machine-Interaction Network on Emotion)

Project Description
HUMAINE (Human-Machine-Interaction Network on Emotion) is a NoE (Network of Excellence) within the European framework of FP6 running from 1.2004 to 12.2007; contract no. 507422. HUMAINE aims to lay the foundations for European development of systems that can register, model and/or influence human emotional and emotion-related states and processes - 'emotion-oriented systems'. Such systems may be central to future interfaces, but their conceptual underpinnings are not sufficiently advanced to be sure of their real potential or the best way to develop them. One of the reasons is that relevant knowledge is dispersed across many disciplines. HUMAINE brings together leading experts from the key disciplines in a programme designed to achieve intellectual integration. It identifies six thematic areas that cut across traditional groupings and offer a framework for an appropriate division of labour - theory of emotion; signal/sign interfaces; the structure of emotionally coloured interactions; emotion in cognition and action; emotion in communication and persuasion; and usability of emotion-oriented systems. Teams linked to each area will run a workshop in it and carry out joint research to define an exemplar embodying guiding principles for future work in their area. Cutting across these are plenary sessions where teams from all areas report; activities to create necessary infrastructure (databases recognising cultural and gender diversity, an ethical framework, an electronic portal); and output to the wider community in the form of a handbook and recommendations of good practice (as precursors to formal standards). FAU Erlangen participates in WP4 on Signals and Signs, and in WP5 on Databases. In the first year, activities concentrated on a kick-off meeting, a summer school on databases, and workshops on theory, signals and signs, and databases. Deliverables were due at the end of 2004 describing in detail so called exemplars, i.e., pieces of work in each of the areas which exemplify how a key problem in the area can be solved in a principled way; and which also demonstrates how work focused on that area can integrate with work focused on the other areas. The exact form of an exemplar is not prespecified: it may be a working system, but it might also be a well-developed design, or a representational system, or a method for user-centred design. As exemplar, our institute initiated a so called forced co-operation initiative called CEICES (Combining Efforts for Improving automatic Classification of Emotional user States): we provide an annotated emotional database (i.e. speech files, phonetic lexicon, manually corrected word segmentation, emotional labels, manually corrected fundamental frequency values, syntactic-prosodic boundary labels) and a definition of train and test samples. All participating HUMAINE partners share extracted feature values; the common goal is improved recognition rates and a repertoire of most relevant features.
Project Details
Head: Nöth, Elmar

Team: Batliner, Anton
Hacker, Christian
Hönig, Florian
Steidl, Stefan

Start: 2004-01-01
End: 2007-12-31

Publications

2007 (8 Publications and Talks)
Conferences
de Rosis, Fiorella; Batliner, Anton; Novielli, Nicole; Steidl, Stefan
`You are Sooo Cool, Valentina!' Recognizing Social Attitude in Speech-Based Dialogues with an ECA In: Paiva, Ana; Prada, Rui; Picard, Rosalind W. (Eds.)
Affective Computing and Intelligent Interaction (ACII 2007 Lisbon 12-14.09.2007) Berlin-Heidelberg : Springer 2007, pp. 179-190 (BiBTeX)

Schuller, B.; Seppi, D.; Batliner, Anton; Maier, Andreas; Steidl, Stefan
Towards more Reality in the Recognition of Emotional Speech In: IEEE Signal Processing Society (Eds.)
ICASSP, 2007 IEEE International Conference on Acoustics, Speech, and Signal Processing, Proceedings (ICASSP - International Conference on Acoustics, Speech, and Signal Processing Honolulu, Hawaii, USA 15-20.4.2007) Bryan, TX : Conference Managament Services, Inc. 2007, pp. 941-944 - ISBN 1-4244-0728-1 (BiBTeX)

Schuller, Björn; Batliner, Anton; Seppi, Dino; Steidl, Stefan; Vogt, Thurid; Wagner, Johannes; Devillers, Laurence; Vidrascu, Laurence; Amir, Noam; Kessous, Loic; Aharonson, Vered
The Relevance of Feature Type for the Automatic Classification of Emotional User States: Low Level Descriptors and Functionals In: ISCA (Eds.)
Proceedings Interspeech (Interspeech Antwerp 2007, pp. 2253-2256 (BiBTeX)

Batliner, Anton; Steidl, Stefan; Schuller, Björn; Seppi, Dino; Vogt, Thurid; Devillers, Laurence; Vidrascu, Laurence; Amir, Noam; Kessous, Loic; Aharonason, Vered
The Impact of F0 Extraction Errors on the Classification of Prominence and Emotion In: IPA (Eds.)
Proceedings of the 16th International Congress of Phonetic Sciences (ICPhS 2007 Saarbrücken 2007, pp. 2201-2204 (BiBTeX)

Douglas-Cowie, Ellen; Cowie, Roddy; Sneddon, Ian; Cox, Cate; Lowry, Orla; McRorie, Margaret; Martin, Jean-Claude; Devillers, Laurence; Abrilan, Sarkis; Batliner, Anton; Amir, Noam; Karpousis, Kostas
The HUMAINE Database: Addressing the Collection and Annotation of Naturalistic and Induced Emotional Data In: Paiva, Ana; Prada, Rui; Picard, Rosalind W. (Eds.)
Affective Computing anf Intelligent Interaction (ACII 2007 Lisbon 12-14.09.2007) Berlin-Heidelberg : Springer 2007, pp. 488-500 (BiBTeX)

Batliner, Anton; Steidl, Stefan; Nöth, Elmar
Laryngealizations and Emotions: How Many Babushkas? In: Schröder, Marc; Batliner, Anton; d'Alessandro, Christophe (Eds.)
Proceedings of the International Workshop on Paralinguistic Speech - between Models and Data (ParaLing'07 Saarbrücken 03.08.2007) Saarbrücken : DFKI 2007, pp. 17-22 (BiBTeX)

Hönig, Florian; Batliner, Anton; Nöth, Elmar
Fast Recursive Data-driven Multi-resolution Feature Extraction for Physiological Signal Classification In: Hornegger, Joachim; Mayr, Ernst W.; Schookin, Sergey; Feußner, Hubertus; Navab, Nassir; Gulyaev, Yuri V.; Höller, Kurt; Ganzha, Victor (Eds.)
3rd Russian-Bavarian Conference on Biomedical Engineering (3rd Russian-Bavarian Conference on Biomedical Engineering Erlangen 2.-3.07.2007) Vol. 1 Erlangen : Union aktuell 2007, pp. 47-52 - ISBN 3-921713-33-X (BiBTeX)

Talks
Hönig, Florian
DRIVAWORK - Driving Under Varying Workload. A Multi-Modal Stress Database in the Automotive Context
(HUMAINE Plenary Meeting) (BiBTeX)

2006 (3 Publications and Talks)
Conferences
Batliner, Anton; Biersack, Sonja; Steidl, Stefan
The Prosody of Pet Robot Directed Speech: Evidence from Children In: Hoffmann, Rüdiger; Mixdorff, Hansjörg (Eds.)
Proc. Speech Prosody, 3rd International Conference (Speech Prosody, 3rd International Conference Dresden 2.5.-5.5.2006) Dresden : TUDpress 2006, pp. 1-4 - ISBN 3-938863-57-9 (BiBTeX)

Batliner, Anton; Steidl, Stefan; Schuller, Björn; Seppi, Dino; Laskowski, Kornel; Vogt, Thurid; Devillers, Laurence; Vidrascu, Laurence; Amir, Noam; Kessous, Loic; Aharonson, Vered
Combining Efforts for Improving Automatic Classification of Emotional User States In: Erjavec, Tomaz; Gros, Jerneja Zganec (Eds.)
Language Technologies, IS-LTC 2006 (Fifth Slovenian and First International Language Technologies Conference Ljubljana, Slovenia October 9 - 10, 2006) Ljubljana, Slovenia : Infornacijska Druzba (Information Society) 2006, pp. 240-245 (BiBTeX)

Batliner, Anton; Burkhardt, Felix; van Ballegooy, Markus; Nöth, Elmar
A Taxonomy of Applications that Utilize Emotional Awareness In: Erjavec, Tomaz; Gros, Jerneja Zganec (Eds.)
Language Technologies, IS-LTC 2006 (Fifth Slovenian and First International Language Technologies Conference Ljubljana, Slovenia October 9 - 10, 2006) Ljubljana, Slovenia : Infornacijska Druzba (Information Society) 2006, pp. 246-250 (BiBTeX)

2005 (3 Publications and Talks)
Conferences
Batliner, Anton; Steidl, Stefan; Hacker, Christian; Nöth, Elmar; Niemann, Heinrich
Tales of Tuning - Prototyping for Automatic Classification of Emotional User States In: ISCA (Eds.)
Proceedings of the 9th European Conference on Speech Communication and Technology (9th European Conference on Speech Communication and Technology - Interspeech 2005 Lisbon 4-8.9.2005) Bonn : ISCA 2005, pp. 489-492 - ISBN 1018-4074 (BiBTeX)

Batliner, Anton; Steidl, Stefan; Hacker, Christian; Nöth, Elmar; Niemann, Heinrich
Private Emotions vs. Social Interaction - towards New Dimensions in Research on Emotion In: Carberry, Sandra; de Rosis, Fiorella (Eds.)
Adapting the Interaction Style to Affective Factors (Workshop on Adapting the Interaction Style to Affective Factors, 10th International Conference on User Modelling Edinburgh 25.7.2005) 2005, pp. - (8 pages, no pagination) (BiBTeX)

Steidl, Stefan; Levit, Michael; Batliner, Anton; Nöth, Elmar; Niemann, Heinrich
"Of All Things the Measure is Man" - Classification of Emotions and Inter-Labeler Consistency In: IEEE (Eds.)
Proceedings of ICASSP 2005 - International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2005 - International Conference on Acoustics, Speech, and Signal Processing Philadelphia, Pennsylvania, U.S.A. March 18-23, 2005) Vol. 1 3833 S. Texas Ave., Ste. 221 Bryan, TX 77802-4015 : Conference Managament Services, Inc. 2005, pp. 317-320 - ISBN 0-7803-8874-7 (BiBTeX)

2004 (1 Publications and Talks)
Conferences
Batliner, Anton; Hacker, Christian; Steidl, Stefan; Nöth, Elmar; D'Arcy, S.; Russell, M.; Wong, M.
"You stupid tin box" - children interacting with the AIBO robot: A cross-linguistic emotional speech corpus. In: ELRA (Eds.)
Proceedings of the 4th International Conference of Language Resources and Evaluation LREC 2004 (LREC Lisbon 2004, pp. 171?174 (BiBTeX)