A survey of affect recognition methods: Audio, visual and spontaneous expressions

Zhihong Zeng, Maja Pantic, Glenn I. Roisman, Thomas S. Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

63 Scopus citations

Abstract

Automated analysis of human affective behavior has attracted increasing attention from researchers in psychology, computer science, linguistics, neuroscience, and related disciplines. Promising approaches have been reported, including automatic methods for fecial and vocal affect recognition. However, the existing methods typically handle only deliberately displayed and exaggerated expressions of prototypical emotions-despite the fact that deliberate behavior differs in visual and audio expressions from spontaneously occurring behavior. Recently efforts to develop algorithms that can process naturally occurring human affective behavior have emerged. This paper surveys these efforts. We first discuss human emotion perception from a psychological perspective. Next, we examine the available approaches to solving the problem of machine understanding of human affective behavior occurring in real-world settings. We finally outline some scientific and engineering challenges for advancing human affect sensing technology.

Original languageEnglish (US)
Title of host publicationProceedings of the 9th International Conference on Multimodal Interfaces, ICMI'07
Pages126-133
Number of pages8
DOIs
StatePublished - Dec 1 2007
Externally publishedYes
Event9th International Conference on Multimodal Interfaces, ICMI 2007 - Nagoya, Japan
Duration: Nov 12 2007Nov 15 2007

Publication series

NameProceedings of the 9th International Conference on Multimodal Interfaces, ICMI'07

Other

Other9th International Conference on Multimodal Interfaces, ICMI 2007
CountryJapan
CityNagoya
Period11/12/0711/15/07

Keywords

  • Affect recognition
  • Affective computing
  • Emotion recognition
  • Human computing
  • Multimodal human computer interaction
  • Multimodal user interfaces

Fingerprint Dive into the research topics of 'A survey of affect recognition methods: Audio, visual and spontaneous expressions'. Together they form a unique fingerprint.

Cite this