Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures

Rana el Kaliouby · Peter Robinson

282 citations0/0 files storedIEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Emotion and Mood Recognition Face recognition and analysis Gaze Tracking and Assistive Technology

Abstract

This paper presents a system for inferring complex mental states from video of facial expressions and head gestures in real-time. The system is based on a multi-level dynamic Bayesian network classifier which models complex mental states as a number of interacting facial and head displays, identified from component-based facial features. Experimental results for 6 mental states groups- agreement, concentrating, disagreement, interested, thinking and unsure are reported. Real-time performance, unobtrusiveness and lack of preprocessing make our system particularly suitable for user-independent human computer interaction.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 282 citations exist upstream.

References

1978Facial Action Coding System 1995Mindblindness: an essay on autism and theory of mind 1993Handbook of Emotions 2002Comprehensive database for facial expression analysis 1993Positive affect and decision making.1971Kinesics and Context 2003Facial expression recognition from video sequences: temporal and static modeling 1970Kinesics and context

Cited by

2013MACH 2007Real-time classification of evoked emotions using facial feature tracking and physiological responses 2007Machine Analysis of Facial Expressions 2013Affectiva-MIT Facial Expression Dataset (AM-FED): Naturalistic and Spontaneous Facial Expressions Collected "In-the-Wild"2012Fusion of facial expressions and EEG for implicit affective tagging 2013Depression recognition based on dynamic facial and vocal expression features using partial least square regression

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.