Automatic Analysis of Facial Actions: A Survey

Brais Martínez · Michel Valstar · Bihan Jiang · Maja Pantić

353 citations0/0 files storedIEEE Transactions on Affective Computing

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Emotion and Mood Recognition Face recognition and analysis Face and Expression Recognition

Abstract

As one of the most comprehensive and objective ways to describe facial expressions, the Facial Action Coding System (FACS) has recently received significant attention. Over the past 30 years, extensive research has been conducted by psychologists and neuroscientists on various aspects of facial expression analysis using FACS. Automating FACS coding would make this research faster and more widely applicable, opening up new avenues to understanding how we communicate through facial expressions. Such an automated process can also potentially increase the reliability, precision and temporal resolution of coding. This paper provides a comprehensive survey of research into machine analysis of facial actions. We systematically review all components of such systems: pre-processing, feature extraction and machine coding of facial actions. In addition, the existing FACS-coded facial expression databases are summarised. Finally, challenges that have to be addressed to make automatic facial action analysis applicable in real-life situations are extensively discussed. There are two underlying motivations for us to write this survey paper: the first is to provide an up-to-date review of the existing literature, and the second is to offer some insights into the future of machine recognition of facial actions: what are the challenges and opportunities that researchers in the field face.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 353 citations exist upstream.

References

1872The expression of the emotions in man and animals.1978Facial Action Coding System 2010The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression 2008A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions 2002Comprehensive database for facial expression analysis 1992Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis.2005Web-Based Database for Facial Expression Analysis 2014CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline Evaluation

Cited by

2019Efficient Facial Expression Recognition Algorithm Based on Hierarchical Deep Neural Network Structure 2020A performance comparison of eight commercially available automatic classifiers for facial affect recognition 2020Investigating Bias and Fairness in Facial Expression Recognition 2021Micro-expression Recognition Based on Facial Graph Representation Learning and Facial Action Unit Fusion 2020Facial Sentiment Analysis Using AI Techniques: State-of-the-Art, Taxonomies, and Challenges

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.