Supervised machine learning for audio emotion recognition

Stuart Cunningham · Harrison Ridley · Jonathan Weinel · Richard Picking

56 citations0/0 files storedPersonal and Ubiquitous Computing

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Emotion and Mood Recognition Neuroscience and Music Perception Music and Audio Processing

Abstract

Abstract The field of Music Emotion Recognition has become and established research sub-domain of Music Information Retrieval. Less attention has been directed towards the counterpart domain of Audio Emotion Recognition, which focuses upon detection of emotional stimuli resulting from non-musical sound. By better understanding how sounds provoke emotional responses in an audience, it may be possible to enhance the work of sound designers. The work in this paper uses the International Affective Digital Sounds set. A total of 76 features are extracted from the sounds, spanning the time and frequency domains. The features are then subjected to an initial analysis to determine what level of similarity exists between pairs of features measured using Pearson’srcorrelation coefficient before being used as inputs to a multiple regression model to determine their weighting and relative importance. The features are then used as the input to two machine learning approaches: regression modelling and artificial neural networks in order to determine their ability to predict the emotional dimensions of arousal and valence. It was found that a small number of strong correlations exist between the features and that a greater number of features contribute significantly to the predictive power of emotional valence, rather than arousal. Shallow neural networks perform significantly better than a range of regression models and the best performing networks were able to account for 64.4% of the variance in prediction of arousal and 65.4% in the case of valence. These findings are a major improvement over those encountered in the literature. Several extensions of this research are discussed, including work related to improving data sets as well as the modelling processes.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 56 citations exist upstream.

References

1980A circumplex model of affect.1992An argument for basic emotions 1994Measuring emotion: The self-assessment manikin and the semantic differential 1997Affective Computing 2000A cognitive model of posttraumatic stress disorder 2018User's guide to correlation coefficients 1993The Soundscape: Our Sonic Environment and the Tuning of the World 1994Audio-vision: sound on screen

Cited by

2023Deep CNN with late fusion for real time multimodal emotion recognition 2022Artificial Emotional Intelligence: Conventional and deep learning approach

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.