Reducing noisy annotations for depression estimation from facial images

Lang He · Prayag Tiwari · Chonghua Lv · Wenshuai Wu · Liyong Guo

47 citations0/0 files storedNeural Networks

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Emotion and Mood Recognition Face recognition and analysis Face and Expression Recognition

Abstract

Depression has been considered the most dominant mental disorder over the past few years. To help clinicians effectively and efficiently estimate the severity scale of depression, various automated systems based on deep learning have been proposed. To estimate the severity of depression, i.e., the depression severity score (Beck Depression Inventory-II), various deep architectures have been designed to perform regression using the Euclidean loss. However, they do not consider the label distribution, and they do not learn the relationships between the facial images and BDI-II scores, which can be resulting in the noisy labeling for automatic depression estimation (ADE). To mitigate this problem, we propose an automated deep architecture, namely the self-adaptation network (SAN), to improve this uncertain labeling for ADE. Specifically, the architecture consists of four modules: (1) ResNet-18 and ResNet-50 are adopted in the deep feature extraction module (DFEM) to extract informative deep features; (2) a self-attention module (SAM) is adopted to learn the weights from the mini-batch; (3) a square ranking regularization module (SRRM) to create high partitions and low partitions is proposed; and (4) a re-label module (RM) is used to re-label the uncertain annotations for ADE in the low partitions. We conduct extensive experiments on depression databases (i.e., AVEC2013 and AVEC2014) and obtain a performance comparable to the performances of other ADE methods in assessing the severity of depression. More importantly, the proposed method can learn valuable depression patterns from facial videos and obtain a performance comparable to the performances of other methods for depression recognition.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 47 citations exist upstream.

References

2006Projections of Global Mortality and Burden of Disease from 2002 to 2030 2013Risk factors for suicide in individuals with depression: A systematic review 2020Suppressing Uncertainties for Large-Scale Facial Expression Recognition 2013AVEC 2013 2018Visually Interpretable Representation Learning for Depression Recognition from Facial Images 2017Automated Depression Diagnosis Based on Deep Networks to Encode Facial Appearance and Dynamics 2021Deep learning for depression recognition with audiovisual cues: A review 2018Automated depression analysis using convolutional neural networks from speech

Cited by

2024LMTformer: facial depression recognition with lightweight multi-scale transformer from videos

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.