Do Models of Mental Health Based on Social Media Data Generalize?

Abstract

Proxy-based methods for annotating mental health status in social media have grown popular in computational research due to their ability to gather large training samples.However, an emerging body of literature has raised new concerns regarding the validity of these types of methods for use in clinical applications.To further understand the robustness of distantly supervised mental health models, we explore the generalization ability of machine learning classifiers trained to detect depression in individuals across multiple social media platforms.Our experiments not only reveal that substantial loss occurs when transferring between platforms, but also that there exist several unreliable confounding factors that may enable researchers to overestimate classification performance.Based on these results, we enumerate recommendations for future mental health dataset construction.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 45 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.