From Lived Experience to Insight: Unpacking the Psychological Risks of Using AI Conversational Agents

Mohit Chandra · Suchismita Naik · Denae Ford · Ebele Okoli · Munmun De Choudhury · Mahsa Ershadi +5 more

44 citations0/0 files storedACM Conference on Fairness, Accountability, and Transparency (FAccT)

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Ethics and Social Impacts of AI Innovative Human-Technology Interaction Digital Mental Health Interventions

Abstract

Recent gains in popularity of AI conversational agents have led to their increased use for improving productivity and supporting well-being.While previous research has aimed to understand the risks associated with interactions with AI conversational agents, these studies often fall short in capturing the lived experiences of individuals.Additionally, psychological risks have often been presented as a sub-category within broader AI-related risks in past taxonomy works, leading to under-representation of the impact of psychological risks of AI use.To address these challenges, our work presents a novel risk taxonomy focusing on psychological risks of using AI gathered through the lived experiences of individuals.We employed a mixed-method approach, involving a comprehensive survey with 283 people with lived mental health experience and workshops involving experts with lived experience to develop a psychological risk taxonomy.Our taxonomy features 19 AI behaviors, 21 negative psychological impacts, and 15 contexts related to individuals.Additionally, we propose a novel multi-path vignettebased framework for understanding the complex interplay between * Work done during internship at Microsoft Research.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 44 citations exist upstream.

References

2006Constructing Grounded Theory. A Practical Guide Through Qualitative Analysis 2020Human Trust in Artificial Intelligence: Review of Empirical Research 2017Semantics derived automatically from language corpora contain human-like biases 1992Whose Science? Whose Knowledge? Thinking from Women's Lives.2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy 2016ASSOCIATION BETWEEN SOCIAL MEDIA USE AND DEPRESSION AMONG U.S. YOUNG ADULTS 2018Online social media fatigue and psychological wellbeing—A study of compulsive use, fear of missing out, fatigue, anxiety and depression 2023When and How Artificial Intelligence Augments Employee Creativity

Cited by

2026Characterizing Delusional Spirals through Human-LLM Chat Logs 2026AI Chatbot Suicide Risk Detection and Response: Human Validation Study of the Open-Source VERA-MH Safety Evaluation 2026A scoping review on the mental health harms of LLM-based chatbots 2026Seeking Late Night Life Lines: Experiences of Conversational AI Use in Mental Health Crisis 2026Beyond the Single Turn: Reframing Refusals as Dynamic Experiences Embedded in the Context of Mental Health Support Interactions with LLMs

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.