ACL 2021long21 citations

Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data

Paul Pu Liang, Terrance Liu, Anna Cai, Michal Muszynski, Ryo Ishii, Nick Allen, Randy Auerbach, David Brent

Abstract

Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications for the early detection, intervention, and treatment of mental health disorders. One promising data source to help monitor human behavior is daily smartphone usage. However, care must be taken to summarize behaviors without identifying the user through personal (e.g., personally identifiable information) or protected (e.g., race, gender) attributes. In this paper, we study behavioral markers of daily mood using a recent dataset of mobile behaviors from adolescent populations at high risk of suicidal behaviors. Using computational models, we find that language and multimodal representations of mobile typed text (spanning typed characters, words, keystroke timings, and app usage) are predictive of daily mood. However, we find that models trained to predict mood often also capture private user identities in their intermediate representations. To tackle this problem, we evaluate approaches that obfuscate user identity while remaining predictive. By combining multimodal representations with privacy-preserving learning, we are able to push forward the performance-privacy frontier.

BibTeX
@inproceedings{liang-etal-2021-learning,
    title = "Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data",
    author = "Liang, Paul Pu  and
      Liu, Terrance  and
      Cai, Anna  and
      Muszynski, Michal  and
      Ishii, Ryo  and
      Allen, Nick  and
      Auerbach, Randy  and
      Brent, David  and
      Salakhutdinov, Ruslan  and
      Morency, Louis-Philippe",
    editor = "Zong, Chengqing  and
      Xia, Fei  and
      Li, Wenjie  and
      Navigli, Roberto",
    booktitle = "Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)",
    month = aug,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2021.acl-long.322/",
    doi = "10.18653/v1/2021.acl-long.322",
    pages = "4170--4187"
}
Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data · ACL 2021