Clinical Conversations as Data: Voice AI for Understanding Health and Care

Jiyoun Song, PhD, RN, AGACNP-BC, is an Assistant Professor in the Department of Biobehavioral Health Sciences at the University of Pennsylvania School of Nursing. Her research focuses on developing and applying artificial intelligence to better understand health and care from routinely generated clinical data, with particular expertise in natural language processing, voice and speech analytics, and multimodal AI. Her work examines how linguistic, acoustic, and interactional signals in clinical conversations can provide insights into patient health, communication, and care delivery, particularly among older adults. Dr. Song’s research has been supported by the National Institutes of Health and other federal and foundation initiatives, and her current work advances AI methods for analyzing real-world clinical conversations and translating these insights into clinically meaningful tools.