Mapping Emotion

My publications

2023

Large-scale nonverbal vocalization detection using transformers. ICASSP 2023.

The nature and neurobiology of fear and anxiety: State of the science and opportunities for accelerating discovery. Neuroscience & Biobehavioral Reviews, 2023.

The ACM Multimedia 2023 Computational Paralinguistics Challenge. ACM 2023.

ABAW: Valence-arousal estimation, expression recognition, action unit detection & emotional reaction intensity estimation challenges. CVPR 2023.

Deep learning reveals what vocal bursts express in different cultures. Nature Human Behaviour, 2023.

The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked emotions, cross-cultural humour, and personalisation. ACM 2023.

Semantic space theory: Data-driven insights into basic emotions. Current Directions in Psychological Science, 2023.

2022

Federated learning for affective computing tasks. Affective Computing & Intelligence Interaction 2022.

The MuSe 2022 Multimodal Sentiment Analysis Challenge: Humor, Emotional Reactions, and Stress. ACM Multimedia 2022.

How emotions, relationships, and culture constitute each other: Advances in social functionalist theory. Cognition and Emotion, 2022.

Intersectionality in emotion signaling and recognition: The influence of gender, ethnicity, and social class. Emotion, 2022.

The ICML 2022 Expressive Vocalizations Workshop and Competition: Recognizing, Generating, and Personalizing Vocal Bursts. International Conference on Machine Learning 2022.

The ACII 2022 Affective Vocal Bursts Workshop & Competition: Understanding a critically understudied modality of emotional expression. Affective Computing & Intelligence Interaction 2022.

State & Trait Measurement from Nonverbal Vocalizations: A Multi-Task Joint Learning Approach. Interspeech, 2022.

2021

Sixteen facial expressions occur in similar contexts worldwide. Nature, 2021. See press release.

Semantic space theory: A computational approach to emotion. Trends in Cognitive Sciences, 2021.

Facial movements have over twenty dimensions of perceived meaning that are only partially captured with traditional methods. PsyArXiv, 2021.

A taxonomy of positive emotions. Current Opinion in Behavioral Sci. 2022.

How emotion is experienced and expressed in multiple cultures: a large-scale experiment. PsyArXiv, 2021.

2020

The neural representation of emotion is high-dimensional, categorical, and distributed across transmodal brain regions. iScience, 2020.

What music makes us feel: Uncovering 13 kinds of emotion evoked by music across cultures. Proceedings of the National Academy of Sciences, 2020. See press release.

How specific emotions are primary in subjective experience. Proceedings of the National Academy of Sciences, 2020.

Github repo krsna6/interactive-embedding-space: Embed interactive media in a 2D space for visualization.

EEV Dataset: Predicting expressions evoked by diverse videos (using machine learning). arXiv, 2020.

GoEmotions: A dataset of fine-grained emotions. Proceedings of … Association for Computational Linguistics, 2020.

Universal dimensions of facial expression uncovered in art of the ancient Americas: A computational approach. Science Advances, 2020. See press release.

2019

The primacy of categories in the recognition of 12 emotions in speech prosody across two cultures. Nature Human Behavior, 2019.

What the face displays: Mapping 28 emotions conveyed by naturalistic expressions. American Psychologist, 2019.

Mapping the passions: Toward a high-dimensional taxonomy of emotional experience and expression. Psychological Science in the Public Interest, 2019.

What Basic Emotion Theory really says for the 21st century study of emotion. Journal of Nonverbal Behavior, 2019.

Emotional expression: Advances in basic emotion theory. Journal of Nonverbal Behavior, 2019.

The recognition of 18 facial-bodily expressions of emotion across nine cultures. Emotion, 2019.

2018 & earlier

How many different kinds of emotion are there? Frontiers for Young Minds, 2018.

Mapping 24 emotions conveyed by brief human vocalization. American Psychologist, 2018. See press release.

Neural portraits of perception: Reconstructing face images from evoked brain activity. NeuroImage, 2014. See press release.

Clarifying the conceptualization, dimensionality, and structure of emotion. Trends in Cognitive Sciences, 2018.

Self-report captures 27 distinct categories of emotion bridged by continuous gradients. Proceedings of the National Academy of Sciences, 2017. See press release.

Related work

Kragel et al.: Emotion schemas are embedded in the human visual system. Science Advances, 2019.

Keltner: Toward a consensual taxonomy of emotions. Cognition and Emotion, 2019.

Vemulapalli & Agarwala: A compact embedding for facial expression similarity. CVPR, 2019.

Zhang & Hong: Top Shot on Pixel, 2018.

Jaques et al.: Learning via social awareness: improving sketch representations with facial feedback. ICLR, 2018.

Koide-Majima et al.: Distinct dimensions of emotion in the human brain and their representation on the cortical surface. NeuroImage, 2020.

Seo et al.: Intense threat switches dorsal raphe serotonin neurons to a paradoxical operational mode. Science, 2019. My take: Neurobiological explanation for diverse responses associated with a single emotion. Science eLetter, 2019.

Jeff Dean: Google Research: Looking back at 2019, and forward to 2020 and beyond.

Tendar: A virtual pet that feeds on laughter, surprise, and tears.

See also: Recommended Reads