用 CLAP 加 LoRA 研究自闭症群体的音频情绪识别
Audio emotion recognition for atypical hearing
作者用 LoRA 微调 CLAP 来识别情绪,想解决自闭症听觉过敏难评估的问题,思路挺有意思。
博士研究项目针对自闭症人群的听觉过敏问题,探索音频情绪识别(AER)在非典型听觉场景下的应用。第一阶段用 LoRA 对 CLAP(Contrastive Language-Audio Pretraining)基础模型做微调,训练数据来自神经典型听者的效价与唤醒度数据集。
研究假设是基于声学特征的情绪理解可以从小规模标注数据泛化到听觉过敏人群。听觉过敏因个体差异大而难以评估,该工作试图用模型方法补充现有评估手段。
Audio emotion recognition for atypical hearing
My doctoral work aims to explore Audio Emotion Recognition (AER) in the context of atypical listening. This research focuses on auditory hypersensitivity in people with autism, a phenomenon that is often difficult to evaluate and unique to each individual. Our core idea is to leverage our understanding of affect from acoustic traits, relying on the possibility of generalizing affective responses from a small amount of annotated data. As a first step, we fine-tune a large foundation model, Contrastive Language-Audio Pretraining (CLAP) using low-rank adaptation (LoRA), trained on a valence and arousal dataset of neurotypical listeners.
本条情报归属 AITOP「论文」核心追踪栏目。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:CLAP、LoRA、音频情绪识别、自闭症,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。
信源核验说明:本文原始线索采编自「arXiv cs.LG」(@Ulysse Roussel),经 AITOP 多维评分管线结构化提炼。