UniAR:多粒度提示学习助力自闭症谱系障碍识别
UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning
一篇医学 AI 论文:UniAR 用多模态模型自动生成诊断文本来补数据缺口,自闭症筛查在 MRI 上准确率到 75.9%,还更可解释。
研究团队提出 UniAR 框架,用于自闭症谱系障碍(ASD)识别。该框架利用大型多模态模型在词、短语、句子三个层级生成层级化诊断描述,弥补临床报告数据稀缺的问题。框架中的 MoE 多尺度对齐模块将向量量化视觉原型与对应粒度的语义表征动态匹配。在覆盖脑部 MRI 和面部表情的四个基准上,UniAR 在 MRI 基准达到 75.9% 平均准确率,面部基准达到 91.6% 平均准确率,分别比基线提升 1.5 和 1.2 个百分点。
UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning
Autism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder for which early and accurate diagnosis is critical to improving long-term developmental outcomes. However, existing ASD recognition methods are often constrained by the scarcity of diagnostic text data, forcing them to rely mainly on visual analysis and limiting their ability to model clinically meaningful semantic reasoning. To address this challenge, we propose UniAR, a unified framework enhanced by multi-granularity prompt learning for robust ASD recognition under heterogeneous data variations. Specifically, UniAR leverages a large multimodal model to generate hierarchical diagnostic descriptions at the word, phrase, and sentence levels, compensating for the lack of paired clinical reports. To align the generated semantics with visual evidence, we further design a Mixture-of-Experts-based Multi-Scale Alignment Module, which dynamically matches vector-quantized visual prototypes with semantic representations at corresponding granularities. Extensive experiments on four benchmarks covering brain MRI and facial expression scenarios show that UniAR consistently outperforms existing state-of-the-art methods, achieving average accuracies of 75.9\% on MRI benchmarks and 91.6\% on facial benchmarks, while improving average Accuracy on MRI benchmarks by 1.5 percentage points and average Accuracy on facial benchmarks by 1.2 percentage points over baselines. These results demonstrate that UniAR offers a robust and interpretable framework for ASD screening under semantic scarcity.