论文

arXiv 论文发现语言模型掌握药物适应症远好于禁忌症

LABEL: Literature Asymmetry between Efficacy and Limits in Drug Knowledge and Language Models

精选理由

做医疗 AI 的开发者该看看这篇。它用 PrimeKG 574 种药物证明模型答禁忌症近乎瞎猜,原因是语料里写得少,而且检索 FDA 标签就能把准确率拉高 15.8 个点。结论很实操:安全问题别靠通用语料,直接接结构化数据库。

一篇 arXiv 论文提出 LABEL(Literature Asymmetry between Efficacy and Limits)概念,测量了 PrimeKG 中 574 种药物在公开文本里的记录情况。结果显示,Wikipedia 和 PubMed 摘要提及药物适应症的频率约为禁忌症的两倍,药物内 odds ratio 为 2.19,即安全限制信息在自由文本中系统性缺失。

正文

语言模型镜像了这一缺口:Qwen2.5 从 0.5B 扩展到 14B 时,适应症问答准确率提升 18.3 个百分点,但禁忌症准确率始终停在接近随机猜测的水平。当给模型提供包含答案的检索文本时,它使用安全事实的效果与使用疗效事实相同;将安全类问题路由到官方 FDA 标签,在标签包含该事实时准确率提升 15.8 个百分点。

论文结论是模型在用药安全上失败并非推理能力不足,而是语料本身缺少安全事实,建议临床 AI 系统把用药安全问题路由到监管标签和结构化数据库而非公开网页。代码和数据已在 GitHub 开源。

原文 · arXiv cs.AI

LABEL: Literature Asymmetry between Efficacy and Limits in Drug Knowledge and Language Models

Every medication comes with two types of medical facts: indications, which describe what conditions the drug treats (benefits), and contraindications, which describe who must avoid it to prevent serious harm (safety limits). Although contraindications are critical for patient safety and FDA regulations require listing them as rigorously as indications, we find that contraindications are far less documented than indications in general prose. In this paper, we measure how often these texts contain both facts across 574 drugs from PrimeKG by comparing a drug's indications against its own contraindications. Across Wikipedia articles and PubMed abstracts, we find that reference prose names a drug's benefits about twice as often as its safety limits (within-drug odds ratio 2.19). We call this documentation gap LABEL (Literature Asymmetry between Efficacy and Limits). Language models mirror this gap. As we scale Qwen2.5 from 0.5B to 14B, accuracy on indications rises by 18.3 points, whereas accuracy on contraindications remains flat near random guessing. However, when we provide models with a retrieved passage that states the answer, they use safety facts just as effectively as benefits. Furthermore, routing safety questions to official FDA labels boosts accuracy by 15.8 points whenever the label states the fact. Overall, our findings show that models fail on medication safety not because they cannot reason about risk, but because free-text corpora lack safety facts. Clinical AI systems should therefore route medication-safety questions to official regulatory labels and structured databases rather than relying on general public records. Code and data are available at https://github.com/SMRayeed/LABEL.

产业坐标与信源核验

本条情报归属 AITOP「论文」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Qwen2.5、FDA、医疗AI、RAG,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「arXiv cs.AI」(@S M Rayeed, Charles V. Stewart, Yao Ma),经 AITOP 多维评分管线结构化提炼。