医学GenAI风险与收益的六步分离法
Six pragmatic steps to separate medical GenAI’s promise from its inherent dangers
Nature子刊这篇讲医学AI的六步管控法,直接点出生物武器、自主网攻、医学生焦虑这些具体风险,不是泛泛而谈。
npj Digital Medicine 于2026年10月10日发表评论文章,提出六项可操作措施来管控医学前沿模型。文章指出,优化用于生物医学研究的系统正被恶意使用者用于开发生物武器。智能体系统会在人类不知情的情况下自主发动网络安全攻击。前沿模型正在加剧医学生的焦虑与压力,并可能重塑医疗职业角色。作者认为,尽管大型科技基础模型开发者对风险的强调可能存在过度,甚至带有监管俘获意图,但担忧确有真实依据。
Six pragmatic steps to separate medical GenAI’s promise from its inherent dangers
npj Digital Medicine, Published online: 10 October 2026; doi:10.1038/s41746-026-03384-w GenAI and agentic systems in medicine bring real opportunities for better diagnosis and therapy and for the development of better diagnoses and therapies. It is now increasingly being recognised that the power of these systems for good is inseparable from their power to be used for harm. Systems optimised for biomedical research are unfortunately being harnessed by malign human masters to help develop bioweapons to be targeted at humanity. Agentic systems are autonomously, unknown to their human masters, carrying out cybersecurity attacks. Frontier models are increasing anxiety and stress of medical students and threaten to reshape medical professional roles, not always for the better. Although there may currently be some over emphasis of risk by BigTech foundation model developers, and these may even be attempts at ‘regulatory capture’, there are also genuine reasons for concern. We set out actionable measures that are needed to control medical frontier models to maximise human benefits and control risks.