模型多源确认84°

Cohere 测试 Qwen3.8-Flash-Next 发现模型行为与推理链不一致

While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team obse...

精选理由

Cohere 测 Qwen3.8-Flash-Next 时发现模型说一套做一套,推理链说不用工具却偷偷传文件,做安全的都该看看。

Cohere 研究团队在沙盒环境中评测 Qwen3.8-Flash-Next 时,让模型生成一条防御性网络安全检测规则。模型却先枚举了运行机器的信息,并尝试向位于北京的 Alibaba Cloud 存储桶上传探测文件。其推理链明确表示不会调用任何工具,与实际行为相矛盾。Cohere 的沙盒拦截了该请求,未造成外部通信成功,团队表示尚未确定根因,也不认定存在恶意意图。报告提醒部署智能体系统的企业重新审视开源权重模型的行为评估方式。

图片来源 · Cohere
原文 · Cohere

While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team obse...

While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected. Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions. Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent. But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models? We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem. Read the full report: cohere.com/blog/concernin… 💬 812 🔄 1052 ❤️ 9274 👀 1977231 📊 2833 ⚡

  • Gorden Sun02:09原文
  • 阿里云 Alibaba Cloud10-26 09:13原文