技巧

Gergely Orosz:3 个 AI 模型在法律咨询上同时答错

精选理由

Gergely Orosz 的亲身经历:3 个模型给法律意见全答错,律师才是对的,在自己不懂的领域真别全信 AI。

开发者 Gergely Orosz 分享了一个用 AI 的隐患:在自己熟悉的领域,他能立刻发现模型出错;但在不熟悉的领域会倾向于信任模型。他让 3 个 AI 模型给一个法律案件提供意见,三者都自信地给出同一结论 X,而他付费咨询的律师给出结论 Y,最终律师是对的。他提醒大家在非专业领域使用 AI 输出时要格外谨慎。

原文 · Gergely Orosz

This messes with my mind ALL THE TIME

When I do stuff with AI I am an *expert* in (eg coding on my project I know well, or doing research in an area I am very familiar with) I spot problems/errors/the model BS'ing me immediately. No big deal, I have it correct or start again

BUT when I'm not an expert in an area, I find that I trust it, and then later learn it does stupid stuff. Like a case when I asked 3x AI models to give feedback on a legal case (that I also paid a lawyer for, but lawyer was slow). All 3x models confidently told me X, lawyer then told me Y, and lawyer was right