有AI就不肯说"我不知道"
论证要点
- 研究者做了5个实验、共3132人,题目选的是模型Step 3.5 Flash几乎必错的电影细节题,因此结果无法用"合理委托给可靠工具"解释。
- 前两个实验中,无AI对照组在36%和44%的题上保留判断,有AI时降到6%和3%;Study 2中信心从29.6分升到75.9分,正确率却从27.6%降到10.0%。
- 全部研究中,有AI且无激励者答对9.2%,无AI者27.5%——答得更多,正确率只有约三分之一。
- Study 2至4加入金钱激励(答对得10美分、答错扣10美分、说"不知道"不得分),激励确实让人少求助AI、答对更多,但效果有限,且三项研究均未出现与AI可用性的显著交互。
- Study 4把AI答案自动展示给参与者(类似搜索摘要和写作助手的主动建议),效果几乎不变:无激励时保留判断从35%降到1%,有激励时从约39%降到7%。
- 作者用"Epistemia"解释:模型永远必须给出答案、从不因不知道而停顿,用户交出判断时可能一并继承了这种不克制;这与传统"建议使用"研究中人们通常低估外部建议的结论相反。
对实践的启示
对做AI产品的人:默认展示AI答案会显著压低用户说"不知道"的意愿,且这种影响不因准确性提高而自动消失。对用AI干活的人:把"不确定"当成需要主动保留的输出,而不是被AI答案填满的空白。
作者承认的反方与局限
作者承认,人们倾向于顺从AI答案这一现象,是否在电影冷知识之外同样强烈仍是未解问题;金钱激励有效但幅度不大,更大或基于声誉的激励能否缩小差距尚不清楚。
原文摘引
Just having AI advice available nearly wiped out people's willingness to say "I don't know."
Participants were far more confident but wrong much more often.
Whether human judgment holds up as AI systems spread may depend less on making models more accurate and more on people continuing to recognize and respect the limits of their own knowledge.
▸ 展开原文全文(34 段,抓取自 The Decoder)
AI access makes people almost entirely unwilling to say "I don't know," study finds
Researchers ran five experiments with 3,132 participants to test whether access to a language model changes how people handle uncertainty. Just having AI advice available nearly wiped out people's willingness to say "I don't know."
The researchers picked questions where the model they used, Step 3.5 Flash, was almost always wrong. These were questions about fine visual details from movies, like the color of a team uniform in Bend It Like Beckham. According to the authors, such details rarely appear in online text, which makes them prime targets for hallucinations. GPT-5.5, Claude 4.6 Sonnet, and Gemini 3.5 Flash got most of the other questions right but sometimes failed on the harder ones.
Because the AI advice was mostly wrong, the effect can't be explained as reasonable delegation to a reliable tool. The researchers still see a tendency for people to defer to AI answers, but whether this holds just as strongly beyond movie trivia remains an open question.
More answers, fewer correct ones
In the first two studies (1a and 1b), participants could choose whether to ask an AI for advice. In the control group without AI access, they withheld their judgment on 36 and 44 percent of questions. With AI access, those numbers dropped to 6 and 3 percent.
In Study 2, the researchers also measured participant confidence. Without financial incentives, confidence with AI access hit 75.9 points on a scale of 100, compared to 29.6 points without AI. That's roughly two and a half times higher. At the same time, the share of correct answers fell from 27.6 to 10.0 percent. Participants were far more confident but wrong much more often.
Across all studies, participants without incentives who had AI access got 9.2 percent of questions right, versus 27.5 percent without AI. They answered more questions with AI but were correct only about a third as often.
Incentives help but don't fix the problem
Studies 2 through 4 added financial incentives. Participants earned 10 cents for each correct answer, lost 10 cents for each wrong one, and got nothing for "I don't know." The researchers had pre-registered the hypothesis that incentives would increase willingness to abstain but that AI availability would weaken that effect. None of the three studies showed a statistically significant interaction.
AI access and financial incentives worked largely on their own, according to the study. Incentives led participants to seek AI advice less often, with 4.53 versus 5.27 out of six possible requests in Study 3, and to answer correctly more often when AI was available. Judgment suspension rose slightly with incentives but stayed well below the no-AI control group.
The incentives worked but were modest, as the researchers acknowledge. Whether larger or reputation-based incentives would close the gap further is unknown.
In Study 4, the AI answer was shown to participants automatically without them having to ask. The researchers say this mirrors a growing reality where search engines display AI-generated summaries and writing assistants offer unsolicited suggestions. The effect barely changed. Without incentives, judgment suspension dropped from 35 percent without AI to 1 percent with automatically displayed AI answers. With incentives, it fell from about 39 to 7 percent.
People might trust AI advice more than advice from other humans
The researchers frame their results in the context of "Epistemia", the tendency to accept AI answers because they sound convincing rather than actually checking them. A language model always has to produce an answer. It never pauses, even when it doesn't know something. When users hand off their judgment to such a system, they may adopt its lack of restraint, the authors write.
The effect also runs counter to what "advice use" research has shown. People normally underweight outside advice and shift only about a third of the way toward an advisor's position. Participants in this study did the opposite, the authors say.
They even conclude from their data that AI access turned some answers that would have been correct into errors. In the conditions without incentives, the AI group answered more questions than the control group but produced fewer correct answers.
As AI answers become ubiquitous and increasingly appear unsolicited, the willingness to say "I don't know" could be among the first casualties of human-AI interaction, the research team writes. Whether human judgment holds up as AI systems spread may depend less on making models more accurate and more on people continuing to recognize and respect the limits of their own knowledge.
What research says about how AI changes human thinking
A growing number of studies suggest that using AI affects human judgment and cognitive skills. A study from Swiss Business School with 666 participants shows a strong negative correlation between AI use and critical thinking. The more people trust AI, the more they delegate cognitive tasks, creating a cycle that further weakens critical thinking.
Experimental evidence shows that as little as ten to 15 minutes working with an AI assistant can measurably reduce problem-solving ability and persistence on follow-up tasks without AI. Participants who used the AI only for explanations or ignored it showed no decline.
A Microsoft study reached a similar conclusion. In a separate paper, Microsoft showed that AI use places high demands on metacognition, the ability to monitor and steer their own thinking. Higher education levels act as a protective factor.
AI News Without the Hype – Curated by Humans
Subscribe now
Read on for the full picture.
Subscribe for hype-free coverage.
- Full access to every article on THE DECODER
- No ads
- Join the comments and community discussions
- A weekly AI news recap via mail
- 6x/year: "AI Radar" — deep dives on the AI topics that matter most
- Daily AI news, always up to date
- Our full ten-year archive
- Covered by a team with 10+ years in AI