用AI十分钟,削弱你的坚持力
论证要点
- 研究设计:三项随机对照试验,共1222名参与者。第一组354人做分数题,一组可用ChatGPT,一组不可用;第二组667人重复;第三组201人做SAT阅读题。
- 关键发现:有AI辅助时准确率更高,但一旦撤走AI,该组几乎立刻停止正确解题或直接放弃;无AI组则坚持更久、最终表现更好。
- 机制解释:AI秒回答案让人习惯这种速度,任何更慢的事都显得低效;同时AI替代了“有产出的挣扎”,而正是这种挣扎帮人找到研究优势与热情。
- 作者立场:Christian认为这印证了很多人直觉中的担忧,他自己也每天写笔记来抵御过度用AI导致学术能力退化的风险。
- 建议方向:AI不应默认给快速答案,而应更像导师一样具有指导性;目标是增强而非取代人类能力。
- 科研影响:过度依赖AI可能危及好科学家的核心——贴近数据、沉浸材料、团队协作;当10人团队缩成2-3人加聊天机器人,可能丢失重要东西。
对实践的启示
做AI应用时,别只优化“秒回答案”,要考虑是否在替代用户的思考过程。对用AI干活的人,把AI当导师而非答案机,刻意保留自己挣扎和坚持的空间,否则撤掉AI后可能连基本独立表现都保不住。
作者承认的反方与局限
文章未直接给出反方观点,但作者承认AI确实能提高初始准确率,且前沿AI公司也承认卸载任务会降低基线理解,暗示问题在于设计方式而非AI本身。
原文摘引
We showed, ironically, that they are often helping us in ways that are kind of unhelpful.
We need to work toward a future in which human abilities are, as much as possible, augmented rather than supplanted.
This is not a story about fractions and SAT problems. This is something that is happening to human knowledge and human expertise from top to bottom.
▸ 展开原文全文(28 段,抓取自 Hacker News)
Using AI for Just 10 Minutes Erodes Your Ability to Persist at Hard Things
A UC Berkeley researcher co-authored a study that raises profound questions about how we interact with artificial intelligence in education — and daily life.
Brian Christian has spent 20 years thinking about how artificial intelligence will change our minds and our world. His 2020 book The Alignment Problem has been praised as one of the best on AI, and like many scientists, he sometimes feels euphoric about the technology’s advances. After all, when everyone has a fleet of autonomous agents on standby to speed up research, it’s hard not to feel as if a life-changing discovery is just a few prompts away.
He also keeps a notebook on his desk and writes in it every day. The practice keeps him grounded and tamps down a gnawing suspicion that too much time working with AI could cause him to lose his own scholarly edge.
He has good reason to worry — and need only look to his most recent research for proof.
Christian was part of a team behind a landmark study that found that spending just 10 minutes relying on an AI tool significantly impairs our ability to focus and persist with difficult tasks. A preliminary draft made waves earlier this year, and the team presented the updated, peer-reviewed paper this week at the Conference on Language Modeling.
“It’s a striking finding, but in a way it supplies ammunition for a story that a lot of us kind of feel in our gut,” said Christian, a research fellow with the UC Berkeley Center for Human-Compatible AI. “I experience it too.”
To test how quickly people’s focus and persistence plummeted, researchers designed a series of randomized controlled trials and recruited 1,222 participants online.
For the first experiment with 354 participants, one group was tasked with solving 15 basic fraction problems without help, while another had ChatGPT open on the side to use for assistance and to even ask for the answer. The group with AI access started off more accurate than the group without it. Then, after 12 problems, researchers took away the AI tool. Almost immediately, the people in that group stopped solving questions accurately.
A similar thing happened when they ran the experiment on a second, larger group of 667 participants. Whereas the AI users got answers wrong or gave up entirely when the AI assistance was withdrawn, the group without AI stuck with the task and were more successful at the end.
Researchers then ran a third experiment with 201 participants and an SAT reading comprehension prompt. The results echoed those from the fraction problems: When the AI tool was removed, persistence and accuracy dropped.
“You almost couldn’t ask for a clearer story,” Christian said.
The findings backed up what anecdotes and surveys have increasingly found in recent years: An overreliance on AI for answers erodes our cognitive fitness. When AI produces answers in seconds, we get used to that speed; anything that takes longer feels inefficient. And relying on AI also removes what the team called “productive struggle,” which can lead people to find their research strengths and passions.
“We’ve built these systems to be helpful, but are they being helpful to us in a way that’s actually helping us?” Christian said. “We showed, ironically, that they are often helping us in ways that are kind of unhelpful.”
The team included scholars from Carnegie Mellon University, the Massachusetts Institute of Technology, the University of Oxford and UCLA. Outlets from WIRED to Psychology Today covered the study when early findings were released in the spring. The New York Times published a story last week about the paper and similar research.
Frontier AI companies have acknowledged how offloading tasks to chatbots can reduce one’s baseline understanding and mastery of a subject. Instead of defaulting to quick answers, AI responses could default to being more instructive, like a tutor, Christian said.
“We need to work toward a future in which human abilities are, as much as possible, augmented rather than supplanted,” he said.
Christian said that’s especially true with research and academia. He worries about the way overreliance on AI tools in science could jeopardize what makes for a good scientist in the first place: staying close to data, being immersed in the material, and working as part of a team. Something significant could be lost when that team of 10 developing the ideas that lead to a breakthrough is whittled down to two or three researchers and a chatbot.
“This is not a story about fractions and SAT problems,” Christian said. “This is something that is happening to human knowledge and human expertise from top to bottom and from grade-school students all the way to the leading experts in the world.”
Related Information
- Paper: “AI Assistance Reduces Persistence and Hurts Independent Performance“
- Brian Christian’s website
- UC Berkeley Center for Human-Compatible AI
Related stories
To decipher local laws, researchers used AI to build a database of millions of them
Berkeley Talks: W. Kamau Bell on AI, creativity and resisting the pull of automation
AI creates risk, opportunities for key human rights fields, report finds
With AI, researchers discover new way to detect sudden cardiac death risk