跳到正文
Ethan Mollick· @emollick · X·· 3 小时前
事实摘要

很高兴看到GDPval有了后继基准来评估AI工作,但它确实需要像GDPval那样的人类基线。 有趣的是,GPT-6 Pro发现了评分中的一些错误。我还认为那些0%的分数掩盖了成功率上具有经济意义的差异。但这仍是一个有价值的基准!

正文 · 原文

Nice to see a successor to GDPval to evaluate AI work but really needs human baselines like GDPval.

Funnily enough, GPT-6 Pro spotted some errors in the grading. I also think the 0% scores hide economically meaningful differences in success rates. But still a valuable benchmark!

引用SemiAnalysis@SemiAnalysis_
Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains. GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
在 X 查看被引用的帖子

来源:Ethan Mollick · x.com

所属事件:Mollick 评 GDPx 基准:缺人类基线