跳到正文
Ethan Mollick· @emollick · X·· 56 分钟前
引用Justin Lo@loresjpg
Nice DeepSWE score! Does it survive a lowercase filename? Introducing MaxxBench: 89 DeepSWE tasks with small changes to the instructions or starting code. Same engineering problem, slightly different requirement. Models clustered around 74% on DeepSWE end up 23 pp apart. Good at coding, or good at DeepSWE? 🧵
在 X 查看被引用的帖子

来源:Ethan Mollick · x.com

所属事件:MaxxBench发布89项DeepSWE变体任务