Ethan Mollick· @emollick · X·· 56 分钟前
Nice DeepSWE score! Does it survive a lowercase filename? Introducing MaxxBench: 89 DeepSWE tasks with small changes to the instructions or starting code. Same engineering problem, slightly different requirement. Models clustered around 74% on DeepSWE end up 23 pp apart. Good at coding, or good at DeepSWE? 🧵在 X 查看被引用的帖子
来源:Ethan Mollick · x.com