Ethan Mollick· @emollick · X·· 3 小时前
事实摘要
再次强调，@SemiAnalysis_ 在这里做了一件有价值的事，你能看出为什么专家级工作的基准测试极难做好。我认为这非常有用，尤其是在许多其他主要基准（ARC-AGI、GDPval、METR Long Tasks）都已完全饱和的时候。
正文 · 原文
Again, @SemiAnalysis_ is doing something valuable here & you can see why benchmarks of expert-level work are incredibly hard to pull off. I think this is quite useful at a time where so many other major benchmarks (ARC-AGI, GDPval, METR Long Tasks) are completely saturated.
来源：Ethan Mollick · x.com