OpenAI 与酶设计生物技术公司 Ligo 联合推出 BioBasicsBench,用于衡量 AI 智能体处理湿实验常规分析的能力。该基准取自 100 个真实实验任务,测试智能体能否解读原始实验数据、识别错误,以及判断证据是否足以支持结论。OpenAI 称该基准可显示模型需要改进之处,并追踪这些改进对科研进展、生物安全和生物安保的意义。
A new way to measure how AI agents handle the routine analyses of wet-lab science—BioBasicsBench.
Developed with Ligo, a biotech company focused on enzyme design, the benchmark draws on 100 tasks from real experiments to test whether agents can interpret raw lab data, identify errors, and recognize when the evidence doesn’t support a conclusion.
Accelerating biological research starts with getting the everyday work right. BioBasicsBench shows where models need to improve, and helps us track what those gains mean for scientific progress, biosafety, and biosecurity.
https://openai.com/index/measuring-how-ai-agents-handle-wet-lab-science/
来源:OpenAI · x.com