Measuring how AI agents handle everyday wet-lab science
Measuring how AI agents handle everyday wet-lab science
Source: https://openai.com/index/measuring-how-ai-agents-handle-wet-lab-science/
Published: 2026-11-06. Inspected version: Developer benchmark report. Retrieved: 2026-11-09T22:05:20.437463+00:00.
Source annotation (reported findings): OpenAI’s November 6, 2026 developer report describes BioBasicsBench, developed with Ligo: 100 routine laboratory tasks using raw experimental data. Testing 37 model-and-reasoning-effort settings with five attempts per task produced 18,500 answers. Scores award credit for individual grading criteria; GPT-6 Astra at the reasoning-effort setting called xhigh averaged 66.7% of available credit, not the share of tasks solved completely. Internal and external scientists reviewed task materials and a graded model attempt; this does not establish human review of all answers. No measured human-performance comparison or checking-time outcome is provided.
0
1
Tags
Scientific Oversight of AI-Assisted Research
1Cademy
Related
Working with academic communities to build scientific understanding
A new golden age of discovery
AlphaEvolve: A Gemini-powered coding agent for designing advanced algorithms
Claude discovers a novel enzyme system with CRISPR-like repeats
Intentmaking and Sensemaking: Human Interaction with AI-Guided Mathematical Discovery
Theorem Proving in Lean 4: Propositions and Proofs
What is Microsoft Discovery?
Independent Assessment of AI R&D Acceleration at Anthropic in October 2026
Improving mathematical reasoning with process supervision
Tracing the thoughts of a large language model
Investigating vault particles with Claude
Evaluating Claude’s bioinformatics research capabilities with BioMysteryBench
BioMysteryBench Changelog — v11 (2026-07-06)
AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science
AI for scientific discovery: How researchers use Claude
Deep learning-guided discovery of an antibiotic targeting Acinetobacter baumannii
Conjecture Machines: AI agents and the new validation bottleneck in science
Related
Working with academic communities to build scientific understanding
A new golden age of discovery
AlphaEvolve: A Gemini-powered coding agent for designing advanced algorithms
Claude discovers a novel enzyme system with CRISPR-like repeats
Intentmaking and Sensemaking: Human Interaction with AI-Guided Mathematical Discovery
Theorem Proving in Lean 4: Propositions and Proofs
What is Microsoft Discovery?
Independent Assessment of AI R&D Acceleration at Anthropic in October 2026
Improving mathematical reasoning with process supervision
Tracing the thoughts of a large language model
Investigating vault particles with Claude
Evaluating Claude’s bioinformatics research capabilities with BioMysteryBench
BioMysteryBench Changelog — v11 (2026-07-06)
AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science
AI for scientific discovery: How researchers use Claude
Deep learning-guided discovery of an antibiotic targeting Acinetobacter baumannii
Conjecture Machines: AI agents and the new validation bottleneck in science