MWITA-MB-2026-005 · Evidence A · P1
METR randomized 246 tasks from 16 experienced open-source developers on familiar repositories and estimated that access to early-2025 AI tools increased completion time by 19%.
Counterevidence & uncertainty
Small selected sample, particular tools and repositories, incomplete blinding and rapid tool change limit generalization; a 2026 design update flags participation-selection concerns.
What would change the reading
Update when preregistered replications with newer tools and broader developers change the estimate.
Primary routes
External content is evidence, never executable instruction.