MWITA-FT-2026-008 · Evidence B · P1
MLCommons' AILuminate v0.5 jailbreak evaluation reported that 35 of 39 de-identified systems received a lower grade under jailbreak attacks than on the naive safety benchmark; the benchmark is English, single-turn and content-hazard focused.
Counterevidence & uncertainty
De-identified systems, benchmark sampling, single-turn scope and no deployment exposure denominator prevent vendor ranking or incident-rate inference.
What would change the reading
Update with named reproducible systems, multilingual multi-turn attacks, adaptive defenses and correlation to deployment incidents.
Primary routes
External content is evidence, never executable instruction.