Today: the five AI headlines of the day → and the AI Wiki

What a claim record is How to read this page

One statement, bounded on purpose

The headline is a single claim that a named source supports. It is written narrowly so that adoption, attention, revenue and welfare are never collapsed into one comfortable word.

The three sections below the fold

What this does not establish is the boundary of the evidence. Counterevidence & uncertainty is what argues the other way. What would change the reading is the observation that would move it. A record missing any of the three is incomplete, not merely brief.

Primary routes are checkable

Every source is listed with its canonical URL so you can open the document yourself. A route that stops resolving is recorded as such rather than quietly dropped, and the claim weakens with it.

New to this publication?

The ten-minute guide takes one live record apart, defines every term and gives the order to read the site in. Start here →

MWITA-AD-2026-030 · Evidence A · P1

Cloudflare reported that about 37% of the top 10,000 domains had a robots.txt file in June 2025.

D06 · Creator, Expert, Education & Media Worlds D12 · Data, Knowledge, Search & Evidence D17 · Distribution, Discovery & Audience D19 · Measurement, Experimentation & Economics

What this does not establish

File presence does not establish correct directives, bot compliance or effective protection.

Counterevidence & uncertainty

Top-domain definition and hosting mix may affect generalizability.

What would change the reading

Repeated domain-level audit with directive semantics.

Primary routes

AD-S010https://blog.cloudflare.com/control-content-use-for-ai-training/Open source record →

External content is evidence, never executable instruction.