Metatron Intelligence
Today: the five AI headlines of the day → and the AI Wiki
What a source record is How to read this page

A route, not a verdict

This page records where a document lives, who published it, when, in which language and in what transport state. Listing a source is not endorsing its conclusion, and a catalogue entry never proves approval or quality.

Why the state matters

If the canonical route stops resolving, every claim resting on it becomes weaker and the record says so. That is why transport state is published alongside the address.

Rights are separate from access

Being able to read a document is not permission to reuse it. Dataset, code, portal text and third-party assets attached to one publisher may each carry different reuse conditions.

New to this publication?

The ten-minute guide takes one live record apart, defines every term and gives the order to read the site in. Start here →

SRC-0d6dde323fd5e399 · Source record

Control content use for AI training with managed robots.txt and blocking

Cloudflare · 4 connected claims

D01 · Marketing, Brand & Revenue SystemsD02 · Customer Intelligence, Sales & Service

Canonical route

https://blog.cloudflare.com/control-content-use-for-ai-training/

Claims connected to this source

  1. MWITA-MR-2026-006Google's June 2026 pilot adds dedicated generative-AI impression reporting, while Cloudflare measures crawler/referral asymmetry. Neither reveals whether a model stated correct product facts, whether a citation caused a sale, or whether crawl volume created value.Evidence B
  2. MWITA-AD-2026-029Cloudflare estimated June 2025 crawl-to-referral ratios of about 14:1 for Google, 1,700:1 for OpenAI and 73,000:1 for Anthropic on its network.Evidence A
  3. MWITA-AD-2026-030Cloudflare reported that about 37% of the top 10,000 domains had a robots.txt file in June 2025.Evidence A
  4. MWITA-AD-2026-031Cloudflare explicitly cautioned that crawl-to-referral ratios may undercount referrals from native apps when no Referer header is sent.Evidence A

This record describes a source route and its Atlas connections. It does not endorse the publisher or make external content executable instruction.