Home › Tools › The Three-Consumer Check
Free check · 7 items · 5 minutesYour site has three consumers. Are you operating for all of them?
People, search crawlers and retrieval agents read the same estate differently. This check scores whether the third one can reach you, read you, and budget a read — and refuses to infer anything you have not measured.
Our own numbers, measured on a live page one and on ourselves
We scored Reachable but not ready — three of seven — the first time we ran this on ourselves. We serve every fetcher and still score 33 on our own scale.
| Measured | What it is |
|---|---|
| 13 of 35 refused (37%) | AI-fetcher requests refused across a live page oneFive AI fetcher user-agent strings against the seven domains ranking for a head term. Every refusal was an HTTP 403. The matrix was re-run four minutes later and returned the same 35 statuses. · Indexable, 9 September 2026, n = 35 fetches |
| 0 of 7 | Domains whose robots.txt disallowed any AI agent tokenNot one of the seven published a disallow. Every refusal contradicted the file the audit would have read. · Indexable, 9 September 2026, 7 robots.txt files |
| 40 of 40 served | Our own estate's answer to the same testTen user-agent strings against four URLs. Nothing refused — and we still scored 33 on the readiness scale below. Serving the request is the easy half. · Indexable, 9 September 2026, n = 40 fetches |
| 33 of 100 | Our own composite agent-readiness score, on Indexable's own scaleDiscoverability 67, content accessibility 0, bot access control 33, protocol discovery 33. This is our scale, not a vendor dashboard score. · Indexable, 9 September 2026 |
| ~3,063 tokens | Our llms.txt, with no per-page token countsAn agent cannot budget a read against it. Estimated, not exact. · Indexable, 9 September 2026 |
A refusal is evidence about edge policy, not vendor intent: record it as “refused a request presenting as GPTBot”, never as “blocks <vendor>”. The composite is on Indexable's own scale, not a vendor dashboard score. One day, one country, seven domains.
Reachable is the easy half
We serve every fetcher that asks and still score 33 of 100 on our own scale. Access is a ticket; legibility is an operating habit.