All payments made in the preview are in test mode. Read more
LLMready
techcrunch.com · measured 28 October 2026

Is TechCrunch AI-ready?

Not really.

TechCrunch scores 67/100 for AI search readiness. Several gaps make it hard for AI engines to read, understand and quote this site.

#2 of 6 in media and publishing#72 of 102 sites measured3 points above the industry median (64)
AI readiness0/ 100D
Bot access34
Content extractability66
Semantic metadata100
Citation readiness83

Can AI crawlers get in?

What techcrunch.com/robots.txt says to each crawler.

  • GPTBotOpenAIBlocked
  • PerplexityBotPerplexityAllowed
  • ClaudeBotAnthropicBlocked
  • Google-ExtendedGoogleBlocked
OAI-SearchBotChatGPT-UserClaude-SearchBotApplebot-ExtendedCCBotMeta-ExternalAgentBytespider

Key signals

What an answer engine finds on the homepage.

llms.txt

Not found

llms-full.txt

Not found

Sitemap

400 URLs

Schema.org JSON-LD

CollectionPage, BreadcrumbList, ListItem +6

Text in initial HTML

1,796 words

Response time

77 ms

Biggest wins

What TechCrunch could fix first

  1. 1

    llms.txt is present and valid

    Bot access+5 pts possible

    Generate an llms.txt below and upload it to your site root.

  2. 2

    GPTBot can crawl

    Bot access+4 pts possible

    Add "User-agent: GPTBot" with "Allow: /" to robots.txt (and remove any matching Disallow rules).

  3. 3

    ClaudeBot can crawl

    Bot access+4 pts possible

    Add "User-agent: ClaudeBot" with "Allow: /" to robots.txt (and remove any matching Disallow rules).

  4. 4

    Google-Extended can crawl

    Bot access+4 pts possible

    Add "User-agent: Google-Extended" with "Allow: /" to robots.txt (and remove any matching Disallow rules).

  5. 5

    Content density

    Content extractability+3 pts possible

    Trim inline scripts, styles and markup bloat so text makes up a larger share of the page.

Every check

The full breakdown

Snapshot of the homepage measured on 28 October 2026 with the same live crawl as the free LLMready audit. A high score means AI engines can reach, read and understand a site. It doesn't guarantee citations — those also depend on authority, relevance and the question being asked. Sites change — run a fresh audit for today's result.

Media and publishing ranking

Full benchmark

Median 64/100 across 6 measured media and publishing sites (all sites: 77).

1
68
Substacksubstack.comD2
67
TechCrunchtechcrunch.comD3
64
WIREDwired.comD4
63
The Vergetheverge.comD5
54
BBCbbc.comF6
49
The Guardiantheguardian.comF

Similar scores elsewhere

Sites in other industries that landed close to 67.

67
Figmafigma.comD
67
Pelotononepeloton.comD
68
Anthropicanthropic.comD
66
Healthlinehealthline.comD
66
Hugging Facehuggingface.coD
66
Miromiro.comD
All 102 measured sites

How does your site compare to TechCrunch?

Get the same breakdown for your site — crawler access, extractability, metadata and citation readiness — plus a generated llms.txt. D is the bar to beat.