Add llms.txt to WordPress and get cited by AI
WordPress sites are usually easy for AI crawlers to read — until a security plugin, CDN toggle or bloated theme gets in the way. Audit your site, then generate an llms.txt that maps your best posts and pages.
Free · live crawl · includes a generated llms.txt
What WordPress gets right
- PHP themes render full post content on the server.
- SEO plugins like Yoast and Rank Math output a rich Schema.org graph (Organization, WebSite, Article).
- Clean permalinks and automatic XML sitemaps make discovery easy.
Where WordPress sites lose AI visibility
CDN or security plugin blocking AI bots
One-click "block AI scrapers" toggles in CDNs and firewall plugins often block GPTBot and ClaudeBot site-wide. The audit shows exactly which crawlers are refused.
Physical robots.txt overriding your SEO plugin
If a robots.txt file exists in the web root, WordPress's virtual robots.txt (and your plugin's settings) are ignored. Edit the physical file or delete it.
Page builder bloat
Heavy builders can push text below 5% of the HTML. Lower content density makes extraction noisier and slower.
Missing author and date signals
Themes that hide author boxes and dates remove the freshness and expertise signals answer engines use when choosing what to cite.
Real data · measured October 2026
wordpress.com itself scores 85/100 B
4 of 4 core AI crawlers allowed · publishes an llms.txt · median across the 102 sites we measured is 77. Your WordPress site starts from the same platform, but your settings and content decide the score.
Step by step
Make WordPress AI-ready
- 1
Check robots.txt for AI crawlers
Open your SEO plugin's robots.txt editor (Yoast: Tools → File editor; Rank Math: General settings → Edit robots.txt) and add explicit allow groups.
robots.txtUser-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://yourblog.com/sitemap_index.xml
- 2
Generate llms.txt and llms-full.txt
Run the audit. LLMready groups your posts, pages and categories into sections and writes descriptions from your meta descriptions.
- 3
Upload to your web root
Upload both files with SFTP or your host's file manager into the same folder as wp-config.php, so they load at yourblog.com/llms.txt. Make sure they're served as plain text.
.htaccess (Apache)<Files "llms.txt"> ForceType text/plain AddDefaultCharset utf-8 </Files> <Files "llms-full.txt"> ForceType text/plain AddDefaultCharset utf-8 </Files>
- 4
Or keep it in sync automatically
With LLMready Pro, point a 301 redirect (for example with the Redirection plugin) from /llms.txt to your hosted file. It regenerates when your sitemap changes, so new posts appear without re-uploading.
Redirection plugin ruleSource URL: /llms.txt Target URL: https://answer-engine-ready.lovable.app/h/your-blog/llms.txt Type: 301