BotLens
Free Chrome extension that scores how well GPTBot, ClaudeBot, Perplexity, Google-Extended and 15+ AI crawlers can AI read your website.
About BotLens
Analyzing AI Readability for the AI-Native Web
Can AI read your website? BotLens is a>free, open-source Chrome extension that gives every page an actionable AI readability score in seconds. It analyzes how LLMs, crawlers, and bots see your content, helping you understand if your site is being blocked or if it's providing enough signal for generative AI systems to represent you accurately.
How BotLens Works
When you click the BotLens icon on any website, it runs a technical audit in under a second. Nothing leaves your browser, ensuring complete privacy.
- Fetch robots.txt & raw HTML: BotLens fetches the site's /robots.txt and the page's server-rendered HTML in parallel to compare what crawlers see versus what your browser renders after JavaScript runs.
- Parse crawler rules: The parser handles the full robots.txt spec, evaluating every rule against 20+ known AI user-sagents including GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, anthropic-ai, Google-Extended, PerplexityBot, Applebot-Extended, Bytespider, Meta-ExternalAgent, CCBot, Amazonbot, Cohere, Bottbot, and more.
- Analyze the DOM: BotLens reads meta directives (robots, gptbot, noai, noimageai), heading hierarchy (H1 count, semantic depth), HTML5 landmarks, image alt-text coverage, JSON-LD structured data, and the <html lang> attribute.
- Detect JS shells:
By comparing initial HTML payload size to rendered DOM, BotLens spots SPA shells where crawlers only see a nearly-empty document.- Compute a weighted score: Signals are weighted (robots/meta 50%, semantic 30%, JS 20%) and combined into a single 0-00 score with a plain-language verdict.
Why BotLens is Different from Traditional SEO
Traditional SEO tools focus on Googlebot and Bingbot. BotLens is built for the AI-native web, specifically detecting blocks against LLM crawlers like GPTBot and ClaudeBot, flags noai and noimageai directives used for AI training opt-outs, specific signals for Generative Engine Optimization (GEO), and identifies SPA shells that hide content from bots that don't execute JavaScript.
Who is BotLens for?
BotLens provides actionable insights for various stakeholders:
- Developers: Ensure your Next.js or React Router app doesn't look like a hollow shell to crawlers.
- SEO Practitioners: Surface the emerging AI-crawler landscape and see which clients are blocking ChatGPT or opting out of AI training.
- Content Teams: Ensure your articles are cited by Perplexity or answered by clearly represented by Claude.
- Site Owners: Quickly check if your CMS silently opted you out of AI training or blocked specific bots in a stale robots.txt file.
Get Started
BotLens is 100% free and open-source under the MIT license. It requires no account and runs entirely in your browser with no telemetry.
Install it now on Chrome, Edge, Brave, Arc, or Vivaldi via the Chrome Web Store or clone the repository for a developer-focused installation.
Value & Audience
Value Proposition
Get an actionable AI readability score for your website in seconds using a free, open-source Chrome extension.
Problem Solved
Helps users identify if their website content is accessible to AI crawlers (like GPTBot, Applebot-Extended) and detect issues like SPA shells that hide content were hidden from bots that do not execute JavaScript.
Target Audience
Use Cases
Tech Stack
Frontend
Other
Social & Links
Loading ratings...
Loading comments...
Gallery
Feedback & Roadmap
BotLens FAQ
Common questions about BotLens's features, pricing, and use cases
What does BotLens do?
Get an actionable AI readability score for your website in seconds using a free, open-source Chrome extension.
Is BotLens free to use?
BotLens offers a free tier alongside its other AI & Machine Learning plans. Pricing details are listed on the BotLens product page on TechLogHub.
What problem does BotLens solve?
Helps users identify if their website content is accessible to AI crawlers (like GPTBot, Applebot-Extended) and detect issues like SPA shells that hide content were hidden from bots that do not execute JavaScript.
Who is BotLens built for?
Developers, SEO practitioners, content teams, and content owners.
What tech stack does BotLens use?
BotLens is built with Manifest V3, Chromium, MIT License.
What category is BotLens listed under?
BotLens is listed in the AI & Machine Learning category on TechLogHub, alongside curated alternatives with community ratings and pricing comparisons.
BotLens appears in
You May Also Like
View all alternatives to BotLens
Meshio
AI social media content tool that scans your niche and delivers personalized post ideas for X, LinkedIn, and Threads.
View Product
Blotato - Social Media Automation & API
Blotato automates social media content creation and publishing across 9+ platforms in minutes.
View Product
Agentis
Trust and identity infrastructure for AI agents. Register your agents against a verified organisation, issue cryptographic DIDs, and give any counterparty a single endpoint to verify who built an agent and whether to trust it. Includes a tamper-evident audit chain developers can write to. Open source stack: proveyouragent (request signing), agentis-verify (FastAPI middleware), agentis-quickstart (end to end example).
View Product
PaioClaw — Setup Secure OpenClaw Agents in 60 Seconds
PaioClaw gives you a private, always-on AI assistant powered by your own API keys. No Docker, no command line — sign up and it's ready in 60 seconds.
View ProductOne email a week
TechLogHub tracks 510 tools and 471 open-source projects. Get the week's new launches, release roundups and open-source picks — nothing else.
Get the TechLogHub digest
One email a week: new and trending developer tools, fresh comparisons, and what shipped. Unsubscribe in one click.