Book a callFree audit
Menu
Get my free auditBook a 30-min call

Free tool · 30 seconds

Can ChatGPT and Google AI Read Your Website?

Enter your website. See whether Google, Bing, ChatGPT, Claude and Perplexity are allowed to read it, which rule decides it, and get a fixed robots.txt if something is blocked. Also checks for llms.txt and your sitemap. Free.

Example: results for a made-up robots.txt. Check your own site below.

We fetch your site’s public robots.txt and llms.txt once to check them. We don’t store the address or the files.

Who can read your site

Files AI tools look for
    Fixed robots.txt

    Keeps your own rules, lets AI search tools in, and handles AI training the way you choose.

    AI training crawlers
    Check it with whoever manages your website before replacing your file. It lives at yourbusiness.com/robots.txt.
    How It Works
    Three Steps, No Sign-Up
    STEP 1Enter your website
    Type your website address, or paste your robots.txt if your site isn’t live yet.
    STEP 2See who can read it
    Every search engine and AI crawler shows as allowed or blocked, with the rule that decides it.
    STEP 3Fix and replace
    Copy the fixed robots.txt and ask whoever runs your website to replace the old one.
    FAQ
    AI Crawler Questions
    Ask us anything
    What is robots.txt?
    A small text file at yourdomain.com/robots.txt that tells crawlers which parts of your site they may read. Search engines and the big AI companies check it before crawling.
    Which AI crawlers should I allow?
    To show up in AI answers, allow the AI search crawlers: OAI-SearchBot for ChatGPT search, Claude-SearchBot and PerplexityBot. Keep Googlebot and Bingbot allowed too, because Google’s AI Overviews and Microsoft Copilot are built on them. Training crawlers such as GPTBot and ClaudeBot are your choice.
    Does blocking GPTBot hide me from ChatGPT?
    Not from ChatGPT search. OpenAI uses GPTBot for training and OAI-SearchBot for search, and each setting is separate. Sites that block OAI-SearchBot won’t be shown in ChatGPT search answers.
    My robots.txt allows them. Can they still be blocked?
    Yes. Firewalls and bot protection, such as Cloudflare’s AI bot settings, can turn crawlers away before they read robots.txt. If this checker says your site refused it, check your host’s bot settings.
    What is llms.txt?
    A newer, proposed standard: a short file at yourdomain.com/llms.txt that summarizes your business for AI tools. Some AI tools read it and some don’t yet. Our free generator makes one.
    Do you store my website address?
    No. We fetch your site’s public robots.txt and llms.txt once to check them, and we don’t keep the address or the files. Rules you paste are checked in your browser.
    More free tools:Does AI recommend you?Where does AI get its answers?Create schema and llms.txtScore your Google Business ProfileCheck your business descriptionSee what your profile brings inMake a review link and QR codeHow many 5-star reviews do you need?Reply to reviews in secondsIs the way you ask allowed?Check your listings matchIs your city still open?All free tools →
    Related:GBP checklistCitation buildingAI search (GEO)Pricing
    Get Started
    Want AI Tools to Recommend You?
    Letting AI crawlers in is step one. GEO is in every plan: clear pages, schema, consistent listings and reviews, so AI tools understand and recommend you. Start with a free 189-point audit.
    
Get my free audit
Book a 30-min call

    hello@klimbiq.com · Reply within 24 hours, US business hours (Eastern Time)
    Get my free audit