Why ChatGPT can’t see your website

We checked about 80 websites

Recently we went through a list of about 80 local business websites — restaurants, auto studios, clinics, service companies. The test was simple: can ChatGPT or Claude open the site and read what the business does?

~70%

of the sites didn’t let the AI assistants in — protection blocked them at the door. To ChatGPT and Claude, those businesses simply don’t exist.

Our own spot check, not a scientific study.

Meanwhile 45% of people used AI assistants for local business recommendations in the past year, up from just 6% the year before (BrightLocal, 2026). Customers are already asking. The website isn’t answering.

Why a site blocks AI

Most of the time the owner has no idea. The usual reasons:

The first is default protection. Since July 1, 2025, Cloudflare blocks AI bots by default on the sites it hosts unless the owner allows them (MIT Technology Review), and many hosting firewalls behave the same way.
Then there’s an old robots.txt: rules copied years ago, or a blanket “block everything unknown”, catch AI bots too.
Some sites run on an old site builder: text loads through scripts or is baked into images, so a bot opens the page and finds nothing to read.
Often there are no facts in a readable form. Address, hours, services and prices aren’t marked up with structured data, so the AI isn’t sure it understood and recommends a competitor.

The consequences are direct. OpenAI’s documentation says sites that opt out of OAI-SearchBot will not be shown in ChatGPT search answers (OpenAI).

A 2016 website vs. a 2026 one

The old tricks stopped working; the new ones are just starting to. Sites built 5–10 years ago don’t need a touch-up. They need a full upgrade:

	2016 website	2026 standard
Who finds you	Google only	Google, Google Maps, ChatGPT, Claude, Perplexity, Siri
Bot access	Blocked or accidental	AI search bots explicitly allowed
Content	Keywords for the sake of keywords	Answers to customers’ real questions
Facts	Address and hours in an image	Structured data (schema.org)
Mobile	A shrunk desktop page	Phone-first, loads in seconds
Photos	Stock images	Real, on-site, also on Google Maps
Accessibility	Not considered	WCAG 2.1 AA, lower legal risk

Check your site in 2 minutes

Open yoursite.com/robots.txt in a browser. If GPTBot, OAI-SearchBot, ClaudeBot or PerplexityBot sits next to Disallow: /, those AIs can’t get in.
Ask ChatGPT or Perplexity: “What is [your business name] in [your city]?” A vague or wrong answer means the AI can’t read the site, or can’t find the facts on it.
Ask like a customer would: “Recommend a [your service] in [your city].” Are you in the answer? Are your competitors?
Run the site through Google PageSpeed on mobile. Red scores mean people leave before they see what you offer.

One important detail: you can allow AI search while blocking model training on your content. OpenAI uses separate bots: OAI-SearchBot surfaces sites in ChatGPT search, while GPTBot collects training data. Anthropic and Perplexity split theirs in a similar way. Blocking everything means disappearing from the answers.

The 2026 website checklist

AI search bots are allowed in robots.txt and not blocked by a firewall.
Address, hours, phone, services and prices are marked up with schema.org.
Your name, address and phone match across Google, Yelp, Apple Maps and Bing, because AI cross-checks them.
There are pages that answer customers’ real questions, the kind AI quotes.
Text is real text, not images, and the site is fast on a phone.
Fresh, real photos, some of them on Google Maps.
Accessibility meets WCAG 2.1 AA, with the legal pages in place.
Google Search Console and analytics are connected, so you can see where people come from.

Every site we build passes this checklist. It’s part of our website package. Not sure where yours stands? Start with the $490 business analysis, which is credited toward the website.

Common questions

How do I know if ChatGPT can read my website?

Open yourdomain.com/robots.txt and look for GPTBot, OAI-SearchBot, ClaudeBot or PerplexityBot next to “Disallow: /”. Then ask ChatGPT or Perplexity to describe your business and recommend a business like yours in your city. If it can’t, something is blocking it or your site doesn’t give it the facts.

Why would my site block AI if I never set that up?

Often it’s a default. Since July 1, 2025, Cloudflare blocks AI bots by default unless the owner allows them, and many hosting firewalls and old robots.txt rules do the same.

Can I allow AI search but not AI training?

Yes. OpenAI uses separate crawlers: OAI-SearchBot for showing sites in ChatGPT search and GPTBot for model training. You can allow the first and block the second. Anthropic and Perplexity separate their bots too.

Book the $490 analysis → Discuss on WhatsApp

Another guide

One customer from Google can pay for your website. Here’s the math.

A calculator for high-ticket businesses: when a website pays for itself and what it brings in over three years.