Crawlers

ChatGPT-User: user agent, robots.txt, and verification

ChatGPT-User handles certain user-directed page visits. It is not OpenAI’s automatic search crawler, and a request is not evidence that the person then opened your website in their own browser.

User agent and purpose

Documented purpose: User-requested retrieval.

ChatGPT-User/1.0 (documented token)

OpenAI’s reference describes this user-requested case separately from GPTBot and OAI-SearchBot.

Robots.txt control

User-agent: ChatGPT-User
Disallow: /

This expresses a preference, but OpenAI warns that robots.txt may not apply because a user initiates the action. Use normal authentication and access controls for private content; a robots rule is not an access-control mechanism.

Review this example in the context of your existing groups and paths. Publish it at the origin’s /robots.txt and check the actual response. A policy change can take time to be read; it does not erase earlier copies of content.

Verify origin before trusting the name

Check the actual source against OpenAI’s ChatGPT-User address feed. This guide does not assert a reverse-DNS verification method for it.

A User-Agent is self-reported and can be spoofed. A matching header is a claimed identity, not an authenticated bot. Use the operator’s current IP or DNS procedure for origin confidence; those checks are not cryptographic request signatures and do not authorize access to private data.

What AnalyticFast detects today

AnalyticFast currently recognizes the self-reported ChatGPT-User token on valid analytics ingest requests. Opt-in crawler aggregates count those requests only; they do not automatically observe every page fetch on your site. AnalyticFast does not authenticate bot identities or perform the IP/rDNS checks described here.

A useful next check

Keep user retrieval and browser referrals as separate observations. If your question is whether an answer led to a sale, inspect a recorded referral journey and payment match instead of interpreting fetch counts as visitors.

Official sources and review date

Last checked . Verify the latest policy and network data before changing production access rules.

Back to the crawler directory.

Questions, answered.

Does ChatGPT-User obey every robots.txt rule?

OpenAI says robots.txt rules may not apply to these user-initiated actions. Treat robots preferences separately from enforceable access controls.