Crawlers

MistralAI-User: user agent, robots.txt, and verification

MistralAI-User retrieves pages for user actions in Mistral’s Vibe product. Mistral says it is not an automatic web crawler and is not used to collect generative-model training content.

User agent and purpose

Documented purpose: User-requested retrieval.

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-User/1.0; +https://docs.mistral.ai/robots)

Mistral’s crawler reference distinguishes MistralAI-User, MistralAI-Index, and MistralAI-Training. Treat their purposes independently.

Robots.txt control

User-agent: MistralAI-User
Disallow: /

This expresses a restriction for the user fetcher using the token Mistral documents for site preferences. The reference does not specify every robots parsing or enforcement edge case. Do not assume this controls MistralAI-Index or MistralAI-Training.

Review this example in the context of your existing groups and paths. Publish it at the origin’s /robots.txt and check the actual response. A policy change can take time to be read; it does not erase earlier copies of content.

Verify origin before trusting the name

Compare the source address with the official MistralAI-User IP list. Keep it fresh. This is a network-origin check, not cryptographic request authentication; no rDNS suffix is claimed here.

A User-Agent is self-reported and can be spoofed. A matching header is a claimed identity, not an authenticated bot. Use the operator’s current IP or DNS procedure for origin confidence; those checks are not cryptographic request signatures and do not authorize access to private data.

What AnalyticFast detects today

AnalyticFast does not currently classify MistralAI-User in its named crawler aggregate. This directory entry is research, not a claim of detection support. AnalyticFast does not authenticate bot identities or perform the IP/rDNS checks described here.

A useful next check

If a support or product page cannot be retrieved, check its public accessibility, robots group, and firewall independently. Successful retrieval still does not guarantee that a user will see a link or visit your site.

Official sources and review date

• Official Mistral crawler purposes and user-agent examples

Last checked 2026-10-31. Verify the latest policy and network data before changing production access rules.

Back to the crawler directory.