Skip to content
Check my business

AEOHitBot

The crawler behind AEOHIT's site audits. If you found it in your server logs, this page explains what it does, when it visits, the robots.txt rules it follows and how to stop it. It reads public pages only, at most one request per second to a website, and never signs in or fills in forms.

How it identifies itself

Every request carries this user agent:

AEOHitBot/1.0 (+https://aeohit.com/bot)

When it visits

AEOHitBot reads a website only when someone uses AEOHIT for that website: an AEOHIT customer's site audit and fixes for their own brand's site, the free AI visibility grader, or the free AI crawler checker (which reads robots.txt only). It reads public pages to check what AI engines can see — page titles, structured data, FAQ content and llms.txt. It does not fill in forms, sign in, or follow links to other websites.

The rules it follows

  • It reads /robots.txt first and obeys it under the robots.txt standard (RFC 9309): the group that names AEOHitBot, otherwise the User-agent: * group.
  • If robots.txt answers with a server error or cannot be reached, it reads no pages from the site.
  • It uses a stored copy of robots.txt for at most 24 hours.
  • When it reads pages, it makes at most one request per second to a website, counted across every AEOHIT user.
  • It reads pages only over https on the audited site itself, and stops each audit at a fixed page limit.

How to block it

To keep AEOHitBot away from your whole site, add this to your robots.txt:

User-agent: AEOHitBot
Disallow: /

To keep it out of one part of the site only:

User-agent: AEOHitBot
Disallow: /private/

The change applies from the next audit, and within 24 hours at the latest.