GralusBot, our crawler
What GralusBot is, what it fetches, and how to block it.
What it is
GralusBot fetches public pages of websites that a Gralus customer has added to their account, to check them for SEO problems such as broken links, missing titles and slow pages. It identifies itself with the user agent “GralusBot/0.1 (+https://gralus.com/bot)”.
How it behaves
- It reads robots.txt first and skips every page that robots.txt disallows for GralusBot.
- It waits about a second between requests to the same site.
- It never logs in, submits forms or reads private areas.
- A site is checked about once a week, and when the site's owner asks for a check.
Block it
Add this to your robots.txt:
- User-agent: GralusBot
- Disallow: /
If you think GralusBot is causing a problem on your site, write to us through the support page.
Still stuck? Write to support.