GralusBot, our crawler

What GralusBot is, what it fetches, and how to block it.

What it is

GralusBot fetches public pages of websites that a Gralus customer has added to their account, to check them for SEO problems such as broken links, missing titles and slow pages. It identifies itself with the user agent “GralusBot/0.1 (+https://gralus.com/bot)”.

How it behaves

  • It reads robots.txt first and skips every page that robots.txt disallows for GralusBot.
  • It waits about a second between requests to the same site.
  • It never logs in, submits forms or reads private areas.
  • A site is checked about once a week, and when the site's owner asks for a check.

Block it

Add this to your robots.txt:

  • User-agent: GralusBot
  • Disallow: /

If you think GralusBot is causing a problem on your site, write to us through the support page.

Still stuck? Write to support.