Schedule a crawl

Scheduling a crawl allows to run it on a regular basis. The results of the crawl will be available under the "Crawls" tab, as if it add been manually triggered.

Running crawls regularly helps you to keep track of the evolution of your website and be informed of regressions, new issues, etc.

Crawl - Setup a scheduled crawl

All the settings of the crawl can be configured as for a manual crawl. But you can also choose the frequency of the crawl, which can be set to:

  • daily
  • weekly
  • or monthly

Once a crawl is finished, you can analyze the results.

You can get notified when a crawl is finished by setting up a notification channel. In the case of weekly or monthly crawls, this can be useful to be informed of the results directly in your mailbox and keep an eye on the evolution of your website.

This page has been updated on August 26th, 2024.
Can't find your answer?