User documentation
  1. What is redirection.io?
  2. Starter's guide
  3. What are organizations and projects?
  4. Invite new collaborators
  5. User account and preferences
  6. Using traffic logs
  7. Create a rule
  8. Triggers and markers reference
  9. Actions reference
  10. How to bulk-import or export redirection rules?
  11. Managing instances
  12. Project notifications
  13. Project segmentation
  14. How much does it cost?
  15. Can I use redirection.io for free?
  16. About us

Developer documentation
  1. TL;DR; Fast track
  2. Installation of the agent
  3. Upgrading the agent
  4. Agent configuration reference
  5. Available integrations
  6. The agent as a reverse proxy
  7. nginx module
  8. Apache module
  9. platform.sh integration
  10. Cloudflare Workers integration
  11. Fastly Compute@Edge integration
  12. Vercel Middleware Integration
  13. Using redirection.io with Docker
  14. How fast is it?
  15. Public API

Crawler
  1. What is the redirection.io crawler?
  2. Start a crawl
  3. Schedule a crawl
  4. Analyzing the results of a crawl
  5. The crawls list
  6. Crawl credits and pricing
  7. Crawl Errors
  8. Crawler metrics reference
  9. Crawler columns reference

Managed instances
  1. What are managed instances?
  2. Add a domain to your project
  3. Managed instances limits and quota
  4. Frequently asked questions

Knowledge base
  1. Create your first redirections
  2. redirection.io rules cookbook
  3. Setting up a redirection server on Azure Cloud
  4. Structured data and Rich Snippets
  5. What is a URL redirection?
  6. Why use URL redirections and how to setup

Legacy versions
  1. Agent 1.x configuration reference
  2. Legacy integrations
  3. Legacy Cloudflare Workers integration

Changelogs
  1. redirectionio-agent
  2. libnginx-mod-redirectionio
  3. libapache2-mod-redirectionio

The crawls list

The crawler is accessible to all plans. You can try it for free on a limited set of pages of your website on the crawler presentation page.

The crawls list is the place where you can see all the crawls that have been launched on your project. It gives you a global overview of the crawls, with some key metrics.

Crawls - List

Archive

redirection.io keeps the crawls without time limit, but in a limited quantity. The oldest crawls are automatically archived to keep the list clean. You can still access the archived crawls, but you can't analyze them anymore.

If you need a longer history of your past crawls, you can contact us.

Pinning a crawl

You can pin a crawl to keep it unarchived, even if it's old. This is useful if you want to keep track of a specific crawl, or if you want to compare it with another one.

Share a public crawls

You can turn a crawl as "public", which generates a public URL that you can share with your team or your clients. This is useful if you want to share the results of a crawl with a partner, without giving them access to the redirection.io project.

This page has been updated on Aug 28, 2025
Can't find your answer?