Back to Blog

How to whitelist MirrorWeb on CloudFlare

Jamie Hoyle

Depending on your Cloudflare settings you may need to whitelist the MirrorWeb user agent to allow our crawlers to archive your site.

To whitelist MirrorWeb, login to Cloudflare, click Firewall and then click Firewall Rules.

On the next screen click Create a Firewall rule.

Give the firewall rule a name and select User Agent from Field dropdown, contains from the Operator dropdown and enter mirrorweb in the Value box. Then pick Allow from the Choose an Action dropdown. Apply this rule by clicking Deploy.

More from the Blog

MirrorWeb Modifies Crawling Process to Reduce Carbon footprint

A closer look at the changes MirrorWeb has made to its web crawling processes to improve energy efficiency.

Read Story

Communications Surveillance: A Company-wide Consideration

Outside of compliance teams, how does communications surveillance impact other critical roles within an organization?

Read Story

Feature Spotlight: Privileged and Marketing Addresses

We're ready to share the second in our MirrorWeb Insight Feature Spotlight series! This time, we'll take you though Privileged and Marketing Addresses.

Read Story

See what we can do for you.

Let us show you why MirrorWeb is trusted by organizations across the globe for their compliance and digital preservation needs.