Back to Blog

How to whitelist MirrorWeb on CloudFlare

Jamie Hoyle

Depending on your Cloudflare settings you may need to whitelist the MirrorWeb user agent to allow our crawlers to archive your site.

To whitelist MirrorWeb, login to Cloudflare, click Firewall and then click Firewall Rules.

On the next screen click Create a Firewall rule.

Give the firewall rule a name and select User Agent from Field dropdown, contains from the Operator dropdown and enter mirrorweb in the Value box. Then pick Allow from the Choose an Action dropdown. Apply this rule by clicking Deploy.

More from the Blog

2023 Data Archiving Trends

A look at the factors shaping digital archiving in 2023, and where it is heading.

Read Story

What License Type Do I Need in Order to Archive Microsoft Teams?

Microsoft has recently updated the licensing requirements for compliance vendors capturing data from their Teams platform.

Read Story

Financial Services’ Inconvenient Need for WhatsApp Archiving

The financial services sector has recently been hit with huge fines over the widespread use of apps like WhatsApp. How did we get to this stage, and what options do firms now have to avoid these penalties?

Read Story

See what we can do for you.

Let us show you why MirrorWeb is trusted by organizations across the globe for their compliance and digital preservation needs.