Back to Blog

How to whitelist MirrorWeb on CloudFlare

Jamie Hoyle

Depending on your Cloudflare settings you may need to whitelist the MirrorWeb user agent to allow our crawlers to archive your site.

To whitelist MirrorWeb, login to Cloudflare, click Firewall and then click Firewall Rules.

On the next screen click Create a Firewall rule.

Give the firewall rule a name and select User Agent from Field dropdown, contains from the Operator dropdown and enter mirrorweb in the Value box. Then pick Allow from the Choose an Action dropdown. Apply this rule by clicking Deploy.

More from the Blog

2024 So Far: Recordkeeping Revamps and Regulatory Rigor

An analysis of the intense regulatory activity we have seen so far from the SEC, FINRA and the FCA.

Read Story

Whatsapp Compliance, Self-Reporting, and Ripping off the Band-Aid

The SEC has incentivized firms to self-report on off-channel violations. We look into the process and its benefits.

Read Story

FINRA Report 2024: Recordkeeping Takeaways

Key recordkeeping teakeaways from the 2024 FINRA Annual Regulatory Oversight Report.

Read Story

See what we can do for you.

Let us show you why MirrorWeb is trusted by organizations across the globe for their compliance and digital preservation needs.