Documentation · Letting our agent through your CDN · Cloudflare

Allowing our agent through Cloudflare

On Cloudflare, our agent is let through with one custom rule: it matches our user agent and our addresses together, and its Skip action passes the request over Super Bot Fight Mode, rate limiting and Browser Integrity Check. The free plan’s Bot Fight Mode cannot be skipped by a rule, so on that plan an IP access rule does the job instead.

What to match

Match both, never the user agent alone: anyone can send our user agent, but only we send it from those addresses. The current addresses are also listed on our agent page.

What you need

Setting it up

  1. 1. Create a list of our addresses

    In your account, go to Settings, Configurations, Lists, and choose Create new list. Name it ottom_agent, choose the IP type, and add each address from the file above.

  2. 2. Create a custom rule

    In the zone, go to Security rules, choose Create rule, then Custom rules. Name it Allow Ottom agent. Choose Edit expression and paste the expression below. starts_with is a function and is case sensitive, so type it exactly.

    (ip.src in $ottom_agent and starts_with(http.user_agent, "OttomAgent/"))
  3. 3. Choose what it skips

    Set the action to Skip. Tick All Super Bot Fight Mode rules and All rate limiting rules. Under More components to skip, tick Browser Integrity Check and Security Level: skipping a whole phase does not skip Browser Integrity Check. Leave All managed rules unticked, so the managed rules that look for attacks still inspect our requests. Tick All remaining custom rules only if a custom rule of your own challenges bots.

  4. 4. On the free plan, add an IP access rule

    Bot Fight Mode cannot be skipped by a custom rule. Cloudflare does not run it when an IP access rule matches first, so in Security rules choose Create rule, then IP access rules, and add each address from the file with the action Allow. This rule matches the address alone, and an Allow here also passes custom rules and managed rules, so add only the addresses in the file. The alternative is to turn Bot Fight Mode off.

  5. 5. Put the rule first and deploy it

    Drag the rule to the top of your custom rules, so no rule above it challenges the request first, and choose Deploy.

Checking it works

Run a scan of your store from your Ottom dashboard. When the rule works, the report has no bot protection finding and the agent reaches your products. In your zone’s security events, filter on the user agent starting with our token: the rule shows as the one that matched, with the action Skip.

When a scan is still blocked

Good to know

Cloudflare documentation

Menus move. If a name here no longer matches your dashboard, these are the pages we checked this guide against:

Questions

Why not an IP access rule on every plan?

It matches the address alone and passes your managed rules too. The custom rule matches the address and the user agent, and skips only the bot checks, which is the narrower opening. On the free plan the IP access rule is the only way past Bot Fight Mode short of turning it off.

What about Cloudflare’s verified bots setting?

This rule does not depend on it. It lets our agent through whatever your verified bots setting is, and changes nothing for any other bot.

The same rule for other providers, and why it is safe: the CDN guides.