SEP 1, 2026

Redirects for AI Training enforces canonical content

Soft directives don’t stop crawlers from ingesting deprecated content. Redirects for AI Training allows anybody on Cloudflare to redirect verified crawlers to...

Cloud AI Canonicalization Content Delivery SEO

Read full article →

Share Share

How we could save petabytes of cache storage with Zstandard and Pingora

Could we get more cache space with the same hardware? We prototyped compression inside Cloudflare's cache to find out.

NetworkingSecurity

1 min

Cloudflare1d ago

Introducing Adaptive Intelligence: undermining the economics of every bot attack

Bot operators have historically had the economic advantage, bypassing static, deterministic detection rules with cheap proxies and retooling. Cloudflare's new...

NetworkingSecurity

1 min

Weekly Brief

Top 10 engineering articles delivered every Monday.

Cloudflare4d ago

BotBase for Operators: A clearer path to joining Cloudflare's directory of bots and agents

Bot operators now have a home in the Cloudflare dashboard to manage submissions. This update adds submission status tracking, submission editing, and a...

NetworkingSecurity

1 min