Cloudflare’s Gen 13 servers double our compute throughput by rethinking the balance between cache and cores. Moving to high-core-count AMD EPYC ™ Turin CPUs, we traded large L3 cache for raw compute d
AI Summary
Cloudflare upgraded its server fleet to Gen 13, based on AMD EPYC 5th Gen Turin processors, which offer 2x core count improvements over Gen 12 but reduce per-core cache. FL2, a Rust-based rewrite of Cloudflare's request handling layer, was crucial in unlocking the performance potential of Gen 13 without latency penalties. By transitioning to a cleaner architecture with improved memory access, FL2 enabled 2x edge compute performance while maintaining service-level agreements (SLAs).