A one-line Kubernetes fix that saved 600 hours a year

Cloudflare has developed a new sandboxing technology, Dynamic Worker Loader, which is 100x faster than traditional containers. It uses isolates, instances of the V8 JavaScript execution engine, which take only a few milliseconds to start and use a few megabytes of memory, allowing for unlimited scalability and zero latency. This technology enables agents to write code on-demand, run it in a secure sandbox, and access specific APIs, all in a scalable and efficient manner.

Cloudflare upgraded its server fleet to Gen 13, based on AMD EPYC 5th Gen Turin processors, which offer 2x core count improvements over Gen 12 but reduce per-core cache. FL2, a Rust-based rewrite of Cloudflare's request handling layer, was crucial in unlocking the performance potential of Gen 13 without latency penalties. By transitioning to a cleaner architecture with improved memory access, FL2 enabled 2x edge compute performance while maintaining service-level agreements (SLAs).