Cloudflare Workflows, a durable execution engine for multi-step applications, now supports higher concurrency and creation rate limits through a rearchitectured control plane, helping scale to meet th
AI Summary
Cloudflare rearchitected the control plane of its Workflows engine to support high-concurrency workflows triggered by autonomous agents. This change allows agents to spawn thousands of workflow instances per second, significantly increasing the system's velocity and throughput. Key to the redesigned control plane are the new components SousChef and Gatekeeper, which enable horizontal scalability and alleviate bottlenecks that limited the original architecture. The redesign includes increased limits: 50,000 concurrent instances, 300 instances per second per account, and 2 million queued instances per workflow, compared to 4,500 concurrency slots and 100 instance creations per 10 seconds in the original system.
Get the top 10 engineering articles delivered every Monday.