The Pulse: token spend breaks budgets – what next?
Large companies are struggling with the increasing cost of tokens, with one company seeing a 10x increase in token spend over six months. To address this issue, some companies are implementing limits on token spend or encouraging developers to use cheaper models such as Claude Sonnet. Others are exploring alternative solutions, such as pooled spend models, to manage costs. In mid-sized companies, some are taking a more proactive approach to managing AI spend by implementing model routing and measuring the impact of token usage on productivity and outcomes. For instance, a SaaS company reduced its costs by 30% by changing the default model, while a finance industry company is working to block expensive models and implement a pooled spend model to reduce costs.