From weeks to a day: how we made LLM evaluation fast enough to iterate on

Training an LLM is the easy part. The hard part is designing experiments and evaluations that you can trust enough to know whether the new model is actually an...