OCT 23, 2026

In-House LLM Serving at Netflix

By AI Platform’s Model Runtime team and Inference teamIntroductionMost organizations consume LLMs through hosted APIs. Netflix went further — we run the full...

AI Distributed Systems Performance LLM APIs gRPC

Read full article →

Single-tenant Titus: VM-level isolation on a multi-tenant container platform

Samartha Chandrashekar & Nick ParkerYou click play on a Friday night, and in the second that follows, dozens of services answer in milliseconds. Most of them...

StreamingScale

31 min

Netflix6d ago

Ontology-Driven Observability: Building an End-to-End Knowledge Graph at Netflix Scale

Prasanna Vijayanathan, Renzo Sanchez-SilvaWhen Jake Paul and Mike Tyson stepped into the ring in November 2024, we delivered the fight to roughly 65 million...

StreamingScale

15 min

Weekly Brief

Top 10 engineering articles delivered every Monday.

Netflix8d ago

Integrating Netflix’s Foundation Model into Personalization applications

Authors: Divya Gadde, Ko-Jen Hsiao, Dhaval Patel and Moumita BhattacharyaThe motivation for building the Netflix Foundation Model for personalization was laid...

StreamingScale

9 min