SEP 8, 2026

In-House LLM Serving at Netflix

By AI Platform’s Model Runtime team and Inference teamIntroductionMost organizations consume LLMs through hosted APIs. Netflix went further — we run the full...

AI Distributed Systems Performance LLM APIs gRPC

Read full article →

MAPS: Netflix’s Multimodal Asset Personalization at Scale

By Emma Yanyang Kong, Aditya Deshpande, Asad Abbasi, Bowei Yan, David Fagnan, Ashish Rastogi, Dhaval Patel, Ray ZhangIntroductionThe Netflix experience is a...

StreamingScale

17 min

Netflix17d ago

A Tale of Two Flink Autoscalers

Samuel Yeboah, Francesco Di Chiara and Mingliang LiuToday, Netflix runs two Flink autoscalers. That is exactly one more than we want. We built the first one...

StreamingScale

11 min

NetflixAug 7, 2026

How and Why Netflix Built a Real-Time Distributed Graph: Part 3 — Querying the graph with gRPC…

How and Why Netflix Built a Real-Time Distributed Graph: Part 3 — Querying the graph with gRPC execution APIAuthors: Nilesh Mishra and Ajit KotiThis is the...

StreamingScale

24 min

Weekly Brief

Top 10 engineering articles delivered every Monday.