Using Traffic Modeling to Load-Balance Netflix Traffic at Global Scale

QCon New York 2023

Session Architecture

Using Traffic Modeling to Load-Balance Netflix Traffic at Global Scale

Tuesday Jun 13 / 10:35AM EDT, Salon A-C

Abstract

Netflix Infrastructure supports personalized UI and Streaming experience across 230M+ members around the world. Spread across multiple locations, it’s important to have predictability and control over how user traffic is balanced across them, to ensure balance between latency, infrastructure costs, and availability risk. 

This talk will tell a story of how Netflix has shifted from geo-based DNS load-balancing to latency-based approach, relying on real-user measurements and building a global data model of Netflix traffic to reduce costs while reducing latency and outage risks. We will cover challenges of integrating the solution into Cloud and CDN components of Netflix infrastructure, and trade-offs between model accuracy and traffic model complexity. The talk also demonstrates how the data-driven approach was applied to influence future infrastructure decisions, by simulating impact of potential infrastructure changes with precision and minimal engineering effort.

Topics

Architecture Platform Engineering Data Analytics Traffic Management Capacity Management
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon New York 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Tuesday 13 June

10:35 Salon A-C Session Architecture Using Traffic Modeling to Load-Balance Netflix Traffic at Global Scale Niosha Behnam, Sergey Fedorov 11:50 Carroll Gardens Unconference Architecture Unconference: Architectures You've Always Wondered About Ben Linders Independent Consultant in Agile, Lean, Quality and Continuous Improvement 13:40 Salon A-C Session Architecture Global Capacity Management through Strategic Demand Allocation Ranjith Kumar S Software Engineer @Meta 14:55 Salon A-C Session Several Components are Rendering: Client Performance at Slack-Scale Jenna Zeigen Staff Engineer @Slack 16:10 Salon A-C Session Platform Building Sub-Second Latency Video Infrastructure at Cloudflare Renan Dincer Systems Engineer @Cloudflare 17:25 Salon A-C Session Architecture From Open Source to SaaS: The Journey of ClickHouse Sichen Zhao, Shane Andrade