Speaker
Abstract
Netflix Infrastructure supports personalized UI and Streaming experience across 230M+ members around the world. Spread across multiple locations, it’s important to have predictability and control over how user traffic is balanced across them, to ensure balance between latency, infrastructure costs, and availability risk.
This talk will tell a story of how Netflix has shifted from geo-based DNS load-balancing to latency-based approach, relying on real-user measurements and building a global data model of Netflix traffic to reduce costs while reducing latency and outage risks. We will cover challenges of integrating the solution into Cloud and CDN components of Netflix infrastructure, and trade-offs between model accuracy and traffic model complexity. The talk also demonstrates how the data-driven approach was applied to influence future infrastructure decisions, by simulating impact of potential infrastructure changes with precision and minimal engineering effort.
Topics
QCon New York 2023 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.
Part of the track
Architectures You've Always Wondered About Hosted by Sergey Fedorov Director of Engineering @NetflixFrom the same track
Tuesday 13 June
10:35 Salon A-C Session Architecture Using Traffic Modeling to Load-Balance Netflix Traffic at Global Scale Niosha Behnam, Sergey Fedorov Netflix Infrastructure supports personalized UI and Streaming experience across 230M+ members around the world. 11:50 Carroll Gardens Unconference Architecture Unconference: Architectures You've Always Wondered About Ben Linders Independent Consultant in Agile, Lean, Quality and Continuous Improvement What is an unconference? An unconference is a participant-driven meeting. Attendees come together, bringing their challenges and relying on the experience and know-how of their peers for solutions. 13:40 Salon A-C Session Architecture Global Capacity Management through Strategic Demand Allocation Ranjith Kumar S Software Engineer @Meta Meta currently operates in more than 15 data center regions around the world. This rapidly expanding global datacenter footprint poses new challenges for service owners as well as our infrastructure management systems. 14:55 Salon A-C Session Several Components are Rendering: Client Performance at Slack-Scale Jenna Zeigen Staff Engineer @Slack Our users expect the interactions in our applications and websites to be fast, no matter how complicated they are under the hood. In this talk, we’ll explore some frontend performance issues encountered by Slack as they continue to grow and evolve the desktop app. 16:10 Salon A-C Session Platform Building Sub-Second Latency Video Infrastructure at Cloudflare Renan Dincer Systems Engineer @Cloudflare Cloudflare has deployed a sub-second latency live streaming system at scale over the last few years. In this talk, we’ll provide insight on how this works under the cover, specifically focusing on protocols that Cloudflare Stream uses: HLS, DASH, RTMPS, SRT and WebRTC. 17:25 Salon A-C Session Architecture From Open Source to SaaS: The Journey of ClickHouse Sichen Zhao, Shane Andrade Have you ever wondered what it takes to go from an open-source project to a fully-fledged saas product? How about doing that in only 1 year’s time? If the answer is yes, then this talk is for you. You’ll hear straight from the experts who worked on the design, and execution of this huge project.