Twitch replaces HAProxy with Intelligest across nearly 100 PoPs
Twitch has developed and deployed "Intelligest," a proprietary ingest routing system designed to intelligently distribute live video streams from edge points of presence (PoPs) to origin data centers. This system replaces HAProxy, aiming to optimize infrastructure resource utilization, improve cost efficiency, and enhance operational availability and extensibility for new streaming capabilities. Intelligest functions with a media proxy at each PoP and a routing service in AWS, leveraging real-time data on compute and network resources.
Key Takeaways
- Twitch says its network spans nearly 100 points of presence (PoPs) connected to a private backbone network.
- Intelligest replaces HAProxy, which previously statically forwarded streams from each PoP to one origin.
- The system has two parts: Intelligest media proxy in each PoP and Intelligest Routing Service (IRS) running in AWS.
- Capacitor tracks compute capacity at every origin, while The Well monitors backbone network link utilization and availability.
- Twitch says IRS can automatically redirect new live streams during origin failure scenarios, including compute loss or network loss.
Why It Matters
Intelligest gives Twitch a way to route ingest traffic based on current compute and network conditions instead of fixed HAProxy rules. That matters immediately for utilization and availability: Twitch says the system can better balance cyclical broadcast demand, handle sudden traffic surges, and reroute around origin failures. The broader signal is that Twitch is moving more control into a stateful routing layer in AWS while keeping media handling at the PoP edge, and the architecture is modular enough to support new protocols and stream-processing features. The next concrete signal to watch is whether Twitch expands the number of failure modes and routing rules IRS can react to beyond origin compute and backbone link issues.
Read full article at blog.twitch.tv