FTRL-WRR: Learning-based two-path scheduler for LEO networks

Date

2024

Authors

Li, Daoping

Journal Title

Journal ISSN

Volume Title

Publisher

Abstract

Multipath QUIC is inspired by the resource pooling principle, aiming to make a collection of resources behave as a single pool. However, current multipath schedulers tend to prioritize specific metrics like Round-Trip Time (RTT) or congestion window, often overlooking strategies that enhance overall resource usage and reduce flow completion time. This can lead to resource underutilization in high dynamic settings, such as those involving Low Earth Orbit (LEO) satellites. Addressing this challenge requires efficient traffic allocation to maximize bandwidth utilization. In this thesis, we verify that the relationship between traffic distribution and throughput in a two-path scenario resembles a quasi-concave function. Accordingly, we formulate the traffic allocation across two paths as a 1-dimensional optimization problem. To solve the two-path scheduling problem in dynamic environments, we introduce the FTRL-WRR algorithm. This approach integrates a Follow The Regularized Leader (FTRL) learner, ADWIN2 distribution change detector, and Weighted Round Robin (WRR) scheduler to enhance bandwidth utilization. We validate the effectiveness of the algorithm through extensive emulation and real-world testbed experiments, demonstrating consistent reduction in completion time across a range of scenarios. Additionally, we discuss the algorithm's limitations and suggest directions for future research.

Description

Keywords

Two-path scheduling, QUIC, Starlink, LEO satellite, Bandit convex optimization

Citation