Joint adaptive transmission and numerology selection for 5G NR PDSCH with DQN-based reinforcement learning solution
dc.contributor.author | San, Thet Naung | |
dc.contributor.supervisor | Yang, Hong-Chuan | |
dc.date.accessioned | 2024-11-04T18:15:45Z | |
dc.date.available | 2024-11-04T18:15:45Z | |
dc.date.issued | 2024 | |
dc.degree.department | Department of Electrical and Computer Engineering | |
dc.degree.level | Master of Engineering MEng | |
dc.description.abstract | The mission critical applications such as industrial automation, remote surgery and autonomous transportation systems demand low-latency, high-reliability communications service. As such, there is an urgent need to optimize transmission technologies in 5G New Radio (NR) to support Ultra-Reliable Low-Latency Communication (URLLC). This project introduces a joint adaptive transmission and numerology selection scheme for Physical Downlink Shared Channel (PDSCH) in 5G NR, targeting URLLC support. The transmission scheme selection problem is modeled as a Markov Decision Process (MDP). A Deep Q-Network (DQN) reinforcement learning agent is trained to dynamically adjust Modulation and Coding Scheme (MCS) and numerology based on real-time channel conditions and latency constraints. To evaluate the performance, we develop custom simulation environment by implementing PDSCH transmission model under frequency-selective fading channels, incorporating the Hybrid Automatic Repeat reQuest (HARQ) mechanism. The results demonstrate that the DQN agent effectively reduces transmission delays and improves reliability by optimizing transmission parameters. This approach enhances performance for 5G NR in URLLC support, achieving both higher reliability and lower latency than conventional adaptive transmission system. | |
dc.description.scholarlevel | Graduate | |
dc.identifier.uri | https://hdl.handle.net/1828/20713 | |
dc.language.iso | en | |
dc.subject | 5G New Radio (NR) | |
dc.subject | Ultra-Reliable Low-Latency Communication (URLLC) | |
dc.subject | Physical Downlink Shared Channel (PDSCH) | |
dc.subject | Deep Q-Network (DQN) | |
dc.subject | reinforcement learning | |
dc.subject | adaptive transmission | |
dc.subject | numerology selection | |
dc.subject | Modulation and Coding Scheme (MCS) | |
dc.subject | Markov Decision Process (MDP) | |
dc.subject | Hybrid Automatic Repeat reQuest (HARQ) | |
dc.subject | latency optimization | |
dc.subject | reliability in 5G | |
dc.title | Joint adaptive transmission and numerology selection for 5G NR PDSCH with DQN-based reinforcement learning solution | |
dc.type | project |