论文

基于TSN的车辆边缘网络多智能体强化学习

Deadline-Aware Multi-Agent Reinforcement Learning for TSN-Based Vehicular Edge Networks

精选理由

清华团队提出MAPPO算法,解决车辆边缘网络中不同服务的延迟需求冲突,性能提升显著。

该研究提出了一种针对时间敏感网络(TSN)的车辆边缘网络队列级调度方法。每个TSN队列分配一个自主智能体,通过多智能体近端策略优化(MAPPO)算法联合学习队列服务顺序和时隙持续时间。与集中式单智能体方法相比,该方法可减少高达66.2%的服务延迟,提高271.8%的可靠性。

原文 · arXiv cs.AI

Deadline-Aware Multi-Agent Reinforcement Learning for TSN-Based Vehicular Edge Networks

Vehicular edge computing (VEC) enables latency-sensitive applications by bringing computing and networking resources closer to vehicles. However, existing approaches often overlook network contention among co-located services with heterogeneous and dynamic latency requirements. While time-sensitive networking (TSN) provides bounded-latency communication, conventional and reinforcement learning-based schedulers struggle to adapt to highly dynamic vehicular environments and inter-queue dependencies. To address these limitations, we propose a multi-agent reinforcement learning (MARL) approach for queue-level scheduling in TSN-enabled VEC. Each TSN queue is assigned an autonomous agent that jointly learns the queue service order and time-slot duration to minimize deadline misses under speed-dependent latency requirements. We employ multi-agent proximal policy optimization (MAPPO) to enable coordinated yet autonomous scheduling decisions. Evaluation against single-agent, multi-agent, and non-learning-based baselines shows that MAPPO provides robust performance across different traffic profiles. Compared with centralized single-agent methods, it reduces service latency by up to 66.2% and improves reliability by up to 271.8%. Furthermore, unlike urgency-based heuristics, MAPPO ensures balanced scheduling while achieving lower inference times compared to other MARL methods.