论文

联邦学习在移动网络中的LLM优化

Federated Learning for LLMs over Mobile Networks: Issues and Solutions in the RAN Transport

精选理由

这篇论文解决了移动网络中联邦学习的传输问题,提出了将异步更新转换为聚合传输的解决方案。

该研究探讨了在移动网络中使用联邦学习优化大型语言模型的问题。研究指出,无线变异性、移动性和设备异质性导致模型更新异步到达。传统传输网络将它们视为独立流量,隐藏了底层结构。研究提出,通过在gNB处进行网络内聚合,可以将异步UE更新转换为具有有限大小和交付要求的更少聚合传输。

原文 · arXiv cs.AI

Federated Learning for LLMs over Mobile Networks: Issues and Solutions in the RAN Transport

Federated LLM fine-tuning enables large models to be adapted using private and geographically distributed data at the network edge, creating recurring and deadline-sensitive communication workloads across access and transport networks. This challenge is particularly relevant in mobile RANs, where wireless variability, mobility, and device heterogeneity cause model updates to arrive asynchronously. Although these updates belong to the same learning round and share a common destination and deadline, conventional transport networks treat them as independent device-originated flows, hiding their underlying structure and limiting the ability to efficiently provision transport resources. This mismatch is particularly problematic for optical circuit switching and all-photonics transport, which benefit from predictable and schedulable traffic demands. We argue that future RANs should act as learning-aware traffic shapers by exposing the communication structure of distributed model adaptation to the transport layer. Through in-network aggregation at the gNB, asynchronous UE updates can be transformed into fewer aggregate transfers with bounded size and delivery requirements. Once shaped in this way, federated LLM traffic becomes a suitable candidate for selectively provisioned optical connectivity, where high-capacity paths can be established during aggregate-transfer windows and released between learning rounds. The resulting architecture combines the flexibility of packet-based mobile access with dynamically provisioned optical capacity, illustrating a broader approach for coordinating distributed AI workloads across programmable access and transport networks.