###
计算机系统应用英文版:2023,32(11):203-211
本文二维码信息
码上扫一扫!
基于改进MADDPG的UAV轨迹和计算卸载联合优化算法
(1.西安工业大学 计算机科学与工程学院, 西安 710021;2.西安工业大学 兵器科学与技术学院, 西安 710021)
Joint Optimization Algorithm for UAV Trajectory and Computational Offloading Based on Improved MADDPG
(1.School of Computer Science and Engineering, Xi’an Technological University, Xi’an 710021, China;2.School of Ordnance Science and Technology, Xi’an Technological University, Xi’an 710021, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 691次   下载 2056
Received:April 08, 2023    Revised:May 11, 2023
中文摘要: 在地震、台风、洪水、泥石流等造成严重破坏的灾区, 无人机(unmanned aerial vehicle, UAV)可以作为空中边缘服务器为地面移动终端提供服务, 由于单无人机有限的计算和存储能力, 难以实时满足复杂的计算密集型任务. 本文首先研究了一个多无人机辅助移动边缘计算模型, 并构建了数学模型; 然后建立部分可观察马尔可夫决策过程, 提出了基于复合优先经验回放采样方法的MADDPG算法(composite priority multi-agent deep deterministic policy gradient, CoP-MADDPG)对无人机的时延能耗以及飞行轨迹进行联合优化; 最后, 仿真实验结果表明, 本文所提出算法的总奖励收敛速度和收敛值均优于其他基准算法, 且可为90%左右的地面移动终端提供服务, 证明了本文算法的有效性与实用性.
Abstract:Unmanned aerial vehicles (UAVs) can act as air edge servers to provide services for ground mobile terminals in disaster areas where earthquakes, typhoons, floods, and mudslides have caused severe damage. However, it is difficult to complete complex computationally intensive tasks in real time due to the limited computation and storage capacity of a single UAV. In this study, a multi-UAV-assisted mobile edge computing model is first investigated and a mathematical model is built. Then a partially observable Markov decision process is established and an improved multi-agent deep deterministic policy gradient (MADDPG) algorithm based on the composite priority experiential replay sampling method (CoP-MADDPG) is proposed to jointly optimize time delay, energy consumption, and flight trajectory of UAVs. Finally, the simulation experimental results show that the proposed algorithm outperforms other benchmark algorithms in terms of total reward convergence speed and convergence value, and can provide services for about 90% of ground mobile terminals, proving the effectiveness and practicality of the proposed algorithm.
文章编号:     中图分类号:    文献标志码:
基金项目:航天高可信嵌入式软件工程技术实验室基金; 西安市碑林区科技计划(GX2137)
引用文本:
苏维亚,徐飞,王森.基于改进MADDPG的UAV轨迹和计算卸载联合优化算法.计算机系统应用,2023,32(11):203-211
SU Wei-Ya,XU Fei,WANG Sen.Joint Optimization Algorithm for UAV Trajectory and Computational Offloading Based on Improved MADDPG.COMPUTER SYSTEMS APPLICATIONS,2023,32(11):203-211