Citation: | GUO Yang, GAO Yuan, CHENG Shaochi, WANG Xiaonan. Optimization Control Strategy for Low-Altitude and Single-Layer Unmanned Aerial Vehicle Network Coverage[J]. Journal of Southwest Jiaotong University, 2024, 59(4): 890-897. doi: 10.3969/j.issn.0258-2724.20230535 |
In order to study the autonomous control problem of unmanned aerial vehicle (UAV) networks in emergency communication scenarios, multiple rotary-wing UAVs equipped with 6G base stations were used, and a low-altitude and single-layer UAV network was formed through the interconnection between UAVs, thus providing wireless network services to users in the ground task area. A numerical model was constructed for typical scenarios, and a multi-agent reinforcement learning method was used to solve the optimization control strategy of the UAV network. The effects of the number of UAV base stations and the communication distance of UAV base stations on the wireless network coverage in the task area were investigated. The research results indicate that the optimization control strategy obtained by using reinforcement learning methods can converge well. The learning curves of the UAV network coverage score and fairness coverage index have similar trends. The curves rapidly increase between the 1000th and 2000th episode and then change slowly. Under the conditions of a communication coverage distance of 1 km and a flight altitude of 300 m for UAV base stations, the UAV network coverage score increases by 53.28%, and the fairness coverage index increases by 43.57% when the number of UAV base stations increases from 3 to 7. Under the condition of five UAV base stations and a flight altitude of 300 m, the UAV network coverage score increases by 86.01%, and the fairness coverage index increases by 41.47% when the communication distance of the base stations increases from 1.0 km to 2.5 km.
[1] |
陈新颖,盛敏,李博,等. 面向6G的无人机通信综述[J]. 电子与信息学报,2022,44(3): 781-789. doi: 10.11999/JEIT210789
CHEN Xinying, SHENG Min, LI Bo, et al. Survey on unmanned aerial vehicle communications for 6G[J]. Journal of Electronics & Information Technology, 2022, 44(3): 781-789. doi: 10.11999/JEIT210789
|
[2] |
向庭立,王红军,杨刚,等. 分布式无人机网络覆盖优化算法[J]. 空军工程大学学报(自然科学版),2019,20(4): 59-65.
XIANG Tingli, WANG Hongjun, YANG Gang, et al. Research on distributed UAV network coverage optimization algorithm[J]. Journal of Air Force Engineering University (Natural Science Edition), 2019, 20(4): 59-65.
|
[3] |
王巍,梁雅静,刘阳,等. 城市灾区无人机网络自适应覆盖优化算法[J]. 计算机工程与应用,2022,58(14): 258-268. doi: 10.3778/j.issn.1002-8331.2010-0211
WANG Wei, LIANG Yajing, LIU Yang, et al. Adaptive coverage optimization algorithm for drone network in urban disaster areas[J]. Computer Engineering and Applications, 2022, 58(14): 258-268. doi: 10.3778/j.issn.1002-8331.2010-0211
|
[4] |
王超. 基于强化学习的无线网络移动性管理技术研究[D]. 合肥: 中国科学技术大学,2021.
|
[5] |
靳晓洁,石建迈,伍国华,等. 无人机基站部署问题综述:模型与算法[J]. 控制理论与应用,2022,39(12): 2219-2232.
JIN Xiaojie, SHI Jianmai, WU Guohua, et al. Review of the UAV base station deployment problem: models and algorithms[J]. Control Theory & Applications, 2022, 39(12): 2219-2232.
|
[6] |
郭艺轩,贾向东,曹胜男,等. 三维动态无人机网络覆盖性能与信道容量分析[J]. 重庆邮电大学学报(自然科学版),2022,34(4): 662-668. doi: 10.3979/j.issn.1673-825X.202101080012
GUO Yixuan, JIA Xiangdong, CAO Shengnan, et al. Analysis of 3D dynamic UAV network coverage performance and channel capacity[J]. Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition), 2022, 34(4): 662-668. doi: 10.3979/j.issn.1673-825X.202101080012
|
[7] |
吕忠昊. 基于强化学习的无人机通信系统容量优化研究[D]. 合肥: 中国科学技术大学,2021.
|
[8] |
蒋逸凡,郭婧,费泽松. 多层高度的无人机-地面异构网络的覆盖性能[J]. 无线电通信技术,2021,47(5): 649-654. doi: 10.3969/j.issn.1003-3114.2021.05.020
JIANG Yifan, GUO Jing, FEI Zesong. Coverage performance of UAV-terrestrial heterogeneous network with multiple altitudes[J]. Radio Communications Technology, 2021, 47(5): 649-654. doi: 10.3969/j.issn.1003-3114.2021.05.020
|
[9] |
崔壮壮. 面向空地通信的无线信道特性和建模研究[D]. 北京: 北京交通大学,2022.
|
[10] |
马张枫. 面向B5G/6G无线网络的无人机信道建模研究[D]. 北京: 北京交通大学,2022.
|
[11] |
王莉,魏青,徐连明,等. 面向通信-导航-感知一体化的应急无人机网络低能耗部署研究[J]. 通信学报,2022,43(7): 1-20.
WANG Li, WEI Qing, XU Lianming, et al. Research on low-energy-consumption deployment of emergency UAV network for integrated communication-navigating-sensing[J]. Journal on Communications, 2022, 43(7): 1-20.
|
[12] |
夏景明,刘玉风,谈玲. 基于蜂窝网络的多无人机能量消耗最优化算法研究[J]. 通信学报,2023,44(2): 185-197.
XIA Jingming, LIU Yufeng, TAN Ling. Research on multi-UAV energy consumption optimization algorithm for cellular-connected network[J]. Journal on Communications, 2023, 44(2): 185-197.
|
[13] |
窦邵婷. 无人机辅助移动边缘计算的空地能耗折衷研究[D]. 南昌: 南昌大学,2022.
|
[14] |
LIU C H, CHEN Z Y, TANG J, et al. Energy-efficient UAV control for effective and fair communication coverage: a deep reinforcement learning approach[J]. IEEE Journal on Selected Areas in Communications, 2018, 36(9): 2059-2070. doi: 10.1109/JSAC.2018.2864373
|
[15] |
LIU C H, MA X X, GAO X D, et al. Distributed energy-efficient multi-UAV navigation for long-term communication coverage by deep reinforcement learning[J]. IEEE Transactions on Mobile Computing, 2020, 19(6): 1274-1285. doi: 10.1109/TMC.2019.2908171
|
[16] |
QI H, HU Z Q, HUANG H, et al. Energy efficient 3-D UAV control for persistent communication service and fairness: a deep reinforcement learning approach[J]. IEEE Access, 2020, 8: 53172-53184. doi: 10.1109/ACCESS.2020.2981403
|
[17] |
JAIN R K, CHIU D M W, HAWE W R. A quantitative measure of fairness and discrimination for resource allocation in shared computer system[R]. Hudson MA: Digital Equipment Corporation, 1984.
|
[18] |
LOWE R, WU Y, TAMAR A, et al. Multi-agent actor-critic for mixed cooperative-competitive environments [C]//Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach: ACM, 2017: 6382-6393.
|
[1] | YANG Da, FENG Tingwei, ZHONG Jiayue, ZHENG Bin, YANG Guo. Research on Lane Selection of Automated Vehicles Group in Front of Intersections Based on Intelligent Vehicle Infrastructure Cooperative Systems[J]. Journal of Southwest Jiaotong University. doi: 10.3969/j.issn.0258-2724.20230216 |
[2] | WU Xinwei, HU Minghua, MAO Jizhi, WANG Yang. Collaborative Target Azimuth Perception Algorithm of Unmanned Aerial Vehicles Based on Spatial Spectrum Estimation[J]. Journal of Southwest Jiaotong University, 2024, 59(4): 898-906, 932. doi: 10.3969/j.issn.0258-2724.20230438 |
[3] | CUI Yaping, YING Zhaopeng, HE Peng, ZHENG Yufeng, WU Dapeng, WANG Ruyan, CHEN Luo. Ultra-Reliable Low-Latency Communication Multi-Unmanned Aerial Vehicle Network Assisted by Intelligent Reflecting Surface in Air[J]. Journal of Southwest Jiaotong University, 2024, 59(4): 907-916. doi: 10.3969/j.issn.0258-2724.20230288 |
[4] | ZHOU Jingxuan, BAO Weidong, WANG Ji, ZHANG Dayu. Multi-Task Federated Learning for Unmanned Aerial Vehicle Swarms Based on Encoder-Decoder Architecture[J]. Journal of Southwest Jiaotong University, 2024, 59(4): 933-941. doi: 10.3969/j.issn.0258-2724.20230539 |
[5] | YE Qibin, XIAO Hongyu, TIAN Chen, LIU Ming, FU Yunlin, HU Su. Self-Interference Cancellation Technology of Integrated Sensing and Communications System for Unmanned Aerial Vehicles[J]. Journal of Southwest Jiaotong University, 2024, 59(4): 925-932. doi: 10.3969/j.issn.0258-2724.20230599 |
[6] | QIN Qiancong, WU Guanlin, GAO Yuan, WANG Shuangshuang, LI Peng. Distributed Storage Methods for Unmanned Aerial Vehicle Clusters in Battlefield[J]. Journal of Southwest Jiaotong University, 2024, 59(4): 942-958. doi: 10.3969/j.issn.0258-2724.20230521 |
[7] | LIU Hongen, HU Minsheng, HU Hailin. Reinforcement Learning Braking Control of Maglev Trains Based on Self-Learning of Hybrid Braking Features[J]. Journal of Southwest Jiaotong University, 2024, 59(4): 839-847. doi: 10.3969/j.issn.0258-2724.20230517 |
[8] | ZHANG Xianyu, CHEN Yong, ZHANG Yu, YANG Hua. Joint Optimization of Resource Allocation and Deployment Location in Unmanned Aerial Vehicle-Assisted Communication[J]. Journal of Southwest Jiaotong University, 2024, 59(4): 917-924. doi: 10.3969/j.issn.0258-2724.20230400 |
[9] | JU Honghao, CHENG Kaijun, DENG Cailian, YAN Xuezhen, YIN Baolin, LONG Yan, FANG Xuming. A Survey on Air-Ground Networks of Unmanned Aerial Vehicles[J]. Journal of Southwest Jiaotong University, 2024, 59(4): 877-889. doi: 10.3969/j.issn.0258-2724.20230646 |
[10] | WANG Jialiang, DONG Kai, GU Zhaojun, CHEN Hui, HAN Qiang. Recognition Algorithm of Safe Obstacle Avoidance Domain for UAVs Based on Maximization Idea[J]. Journal of Southwest Jiaotong University, 2023, 58(6): 1267-1276. doi: 10.3969/j.issn.0258-2724.20220262 |
[11] | WANG Jian, QIN Chunxia, YANG Ke, REN Ping, ZHENG Jie, ZHAO Yuanpeng, CHEN Guifeng. Design of Airborne Video Dehazing System for UCAV Based on HSV Transmission Weighted Correction[J]. Journal of Southwest Jiaotong University, 2021, 56(1): 160-167, 205. doi: 10.3969/j.issn.0258-2724.20190985 |
[12] | SHU Li, LIN Feng, LIU Zhonghao, YOU Jian, ZHOU Jiliu. POI Classfication Based Sweep Coverage Scheme in Wireless Sensor Networks[J]. Journal of Southwest Jiaotong University, 2014, 27(1): 165-172. doi: 10.3969/j.issn.0258-2724.2014.01.026 |
[13] | MA Lei, ZHANG Wenxu, DAI Chaohua. A Review of Developments in Reinforcement Learning for Multi-robot Systems[J]. Journal of Southwest Jiaotong University, 2014, 27(6): 1032-1044. doi: 10.3969/j.issn.0258-2724.2014.06.015 |
[14] | HE Jing, LI Yongshu, LI Xin, TANG Min. Registration Method for Unmanned Aerial Vehicle Images Based on Point Feature and Edge Feature[J]. Journal of Southwest Jiaotong University, 2012, 25(6): 955-961. doi: 10.3969/j.issn.0258-2724.2012.06.008 |
[15] | TANG Min, LI Yong-Shu, HE Jing. Relative Orientation Method of UAV Images without Ground Control Points[J]. Journal of Southwest Jiaotong University, 2011, 24(5): 808-813. doi: 10.3969/j.issn.0258-2724.2011.05.016 |
[16] | HE Rong, FANG Xu-Meng. Price-Based Congestion Control Algorithm for Wireless Multi-hop Networks[J]. Journal of Southwest Jiaotong University, 2011, 24(5): 779-786. doi: 10.3969/j.issn.0258-2724.2011.05.011 |
[17] | LU Heng, LI Yong-Shu, LI He-Chao, HE Jing, REN Zhi-Ming. Digital Processing of Unmanned Aerial Vehicle Image and Its Application in Reconstruction of Wenchuan Earthquake-Hit Areas[J]. Journal of Southwest Jiaotong University, 2010, 23(4): 533-538. doi: 10. 3969/ j. issn. 0258-2724. |
[18] | SHEN Yuanxia, WANG Guoyin. Data-Driven Q-Learning in Dynamic Environment[J]. Journal of Southwest Jiaotong University, 2009, 22(6): 877-881. |
[19] | XIGuo-hua, LUXiang-yang, XIA Yin. Network Communication System for the Tilting Diesel-Electric Train-Set[J]. Journal of Southwest Jiaotong University, 2000, 13(6): 629-632. |