Combat effectiveness of unmanned aerial vehicle(UAV)formations can be severely affected by the mission execution reliability.During the practical execution phase,there are inevitable risks where UAVs being destroyed o...Combat effectiveness of unmanned aerial vehicle(UAV)formations can be severely affected by the mission execution reliability.During the practical execution phase,there are inevitable risks where UAVs being destroyed or targets failed to be executed.To improve the mission reliability,a resilient mission planning framework integrates task pre-and re-assignment modules is developed in this paper.In the task pre-assignment phase,to guarantee the mission reliability,probability constraints regarding the minimum mission success rate are imposed to establish a multi-objective optimization model.And an improved genetic algorithm with the multi-population mechanism and specifically designed evolutionary operators is used for efficient solution.As in the task-reassignment phase,possible trigger events are first analyzed.A real-time contract net protocol-based algorithm is then proposed to address the corresponding emergency scenario.And the dual objective used in the former phase is adapted into a single objective to keep a consistent combat intention.Three cases of different scales demonstrate that the two modules cooperate well with each other.On the one hand,the pre-assignment module can generate high-reliability mission schedules as an elaborate mathematical model is introduced.On the other hand,the re-assignment module can efficiently respond to various emergencies and adjust the original schedule within a millisecond.The corresponding animation is accessible at bilibili.com/video/BV12t421w7EE for better illustration.展开更多
Complex multi-area collaborative coverage path planning in dynamic environments poses a significant challenge for multi-fixed-wing UAVs(multi-UAV).This study establishes a comprehensive framework that incorporates UAV...Complex multi-area collaborative coverage path planning in dynamic environments poses a significant challenge for multi-fixed-wing UAVs(multi-UAV).This study establishes a comprehensive framework that incorporates UAV capabilities,terrain,complex areas,and mission dynamics.A novel dynamic collaborative path planning algorithm is introduced,designed to ensure complete coverage of designated areas.This algorithm meticulously optimizes the operation,entry,and transition paths for each UAV,while also establishing evaluation metrics to refine coverage sequences for each area.Additionally,a three-dimensional path is computed utilizing an altitude descent method,effectively integrating twodimensional coverage paths with altitude constraints.The efficacy of the proposed approach is validated through digital simulations and mixed-reality semi-physical experiments across a variety of dynamic scenarios,including both single-area and multi-area coverage by multi-UAV.Results show that the coverage paths generated by this method significantly reduce both computation time and path length,providing a reliable solution for dynamic multi-UAV mission planning in semi-physical environments.展开更多
For low-speed underwater vehicles, the ocean currents has a great influence on them, and the changes in ocean currents is complex and continuous, thus whose impact must be taken into consideration in the path planning...For low-speed underwater vehicles, the ocean currents has a great influence on them, and the changes in ocean currents is complex and continuous, thus whose impact must be taken into consideration in the path planning. There are still lack of authoritative indicator and method for the cooperating path planning. The calculation of the voyage time is a difficult problem in the time-varying ocean, for the existing methods of the cooperating path planning, the computation time will increase exponentially as the autonomous underwater vehicle（AUV） counts increase, rendering them unfeasible. A collaborative path planning method is presehted for multi-AUV under the influence of time-varying ocean currents based on the dynamic programming algorithm. Each AUV cooperates with the one who has the longest estimated time of sailing, enabling the arrays of AUV to get their common goal in the shortest time with minimum timedifference. At the same time, they could avoid the obstacles along the way to the target. Simulation results show that the proposed method has a promising applicability.展开更多
With the new development trend of multi-resource coordinated Earth observation and the new goal of Earth observation application of“short response time,high observation accuracy,and wide coverage”,space-aeronautics ...With the new development trend of multi-resource coordinated Earth observation and the new goal of Earth observation application of“short response time,high observation accuracy,and wide coverage”,space-aeronautics cooperative complex task planning problem has become an urgent problem to be solved.The focus of this problem is to use multiple resources to perform collaborative observations on complex tasks.By analyzing the process from task assignment to receiving task observation results,we propose a multi-layer interactive task planning framework which is composed of a preprocessing method for complex tasks,a task allocation layer,a task planning layer,and a task coordination layer.According to the characteristics of the framework,a hybrid genetic parallel tabu(HGPT)algorithm is proposed on this basis.The algorithm uses genetic annealing algorithm(GAA),parallel tabu(PT)algorithm,and heuristic rules to achieve task allocation,task planning,and task coordination.At the same time,coding improvements,operator design,annealing operations,and parallel calculations are added to the algorithm.In order to verify the effectiveness of the algorithm,simulation experiments under complex task scenarios of different scales are carried out.Experimental results show that this method can effectively solve the problems of observing complex tasks.Meanwhile,the optimization effect and convergence speed of the HGPT is better than that of the related algorithms.展开更多
Improvement of integrated battlefield situational awareness in complex environments involving dynamic factors such as restricted communications and electromagnetic interference(EMI)has become a contentious research pr...Improvement of integrated battlefield situational awareness in complex environments involving dynamic factors such as restricted communications and electromagnetic interference(EMI)has become a contentious research problem.In certain mission environments,due to the impact of many interference sources on real-time communication or mission requirements such as the need to implement communication regulations,the mission stages are represented as a dynamic combination of several communication-available and communication-unavailable stages.Furthermore,the data interaction between unmanned aerial vehicles(UAVs)can only be performed in specific communication-available stages.Traditional cooperative search algorithms cannot handle such situations well.To solve this problem,this study constructed a distributed model predictive control(DMPC)architecture for a collaborative control of UAVs and used the Voronoi diagram generation method to re-plan the search areas of all UAVs in real time to avoid repetition of search areas and UAV collisions while improving the search efficiency and safety factor.An attention mechanism ant-colony optimization(AACO)algorithm is proposed for UAV search-control decision planning.The search strategy is adaptively updated by introducing an attention mechanism for regular instruction information,a priori information,and emergent information of the mission to satisfy different search expectations to the maximum extent.Simulation results show that the proposed algorithm achieves better search performance than traditional algorithms in restricted communication constraint scenarios.展开更多
Collaborative coverage path planning(CCPP) refers to obtaining the shortest paths passing over all places except obstacles in a certain area or space. A multi-unmanned aerial vehicle(UAV) collaborative CCPP algorithm ...Collaborative coverage path planning(CCPP) refers to obtaining the shortest paths passing over all places except obstacles in a certain area or space. A multi-unmanned aerial vehicle(UAV) collaborative CCPP algorithm is proposed for the urban rescue search or military search in outdoor environment.Due to flexible control of small UAVs, it can be considered that all UAVs fly at the same altitude, that is, they perform search tasks on a two-dimensional plane. Based on the agents’ motion characteristics and environmental information, a mathematical model of CCPP problem is established. The minimum time for UAVs to complete the CCPP is the objective function, and complete coverage constraint, no-fly constraint, collision avoidance constraint, and communication constraint are considered. Four motion strategies and two communication strategies are designed. Then a distributed CCPP algorithm is designed based on hybrid strategies. Simulation results compared with patternbased genetic algorithm(PBGA) and random search method show that the proposed method has stronger real-time performance and better scalability and can complete the complete CCPP task more efficiently and stably.展开更多
Aiming at the practical application of Unmanned Underwater Vehicle(UUV)in underwater combat,this paper proposes a battlefield ambush scene with UUV considering ocean current.Firstly,by establishing these mathematical ...Aiming at the practical application of Unmanned Underwater Vehicle(UUV)in underwater combat,this paper proposes a battlefield ambush scene with UUV considering ocean current.Firstly,by establishing these mathematical models of ocean current environment,target movement,and sonar detection,the probability calculation methods of single UUV searching target and multiple UUV cooperatively searching target are given respectively.Then,based on the Hybrid Quantum-behaved Particle Swarm Optimization(HQPSO)algorithm,the path with the highest target search probability is found.Finally,through simulation calculations,the influence of different UUV parameters and target parameters on the target search probability is analyzed,and the minimum number of UUVs that need to be deployed to complete the ambush task is demonstrated,and the optimal search path scheme is obtained.The method proposed in this paper provides a theoretical basis for the practical application of UUV in the future combat.展开更多
Motion planning is critical to realize the autonomous operation of mobile robots.As the complexity and randomness of robot application scenarios increase,the planning capability of the classical hierarchical motion pl...Motion planning is critical to realize the autonomous operation of mobile robots.As the complexity and randomness of robot application scenarios increase,the planning capability of the classical hierarchical motion planners is challenged.With the development of machine learning,the deep reinforcement learning(DRL)-based motion planner has gradually become a research hotspot due to its several advantageous feature.The DRL-based motion planner is model-free and does not rely on the prior structured map.Most importantly,the DRL-based motion planner achieves the unification of the global planner and the local planner.In this paper,we provide a systematic review of various motion planning methods.Firstly,we summarize the representative and state-of-the-art works for each submodule of the classical motion planning architecture and analyze their performance features.Then,we concentrate on summarizing reinforcement learning(RL)-based motion planning approaches,including motion planners combined with RL improvements,map-free RL-based motion planners,and multi-robot cooperative planning methods.Finally,we analyze the urgent challenges faced by these mainstream RLbased motion planners in detail,review some state-of-the-art works for these issues,and propose suggestions for future research.展开更多
Cooperative path planning is an important area in fixed-wing UAV swarm.However,avoiding multiple timevarying obstacles and avoiding local optimum are two challenges for existing approaches in a dynamic environment.Fir...Cooperative path planning is an important area in fixed-wing UAV swarm.However,avoiding multiple timevarying obstacles and avoiding local optimum are two challenges for existing approaches in a dynamic environment.Firstly,a normalized artificial potential field optimization is proposed by reconstructing a novel function with anisotropy in each dimension,which can make the flight speed of a fixed UAV swarm independent of the repulsive/attractive gain coefficient and avoid trapping into local optimization and local oscillation.Then,taking into account minimum velocity and turning angular velocity of fixed-wing UAV swarm,a strategy of decomposing target vector to avoid moving obstacles and pop-up threats is proposed.Finally,several simulations are carried out to illustrate superiority and effectiveness.展开更多
Anti-ship missile coordinated attack mission planning is a complex multi-objective optimization problem with multiple combinations of platforms, strong decision-making constraints,and tightly coupled links. To avoid t...Anti-ship missile coordinated attack mission planning is a complex multi-objective optimization problem with multiple combinations of platforms, strong decision-making constraints,and tightly coupled links. To avoid the coupling disorder between path planning and firepower distribution and improve the efficiency of coordinated attack mission planning, a firepower distribution model under the conditions of path planning is established from the perspective of decoupling optimization and the algorithm is implemented. First, we establish reference coordinate system of firepower distribution to clarify the reference direction of firepower distribution and divide the area of firepower distribution;then, we construct an index table of membership of firepower distribution to obtain alternative firepower distribution plans;finally, the fitness function of firepower distribution is established based on damage income, missile loss,ratio of efficiency and cost of firepower distribution, and the mean square deviation of the number of missiles used, and the alternatives are sorted to obtain the optimal firepower distribution plan. According to two simulation experiments, the method in this paper can effectively solve the many-to-many firepower distribution problem of coupled path planning. Under the premise of ensuring that no path crossing occurs, the optimal global solution can be obtained, and the operability and timeliness are good.展开更多
在进行实时对抗的任务中,对于敌方的动作识别较为困难,需要根据对方的移动轨迹或行为来分析对方的意图,预测其未来目标,构建规划策略库.针对此问题,提出基于数据驱动的多智能体识别算法,该算法首先采用基于自动机的特征提取方法,获得规...在进行实时对抗的任务中,对于敌方的动作识别较为困难,需要根据对方的移动轨迹或行为来分析对方的意图,预测其未来目标,构建规划策略库.针对此问题,提出基于数据驱动的多智能体识别算法,该算法首先采用基于自动机的特征提取方法,获得规划需要的位置和任务信息;然后将规划识别问题转换为多分类问题,并从单智能体角度切入,给出了一种基于极端梯度提升(extreme gradient boosting,XGBoost)的多分类模型;之后,对于多智能体之间可能存在的合作行为,使用无监督学习的一种基于密度对噪声鲁棒的空间聚类算法(density-based spatial clustering of applications with noise,DBSCAN)对多智能体进行分簇,以促进协同合作.对于同簇智能体,构建了一种针对多智能体的多分类模型,完成对多智能体的目标预测.在获悉敌方目标后,提出基于博弈的围捕逼停算法,构建非合作动态博弈模型,通过求解纳什均衡得到应对敌方的最优策略.最后,通过仿真验证了所提出算法的有效性.展开更多
基金supported by the National Key Research and Development Plan(Grant No.2021YFB3302501)the National Natural Science Foundation of China(Grant Nos.12102077,12161076,U2241263).
文摘Combat effectiveness of unmanned aerial vehicle(UAV)formations can be severely affected by the mission execution reliability.During the practical execution phase,there are inevitable risks where UAVs being destroyed or targets failed to be executed.To improve the mission reliability,a resilient mission planning framework integrates task pre-and re-assignment modules is developed in this paper.In the task pre-assignment phase,to guarantee the mission reliability,probability constraints regarding the minimum mission success rate are imposed to establish a multi-objective optimization model.And an improved genetic algorithm with the multi-population mechanism and specifically designed evolutionary operators is used for efficient solution.As in the task-reassignment phase,possible trigger events are first analyzed.A real-time contract net protocol-based algorithm is then proposed to address the corresponding emergency scenario.And the dual objective used in the former phase is adapted into a single objective to keep a consistent combat intention.Three cases of different scales demonstrate that the two modules cooperate well with each other.On the one hand,the pre-assignment module can generate high-reliability mission schedules as an elaborate mathematical model is introduced.On the other hand,the re-assignment module can efficiently respond to various emergencies and adjust the original schedule within a millisecond.The corresponding animation is accessible at bilibili.com/video/BV12t421w7EE for better illustration.
基金National Natural Science Foundation of China(Grant No.52472417)to provide fund for conducting experiments.
文摘Complex multi-area collaborative coverage path planning in dynamic environments poses a significant challenge for multi-fixed-wing UAVs(multi-UAV).This study establishes a comprehensive framework that incorporates UAV capabilities,terrain,complex areas,and mission dynamics.A novel dynamic collaborative path planning algorithm is introduced,designed to ensure complete coverage of designated areas.This algorithm meticulously optimizes the operation,entry,and transition paths for each UAV,while also establishing evaluation metrics to refine coverage sequences for each area.Additionally,a three-dimensional path is computed utilizing an altitude descent method,effectively integrating twodimensional coverage paths with altitude constraints.The efficacy of the proposed approach is validated through digital simulations and mixed-reality semi-physical experiments across a variety of dynamic scenarios,including both single-area and multi-area coverage by multi-UAV.Results show that the coverage paths generated by this method significantly reduce both computation time and path length,providing a reliable solution for dynamic multi-UAV mission planning in semi-physical environments.
基金supported by the National Natural Science Foundation of China(5110917951179156+2 种基金5137917661473233)the Natural Science Basic Research Plan in Shaanxi Province of China(2014JQ8330)
文摘For low-speed underwater vehicles, the ocean currents has a great influence on them, and the changes in ocean currents is complex and continuous, thus whose impact must be taken into consideration in the path planning. There are still lack of authoritative indicator and method for the cooperating path planning. The calculation of the voyage time is a difficult problem in the time-varying ocean, for the existing methods of the cooperating path planning, the computation time will increase exponentially as the autonomous underwater vehicle（AUV） counts increase, rendering them unfeasible. A collaborative path planning method is presehted for multi-AUV under the influence of time-varying ocean currents based on the dynamic programming algorithm. Each AUV cooperates with the one who has the longest estimated time of sailing, enabling the arrays of AUV to get their common goal in the shortest time with minimum timedifference. At the same time, they could avoid the obstacles along the way to the target. Simulation results show that the proposed method has a promising applicability.
基金the National Natural Science Foundation of China(72001212).
文摘With the new development trend of multi-resource coordinated Earth observation and the new goal of Earth observation application of“short response time,high observation accuracy,and wide coverage”,space-aeronautics cooperative complex task planning problem has become an urgent problem to be solved.The focus of this problem is to use multiple resources to perform collaborative observations on complex tasks.By analyzing the process from task assignment to receiving task observation results,we propose a multi-layer interactive task planning framework which is composed of a preprocessing method for complex tasks,a task allocation layer,a task planning layer,and a task coordination layer.According to the characteristics of the framework,a hybrid genetic parallel tabu(HGPT)algorithm is proposed on this basis.The algorithm uses genetic annealing algorithm(GAA),parallel tabu(PT)algorithm,and heuristic rules to achieve task allocation,task planning,and task coordination.At the same time,coding improvements,operator design,annealing operations,and parallel calculations are added to the algorithm.In order to verify the effectiveness of the algorithm,simulation experiments under complex task scenarios of different scales are carried out.Experimental results show that this method can effectively solve the problems of observing complex tasks.Meanwhile,the optimization effect and convergence speed of the HGPT is better than that of the related algorithms.
基金the support of the National Natural Science Foundation of China(Grant No.62076204)the Seed Foundation of Innovation and Creation for Graduate Students in Northwestern Polytechnical University(Grant No.CX2020019)in part by the China Postdoctoral Science Foundation(Grants No.2021M700337)。
文摘Improvement of integrated battlefield situational awareness in complex environments involving dynamic factors such as restricted communications and electromagnetic interference(EMI)has become a contentious research problem.In certain mission environments,due to the impact of many interference sources on real-time communication or mission requirements such as the need to implement communication regulations,the mission stages are represented as a dynamic combination of several communication-available and communication-unavailable stages.Furthermore,the data interaction between unmanned aerial vehicles(UAVs)can only be performed in specific communication-available stages.Traditional cooperative search algorithms cannot handle such situations well.To solve this problem,this study constructed a distributed model predictive control(DMPC)architecture for a collaborative control of UAVs and used the Voronoi diagram generation method to re-plan the search areas of all UAVs in real time to avoid repetition of search areas and UAV collisions while improving the search efficiency and safety factor.An attention mechanism ant-colony optimization(AACO)algorithm is proposed for UAV search-control decision planning.The search strategy is adaptively updated by introducing an attention mechanism for regular instruction information,a priori information,and emergent information of the mission to satisfy different search expectations to the maximum extent.Simulation results show that the proposed algorithm achieves better search performance than traditional algorithms in restricted communication constraint scenarios.
基金supported by the National Natural Science Foundation of China (61903036, 61822304)Shanghai Municipal Science and Technology Major Project (2021SHZDZX0100)。
文摘Collaborative coverage path planning(CCPP) refers to obtaining the shortest paths passing over all places except obstacles in a certain area or space. A multi-unmanned aerial vehicle(UAV) collaborative CCPP algorithm is proposed for the urban rescue search or military search in outdoor environment.Due to flexible control of small UAVs, it can be considered that all UAVs fly at the same altitude, that is, they perform search tasks on a two-dimensional plane. Based on the agents’ motion characteristics and environmental information, a mathematical model of CCPP problem is established. The minimum time for UAVs to complete the CCPP is the objective function, and complete coverage constraint, no-fly constraint, collision avoidance constraint, and communication constraint are considered. Four motion strategies and two communication strategies are designed. Then a distributed CCPP algorithm is designed based on hybrid strategies. Simulation results compared with patternbased genetic algorithm(PBGA) and random search method show that the proposed method has stronger real-time performance and better scalability and can complete the complete CCPP task more efficiently and stably.
文摘Aiming at the practical application of Unmanned Underwater Vehicle(UUV)in underwater combat,this paper proposes a battlefield ambush scene with UUV considering ocean current.Firstly,by establishing these mathematical models of ocean current environment,target movement,and sonar detection,the probability calculation methods of single UUV searching target and multiple UUV cooperatively searching target are given respectively.Then,based on the Hybrid Quantum-behaved Particle Swarm Optimization(HQPSO)algorithm,the path with the highest target search probability is found.Finally,through simulation calculations,the influence of different UUV parameters and target parameters on the target search probability is analyzed,and the minimum number of UUVs that need to be deployed to complete the ambush task is demonstrated,and the optimal search path scheme is obtained.The method proposed in this paper provides a theoretical basis for the practical application of UUV in the future combat.
基金supported by the National Natural Science Foundation of China (62173251)the“Zhishan”Scholars Programs of Southeast University+1 种基金the Fundamental Research Funds for the Central UniversitiesShanghai Gaofeng&Gaoyuan Project for University Academic Program Development (22120210022)
文摘Motion planning is critical to realize the autonomous operation of mobile robots.As the complexity and randomness of robot application scenarios increase,the planning capability of the classical hierarchical motion planners is challenged.With the development of machine learning,the deep reinforcement learning(DRL)-based motion planner has gradually become a research hotspot due to its several advantageous feature.The DRL-based motion planner is model-free and does not rely on the prior structured map.Most importantly,the DRL-based motion planner achieves the unification of the global planner and the local planner.In this paper,we provide a systematic review of various motion planning methods.Firstly,we summarize the representative and state-of-the-art works for each submodule of the classical motion planning architecture and analyze their performance features.Then,we concentrate on summarizing reinforcement learning(RL)-based motion planning approaches,including motion planners combined with RL improvements,map-free RL-based motion planners,and multi-robot cooperative planning methods.Finally,we analyze the urgent challenges faced by these mainstream RLbased motion planners in detail,review some state-of-the-art works for these issues,and propose suggestions for future research.
文摘Cooperative path planning is an important area in fixed-wing UAV swarm.However,avoiding multiple timevarying obstacles and avoiding local optimum are two challenges for existing approaches in a dynamic environment.Firstly,a normalized artificial potential field optimization is proposed by reconstructing a novel function with anisotropy in each dimension,which can make the flight speed of a fixed UAV swarm independent of the repulsive/attractive gain coefficient and avoid trapping into local optimization and local oscillation.Then,taking into account minimum velocity and turning angular velocity of fixed-wing UAV swarm,a strategy of decomposing target vector to avoid moving obstacles and pop-up threats is proposed.Finally,several simulations are carried out to illustrate superiority and effectiveness.
基金supported by the Natural Science Foundation of Hunan Province (2020JJ4339)the Scientific Research Fund of Hunan Provincial Education Department (20B272)。
文摘Anti-ship missile coordinated attack mission planning is a complex multi-objective optimization problem with multiple combinations of platforms, strong decision-making constraints,and tightly coupled links. To avoid the coupling disorder between path planning and firepower distribution and improve the efficiency of coordinated attack mission planning, a firepower distribution model under the conditions of path planning is established from the perspective of decoupling optimization and the algorithm is implemented. First, we establish reference coordinate system of firepower distribution to clarify the reference direction of firepower distribution and divide the area of firepower distribution;then, we construct an index table of membership of firepower distribution to obtain alternative firepower distribution plans;finally, the fitness function of firepower distribution is established based on damage income, missile loss,ratio of efficiency and cost of firepower distribution, and the mean square deviation of the number of missiles used, and the alternatives are sorted to obtain the optimal firepower distribution plan. According to two simulation experiments, the method in this paper can effectively solve the many-to-many firepower distribution problem of coupled path planning. Under the premise of ensuring that no path crossing occurs, the optimal global solution can be obtained, and the operability and timeliness are good.
文摘在进行实时对抗的任务中,对于敌方的动作识别较为困难,需要根据对方的移动轨迹或行为来分析对方的意图,预测其未来目标,构建规划策略库.针对此问题,提出基于数据驱动的多智能体识别算法,该算法首先采用基于自动机的特征提取方法,获得规划需要的位置和任务信息;然后将规划识别问题转换为多分类问题,并从单智能体角度切入,给出了一种基于极端梯度提升(extreme gradient boosting,XGBoost)的多分类模型;之后,对于多智能体之间可能存在的合作行为,使用无监督学习的一种基于密度对噪声鲁棒的空间聚类算法(density-based spatial clustering of applications with noise,DBSCAN)对多智能体进行分簇,以促进协同合作.对于同簇智能体,构建了一种针对多智能体的多分类模型,完成对多智能体的目标预测.在获悉敌方目标后,提出基于博弈的围捕逼停算法,构建非合作动态博弈模型,通过求解纳什均衡得到应对敌方的最优策略.最后,通过仿真验证了所提出算法的有效性.
