System upgrades in unmanned systems have made Unmanned Aerial Vehicle(UAV)-based patrolling and monitoring a preferred solution for ocean surveillance.However,dynamic environments and large-scale deployments pose sign...System upgrades in unmanned systems have made Unmanned Aerial Vehicle(UAV)-based patrolling and monitoring a preferred solution for ocean surveillance.However,dynamic environments and large-scale deployments pose significant challenges for efficient decision-making,necessitating a modular multiagent control system.Deep Reinforcement Learning(DRL)and Decision Tree(DT)have been utilized for these complex decision-making tasks,but each has its limitations:DRL is highly adaptive but lacks interpretability,while DT is inherently interpretable but has limited adaptability.To overcome these challenges,we propose the Adaptive Interpretable Decision Tree(AIDT),an evolutionary-based algorithm that is both adaptable to diverse environmental settings and highly interpretable in its decision-making processes.We first construct a Markov decision process(MDP)-based simulation environment using the Cooperative Submarine Search task as a representative scenario for training and testing the proposed method.Specifically,we use the heat map as a state variable to address the issue of multi-agent input state proliferation.Next,we introduce the curiosity-guiding intrinsic reward to encourage comprehensive exploration and enhance algorithm performance.Additionally,we incorporate decision tree size as an influence factor in the adaptation process to balance task completion with computational efficiency.To further improve the generalization capability of the decision tree,we apply a normalization method to ensure consistent processing of input states.Finally,we validate the proposed algorithm in different environmental settings,and the results demonstrate both its adaptability and interpretability.展开更多
This paper presents a fixed-time cooperative gui-dance method with impact angle constraints for multiple flight vehicles (MFV) to address the challenges of intercepting large maneuvering targets with difficulty and lo...This paper presents a fixed-time cooperative gui-dance method with impact angle constraints for multiple flight vehicles (MFV) to address the challenges of intercepting large maneuvering targets with difficulty and low precision. A coopera-tive guidance model is proposed, transforming the cooperative interception problem into a consensus problem based on the remaining flight time of the flight vehicles. First, the impact angle constraint is converted into the line of sight (LOS) angle con-straint, and a new fixed-time convergent non-singular terminal sliding surface is introduced, which resolves the singularity issue of the traditional sliding surfaces. With this approach, LOS angle rate and normal overloads can converge in fixed time, ensuring that the upper bound of the system convergence time is not affected by the initial value of the system. Furthermore, the maneuvering movement of the target is considered as a system disturbance, and an extended state observer is employed to estimate and compensate for it in the guidance law. Lastly, by applying consensus theory and distributed communication topology, the remaining flight time of each flight vehicle is syn-chronized to ensure that they intercept the target simulta-neously with different impact angles. Simulation experiments are conducted to validate the effectiveness of the proposed cooper-ative interception and guidance method.展开更多
How multi-unmanned aerial vehicles(UAVs)carrying a payload pass an obstacle-dense environment is practically important.Up to now,there have been few results on safe motion planning for the multi-UAVs cooperative trans...How multi-unmanned aerial vehicles(UAVs)carrying a payload pass an obstacle-dense environment is practically important.Up to now,there have been few results on safe motion planning for the multi-UAVs cooperative transportation system(CTS)to pass through such an environment.The prob-lem is challenging because it is difficult to analyze and explicitly take into account the swing motion of the payload in planning.In this paper,a modeling method of virtual tube is proposed by fus-ing the advantages of the existing modeling algorithm for regu-lar virtual tube and the expansion environment method.The pro-posed method can not only generate a safe and smooth tube for UAVs,but also ensure the payload stays away from the dense obstacles.Simulation results show the effectiveness of the method and the safety of the planned tube.展开更多
To solve the problem of providing the best initial situation for terminal guidance when multiple missiles intercept multiple targets,a group cooperative midcourse guidance law(GCMGL)considering time-to-go is proposed....To solve the problem of providing the best initial situation for terminal guidance when multiple missiles intercept multiple targets,a group cooperative midcourse guidance law(GCMGL)considering time-to-go is proposed.Firstly,a threedimensional(3D)guidance model is established and a cooperative trajectory shaping guidance law is given.Secondly,for estimating the unknown target maneuvering acceleration,an adaptive disturbance observer(ADO)is designed,combining finitetime theory with a radial basis function(RBF)neural network,and the convergence of the estimation error is proven using Lyapunov stability theory.Then,to ensure time-to-go cooperation among missiles within the same group and across different groups,the group consensus protocols of virtual collision point mean and the inter-group cooperative consensus protocol are designed respectively.Based on the group consensus protocols,the virtual collision point cooperative guidance law is given,and the finite-time convergence is proved by Lyapunov stability theory.Simultaneously,combined with trajectory shaping guidance law,virtual collision point cooperative guidance law and the intergroup cooperative consensus protocol,the design of GCMGL considering time-to-go is given.Finally,numerical simulation results show the effectiveness and the superiority of the proposed GCMGL.展开更多
A situation maintenance-based cooperative guidance strategy is proposed to intercept a high-speed and high-maneuverability target via inferior missiles.Reachability and relative motion analyses are conducted to develo...A situation maintenance-based cooperative guidance strategy is proposed to intercept a high-speed and high-maneuverability target via inferior missiles.Reachability and relative motion analyses are conducted to develop and pursue virtual targets,respectively.A two-stage guidance strategy under nonlinear kinematics is developed on the basis of virtual targets.The first stage optimizes the coverage and collision situation by pursuing virtual targets under specific angular constraints.The second stage subsequently intercepts the superior target based on the handover condition optimized by the first stage.Numerical simulation results are provided to compare the effectiveness and superiority of the proposed strategy with those of the reachability-based cooperative strategy(RCS),coverage-based cooperative guidance(CBCG)and augmented proportional navigation(APN)under various maneuvering modes.展开更多
This paper presents a mode-switching collaborative defense strategy for spacecraft pursuit-evasiondefense scenarios.In these scenarios,the pursuer tries to avoid the defender while capturing the evader,while the evade...This paper presents a mode-switching collaborative defense strategy for spacecraft pursuit-evasiondefense scenarios.In these scenarios,the pursuer tries to avoid the defender while capturing the evader,while the evader and defender form an alliance to prevent the pursuer from achieving its goal.First,the behavioral modes of the pursuer,including attack and avoidance modes,were established using differential game theory.These modes are then recognized by an interactive multiple model-matching algorithm(IMM),that uses several smooth variable structure filters to match the modes of the pursuer and update their probabilities in real time.Based on the linear-quadratic optimization theory,combined with the results of strategy identification,a two-way cooperative optimal strategy for the defender and evader is proposed,where the evader aids the defender to intercept the pursuer by performing luring maneuvers.Simulation results show that the interactive multi-model algorithm based on several smooth variable structure filters perform well in the strategy identification of the pursuer,and the cooperative defense strategy based on strategy identification has good interception performance when facing pursuers,who are able to flexibly adjust their game objectives.展开更多
In the realm of missile defense systems,the self-sufficient maneuver capacity of missile swarms is pivotal for their survival.Through the analysis of the missile dynamics model,a time-efficient cooperative attack stra...In the realm of missile defense systems,the self-sufficient maneuver capacity of missile swarms is pivotal for their survival.Through the analysis of the missile dynamics model,a time-efficient cooperative attack strategy for missile swarm is proposed.Based on the distribution of the attackers and defenders,the collision avoidance against the defenders is considered during the attack process.By analyzing the geometric relationship between the relative velocity vector and relative position vector of the attackers and defenders,the collision avoidance constrains of attacking swarm are redefined.The key point is on adjusting the relative velocity vectors to fall outside the collision cone.This work facilitates high-precision attack toward the target while keeping safe missing distance between other attackers during collision avoidance process.By leveraging an innovative repulsion artificial function,a time-efficient cooperative attack strategy for missile swarm is obtained.Through rigorous simulation,the effectiveness of this cooperative attack strategy is substantiated.Furthermore,by employing Monte Carlo simulation,the success rate of the cooperative attack strategy is assessesed and the optimal configuration for the missile swarm is deduced.展开更多
Cooperative driving around intersections has aroused increasing interest in the last five years.Meanwhile,driving safety in non-signalized intersections has become an issue that has attracted attention globally.In vie...Cooperative driving around intersections has aroused increasing interest in the last five years.Meanwhile,driving safety in non-signalized intersections has become an issue that has attracted attention globally.In view of the potential collision risk when more than three vehicles approach a non-signalized intersection from different directions,we propose a driving model using cooperative game theory.First,the characteristic functions of this model are primarily established on each vehicle’s profit function and include safety,rapidity and comfort indicators.Second,the Shapley theorem is adopted,and its group rationality,individual rationality,and uniqueness are proved to be suitable for the characteristic functions of the model.Following this,different drivers’characteristics are considered.In order to simplify the calculation process,a zero-mean normalization method is introduced.In addition,a genetic algorithm method is adopted to search an optimal strategy set in the constrained multi-objective optimization problem.Finally,the model is confirmed as valid after simulation with a series of initial conditions.展开更多
In non-dedicated cooperative relay networks, each node is autonomous and selfish in nature, and thus spontaneous cooperation among nodes is challenged. To stimulate the selfish node to participate in cooperation, a pr...In non-dedicated cooperative relay networks, each node is autonomous and selfish in nature, and thus spontaneous cooperation among nodes is challenged. To stimulate the selfish node to participate in cooperation, a pricing-based cooperation engine using game theory was designed. Firstly, the feasible regions of the charge price and reimbursement price were deduced. Then, the non-cooperative and cooperative games were adopted to analyze the amount of bandwidth that initiating cooperation node(ICN) forwards data through participating cooperation node(PCN) and the amount of bandwidth that PCN helps ICN to relay data. Meanwhile, the Nash equilibrium solutions of cooperation bandwidth allocations(CBAs) were obtained through geometrical interpretation. Secondly, a pricing-based cooperation engine was proposed and a cooperative communication system model with cooperation engines was depicted. Finally, an algorithm based on game theory was proposed to realize the cooperation engine. The simulation results demonstrate that, compared with the system without pricing-based incentive, the proposed system can significantly improve the ICN's metric measured by bit-per-Joule and increase the PCN's revenue.展开更多
The application of multiple UAVs in complicated tasks has been widely explored in recent years.Due to the advantages of flexibility,cheapness and consistence,the performance of heterogeneous multi-UAVs with proper coo...The application of multiple UAVs in complicated tasks has been widely explored in recent years.Due to the advantages of flexibility,cheapness and consistence,the performance of heterogeneous multi-UAVs with proper cooperative task allocation is superior to over the single UAV.Accordingly,several constraints should be satisfied to realize the efficient cooperation,such as special time-window,variant equipment,specified execution sequence.Hence,a proper task allocation in UAVs is the crucial point for the final success.The task allocation problem of the heterogeneous UAVs can be formulated as a multi-objective optimization problem coupled with the UAV dynamics.To this end,a multi-layer encoding strategy and a constraint scheduling method are designed to handle the critical logical and physical constraints.In addition,four optimization objectives:completion time,target reward,UAV damage,and total range,are introduced to evaluate various allocation plans.Subsequently,to efficiently solve the multi-objective optimization problem,an improved multi-objective quantum-behaved particle swarm optimization(IMOQPSO)algorithm is proposed.During this algorithm,a modified solution evaluation method is designed to guide algorithmic evolution;both the convergence and distribution of particles are considered comprehensively;and boundary solutions which may produce some special allocation plans are preserved.Moreover,adaptive parameter control and mixed update mechanism are also introduced in this algorithm.Finally,both the proposed model and algorithm are verified by simulation experiments.展开更多
In order to improve the autonomous ability of unmanned aerial vehicles(UAV)to implement air combat mission,many artificial intelligence-based autonomous air combat maneuver decision-making studies have been carried ou...In order to improve the autonomous ability of unmanned aerial vehicles(UAV)to implement air combat mission,many artificial intelligence-based autonomous air combat maneuver decision-making studies have been carried out,but these studies are often aimed at individual decision-making in 1 v1 scenarios which rarely happen in actual air combat.Based on the research of the 1 v1 autonomous air combat maneuver decision,this paper builds a multi-UAV cooperative air combat maneuver decision model based on multi-agent reinforcement learning.Firstly,a bidirectional recurrent neural network(BRNN)is used to achieve communication between UAV individuals,and the multi-UAV cooperative air combat maneuver decision model under the actor-critic architecture is established.Secondly,through combining with target allocation and air combat situation assessment,the tactical goal of the formation is merged with the reinforcement learning goal of every UAV,and a cooperative tactical maneuver policy is generated.The simulation results prove that the multi-UAV cooperative air combat maneuver decision model established in this paper can obtain the cooperative maneuver policy through reinforcement learning,the cooperative maneuver policy can guide UAVs to obtain the overall situational advantage and defeat the opponents under tactical cooperation.展开更多
This paper addresses the cooperative control problem of multiple unmanned aerial vehicles(multi-UAV)systems.First,a new distributed consensus algorithm for second-order nonlinear multi-agent systems(MAS)is formulated ...This paper addresses the cooperative control problem of multiple unmanned aerial vehicles(multi-UAV)systems.First,a new distributed consensus algorithm for second-order nonlinear multi-agent systems(MAS)is formulated under the leader-following approach.The algorithm provides smooth input signals to the agents’control channels,which avoids the chattering effect generated by the conventional sliding mode-based control protocols.Second,a new formation control scheme is developed by integrating smooth distributed consensus control protocols into the geometric pattern model to achieve three-dimensional formation tracking.The Lyapunov theory is used to prove the stability and convergence of both distributed consensus and formation controllers.The effectiveness of the proposed algorithms is demonstrated through simulation results.展开更多
Cooperative path planning is an important area in fixed-wing UAV swarm.However,avoiding multiple timevarying obstacles and avoiding local optimum are two challenges for existing approaches in a dynamic environment.Fir...Cooperative path planning is an important area in fixed-wing UAV swarm.However,avoiding multiple timevarying obstacles and avoiding local optimum are two challenges for existing approaches in a dynamic environment.Firstly,a normalized artificial potential field optimization is proposed by reconstructing a novel function with anisotropy in each dimension,which can make the flight speed of a fixed UAV swarm independent of the repulsive/attractive gain coefficient and avoid trapping into local optimization and local oscillation.Then,taking into account minimum velocity and turning angular velocity of fixed-wing UAV swarm,a strategy of decomposing target vector to avoid moving obstacles and pop-up threats is proposed.Finally,several simulations are carried out to illustrate superiority and effectiveness.展开更多
Recent advances in on-board radar and missile capabilities,combined with individual payload limitations,have led to increased interest in the use of unmanned combat aerial vehicles(UCAVs)for cooperative occupation dur...Recent advances in on-board radar and missile capabilities,combined with individual payload limitations,have led to increased interest in the use of unmanned combat aerial vehicles(UCAVs)for cooperative occupation during beyond-visual-range(BVR)air combat.However,prior research on occupational decision-making in BVR air combat has mostly been limited to one-on-one scenarios.As such,this study presents a practical cooperative occupation decision-making methodology for use with multiple UCAVs.The weapon engagement zone(WEZ)and combat geometry were first used to develop an advantage function for situational assessment of one-on-one engagement.An encircling advantage function was then designed to represent the cooperation of UCAVs,thereby establishing a cooperative occupation model.The corresponding objective function was derived from the one-on-one engagement advantage function and the encircling advantage function.The resulting model exhibited similarities to a mixed-integer nonlinear programming(MINLP)problem.As such,an improved discrete particle swarm optimization(DPSO)algorithm was used to identify a solution.The occupation process was then converted into a formation switching task as part of the cooperative occupation model.A series of simulations were conducted to verify occupational solutions in varying situations,including two-on-two engagement.Simulated results showed these solutions varied with initial conditions and weighting coefficients.This occupation process,based on formation switching,effectively demonstrates the viability of the proposed technique.These cooperative occupation results could provide a theoretical framework for subsequent research in cooperative BVR air combat.展开更多
Particle swarm optimization （PSO） is a new heuristic algorithm which has been applied to many optimization problems successfully. Attribute reduction is a key studying point of the rough set theory, and it has been ...Particle swarm optimization （PSO） is a new heuristic algorithm which has been applied to many optimization problems successfully. Attribute reduction is a key studying point of the rough set theory, and it has been proven that computing minimal reduc- tion of decision tables is a non-derterministic polynomial （NP）-hard problem. A new cooperative extended attribute reduction algorithm named Co-PSAR based on improved PSO is proposed, in which the cooperative evolutionary strategy with suitable fitness func- tions is involved to learn a good hypothesis for accelerating the optimization of searching minimal attribute reduction. Experiments on Benchmark functions and University of California, Irvine （UCI） data sets, compared with other algorithms, verify the superiority of the Co-PSAR algorithm in terms of the convergence speed, efficiency and accuracy for the attribute reduction.展开更多
Manned combat aerial vehicles （MCAVs）, and un-manned combat aerial vehicles （UCAVs） together form a cooper-ative engagement system to carry out operational mission, whichwill be a new air engagement style in the n...Manned combat aerial vehicles （MCAVs）, and un-manned combat aerial vehicles （UCAVs） together form a cooper-ative engagement system to carry out operational mission, whichwill be a new air engagement style in the near future. On the basisof analyzing the structure of the MCAV/UCAV cooperative engage-ment system, this paper divides the unique system into three hi-erarchical levels, respectively, i.e., mission level, task-cluster leveland task level. To solve the formation and adjustment problem ofthe latter two levels, three corresponding mathematical modelsare established. To solve these models, three algorithms calledquantum artificial bee colony （QABC） algorithm, greedy strategy（GS） and two-stage greedy strategy （TSGS） are proposed. Finally,a series of simulation experiments are designed to verify the effec-tiveness and superiority of the proposed algorithms.展开更多
Aiming at the problem on cooperative air-defense of surface warship formation, this paper maps the cooperative airdefense system of systems （SoS） for surface warship formation （CASoSSWF） to the biological immune s...Aiming at the problem on cooperative air-defense of surface warship formation, this paper maps the cooperative airdefense system of systems （SoS） for surface warship formation （CASoSSWF） to the biological immune system （BIS） according to the similarity of the defense mechanism and characteristics between the CASoSSWF and the BIS, and then designs the models of components and the architecture for a monitoring agent, a regulating agent, a killer agent, a pre-warning agent and a communicating agent by making use of the theories and methods of the artificial immune system, the multi-agent system （MAS）, the vaccine and the danger theory （DT）. Moreover a new immune multi-agent model using vaccine based on DT （IMMUVBDT） for the cooperative air-defense SoS is advanced. The immune response and immune mechanism of the CASoSSWF are analyzed. The model has a capability of memory, evolution, commendable dynamic environment adaptability and self-learning, and embodies adequately the cooperative air-defense mechanism for the CASoSSWF. Therefore it shows a novel idea for the CASoSSWF which can provide conception models for a surface warship formation operation simulation system.展开更多
Cooperative autonomous air combat of multiple unmanned aerial vehicles(UAVs)is one of the main combat modes in future air warfare,which becomes even more complicated with highly changeable situation and uncertain info...Cooperative autonomous air combat of multiple unmanned aerial vehicles(UAVs)is one of the main combat modes in future air warfare,which becomes even more complicated with highly changeable situation and uncertain information of the opponents.As such,this paper presents a cooperative decision-making method based on incomplete information dynamic game to generate maneuver strategies for multiple UAVs in air combat.Firstly,a cooperative situation assessment model is presented to measure the overall combat situation.Secondly,an incomplete information dynamic game model is proposed to model the dynamic process of air combat,and a dynamic Bayesian network is designed to infer the tactical intention of the opponent.Then a reinforcement learning framework based on multiagent deep deterministic policy gradient is established to obtain the perfect Bayes-Nash equilibrium solution of the air combat game model.Finally,a series of simulations are conducted to verify the effectiveness of the proposed method,and the simulation results show effective synergies and cooperative tactics.展开更多
This paper investigates the problem of distributed cooperative guidance law design for multiple anti-ship missiles in the three-dimensional(3-D)space hitting simultaneously the same target with considering the desired...This paper investigates the problem of distributed cooperative guidance law design for multiple anti-ship missiles in the three-dimensional(3-D)space hitting simultaneously the same target with considering the desired terminal impact angle constraint.To address this issue,the problem formulation including 3-D nonlinear mathematical model description,and communication topology are built firstly.Then the consensus variable is constructed using the available information and can reach consensus under the proposed acceleration command along the line-of-sight(LOS)which satisfies the impact time constraint.However,the normal accelerations are designed to guarantee the convergence of the LOS angular rate.Furthermore,consider the terminal impact angle constraints,a nonsingular terminal sliding mode(NTSM)control is introduced,and a finite time convergent control law of normal acceleration is proposed.The convergence of the proposed guidance law is proved by using the second Lyapunov stability method,and numerical simulations are also conducted to verify its effectiveness.The results indicate that the proposed cooperative guidance law can regulate the impact time error and impact angle error in finite time if the connecting time of the communication topology is longer than the required convergent time.展开更多
文摘System upgrades in unmanned systems have made Unmanned Aerial Vehicle(UAV)-based patrolling and monitoring a preferred solution for ocean surveillance.However,dynamic environments and large-scale deployments pose significant challenges for efficient decision-making,necessitating a modular multiagent control system.Deep Reinforcement Learning(DRL)and Decision Tree(DT)have been utilized for these complex decision-making tasks,but each has its limitations:DRL is highly adaptive but lacks interpretability,while DT is inherently interpretable but has limited adaptability.To overcome these challenges,we propose the Adaptive Interpretable Decision Tree(AIDT),an evolutionary-based algorithm that is both adaptable to diverse environmental settings and highly interpretable in its decision-making processes.We first construct a Markov decision process(MDP)-based simulation environment using the Cooperative Submarine Search task as a representative scenario for training and testing the proposed method.Specifically,we use the heat map as a state variable to address the issue of multi-agent input state proliferation.Next,we introduce the curiosity-guiding intrinsic reward to encourage comprehensive exploration and enhance algorithm performance.Additionally,we incorporate decision tree size as an influence factor in the adaptation process to balance task completion with computational efficiency.To further improve the generalization capability of the decision tree,we apply a normalization method to ensure consistent processing of input states.Finally,we validate the proposed algorithm in different environmental settings,and the results demonstrate both its adaptability and interpretability.
基金supported by the National Natural Science Foundation of China(61903099)the Natural Science Foundation of Heilongjiang Province(LH2020F025)+2 种基金the Project of Science and Technology Research Program of Chongqing Education Commission of China(KJZD-K20200470)the Postdoctoral Science Foundation of China(2021M690812)the Postdoctoral Science Fund of Heilongjiang Province(LBH-Z21048).
文摘This paper presents a fixed-time cooperative gui-dance method with impact angle constraints for multiple flight vehicles (MFV) to address the challenges of intercepting large maneuvering targets with difficulty and low precision. A coopera-tive guidance model is proposed, transforming the cooperative interception problem into a consensus problem based on the remaining flight time of the flight vehicles. First, the impact angle constraint is converted into the line of sight (LOS) angle con-straint, and a new fixed-time convergent non-singular terminal sliding surface is introduced, which resolves the singularity issue of the traditional sliding surfaces. With this approach, LOS angle rate and normal overloads can converge in fixed time, ensuring that the upper bound of the system convergence time is not affected by the initial value of the system. Furthermore, the maneuvering movement of the target is considered as a system disturbance, and an extended state observer is employed to estimate and compensate for it in the guidance law. Lastly, by applying consensus theory and distributed communication topology, the remaining flight time of each flight vehicle is syn-chronized to ensure that they intercept the target simulta-neously with different impact angles. Simulation experiments are conducted to validate the effectiveness of the proposed cooper-ative interception and guidance method.
基金supported by the National Natural Science Foundation of China(6237338661973327).
文摘How multi-unmanned aerial vehicles(UAVs)carrying a payload pass an obstacle-dense environment is practically important.Up to now,there have been few results on safe motion planning for the multi-UAVs cooperative transportation system(CTS)to pass through such an environment.The prob-lem is challenging because it is difficult to analyze and explicitly take into account the swing motion of the payload in planning.In this paper,a modeling method of virtual tube is proposed by fus-ing the advantages of the existing modeling algorithm for regu-lar virtual tube and the expansion environment method.The pro-posed method can not only generate a safe and smooth tube for UAVs,but also ensure the payload stays away from the dense obstacles.Simulation results show the effectiveness of the method and the safety of the planned tube.
基金supported by the National Natural Science Foundation of China(62003264).
文摘To solve the problem of providing the best initial situation for terminal guidance when multiple missiles intercept multiple targets,a group cooperative midcourse guidance law(GCMGL)considering time-to-go is proposed.Firstly,a threedimensional(3D)guidance model is established and a cooperative trajectory shaping guidance law is given.Secondly,for estimating the unknown target maneuvering acceleration,an adaptive disturbance observer(ADO)is designed,combining finitetime theory with a radial basis function(RBF)neural network,and the convergence of the estimation error is proven using Lyapunov stability theory.Then,to ensure time-to-go cooperation among missiles within the same group and across different groups,the group consensus protocols of virtual collision point mean and the inter-group cooperative consensus protocol are designed respectively.Based on the group consensus protocols,the virtual collision point cooperative guidance law is given,and the finite-time convergence is proved by Lyapunov stability theory.Simultaneously,combined with trajectory shaping guidance law,virtual collision point cooperative guidance law and the intergroup cooperative consensus protocol,the design of GCMGL considering time-to-go is given.Finally,numerical simulation results show the effectiveness and the superiority of the proposed GCMGL.
基金supported by the National Natural Science Foundation of China(Grant No.62203362)the Natural Science Basic Research Program of Shaanxi(Grant No.2023-JC-QN-0569)。
文摘A situation maintenance-based cooperative guidance strategy is proposed to intercept a high-speed and high-maneuverability target via inferior missiles.Reachability and relative motion analyses are conducted to develop and pursue virtual targets,respectively.A two-stage guidance strategy under nonlinear kinematics is developed on the basis of virtual targets.The first stage optimizes the coverage and collision situation by pursuing virtual targets under specific angular constraints.The second stage subsequently intercepts the superior target based on the handover condition optimized by the first stage.Numerical simulation results are provided to compare the effectiveness and superiority of the proposed strategy with those of the reachability-based cooperative strategy(RCS),coverage-based cooperative guidance(CBCG)and augmented proportional navigation(APN)under various maneuvering modes.
基金the Science and Technology Department,Heilongjiang Province under Grant Agreement No JJ2022LH0315。
文摘This paper presents a mode-switching collaborative defense strategy for spacecraft pursuit-evasiondefense scenarios.In these scenarios,the pursuer tries to avoid the defender while capturing the evader,while the evader and defender form an alliance to prevent the pursuer from achieving its goal.First,the behavioral modes of the pursuer,including attack and avoidance modes,were established using differential game theory.These modes are then recognized by an interactive multiple model-matching algorithm(IMM),that uses several smooth variable structure filters to match the modes of the pursuer and update their probabilities in real time.Based on the linear-quadratic optimization theory,combined with the results of strategy identification,a two-way cooperative optimal strategy for the defender and evader is proposed,where the evader aids the defender to intercept the pursuer by performing luring maneuvers.Simulation results show that the interactive multi-model algorithm based on several smooth variable structure filters perform well in the strategy identification of the pursuer,and the cooperative defense strategy based on strategy identification has good interception performance when facing pursuers,who are able to flexibly adjust their game objectives.
基金supported by the Intelligent Aerospace System Leading Innovation Team Program of Zhejiang(2022R01003).
文摘In the realm of missile defense systems,the self-sufficient maneuver capacity of missile swarms is pivotal for their survival.Through the analysis of the missile dynamics model,a time-efficient cooperative attack strategy for missile swarm is proposed.Based on the distribution of the attackers and defenders,the collision avoidance against the defenders is considered during the attack process.By analyzing the geometric relationship between the relative velocity vector and relative position vector of the attackers and defenders,the collision avoidance constrains of attacking swarm are redefined.The key point is on adjusting the relative velocity vectors to fall outside the collision cone.This work facilitates high-precision attack toward the target while keeping safe missing distance between other attackers during collision avoidance process.By leveraging an innovative repulsion artificial function,a time-efficient cooperative attack strategy for missile swarm is obtained.Through rigorous simulation,the effectiveness of this cooperative attack strategy is substantiated.Furthermore,by employing Monte Carlo simulation,the success rate of the cooperative attack strategy is assessesed and the optimal configuration for the missile swarm is deduced.
基金Project(61673233)supported by the National Natural Science Foundation of ChinaProject(D171100006417003)supported by Beijing Municipal Science and Technology Program,China
文摘Cooperative driving around intersections has aroused increasing interest in the last five years.Meanwhile,driving safety in non-signalized intersections has become an issue that has attracted attention globally.In view of the potential collision risk when more than three vehicles approach a non-signalized intersection from different directions,we propose a driving model using cooperative game theory.First,the characteristic functions of this model are primarily established on each vehicle’s profit function and include safety,rapidity and comfort indicators.Second,the Shapley theorem is adopted,and its group rationality,individual rationality,and uniqueness are proved to be suitable for the characteristic functions of the model.Following this,different drivers’characteristics are considered.In order to simplify the calculation process,a zero-mean normalization method is introduced.In addition,a genetic algorithm method is adopted to search an optimal strategy set in the constrained multi-objective optimization problem.Finally,the model is confirmed as valid after simulation with a series of initial conditions.
基金Project(61201143)supported by the National Natural Science Foundation of China
文摘In non-dedicated cooperative relay networks, each node is autonomous and selfish in nature, and thus spontaneous cooperation among nodes is challenged. To stimulate the selfish node to participate in cooperation, a pricing-based cooperation engine using game theory was designed. Firstly, the feasible regions of the charge price and reimbursement price were deduced. Then, the non-cooperative and cooperative games were adopted to analyze the amount of bandwidth that initiating cooperation node(ICN) forwards data through participating cooperation node(PCN) and the amount of bandwidth that PCN helps ICN to relay data. Meanwhile, the Nash equilibrium solutions of cooperation bandwidth allocations(CBAs) were obtained through geometrical interpretation. Secondly, a pricing-based cooperation engine was proposed and a cooperative communication system model with cooperation engines was depicted. Finally, an algorithm based on game theory was proposed to realize the cooperation engine. The simulation results demonstrate that, compared with the system without pricing-based incentive, the proposed system can significantly improve the ICN's metric measured by bit-per-Joule and increase the PCN's revenue.
基金Project(61801495)supported by the National Natural Science Foundation of China
文摘The application of multiple UAVs in complicated tasks has been widely explored in recent years.Due to the advantages of flexibility,cheapness and consistence,the performance of heterogeneous multi-UAVs with proper cooperative task allocation is superior to over the single UAV.Accordingly,several constraints should be satisfied to realize the efficient cooperation,such as special time-window,variant equipment,specified execution sequence.Hence,a proper task allocation in UAVs is the crucial point for the final success.The task allocation problem of the heterogeneous UAVs can be formulated as a multi-objective optimization problem coupled with the UAV dynamics.To this end,a multi-layer encoding strategy and a constraint scheduling method are designed to handle the critical logical and physical constraints.In addition,four optimization objectives:completion time,target reward,UAV damage,and total range,are introduced to evaluate various allocation plans.Subsequently,to efficiently solve the multi-objective optimization problem,an improved multi-objective quantum-behaved particle swarm optimization(IMOQPSO)algorithm is proposed.During this algorithm,a modified solution evaluation method is designed to guide algorithmic evolution;both the convergence and distribution of particles are considered comprehensively;and boundary solutions which may produce some special allocation plans are preserved.Moreover,adaptive parameter control and mixed update mechanism are also introduced in this algorithm.Finally,both the proposed model and algorithm are verified by simulation experiments.
基金supported by the Aeronautical Science Foundation of China(2017ZC53033)the Seed Foundation of Innovation and Creation for Graduate Students in Northwestern Polytechnical University(CX2020156)。
文摘In order to improve the autonomous ability of unmanned aerial vehicles(UAV)to implement air combat mission,many artificial intelligence-based autonomous air combat maneuver decision-making studies have been carried out,but these studies are often aimed at individual decision-making in 1 v1 scenarios which rarely happen in actual air combat.Based on the research of the 1 v1 autonomous air combat maneuver decision,this paper builds a multi-UAV cooperative air combat maneuver decision model based on multi-agent reinforcement learning.Firstly,a bidirectional recurrent neural network(BRNN)is used to achieve communication between UAV individuals,and the multi-UAV cooperative air combat maneuver decision model under the actor-critic architecture is established.Secondly,through combining with target allocation and air combat situation assessment,the tactical goal of the formation is merged with the reinforcement learning goal of every UAV,and a cooperative tactical maneuver policy is generated.The simulation results prove that the multi-UAV cooperative air combat maneuver decision model established in this paper can obtain the cooperative maneuver policy through reinforcement learning,the cooperative maneuver policy can guide UAVs to obtain the overall situational advantage and defeat the opponents under tactical cooperation.
基金This work was supported by the Deanship of Scientific Research(DSR)at King Abdulaziz University,Jeddah(G-363-135-1438).
文摘This paper addresses the cooperative control problem of multiple unmanned aerial vehicles(multi-UAV)systems.First,a new distributed consensus algorithm for second-order nonlinear multi-agent systems(MAS)is formulated under the leader-following approach.The algorithm provides smooth input signals to the agents’control channels,which avoids the chattering effect generated by the conventional sliding mode-based control protocols.Second,a new formation control scheme is developed by integrating smooth distributed consensus control protocols into the geometric pattern model to achieve three-dimensional formation tracking.The Lyapunov theory is used to prove the stability and convergence of both distributed consensus and formation controllers.The effectiveness of the proposed algorithms is demonstrated through simulation results.
文摘Cooperative path planning is an important area in fixed-wing UAV swarm.However,avoiding multiple timevarying obstacles and avoiding local optimum are two challenges for existing approaches in a dynamic environment.Firstly,a normalized artificial potential field optimization is proposed by reconstructing a novel function with anisotropy in each dimension,which can make the flight speed of a fixed UAV swarm independent of the repulsive/attractive gain coefficient and avoid trapping into local optimization and local oscillation.Then,taking into account minimum velocity and turning angular velocity of fixed-wing UAV swarm,a strategy of decomposing target vector to avoid moving obstacles and pop-up threats is proposed.Finally,several simulations are carried out to illustrate superiority and effectiveness.
基金supported by the National Natural Science Foundation of China(No.61573286)the Aeronautical Science Foundation of China(No.20180753006)+2 种基金the Fundamental Research Funds for the Central Universities(3102019ZDHKY07)the Natural Science Foundation of Shaanxi Province(2020JQ-218)the Shaanxi Province Key Laboratory of Flight Control and Simulation Technology。
文摘Recent advances in on-board radar and missile capabilities,combined with individual payload limitations,have led to increased interest in the use of unmanned combat aerial vehicles(UCAVs)for cooperative occupation during beyond-visual-range(BVR)air combat.However,prior research on occupational decision-making in BVR air combat has mostly been limited to one-on-one scenarios.As such,this study presents a practical cooperative occupation decision-making methodology for use with multiple UCAVs.The weapon engagement zone(WEZ)and combat geometry were first used to develop an advantage function for situational assessment of one-on-one engagement.An encircling advantage function was then designed to represent the cooperation of UCAVs,thereby establishing a cooperative occupation model.The corresponding objective function was derived from the one-on-one engagement advantage function and the encircling advantage function.The resulting model exhibited similarities to a mixed-integer nonlinear programming(MINLP)problem.As such,an improved discrete particle swarm optimization(DPSO)algorithm was used to identify a solution.The occupation process was then converted into a formation switching task as part of the cooperative occupation model.A series of simulations were conducted to verify occupational solutions in varying situations,including two-on-two engagement.Simulated results showed these solutions varied with initial conditions and weighting coefficients.This occupation process,based on formation switching,effectively demonstrates the viability of the proposed technique.These cooperative occupation results could provide a theoretical framework for subsequent research in cooperative BVR air combat.
基金supported by the National Natural Science Foundation of China (60873069 61171132)+3 种基金the Jiangsu Government Scholarship for Overseas Studies (JS-2010-K005)the Funding of Jiangsu Innovation Program for Graduate Education (CXZZ11 0219)the Open Project Program of Jiangsu Provincial Key Laboratory of Computer Information Processing Technology (KJS1023)the Applying Study Foundation of Nantong (BK2011062)
文摘Particle swarm optimization （PSO） is a new heuristic algorithm which has been applied to many optimization problems successfully. Attribute reduction is a key studying point of the rough set theory, and it has been proven that computing minimal reduc- tion of decision tables is a non-derterministic polynomial （NP）-hard problem. A new cooperative extended attribute reduction algorithm named Co-PSAR based on improved PSO is proposed, in which the cooperative evolutionary strategy with suitable fitness func- tions is involved to learn a good hypothesis for accelerating the optimization of searching minimal attribute reduction. Experiments on Benchmark functions and University of California, Irvine （UCI） data sets, compared with other algorithms, verify the superiority of the Co-PSAR algorithm in terms of the convergence speed, efficiency and accuracy for the attribute reduction.
基金supported by the National Natural Science Foundation of China(61573017)the Doctoral Innovation Found of Air Force Engineering University(KGD08101604)
文摘Manned combat aerial vehicles （MCAVs）, and un-manned combat aerial vehicles （UCAVs） together form a cooper-ative engagement system to carry out operational mission, whichwill be a new air engagement style in the near future. On the basisof analyzing the structure of the MCAV/UCAV cooperative engage-ment system, this paper divides the unique system into three hi-erarchical levels, respectively, i.e., mission level, task-cluster leveland task level. To solve the formation and adjustment problem ofthe latter two levels, three corresponding mathematical modelsare established. To solve these models, three algorithms calledquantum artificial bee colony （QABC） algorithm, greedy strategy（GS） and two-stage greedy strategy （TSGS） are proposed. Finally,a series of simulation experiments are designed to verify the effec-tiveness and superiority of the proposed algorithms.
文摘Aiming at the problem on cooperative air-defense of surface warship formation, this paper maps the cooperative airdefense system of systems （SoS） for surface warship formation （CASoSSWF） to the biological immune system （BIS） according to the similarity of the defense mechanism and characteristics between the CASoSSWF and the BIS, and then designs the models of components and the architecture for a monitoring agent, a regulating agent, a killer agent, a pre-warning agent and a communicating agent by making use of the theories and methods of the artificial immune system, the multi-agent system （MAS）, the vaccine and the danger theory （DT）. Moreover a new immune multi-agent model using vaccine based on DT （IMMUVBDT） for the cooperative air-defense SoS is advanced. The immune response and immune mechanism of the CASoSSWF are analyzed. The model has a capability of memory, evolution, commendable dynamic environment adaptability and self-learning, and embodies adequately the cooperative air-defense mechanism for the CASoSSWF. Therefore it shows a novel idea for the CASoSSWF which can provide conception models for a surface warship formation operation simulation system.
基金supported by the National Natural Science Foundation of China(Grant No.61933010 and 61903301)Shaanxi Aerospace Flight Vehicle Design Key Laboratory。
文摘Cooperative autonomous air combat of multiple unmanned aerial vehicles(UAVs)is one of the main combat modes in future air warfare,which becomes even more complicated with highly changeable situation and uncertain information of the opponents.As such,this paper presents a cooperative decision-making method based on incomplete information dynamic game to generate maneuver strategies for multiple UAVs in air combat.Firstly,a cooperative situation assessment model is presented to measure the overall combat situation.Secondly,an incomplete information dynamic game model is proposed to model the dynamic process of air combat,and a dynamic Bayesian network is designed to infer the tactical intention of the opponent.Then a reinforcement learning framework based on multiagent deep deterministic policy gradient is established to obtain the perfect Bayes-Nash equilibrium solution of the air combat game model.Finally,a series of simulations are conducted to verify the effectiveness of the proposed method,and the simulation results show effective synergies and cooperative tactics.
文摘This paper investigates the problem of distributed cooperative guidance law design for multiple anti-ship missiles in the three-dimensional(3-D)space hitting simultaneously the same target with considering the desired terminal impact angle constraint.To address this issue,the problem formulation including 3-D nonlinear mathematical model description,and communication topology are built firstly.Then the consensus variable is constructed using the available information and can reach consensus under the proposed acceleration command along the line-of-sight(LOS)which satisfies the impact time constraint.However,the normal accelerations are designed to guarantee the convergence of the LOS angular rate.Furthermore,consider the terminal impact angle constraints,a nonsingular terminal sliding mode(NTSM)control is introduced,and a finite time convergent control law of normal acceleration is proposed.The convergence of the proposed guidance law is proved by using the second Lyapunov stability method,and numerical simulations are also conducted to verify its effectiveness.The results indicate that the proposed cooperative guidance law can regulate the impact time error and impact angle error in finite time if the connecting time of the communication topology is longer than the required convergent time.
