Natural selection opposes the evolution of cooperation unless specific mechanisms are at work in Prisoner＇s Dilemma. By taking advantage of the modern control theory, the controller design is discussed and the optima...Natural selection opposes the evolution of cooperation unless specific mechanisms are at work in Prisoner＇s Dilemma. By taking advantage of the modern control theory, the controller design is discussed and the optimal control is designed for promoting cooperation based on the recent advances in mechanisms for the evolution of cooperation. Two con- trol strategies are proposed： compensation control strategy for the cooperator when playing against a defector and reward control strategy for cooperator when playing against a coop- erator. The feasibility and effectiveness of these control strategies for promoting cooperation in different stages are analyzed. The reward for cooperation can＇t prevent defection from being evolutionary stable strategy （ESS）. On the other hand, compensation for the coopera- tor can＇t prevent defection from emerging and sustaining. By considering the effect and the cost, an optimal control scheme with constraint on the admissible control set is put forward. By analyzing the special nonlinear system of replicator dynamics, the exact analytic solution of the optimal control scheme is obtained based on the maximum principle. Finally, the effectiveness of the proposed method is illustrated by examples.展开更多
The cooperative control and stability analysis problems for the multi-agent system with sampled com- munication are investigated. Distributed state feedback controllers are adopted for the cooperation of networked age...The cooperative control and stability analysis problems for the multi-agent system with sampled com- munication are investigated. Distributed state feedback controllers are adopted for the cooperation of networked agents. A theorem in the form of linear matrix inequalities（LMI） is derived to analyze the system stability. An- other theorem in the form of optimization problem subject to LMI constraints is proposed to design the controller, and then the algorithm is presented. The simulation results verify the validity and the effectiveness of the pro- posed approach.展开更多
Multiple unmanned aerial vehicles(UAVs)cooperative operation is the main form for UAVs fighting in battlefield,and multi-UAV mission rendezvous is the premise of cooperative reconnaissance and attack missions.We propo...Multiple unmanned aerial vehicles(UAVs)cooperative operation is the main form for UAVs fighting in battlefield,and multi-UAV mission rendezvous is the premise of cooperative reconnaissance and attack missions.We propose a rendezvous control strategy,which divides the rendezvous process into two parts:The loose formation rendezvous and the close formation rendezvous.In the first stage,UAVs are supposed to reach the specific target locations simultaneously and form a loose formation.A distributed control strategy based on first-order consensus algorithm is presented to achieve this goal.Then the second stage is designed based on the second-order consensus algorithm to complete the transition from the loose formation to the close formation.This process needs the speeds and heading angles of UAVs to reach an agreement.Besides,control algorithms with a virtual leader are proposed,by which the formation states can reach a specific value.Finally,simulation results show that the control algorithms are capable of realizing the mission rendezvous of multi-UAV and the consistence of UAVs′final states,which verify the effectiveness and feasibility of the designed control strategy.展开更多
This paper proposes cooperative adaptive control schemes for a train platoon to improve efficient utility and guarantee string stability. The control schemes are developed based on a bidirectional strategy, i.e., the ...This paper proposes cooperative adaptive control schemes for a train platoon to improve efficient utility and guarantee string stability. The control schemes are developed based on a bidirectional strategy, i.e., the information of proximal（preceding and following） trains is used in the controller design. Based on available proximal information（prox-info） of location, speed, and acceleration, a direct adaptive control is designed to maintain the tracking interval at the minimum safe distance. Based on available prox-info of location, an observer-based adaptive control is designed to achieve the same target, which alleviates the requirements of equipped sensors to measure prox-info of speed and acceleration. The developed schemes are capable of on-line estimating of the unknown system parameters and stabilizing the closed-loop system, the string stability of train platoon is guaranteed on the basis of Lyapunov stability theorem. Numerical simulation results are presented to verify the effectiveness of the proposed control laws.展开更多
Road throughput can be increased by driving at small inter-vehicle time gaps. The amplification of velocity disturbances in upstream direction, however, poses limitations to the minimum feasible time gap. This effect ...Road throughput can be increased by driving at small inter-vehicle time gaps. The amplification of velocity disturbances in upstream direction, however, poses limitations to the minimum feasible time gap. This effect is covered by the notion of string stability. String-stable behavior is thus considered an essential requirement for the design of automatic distance control systems, which are needed to allow for safe driving at time gaps well below 1 s. Using wireless inter-vehicle communications to provide real-time information of the preceding vehicle, in addition to the information obtained by common Adaptive Cruise Control （ACC） sensors, appears to significantly decrease the feasible time gap, which is shown by practical experiments with a test fleet consisting of six passenger vehicles. The large-scale deployment of this system, known as Cooperative ACC （CACC）, however, poses challenges with respect to the reliability of the wireless communication system. A solution for this scalability problem can be found in decreasing the transmission power and/or beaconing rate, or adapting the communications protocol. Although the main CACC objective is to increase road throughput, the first commercial application of CACC is foreseen to be in truck platooning, since short distance following is expected to yield significant fuel savings in this case.展开更多
Various distributed cooperative control schemes have been widely utilized for cyber-physical power system(CPPS),which only require local communications among geographic neighbors to fulfill certain goals.However,the p...Various distributed cooperative control schemes have been widely utilized for cyber-physical power system(CPPS),which only require local communications among geographic neighbors to fulfill certain goals.However,the process of evaluating the performance of an algorithm for a CPPS can be affected by the physical target characteristics and real communication conditions.To address this potential problem,a testbed with controller hardware-in-the-loop(CHIL)is proposed in this paper.On the basis of a power grid simulation conducted using the real-time simulator RT-LAB developed by the company OPAL-RT,along with a communication network simulation developed with OPNET,multiple distributed controllers were developed with hardware devices to directly collect the real-time operating data of the power system model in RT-LAB and provide local control.Furthermore,the communication between neighboring controllers was realized using the cyber system modelin OPNET with an Ethernet interface.The hardware controllers produced a real-world control behavior instead of a digital simulation,and precisely simulated the dynamic features of a CPPS with high speed.A classic cooperative control case for active power output was studied to explain the integrated simulation process and validate the effectiveness of the co-simulation testbed.展开更多
To further investigate car-following behaviors in the cooperative adaptive cruise control（CACC） strategy,a comprehensive control system which can handle three traffic conditions to guarantee driving efficiency and s...To further investigate car-following behaviors in the cooperative adaptive cruise control（CACC） strategy,a comprehensive control system which can handle three traffic conditions to guarantee driving efficiency and safety is designed by using three CACC models.In this control system,some vital comprehensive information,such as multiple preceding cars’ speed differences and headway,variable safety distance（VSD） and time-delay effect on the traffic current and the jamming transition have been investigated via analytical or numerical methods.Local and string stability criterion for the velocity control（VC） model and gap control（GC） model are derived via linear stability theory.Numerical simulations are conducted to study the performance of the simulated traffic flow.The simulation results show that the VC model and GC model can improve driving efficiency and suppress traffic congestion.展开更多
Aiming at the problem of multi-UAV pursuit-evasion confrontation, a UAV cooperative maneuver method based on an improved multi-agent deep reinforcement learning(MADRL) is proposed. In this method, an improved Comm Net...Aiming at the problem of multi-UAV pursuit-evasion confrontation, a UAV cooperative maneuver method based on an improved multi-agent deep reinforcement learning(MADRL) is proposed. In this method, an improved Comm Net network based on a communication mechanism is introduced into a deep reinforcement learning algorithm to solve the multi-agent problem. A layer of gated recurrent unit(GRU) is added to the actor-network structure to remember historical environmental states. Subsequently,another GRU is designed as a communication channel in the Comm Net core network layer to refine communication information between UAVs. Finally, the simulation results of the algorithm in two sets of scenarios are given, and the results show that the method has good effectiveness and applicability.展开更多
The research progress of swarm robotics is reviewed in details. The swarm robotics inspired from nature is a combination of swarm intelligence and robotics, which shows a great potential in several aspects. First of a...The research progress of swarm robotics is reviewed in details. The swarm robotics inspired from nature is a combination of swarm intelligence and robotics, which shows a great potential in several aspects. First of all, the cooperation of nature swarm and swarm intelligence are briefly introduced, and the special features of the swarm robotics are summarized compared to a single robot and other multi-individual systems. Then the modeling methods for swarm robotics are described by a list of several widely used swarm robotics entity projects and simulation platforms. Finally, as a main part of this paper, the current research on the swarm robotic algorithms are presented in detail, including cooperative control mechanisms in swarm robotics for flocking, navigating and searching applications.展开更多
文摘Natural selection opposes the evolution of cooperation unless specific mechanisms are at work in Prisoner＇s Dilemma. By taking advantage of the modern control theory, the controller design is discussed and the optimal control is designed for promoting cooperation based on the recent advances in mechanisms for the evolution of cooperation. Two con- trol strategies are proposed： compensation control strategy for the cooperator when playing against a defector and reward control strategy for cooperator when playing against a coop- erator. The feasibility and effectiveness of these control strategies for promoting cooperation in different stages are analyzed. The reward for cooperation can＇t prevent defection from being evolutionary stable strategy （ESS）. On the other hand, compensation for the coopera- tor can＇t prevent defection from emerging and sustaining. By considering the effect and the cost, an optimal control scheme with constraint on the admissible control set is put forward. By analyzing the special nonlinear system of replicator dynamics, the exact analytic solution of the optimal control scheme is obtained based on the maximum principle. Finally, the effectiveness of the proposed method is illustrated by examples.
基金Supported by the National Natural Science Foundation of China(91016017)the National Aviation Found of China(20115868009)~~
文摘The cooperative control and stability analysis problems for the multi-agent system with sampled com- munication are investigated. Distributed state feedback controllers are adopted for the cooperation of networked agents. A theorem in the form of linear matrix inequalities（LMI） is derived to analyze the system stability. An- other theorem in the form of optimization problem subject to LMI constraints is proposed to design the controller, and then the algorithm is presented. The simulation results verify the validity and the effectiveness of the pro- posed approach.
基金jointly granted by the Science and Technology on Avionics Integration Laboratorythe Aeronautical Science Foundation(2016ZC15008)
文摘Multiple unmanned aerial vehicles(UAVs)cooperative operation is the main form for UAVs fighting in battlefield,and multi-UAV mission rendezvous is the premise of cooperative reconnaissance and attack missions.We propose a rendezvous control strategy,which divides the rendezvous process into two parts:The loose formation rendezvous and the close formation rendezvous.In the first stage,UAVs are supposed to reach the specific target locations simultaneously and form a loose formation.A distributed control strategy based on first-order consensus algorithm is presented to achieve this goal.Then the second stage is designed based on the second-order consensus algorithm to complete the transition from the loose formation to the close formation.This process needs the speeds and heading angles of UAVs to reach an agreement.Besides,control algorithms with a virtual leader are proposed,by which the formation states can reach a specific value.Finally,simulation results show that the control algorithms are capable of realizing the mission rendezvous of multi-UAV and the consistence of UAVs′final states,which verify the effectiveness and feasibility of the designed control strategy.
基金Project supported by the Beijing Jiaotong University Research Program,China(Grant No.RCS2014ZT18)the Fundamental Research Funds for Central Universities,China(Grant No.2015JBZ007)the National Natural Science Foundation of China(Grant Nos.61233001,61322307,and 61304196)
文摘This paper proposes cooperative adaptive control schemes for a train platoon to improve efficient utility and guarantee string stability. The control schemes are developed based on a bidirectional strategy, i.e., the information of proximal（preceding and following） trains is used in the controller design. Based on available proximal information（prox-info） of location, speed, and acceleration, a direct adaptive control is designed to maintain the tracking interval at the minimum safe distance. Based on available prox-info of location, an observer-based adaptive control is designed to achieve the same target, which alleviates the requirements of equipped sensors to measure prox-info of speed and acceleration. The developed schemes are capable of on-line estimating of the unknown system parameters and stabilizing the closed-loop system, the string stability of train platoon is guaranteed on the basis of Lyapunov stability theorem. Numerical simulation results are presented to verify the effectiveness of the proposed control laws.
文摘Road throughput can be increased by driving at small inter-vehicle time gaps. The amplification of velocity disturbances in upstream direction, however, poses limitations to the minimum feasible time gap. This effect is covered by the notion of string stability. String-stable behavior is thus considered an essential requirement for the design of automatic distance control systems, which are needed to allow for safe driving at time gaps well below 1 s. Using wireless inter-vehicle communications to provide real-time information of the preceding vehicle, in addition to the information obtained by common Adaptive Cruise Control （ACC） sensors, appears to significantly decrease the feasible time gap, which is shown by practical experiments with a test fleet consisting of six passenger vehicles. The large-scale deployment of this system, known as Cooperative ACC （CACC）, however, poses challenges with respect to the reliability of the wireless communication system. A solution for this scalability problem can be found in decreasing the transmission power and/or beaconing rate, or adapting the communications protocol. Although the main CACC objective is to increase road throughput, the first commercial application of CACC is foreseen to be in truck platooning, since short distance following is expected to yield significant fuel savings in this case.
基金the National Key Research and Development Program of China(Basic Research Class)(No.2017YFB0903000)the National Natural Science Foundation of China(No.U1909201).
文摘Various distributed cooperative control schemes have been widely utilized for cyber-physical power system(CPPS),which only require local communications among geographic neighbors to fulfill certain goals.However,the process of evaluating the performance of an algorithm for a CPPS can be affected by the physical target characteristics and real communication conditions.To address this potential problem,a testbed with controller hardware-in-the-loop(CHIL)is proposed in this paper.On the basis of a power grid simulation conducted using the real-time simulator RT-LAB developed by the company OPAL-RT,along with a communication network simulation developed with OPNET,multiple distributed controllers were developed with hardware devices to directly collect the real-time operating data of the power system model in RT-LAB and provide local control.Furthermore,the communication between neighboring controllers was realized using the cyber system modelin OPNET with an Ethernet interface.The hardware controllers produced a real-world control behavior instead of a digital simulation,and precisely simulated the dynamic features of a CPPS with high speed.A classic cooperative control case for active power output was studied to explain the integrated simulation process and validate the effectiveness of the co-simulation testbed.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.71571107 and 11302110)The Scientific Research Fund of Zhejiang Province,China(Grant Nos.LY15A020007,LY15E080013,and LY16G010003)+2 种基金The Natural Science Foundation of Ningbo City(Grant Nos.2014A610030and 2015A610299)the Fund from the Government of the Hong Kong Administrative Region,China(Grant No.City U11209614)the K C Wong Magna Fund in Ningbo University,China
文摘To further investigate car-following behaviors in the cooperative adaptive cruise control（CACC） strategy,a comprehensive control system which can handle three traffic conditions to guarantee driving efficiency and safety is designed by using three CACC models.In this control system,some vital comprehensive information,such as multiple preceding cars’ speed differences and headway,variable safety distance（VSD） and time-delay effect on the traffic current and the jamming transition have been investigated via analytical or numerical methods.Local and string stability criterion for the velocity control（VC） model and gap control（GC） model are derived via linear stability theory.Numerical simulations are conducted to study the performance of the simulated traffic flow.The simulation results show that the VC model and GC model can improve driving efficiency and suppress traffic congestion.
基金supported in part by the National Key Laboratory of Air-based Information Perception and Fusion and the Aeronautical Science Foundation of China (Grant No. 20220001068001)National Natural Science Foundation of China (Grant No.61673327)+1 种基金Natural Science Basic Research Plan in Shaanxi Province,China (Grant No. 2023-JC-QN-0733)China IndustryUniversity-Research Innovation Foundation (Grant No. 2022IT188)。
文摘Aiming at the problem of multi-UAV pursuit-evasion confrontation, a UAV cooperative maneuver method based on an improved multi-agent deep reinforcement learning(MADRL) is proposed. In this method, an improved Comm Net network based on a communication mechanism is introduced into a deep reinforcement learning algorithm to solve the multi-agent problem. A layer of gated recurrent unit(GRU) is added to the actor-network structure to remember historical environmental states. Subsequently,another GRU is designed as a communication channel in the Comm Net core network layer to refine communication information between UAVs. Finally, the simulation results of the algorithm in two sets of scenarios are given, and the results show that the method has good effectiveness and applicability.
基金Sponsored by National Natural Science Foundation of China under Grant( 61170057,60875080)
文摘The research progress of swarm robotics is reviewed in details. The swarm robotics inspired from nature is a combination of swarm intelligence and robotics, which shows a great potential in several aspects. First of all, the cooperation of nature swarm and swarm intelligence are briefly introduced, and the special features of the swarm robotics are summarized compared to a single robot and other multi-individual systems. Then the modeling methods for swarm robotics are described by a list of several widely used swarm robotics entity projects and simulation platforms. Finally, as a main part of this paper, the current research on the swarm robotic algorithms are presented in detail, including cooperative control mechanisms in swarm robotics for flocking, navigating and searching applications.
