Tracking maneuvering target in real time autonomously and accurately in an uncertain environment is one of the challenging missions for unmanned aerial vehicles(UAVs).In this paper,aiming to address the control proble...Tracking maneuvering target in real time autonomously and accurately in an uncertain environment is one of the challenging missions for unmanned aerial vehicles(UAVs).In this paper,aiming to address the control problem of maneuvering target tracking and obstacle avoidance,an online path planning approach for UAV is developed based on deep reinforcement learning.Through end-to-end learning powered by neural networks,the proposed approach can achieve the perception of the environment and continuous motion output control.This proposed approach includes:(1)A deep deterministic policy gradient(DDPG)-based control framework to provide learning and autonomous decision-making capability for UAVs;(2)An improved method named MN-DDPG for introducing a type of mixed noises to assist UAV with exploring stochastic strategies for online optimal planning;and(3)An algorithm of taskdecomposition and pre-training for efficient transfer learning to improve the generalization capability of UAV’s control model built based on MN-DDPG.The experimental simulation results have verified that the proposed approach can achieve good self-adaptive adjustment of UAV’s flight attitude in the tasks of maneuvering target tracking with a significant improvement in generalization capability and training efficiency of UAV tracking controller in uncertain environments.展开更多
The basic"current"statistical model and adaptive Kalman filter algorithm can not track a weakly maneuvering target precisely,though it has good estimate accuracy for strongly maneuvering target.In order to s...The basic"current"statistical model and adaptive Kalman filter algorithm can not track a weakly maneuvering target precisely,though it has good estimate accuracy for strongly maneuvering target.In order to solve this problem,a novel nonlinear fuzzy membership function was presented to adjust the upper and lower limit of target acceleration adaptively,and then the validity of the new algorithm for feeblish maneuvering target was proved in theory.At last,the computer simulation experiments indicated that the new algorithm has a great advantage over the basic"current"statistical model and adaptive algorithm.展开更多
The scheme for tracking maneuvering target based on neural fuzzy network with incremental neural learning is proposed. When tracked target maneuver occurs, the scheme can detect maneuver immediately and estimate the m...The scheme for tracking maneuvering target based on neural fuzzy network with incremental neural learning is proposed. When tracked target maneuver occurs, the scheme can detect maneuver immediately and estimate the maneuver value accurately , then the tracking filter can be compensated correctly and duly by the estimated maneuver value. When environment changes, neural fuzzy network with incremental neural learning （INL-SONFIN） can find its optimal structure and parameters automatically to adopt to changed environment. So, it always produce estimated output very close to the true maneuver value that leads to good tracking performance and avoids misstracking. Simulation results show that the performance is superior to the traditional schemes and the scheme can fit changed dynamic environment to track maneuvering target accurately and duly.展开更多
It is a tough problem to jointly detect and track a weak target, and it becomes even more challenging when the target is maneuvering. The above problem is formulated by using the Bayesian theory and a multiple model(M...It is a tough problem to jointly detect and track a weak target, and it becomes even more challenging when the target is maneuvering. The above problem is formulated by using the Bayesian theory and a multiple model(MM) based filter is proposed. The filter presented uses the MM method to accommodate the multiple motions that a maneuvering target may travel under by adding a random variable representing the motion model to the target state. To strengthen the efficiency performance of the filter,the target existence variable is separated from the target state and the existence probability is calculated in a more efficient way. To examine the performance of the MM based approach, a typical track-before-detect(TBD) scenario with a maneuvering target is used for simulations. The simulation results indicate that the MM based filter proposed has a good performance in joint detecting and tracking of a weak and maneuvering target, and it is more efficient than the general MM method.展开更多
The state estimation of a maneuvering target,of which the trajectory shape is independent on dynamic characteristics,is studied.The conventional motion models in Cartesian coordinates imply that the trajectory of a ta...The state estimation of a maneuvering target,of which the trajectory shape is independent on dynamic characteristics,is studied.The conventional motion models in Cartesian coordinates imply that the trajectory of a target is completely determined by its dynamic characteristics.However,this is not true in the applications of road-target,sea-route-target or flight route-target tracking,where target trajectory shape is uncoupled with target velocity properties.In this paper,a new estimation algorithm based on separate modeling of target trajectory shape and dynamic characteristics is proposed.The trajectory of a target over a sliding window is described by a linear function of the arc length.To determine the unknown target trajectory,an augmented system is derived by denoting the unknown coefficients of the function as states in mileage coordinates.At every estimation cycle except the first one,the interaction(mixing)stage of the proposed algorithm starts from the latest estimated base state and a recalculated parameter vector,which is determined by the least squares(LS).Numerical experiments are conducted to assess the performance of the proposed algorithm.Simulation results show that the proposed algorithm can achieve better performance than the conventional coupled model-based algorithms in the presence of target maneuvers.展开更多
Satisfactory results cannot be obtained when three-dimensional (3D) targets with complex maneuvering characteristics are tracked by the commonly used two-dimensional coordinated turn (2DCT) model. To address the probl...Satisfactory results cannot be obtained when three-dimensional (3D) targets with complex maneuvering characteristics are tracked by the commonly used two-dimensional coordinated turn (2DCT) model. To address the problem of 3D target tracking with strong maneuverability, on the basis of the modified three-dimensional variable turn (3DVT) model, an adaptive tracking algorithm is proposed by combining with the cubature Kalman filter (CKF) in this paper. Through ideology of real-time identification, the parameters of the model are changed to adjust the state transition matrix and the state noise covariance matrix. Therefore, states of the target are matched in real-time to achieve the purpose of adaptive tracking. Finally, four simulations are analyzed in different settings by the Monte Carlo method. All results show that the proposed algorithm can update parameters of the model and identify motion characteristics in real-time when targets tracking also has a better tracking accuracy.展开更多
A Target State Estimator (TSE) for airborne radar system is proposed in this paper. It is very important for fire control system to obtain accurate estimation of the maneuvering target and the TSE becomes a key link i...A Target State Estimator (TSE) for airborne radar system is proposed in this paper. It is very important for fire control system to obtain accurate estimation of the maneuvering target and the TSE becomes a key link in the integrated Flight/Fire Control (IFFC) system. By adopting the Cartesian coordinates and pseudomeasurements ,the result ed TSE has it s advantages in computation.In addition, by employing accurate range and range-rate redundant filter, the range direction estimations obtained in Cartesian filter are greatly improved. The TSE shows its satisfaCtory performance in the Monte Carlo simulation of the IFFC system.展开更多
The finite set statistics provides a mathematically rig- orous single target Bayesian filter （STBF） for tracking a target that generates multiple measurements in a cluttered environment. However, the target maneuver...The finite set statistics provides a mathematically rig- orous single target Bayesian filter （STBF） for tracking a target that generates multiple measurements in a cluttered environment. However, the target maneuvers may lead to the degraded track- ing performance and even track loss when using the STBF. The multiple-model technique has been generally considered as the mainstream approach to maneuvering the target tracking. Moti- vated by the above observations, we propose the multiple-model extension of the original STBF, called MM-STBF, to accommodate the possible target maneuvering behavior. Since the derived MM- STBF involve multiple integrals with no closed form in general, a sequential Monte Carlo implementation （for generic models） and a Gaussian mixture implementation （for linear Gaussian models） are presented. Simulation results show that the proposed MM-STBF outperforms the STBF in terms of root mean squared errors of dynamic state estimates.展开更多
In order to estimate the systematic error in the processof maneuvering target adaptive tracking, a new method is proposed.The proposed method is a linear tracking scheme basedon a modified input estimation approach. A...In order to estimate the systematic error in the processof maneuvering target adaptive tracking, a new method is proposed.The proposed method is a linear tracking scheme basedon a modified input estimation approach. A special augmentationin the state space model is considered, in which both the systematicerror and the unknown input vector are attached to thestate vector. Then, an augmented state model and a measurementmodel are established in the case of systematic error, andthe corresponding filter formulas are also given. In the proposedscheme, the original state, the acceleration and the systematicerror vector can be estimated simultaneously. This method can notonly solve the maneuvering target adaptive tracking problem in thecase of systematic error, but also give the system error value inreal time. Simulation results show that the proposed tracking algorithmoperates in both the non-maneuvering and the maneuveringmodes, and the original state, the acceleration and the systematicerror vector can be estimated simultaneously.展开更多
基金The authors would like to acknowledge National Natural Science Foundation of China(Grant No.61573285,No.62003267)Aeronautical Science Foundation of China(Grant No.2017ZC53021)+1 种基金Open Fund of Key Laboratory of Data Link Technology of China Electronics Technology Group Corporation(Grant No.CLDL-20182101)Natural Science Foundation of Shaanxi Province(Grant No.2020JQ-220)to provide fund for conducting experiments.
文摘Tracking maneuvering target in real time autonomously and accurately in an uncertain environment is one of the challenging missions for unmanned aerial vehicles(UAVs).In this paper,aiming to address the control problem of maneuvering target tracking and obstacle avoidance,an online path planning approach for UAV is developed based on deep reinforcement learning.Through end-to-end learning powered by neural networks,the proposed approach can achieve the perception of the environment and continuous motion output control.This proposed approach includes:(1)A deep deterministic policy gradient(DDPG)-based control framework to provide learning and autonomous decision-making capability for UAVs;(2)An improved method named MN-DDPG for introducing a type of mixed noises to assist UAV with exploring stochastic strategies for online optimal planning;and(3)An algorithm of taskdecomposition and pre-training for efficient transfer learning to improve the generalization capability of UAV’s control model built based on MN-DDPG.The experimental simulation results have verified that the proposed approach can achieve good self-adaptive adjustment of UAV’s flight attitude in the tasks of maneuvering target tracking with a significant improvement in generalization capability and training efficiency of UAV tracking controller in uncertain environments.
文摘The basic"current"statistical model and adaptive Kalman filter algorithm can not track a weakly maneuvering target precisely,though it has good estimate accuracy for strongly maneuvering target.In order to solve this problem,a novel nonlinear fuzzy membership function was presented to adjust the upper and lower limit of target acceleration adaptively,and then the validity of the new algorithm for feeblish maneuvering target was proved in theory.At last,the computer simulation experiments indicated that the new algorithm has a great advantage over the basic"current"statistical model and adaptive algorithm.
基金This project was supported by Spaceflight Support Fund ( HIT01) and the Spaceflight Science Project Group
文摘The scheme for tracking maneuvering target based on neural fuzzy network with incremental neural learning is proposed. When tracked target maneuver occurs, the scheme can detect maneuver immediately and estimate the maneuver value accurately , then the tracking filter can be compensated correctly and duly by the estimated maneuver value. When environment changes, neural fuzzy network with incremental neural learning （INL-SONFIN） can find its optimal structure and parameters automatically to adopt to changed environment. So, it always produce estimated output very close to the true maneuver value that leads to good tracking performance and avoids misstracking. Simulation results show that the performance is superior to the traditional schemes and the scheme can fit changed dynamic environment to track maneuvering target accurately and duly.
基金supported by the Natural Science Foundation of Anhui Province(1708085QF149)。
文摘It is a tough problem to jointly detect and track a weak target, and it becomes even more challenging when the target is maneuvering. The above problem is formulated by using the Bayesian theory and a multiple model(MM) based filter is proposed. The filter presented uses the MM method to accommodate the multiple motions that a maneuvering target may travel under by adding a random variable representing the motion model to the target state. To strengthen the efficiency performance of the filter,the target existence variable is separated from the target state and the existence probability is calculated in a more efficient way. To examine the performance of the MM based approach, a typical track-before-detect(TBD) scenario with a maneuvering target is used for simulations. The simulation results indicate that the MM based filter proposed has a good performance in joint detecting and tracking of a weak and maneuvering target, and it is more efficient than the general MM method.
基金supported by the National Natural Science Foundation of China(61671181).
文摘The state estimation of a maneuvering target,of which the trajectory shape is independent on dynamic characteristics,is studied.The conventional motion models in Cartesian coordinates imply that the trajectory of a target is completely determined by its dynamic characteristics.However,this is not true in the applications of road-target,sea-route-target or flight route-target tracking,where target trajectory shape is uncoupled with target velocity properties.In this paper,a new estimation algorithm based on separate modeling of target trajectory shape and dynamic characteristics is proposed.The trajectory of a target over a sliding window is described by a linear function of the arc length.To determine the unknown target trajectory,an augmented system is derived by denoting the unknown coefficients of the function as states in mileage coordinates.At every estimation cycle except the first one,the interaction(mixing)stage of the proposed algorithm starts from the latest estimated base state and a recalculated parameter vector,which is determined by the least squares(LS).Numerical experiments are conducted to assess the performance of the proposed algorithm.Simulation results show that the proposed algorithm can achieve better performance than the conventional coupled model-based algorithms in the presence of target maneuvers.
基金supported by the National Natural Science Foundation of China(51467013)
文摘Satisfactory results cannot be obtained when three-dimensional (3D) targets with complex maneuvering characteristics are tracked by the commonly used two-dimensional coordinated turn (2DCT) model. To address the problem of 3D target tracking with strong maneuverability, on the basis of the modified three-dimensional variable turn (3DVT) model, an adaptive tracking algorithm is proposed by combining with the cubature Kalman filter (CKF) in this paper. Through ideology of real-time identification, the parameters of the model are changed to adjust the state transition matrix and the state noise covariance matrix. Therefore, states of the target are matched in real-time to achieve the purpose of adaptive tracking. Finally, four simulations are analyzed in different settings by the Monte Carlo method. All results show that the proposed algorithm can update parameters of the model and identify motion characteristics in real-time when targets tracking also has a better tracking accuracy.
文摘A Target State Estimator (TSE) for airborne radar system is proposed in this paper. It is very important for fire control system to obtain accurate estimation of the maneuvering target and the TSE becomes a key link in the integrated Flight/Fire Control (IFFC) system. By adopting the Cartesian coordinates and pseudomeasurements ,the result ed TSE has it s advantages in computation.In addition, by employing accurate range and range-rate redundant filter, the range direction estimations obtained in Cartesian filter are greatly improved. The TSE shows its satisfaCtory performance in the Monte Carlo simulation of the IFFC system.
基金supported by the National Natural Science Foundation of China (61101181)
文摘The finite set statistics provides a mathematically rig- orous single target Bayesian filter （STBF） for tracking a target that generates multiple measurements in a cluttered environment. However, the target maneuvers may lead to the degraded track- ing performance and even track loss when using the STBF. The multiple-model technique has been generally considered as the mainstream approach to maneuvering the target tracking. Moti- vated by the above observations, we propose the multiple-model extension of the original STBF, called MM-STBF, to accommodate the possible target maneuvering behavior. Since the derived MM- STBF involve multiple integrals with no closed form in general, a sequential Monte Carlo implementation （for generic models） and a Gaussian mixture implementation （for linear Gaussian models） are presented. Simulation results show that the proposed MM-STBF outperforms the STBF in terms of root mean squared errors of dynamic state estimates.
基金supported by the National Natural Science Foundation of China(91538201)
文摘In order to estimate the systematic error in the processof maneuvering target adaptive tracking, a new method is proposed.The proposed method is a linear tracking scheme basedon a modified input estimation approach. A special augmentationin the state space model is considered, in which both the systematicerror and the unknown input vector are attached to thestate vector. Then, an augmented state model and a measurementmodel are established in the case of systematic error, andthe corresponding filter formulas are also given. In the proposedscheme, the original state, the acceleration and the systematicerror vector can be estimated simultaneously. This method can notonly solve the maneuvering target adaptive tracking problem in thecase of systematic error, but also give the system error value inreal time. Simulation results show that the proposed tracking algorithmoperates in both the non-maneuvering and the maneuveringmodes, and the original state, the acceleration and the systematicerror vector can be estimated simultaneously.
