Due to the requirement of anti-interception and the limitation of processing capability of the fusion center, the subarray selection is very important for the distributed multiple-input multiple-output(MIMO) radar sys...Due to the requirement of anti-interception and the limitation of processing capability of the fusion center, the subarray selection is very important for the distributed multiple-input multiple-output(MIMO) radar system, especially in the hostile environment. In such conditions, an efficient subarray selection strategy is proposed for MIMO radar performing tasks of target tracking and detection. The goal of the proposed strategy is to minimize the worst-case predicted posterior Cramer-Rao lower bound(PCRLB) while maximizing the detection probability for a certain region. It is shown that the subarray selection problem is NP-hard, and a modified particle swarm optimization(MPSO) algorithm is developed as the solution strategy. A large number of simulations verify that the MPSO can provide close performance to the exhaustive search(ES) algorithm. Furthermore, the MPSO has the advantages of simpler structure and lower computational complexity than the multi-start local search algorithm.展开更多
A real-time pedestrian detection and tracking system using a single video camera was developed to monitor pedestrians. This system contained six modules: video flow capture, pre-processing, movement detection, shadow ...A real-time pedestrian detection and tracking system using a single video camera was developed to monitor pedestrians. This system contained six modules: video flow capture, pre-processing, movement detection, shadow removal, tracking, and object classification. The Gaussian mixture model was utilized to extract the moving object from an image sequence segmented by the mean-shift technique in the pre-processing module. Shadow removal was used to alleviate the negative impact of the shadow to the detected objects. A model-free method was adopted to identify pedestrians. The maximum and minimum integration methods were developed to integrate multiple cues into the mean-shift algorithm and the initial tracking iteration with the competent integrated probability distribution map for object tracking. A simple but effective algorithm was proposed to handle full occlusion cases. The system was tested using real traffic videos from different sites. The results of the test confirm that the system is reliable and has an overall accuracy of over 85%.展开更多
Video processing is one challenge in collecting vehicle trajectories from unmanned aerial vehicle(UAV) and road boundary estimation is one way to improve the video processing algorithms. However, current methods do no...Video processing is one challenge in collecting vehicle trajectories from unmanned aerial vehicle(UAV) and road boundary estimation is one way to improve the video processing algorithms. However, current methods do not work well for low volume road, which is not well-marked and with noises such as vehicle tracks. A fusion-based method termed Dempster-Shafer-based road detection(DSRD) is proposed to address this issue. This method detects road boundary by combining multiple information sources using Dempster-Shafer theory(DST). In order to test the performance of the proposed method, two field experiments were conducted, one of which was on a highway partially covered by snow and another was on a dense traffic highway. The results show that DSRD is robust and accurate, whose detection rates are 100% and 99.8% compared with manual detection results. Then, DSRD is adopted to improve UAV video processing algorithm, and the vehicle detection and tracking rate are improved by 2.7% and 5.5%,respectively. Also, the computation time has decreased by 5% and 8.3% for two experiments, respectively.展开更多
It is a tough problem to jointly detect and track a weak target, and it becomes even more challenging when the target is maneuvering. The above problem is formulated by using the Bayesian theory and a multiple model(M...It is a tough problem to jointly detect and track a weak target, and it becomes even more challenging when the target is maneuvering. The above problem is formulated by using the Bayesian theory and a multiple model(MM) based filter is proposed. The filter presented uses the MM method to accommodate the multiple motions that a maneuvering target may travel under by adding a random variable representing the motion model to the target state. To strengthen the efficiency performance of the filter,the target existence variable is separated from the target state and the existence probability is calculated in a more efficient way. To examine the performance of the MM based approach, a typical track-before-detect(TBD) scenario with a maneuvering target is used for simulations. The simulation results indicate that the MM based filter proposed has a good performance in joint detecting and tracking of a weak and maneuvering target, and it is more efficient than the general MM method.展开更多
针对夜间低光照场景下目标特征提取困难和跟踪不稳定的问题,提出了基于自编码器结构及改进Bytetrack的多目标行人检测及跟踪算法。在检测阶段,基于YOLOX(you only look once X)搭建多任务自编码变换模型框架,以一种自监督的方式考虑物...针对夜间低光照场景下目标特征提取困难和跟踪不稳定的问题,提出了基于自编码器结构及改进Bytetrack的多目标行人检测及跟踪算法。在检测阶段,基于YOLOX(you only look once X)搭建多任务自编码变换模型框架,以一种自监督的方式考虑物理噪声模型和图像信号处理(image signal processing,ISP)的过程,通过对真实光照退化变换过程进行编码与解码学习内在视觉结构,并基于这种表示通过解码边界框坐标与类实现目标检测任务。为了抑制背景噪声的干扰,在目标解码器颈部网络引入自适应特征融合模块ASFF。跟踪阶段,基于Bytetrack算法进行改进,将基于Tranformer重识别网络提取到的外观嵌入信息与NSA卡尔曼滤波获得的运动信息通过自适应加权的方法完成数据关联,并通过Byte两次匹配的算法完成夜间行人的跟踪。在自建夜间行人检测数据集上测试检测模型的泛化能力,mAP@0.5达到了94.9%,结果表明本文的退化变换过程符合现实条件,具有良好的泛化能力。最后通过自建夜间行人跟踪数据集验证多目标跟踪性能,实验结果表明,本文提出的夜间低光照行人多目标跟踪算法MOTA(multiple object tracking accuracy)为89.55%,IDF1(identity F1 score)为88.34%,IDs(ID switches)为15。与基准方法Bytetrack相比,MOTA提高了10.72%,IDF1提高了6.19%,IDs减少了50%。结果表明,本文提出的基于自编码结构及改进Bytetrack的多目标跟踪算法可以有效解决在夜间低光照场景下行人跟踪困难的问题。展开更多
The basic scheme of the orientation detection system using L-shape reticle is introduced. The dimension of the patterns on the reticle of the system in practical applications is designed and an analysis of the princip...The basic scheme of the orientation detection system using L-shape reticle is introduced. The dimension of the patterns on the reticle of the system in practical applications is designed and an analysis of the principle of abstracting the orientation information of the target and the effects and formation method of self-adapting tracking gate is presented. The research result shows that the orientation detection system using L-shape reticle has a good effect on space-filtering, the signals that the orientation detection system sends out are easy to be processed by computer, its self-adapting tracking gate has a strong anti-interference ability, and the whole system＇s searching and tracking performances are quite high.展开更多
A new parallel algorithm for corner detection on object contour is presented in the paper. In this algorithm whenever a point (pixel) is scanned, the k direction codes between the two sides of the point, which is on t...A new parallel algorithm for corner detection on object contour is presented in the paper. In this algorithm whenever a point (pixel) is scanned, the k direction codes between the two sides of the point, which is on the edge of an object, are obtained by k-step forward and backward boundary tracking. A comer is determined by the sum of the difference between the two weighted code chains. Note that the whole chain code sequence or boundary of an object is not necessary to be extracted at all in this algorithm, and the corners are obtained immediately once the image is scanned, furthermore, what humans perceive as corners can be detected and localized by this algorithm.展开更多
目标跟踪作为图像处理领域的重要组成部分,广泛应用于智能视频监控、军事侦察等领域。但在面对物体形变以及遮挡等复杂应用场景时,相关滤波算法由于缺乏目标和背景判别区分以及遮挡状态判断等策略,存在跟错目标、缓慢漂移到背景等现象,...目标跟踪作为图像处理领域的重要组成部分,广泛应用于智能视频监控、军事侦察等领域。但在面对物体形变以及遮挡等复杂应用场景时,相关滤波算法由于缺乏目标和背景判别区分以及遮挡状态判断等策略,存在跟错目标、缓慢漂移到背景等现象,在遮挡后目标重新出现时,缺乏重检测机制,这些问题导致了跟踪性能在实际工程中大幅下降。针对以上问题进行改进设计,首先在跟踪过程中,使用网络优化器更新多层深度特征提取网络,优化损失函数提高目标与背景的判别能力;其次,采用多重检测抗遮挡优化机制,确定跟踪器状态更新机制;最后,基于深度学习进行检测跟踪识别一体化设计,实现跟踪前典型目标的自动捕获,目标受遮挡后重新出现时实现对典型目标的重新捕获定位。在实验分析中,分别从跟踪精度、可视化定量损失以及算法速度等方面进行了性能验证。实测数据显示,本文采用的方法在以上方面性能表现良好,优于改进前的ECO(efficientconvolution operators for tracking)算法。展开更多
基金supported by the National Natural Science Foundation of China(61601504)。
文摘Due to the requirement of anti-interception and the limitation of processing capability of the fusion center, the subarray selection is very important for the distributed multiple-input multiple-output(MIMO) radar system, especially in the hostile environment. In such conditions, an efficient subarray selection strategy is proposed for MIMO radar performing tasks of target tracking and detection. The goal of the proposed strategy is to minimize the worst-case predicted posterior Cramer-Rao lower bound(PCRLB) while maximizing the detection probability for a certain region. It is shown that the subarray selection problem is NP-hard, and a modified particle swarm optimization(MPSO) algorithm is developed as the solution strategy. A large number of simulations verify that the MPSO can provide close performance to the exhaustive search(ES) algorithm. Furthermore, the MPSO has the advantages of simpler structure and lower computational complexity than the multi-start local search algorithm.
基金Project(50778015)supported by the National Natural Science Foundation of ChinaProject(2012CB725403)supported by the Major State Basic Research Development Program of China
文摘A real-time pedestrian detection and tracking system using a single video camera was developed to monitor pedestrians. This system contained six modules: video flow capture, pre-processing, movement detection, shadow removal, tracking, and object classification. The Gaussian mixture model was utilized to extract the moving object from an image sequence segmented by the mean-shift technique in the pre-processing module. Shadow removal was used to alleviate the negative impact of the shadow to the detected objects. A model-free method was adopted to identify pedestrians. The maximum and minimum integration methods were developed to integrate multiple cues into the mean-shift algorithm and the initial tracking iteration with the competent integrated probability distribution map for object tracking. A simple but effective algorithm was proposed to handle full occlusion cases. The system was tested using real traffic videos from different sites. The results of the test confirm that the system is reliable and has an overall accuracy of over 85%.
基金Project(2009AA11Z220)supported by the National High Technology Research and Development Program of China
文摘Video processing is one challenge in collecting vehicle trajectories from unmanned aerial vehicle(UAV) and road boundary estimation is one way to improve the video processing algorithms. However, current methods do not work well for low volume road, which is not well-marked and with noises such as vehicle tracks. A fusion-based method termed Dempster-Shafer-based road detection(DSRD) is proposed to address this issue. This method detects road boundary by combining multiple information sources using Dempster-Shafer theory(DST). In order to test the performance of the proposed method, two field experiments were conducted, one of which was on a highway partially covered by snow and another was on a dense traffic highway. The results show that DSRD is robust and accurate, whose detection rates are 100% and 99.8% compared with manual detection results. Then, DSRD is adopted to improve UAV video processing algorithm, and the vehicle detection and tracking rate are improved by 2.7% and 5.5%,respectively. Also, the computation time has decreased by 5% and 8.3% for two experiments, respectively.
基金supported by the Natural Science Foundation of Anhui Province(1708085QF149)。
文摘It is a tough problem to jointly detect and track a weak target, and it becomes even more challenging when the target is maneuvering. The above problem is formulated by using the Bayesian theory and a multiple model(MM) based filter is proposed. The filter presented uses the MM method to accommodate the multiple motions that a maneuvering target may travel under by adding a random variable representing the motion model to the target state. To strengthen the efficiency performance of the filter,the target existence variable is separated from the target state and the existence probability is calculated in a more efficient way. To examine the performance of the MM based approach, a typical track-before-detect(TBD) scenario with a maneuvering target is used for simulations. The simulation results indicate that the MM based filter proposed has a good performance in joint detecting and tracking of a weak and maneuvering target, and it is more efficient than the general MM method.
文摘针对夜间低光照场景下目标特征提取困难和跟踪不稳定的问题,提出了基于自编码器结构及改进Bytetrack的多目标行人检测及跟踪算法。在检测阶段,基于YOLOX(you only look once X)搭建多任务自编码变换模型框架,以一种自监督的方式考虑物理噪声模型和图像信号处理(image signal processing,ISP)的过程,通过对真实光照退化变换过程进行编码与解码学习内在视觉结构,并基于这种表示通过解码边界框坐标与类实现目标检测任务。为了抑制背景噪声的干扰,在目标解码器颈部网络引入自适应特征融合模块ASFF。跟踪阶段,基于Bytetrack算法进行改进,将基于Tranformer重识别网络提取到的外观嵌入信息与NSA卡尔曼滤波获得的运动信息通过自适应加权的方法完成数据关联,并通过Byte两次匹配的算法完成夜间行人的跟踪。在自建夜间行人检测数据集上测试检测模型的泛化能力,mAP@0.5达到了94.9%,结果表明本文的退化变换过程符合现实条件,具有良好的泛化能力。最后通过自建夜间行人跟踪数据集验证多目标跟踪性能,实验结果表明,本文提出的夜间低光照行人多目标跟踪算法MOTA(multiple object tracking accuracy)为89.55%,IDF1(identity F1 score)为88.34%,IDs(ID switches)为15。与基准方法Bytetrack相比,MOTA提高了10.72%,IDF1提高了6.19%,IDs减少了50%。结果表明,本文提出的基于自编码结构及改进Bytetrack的多目标跟踪算法可以有效解决在夜间低光照场景下行人跟踪困难的问题。
文摘The basic scheme of the orientation detection system using L-shape reticle is introduced. The dimension of the patterns on the reticle of the system in practical applications is designed and an analysis of the principle of abstracting the orientation information of the target and the effects and formation method of self-adapting tracking gate is presented. The research result shows that the orientation detection system using L-shape reticle has a good effect on space-filtering, the signals that the orientation detection system sends out are easy to be processed by computer, its self-adapting tracking gate has a strong anti-interference ability, and the whole system＇s searching and tracking performances are quite high.
文摘A new parallel algorithm for corner detection on object contour is presented in the paper. In this algorithm whenever a point (pixel) is scanned, the k direction codes between the two sides of the point, which is on the edge of an object, are obtained by k-step forward and backward boundary tracking. A comer is determined by the sum of the difference between the two weighted code chains. Note that the whole chain code sequence or boundary of an object is not necessary to be extracted at all in this algorithm, and the corners are obtained immediately once the image is scanned, furthermore, what humans perceive as corners can be detected and localized by this algorithm.
文摘目标跟踪作为图像处理领域的重要组成部分,广泛应用于智能视频监控、军事侦察等领域。但在面对物体形变以及遮挡等复杂应用场景时,相关滤波算法由于缺乏目标和背景判别区分以及遮挡状态判断等策略,存在跟错目标、缓慢漂移到背景等现象,在遮挡后目标重新出现时,缺乏重检测机制,这些问题导致了跟踪性能在实际工程中大幅下降。针对以上问题进行改进设计,首先在跟踪过程中,使用网络优化器更新多层深度特征提取网络,优化损失函数提高目标与背景的判别能力;其次,采用多重检测抗遮挡优化机制,确定跟踪器状态更新机制;最后,基于深度学习进行检测跟踪识别一体化设计,实现跟踪前典型目标的自动捕获,目标受遮挡后重新出现时实现对典型目标的重新捕获定位。在实验分析中,分别从跟踪精度、可视化定量损失以及算法速度等方面进行了性能验证。实测数据显示,本文采用的方法在以上方面性能表现良好,优于改进前的ECO(efficientconvolution operators for tracking)算法。
