While moving ahead with the object detection technology, especially deep neural networks, many related tasks, such as medical application and industrial automation, have achieved great success. However, the detection ...While moving ahead with the object detection technology, especially deep neural networks, many related tasks, such as medical application and industrial automation, have achieved great success. However, the detection of objects with multiple aspect ratios and scales is still a key problem. This paper proposes a top-down and bottom-up feature pyramid network(TDBU-FPN),which combines multi-scale feature representation and anchor generation at multiple aspect ratios. First, in order to build the multi-scale feature map, this paper puts a number of fully convolutional layers after the backbone. Second, to link neighboring feature maps, top-down and bottom-up flows are adopted to introduce context information via top-down flow and supplement suboriginal information via bottom-up flow. The top-down flow refers to the deconvolution procedure, and the bottom-up flow refers to the pooling procedure. Third, the problem of adapting different object aspect ratios is tackled via many anchor shapes with different aspect ratios on each multi-scale feature map. The proposed method is evaluated on the pattern analysis, statistical modeling and computational learning visual object classes(PASCAL VOC)dataset and reaches an accuracy of 79%, which exhibits a 1.8% improvement with a detection speed of 23 fps.展开更多
A schlieren detection algorithm is proposed for the ground-to-air background oriented schlieren(BOS) system to achieve high-speed airplane shock waves visualization. The proposed method consists of three steps. Firstl...A schlieren detection algorithm is proposed for the ground-to-air background oriented schlieren(BOS) system to achieve high-speed airplane shock waves visualization. The proposed method consists of three steps. Firstly, image registration is incorporated for reducing errors caused by the camera motion.Then, the background subtraction dual-model single Gaussian model(BS-DSGM) is proposed to build a precise background model. The BS-DSGM could prevent the background model from being contaminated by the shock waves. Finally, the twodimensional orthogonal discrete wavelet transformation is used to extract schlieren information and averaging schlieren data. Experimental results show our proposed algorithm is able to detect the aircraft in-flight and to extract the schlieren information. The precision of schlieren detection algorithm is 0.96. Three image quality evaluation indices are chosen for quantitative analysis of the shock waves visualization. The white Gaussian noise is added in the frames to validate the robustness of the proposed algorithm.Moreover, we adopt two times and four times down sampling to simulate different imaging distances for revealing how the imaging distance affects the schlieren information in the BOS system.展开更多
The paper designs a peripheral maximum gray differ-ence(PMGD)image segmentation method,a connected-compo-nent labeling(CCL)algorithm based on dynamic run length(DRL),and a real-time implementation streaming processor ...The paper designs a peripheral maximum gray differ-ence(PMGD)image segmentation method,a connected-compo-nent labeling(CCL)algorithm based on dynamic run length(DRL),and a real-time implementation streaming processor for DRL-CCL.And it verifies the function and performance in space target monitoring scene by the carrying experiment of Tianzhou-3 cargo spacecraft(TZ-3).The PMGD image segmentation method can segment the image into highly discrete and simple point tar-gets quickly,which reduces the generation of equivalences greatly and improves the real-time performance for DRL-CCL.Through parallel pipeline design,the storage of the streaming processor is optimized by 55%with no need for external me-mory,the logic is optimized by 60%,and the energy efficiency ratio is 12 times than that of the graphics processing unit,62 times than that of the digital signal proccessing,and 147 times than that of personal computers.Analyzing the results of 8756 images completed on-orbit,the speed is up to 5.88 FPS and the target detection rate is 100%.Our algorithm and implementation method meet the requirements of lightweight,high real-time,strong robustness,full-time,and stable operation in space irradia-tion environment.展开更多
基金supported by the Program of Introducing Talents of Discipline to Universities(111 Plan)of China(B14010)the National Natural Science Foundation of China(31727901)
文摘While moving ahead with the object detection technology, especially deep neural networks, many related tasks, such as medical application and industrial automation, have achieved great success. However, the detection of objects with multiple aspect ratios and scales is still a key problem. This paper proposes a top-down and bottom-up feature pyramid network(TDBU-FPN),which combines multi-scale feature representation and anchor generation at multiple aspect ratios. First, in order to build the multi-scale feature map, this paper puts a number of fully convolutional layers after the backbone. Second, to link neighboring feature maps, top-down and bottom-up flows are adopted to introduce context information via top-down flow and supplement suboriginal information via bottom-up flow. The top-down flow refers to the deconvolution procedure, and the bottom-up flow refers to the pooling procedure. Third, the problem of adapting different object aspect ratios is tackled via many anchor shapes with different aspect ratios on each multi-scale feature map. The proposed method is evaluated on the pattern analysis, statistical modeling and computational learning visual object classes(PASCAL VOC)dataset and reaches an accuracy of 79%, which exhibits a 1.8% improvement with a detection speed of 23 fps.
文摘A schlieren detection algorithm is proposed for the ground-to-air background oriented schlieren(BOS) system to achieve high-speed airplane shock waves visualization. The proposed method consists of three steps. Firstly, image registration is incorporated for reducing errors caused by the camera motion.Then, the background subtraction dual-model single Gaussian model(BS-DSGM) is proposed to build a precise background model. The BS-DSGM could prevent the background model from being contaminated by the shock waves. Finally, the twodimensional orthogonal discrete wavelet transformation is used to extract schlieren information and averaging schlieren data. Experimental results show our proposed algorithm is able to detect the aircraft in-flight and to extract the schlieren information. The precision of schlieren detection algorithm is 0.96. Three image quality evaluation indices are chosen for quantitative analysis of the shock waves visualization. The white Gaussian noise is added in the frames to validate the robustness of the proposed algorithm.Moreover, we adopt two times and four times down sampling to simulate different imaging distances for revealing how the imaging distance affects the schlieren information in the BOS system.
文摘The paper designs a peripheral maximum gray differ-ence(PMGD)image segmentation method,a connected-compo-nent labeling(CCL)algorithm based on dynamic run length(DRL),and a real-time implementation streaming processor for DRL-CCL.And it verifies the function and performance in space target monitoring scene by the carrying experiment of Tianzhou-3 cargo spacecraft(TZ-3).The PMGD image segmentation method can segment the image into highly discrete and simple point tar-gets quickly,which reduces the generation of equivalences greatly and improves the real-time performance for DRL-CCL.Through parallel pipeline design,the storage of the streaming processor is optimized by 55%with no need for external me-mory,the logic is optimized by 60%,and the energy efficiency ratio is 12 times than that of the graphics processing unit,62 times than that of the digital signal proccessing,and 147 times than that of personal computers.Analyzing the results of 8756 images completed on-orbit,the speed is up to 5.88 FPS and the target detection rate is 100%.Our algorithm and implementation method meet the requirements of lightweight,high real-time,strong robustness,full-time,and stable operation in space irradia-tion environment.
