The fusion of infrared and visible images should emphasize the salient targets in the infrared image while preserving the textural details of the visible images.To meet these requirements,an autoencoder-based method f...The fusion of infrared and visible images should emphasize the salient targets in the infrared image while preserving the textural details of the visible images.To meet these requirements,an autoencoder-based method for infrared and visible image fusion is proposed.The encoder designed according to the optimization objective consists of a base encoder and a detail encoder,which is used to extract low-frequency and high-frequency information from the image.This extraction may lead to some information not being captured,so a compensation encoder is proposed to supplement the missing information.Multi-scale decomposition is also employed to extract image features more comprehensively.The decoder combines low-frequency,high-frequency and supplementary information to obtain multi-scale features.Subsequently,the attention strategy and fusion module are introduced to perform multi-scale fusion for image reconstruction.Experimental results on three datasets show that the fused images generated by this network effectively retain salient targets while being more consistent with human visual perception.展开更多
The strength of cement-based materials,such as mortar,concrete and cement paste backfill(CPB),depends on its microstructures(e.g.pore structure and arrangement of particles and skeleton).Numerous studies on the relati...The strength of cement-based materials,such as mortar,concrete and cement paste backfill(CPB),depends on its microstructures(e.g.pore structure and arrangement of particles and skeleton).Numerous studies on the relationship between strength and pore structure(e.g.,pore size and its distribution)were performed,but the micro-morphology characteristics have been rarely concerned.Texture describing the surface properties of the sample is a global feature,which is an effective way to quantify the micro-morphological properties.In statistical analysis,GLCM features and Tamura texture are the most representative methods for characterizing the texture features.The mechanical strength and section image of the backfill sample prepared from three different solid concentrations of paste were obtained by uniaxial compressive strength test and scanning electron microscope,respectively.The texture features of different SEM images were calculated based on image analysis technology,and then the correlation between these parameters and the strength was analyzed.It was proved that the method is effective in the quantitative analysis on the micro-morphology characteristics of CPB.There is a significant correlation between the texture features and the unconfined compressive strength,and the prediction of strength is feasible using texture parameters of the CPB microstructure.展开更多
In modern electromagnetic environment, radar emitter signal recognition is an important research topic. On the basis of multi-resolution wavelet analysis, an adaptive radar emitter signal recognition method based on m...In modern electromagnetic environment, radar emitter signal recognition is an important research topic. On the basis of multi-resolution wavelet analysis, an adaptive radar emitter signal recognition method based on multi-scale wavelet entropy feature extraction and feature weighting was proposed. With the only priori knowledge of signal to noise ratio(SNR), the method of extracting multi-scale wavelet entropy features of wavelet coefficients from different received signals were combined with calculating uneven weight factor and stability weight factor of the extracted multi-dimensional characteristics. Radar emitter signals of different modulation types and different parameters modulated were recognized through feature weighting and feature fusion. Theoretical analysis and simulation results show that the presented algorithm has a high recognition rate. Additionally, when the SNR is greater than-4 d B, the correct recognition rate is higher than 93%. Hence, the proposed algorithm has great application value.展开更多
In this study,an underwater image enhancement method based on multi-scale adversarial network was proposed to solve the problem of detail blur and color distortion in underwater images.Firstly,the local features of ea...In this study,an underwater image enhancement method based on multi-scale adversarial network was proposed to solve the problem of detail blur and color distortion in underwater images.Firstly,the local features of each layer were enhanced into the global features by the proposed residual dense block,which ensured that the generated images retain more details.Secondly,a multi-scale structure was adopted to extract multi-scale semantic features of the original images.Finally,the features obtained from the dual channels were fused by an adaptive fusion module to further optimize the features.The discriminant network adopted the structure of the Markov discriminator.In addition,by constructing mean square error,structural similarity,and perceived color loss function,the generated image is consistent with the reference image in structure,color,and content.The experimental results showed that the enhanced underwater image deblurring effect of the proposed algorithm was good and the problem of underwater image color bias was effectively improved.In both subjective and objective evaluation indexes,the experimental results of the proposed algorithm are better than those of the comparison algorithm.展开更多
In order to extract the richer feature information of ship targets from sea clutter, and address the high dimensional data problem, a method termed as multi-scale fusion kernel sparse preserving projection(MSFKSPP) ba...In order to extract the richer feature information of ship targets from sea clutter, and address the high dimensional data problem, a method termed as multi-scale fusion kernel sparse preserving projection(MSFKSPP) based on the maximum margin criterion(MMC) is proposed for recognizing the class of ship targets utilizing the high-resolution range profile(HRRP). Multi-scale fusion is introduced to capture the local and detailed information in small-scale features, and the global and contour information in large-scale features, offering help to extract the edge information from sea clutter and further improving the target recognition accuracy. The proposed method can maximally preserve the multi-scale fusion sparse of data and maximize the class separability in the reduced dimensionality by reproducing kernel Hilbert space. Experimental results on the measured radar data show that the proposed method can effectively extract the features of ship target from sea clutter, further reduce the feature dimensionality, and improve target recognition performance.展开更多
In this paper,based on a bidirectional parallel multi-branch feature pyramid network(BPMFPN),a novel one-stage object detector called BPMFPN Det is proposed for real-time detection of ground multi-scale targets by swa...In this paper,based on a bidirectional parallel multi-branch feature pyramid network(BPMFPN),a novel one-stage object detector called BPMFPN Det is proposed for real-time detection of ground multi-scale targets by swarm unmanned aerial vehicles(UAVs).First,the bidirectional parallel multi-branch convolution modules are used to construct the feature pyramid to enhance the feature expression abilities of different scale feature layers.Next,the feature pyramid is integrated into the single-stage object detection framework to ensure real-time performance.In order to validate the effectiveness of the proposed algorithm,experiments are conducted on four datasets.For the PASCAL VOC dataset,the proposed algorithm achieves the mean average precision(mAP)of 85.4 on the VOC 2007 test set.With regard to the detection in optical remote sensing(DIOR)dataset,the proposed algorithm achieves 73.9 mAP.For vehicle detection in aerial imagery(VEDAI)dataset,the detection accuracy of small land vehicle(slv)targets reaches 97.4 mAP.For unmanned aerial vehicle detection and tracking(UAVDT)dataset,the proposed BPMFPN Det achieves the mAP of 48.75.Compared with the previous state-of-the-art methods,the results obtained by the proposed algorithm are more competitive.The experimental results demonstrate that the proposed algorithm can effectively solve the problem of real-time detection of ground multi-scale targets in aerial images of swarm UAVs.展开更多
In order to solve the problem of poor fusion between the spots of deformation camouflage and the background,a small-spot deformation camouflage design algorithm based on background texture matching is proposed in this...In order to solve the problem of poor fusion between the spots of deformation camouflage and the background,a small-spot deformation camouflage design algorithm based on background texture matching is proposed in this research.The combination of spots and textures improved the fusion of the spot pattern and the background.An adversarial autoencoder convolutional network was designed to extract background texture features.The image adversarial loss was added and the reconstruction loss was improved to improve the clarity of the generated texture pattern and the generalization ability of the model.The digital camouflage was formed by obtaining the mean value of the square area and replacing the main color.At the same time,the spots in the square area with a side length of 2 s were subjected to simple linear iterative clustering to form irregular small-spot camouflage.A dataset with a scale of 1050 was established in the experiment.The training results of three different loss functions were investigated.The results showed that the proposed loss function could enhance the generalization of the model and improve the quality of the generated texture image.A variety of digital camouflages with main colors and irregular small-spot camouflage were generated,and their efficiency was tested.On the one hand,intuitive evaluation was given by personnel observing the camouflage pattern embedded in the background and its contour map calculated by the canny operator.On the other hand,objective comparison result was formed by calculating the 4 evaluation indexes between the camouflage pattern and the background.Both results showed that the generated pattern had a high degree of fusion with the background.This model could balance the relationship between the spot size,the number of main colors and the actual effect according to actual needs.展开更多
基金Supported by the Henan Province Key Research and Development Project(231111211300)the Central Government of Henan Province Guides Local Science and Technology Development Funds(Z20231811005)+2 种基金Henan Province Key Research and Development Project(231111110100)Henan Provincial Outstanding Foreign Scientist Studio(GZS2024006)Henan Provincial Joint Fund for Scientific and Technological Research and Development Plan(Application and Overcoming Technical Barriers)(242103810028)。
文摘The fusion of infrared and visible images should emphasize the salient targets in the infrared image while preserving the textural details of the visible images.To meet these requirements,an autoencoder-based method for infrared and visible image fusion is proposed.The encoder designed according to the optimization objective consists of a base encoder and a detail encoder,which is used to extract low-frequency and high-frequency information from the image.This extraction may lead to some information not being captured,so a compensation encoder is proposed to supplement the missing information.Multi-scale decomposition is also employed to extract image features more comprehensively.The decoder combines low-frequency,high-frequency and supplementary information to obtain multi-scale features.Subsequently,the attention strategy and fusion module are introduced to perform multi-scale fusion for image reconstruction.Experimental results on three datasets show that the fused images generated by this network effectively retain salient targets while being more consistent with human visual perception.
基金Project(51722401)supported by the National Natural Science Foundation for Excellent Young Scholars of ChinaProject(FRF-TP-18-003C1)supported by the Fundamental Research Funds for the Central Universities,ChinaProject(51734001)supported by the Key Program of National Natural Science Foundation of China
文摘The strength of cement-based materials,such as mortar,concrete and cement paste backfill(CPB),depends on its microstructures(e.g.pore structure and arrangement of particles and skeleton).Numerous studies on the relationship between strength and pore structure(e.g.,pore size and its distribution)were performed,but the micro-morphology characteristics have been rarely concerned.Texture describing the surface properties of the sample is a global feature,which is an effective way to quantify the micro-morphological properties.In statistical analysis,GLCM features and Tamura texture are the most representative methods for characterizing the texture features.The mechanical strength and section image of the backfill sample prepared from three different solid concentrations of paste were obtained by uniaxial compressive strength test and scanning electron microscope,respectively.The texture features of different SEM images were calculated based on image analysis technology,and then the correlation between these parameters and the strength was analyzed.It was proved that the method is effective in the quantitative analysis on the micro-morphology characteristics of CPB.There is a significant correlation between the texture features and the unconfined compressive strength,and the prediction of strength is feasible using texture parameters of the CPB microstructure.
基金Project(61301095)supported by the National Natural Science Foundation of ChinaProject(QC2012C070)supported by Heilongjiang Provincial Natural Science Foundation for the Youth,ChinaProjects(HEUCF130807,HEUCFZ1129)supported by the Fundamental Research Funds for the Central Universities of China
文摘In modern electromagnetic environment, radar emitter signal recognition is an important research topic. On the basis of multi-resolution wavelet analysis, an adaptive radar emitter signal recognition method based on multi-scale wavelet entropy feature extraction and feature weighting was proposed. With the only priori knowledge of signal to noise ratio(SNR), the method of extracting multi-scale wavelet entropy features of wavelet coefficients from different received signals were combined with calculating uneven weight factor and stability weight factor of the extracted multi-dimensional characteristics. Radar emitter signals of different modulation types and different parameters modulated were recognized through feature weighting and feature fusion. Theoretical analysis and simulation results show that the presented algorithm has a high recognition rate. Additionally, when the SNR is greater than-4 d B, the correct recognition rate is higher than 93%. Hence, the proposed algorithm has great application value.
文摘In this study,an underwater image enhancement method based on multi-scale adversarial network was proposed to solve the problem of detail blur and color distortion in underwater images.Firstly,the local features of each layer were enhanced into the global features by the proposed residual dense block,which ensured that the generated images retain more details.Secondly,a multi-scale structure was adopted to extract multi-scale semantic features of the original images.Finally,the features obtained from the dual channels were fused by an adaptive fusion module to further optimize the features.The discriminant network adopted the structure of the Markov discriminator.In addition,by constructing mean square error,structural similarity,and perceived color loss function,the generated image is consistent with the reference image in structure,color,and content.The experimental results showed that the enhanced underwater image deblurring effect of the proposed algorithm was good and the problem of underwater image color bias was effectively improved.In both subjective and objective evaluation indexes,the experimental results of the proposed algorithm are better than those of the comparison algorithm.
基金supported by the National Natural Science Foundation of China (62271255,61871218)the Fundamental Research Funds for the Central University (3082019NC2019002)+1 种基金the Aeronautical Science Foundation (ASFC-201920007002)the Program of Remote Sensing Intelligent Monitoring and Emergency Services for Regional Security Elements。
文摘In order to extract the richer feature information of ship targets from sea clutter, and address the high dimensional data problem, a method termed as multi-scale fusion kernel sparse preserving projection(MSFKSPP) based on the maximum margin criterion(MMC) is proposed for recognizing the class of ship targets utilizing the high-resolution range profile(HRRP). Multi-scale fusion is introduced to capture the local and detailed information in small-scale features, and the global and contour information in large-scale features, offering help to extract the edge information from sea clutter and further improving the target recognition accuracy. The proposed method can maximally preserve the multi-scale fusion sparse of data and maximize the class separability in the reduced dimensionality by reproducing kernel Hilbert space. Experimental results on the measured radar data show that the proposed method can effectively extract the features of ship target from sea clutter, further reduce the feature dimensionality, and improve target recognition performance.
文摘In this paper,based on a bidirectional parallel multi-branch feature pyramid network(BPMFPN),a novel one-stage object detector called BPMFPN Det is proposed for real-time detection of ground multi-scale targets by swarm unmanned aerial vehicles(UAVs).First,the bidirectional parallel multi-branch convolution modules are used to construct the feature pyramid to enhance the feature expression abilities of different scale feature layers.Next,the feature pyramid is integrated into the single-stage object detection framework to ensure real-time performance.In order to validate the effectiveness of the proposed algorithm,experiments are conducted on four datasets.For the PASCAL VOC dataset,the proposed algorithm achieves the mean average precision(mAP)of 85.4 on the VOC 2007 test set.With regard to the detection in optical remote sensing(DIOR)dataset,the proposed algorithm achieves 73.9 mAP.For vehicle detection in aerial imagery(VEDAI)dataset,the detection accuracy of small land vehicle(slv)targets reaches 97.4 mAP.For unmanned aerial vehicle detection and tracking(UAVDT)dataset,the proposed BPMFPN Det achieves the mAP of 48.75.Compared with the previous state-of-the-art methods,the results obtained by the proposed algorithm are more competitive.The experimental results demonstrate that the proposed algorithm can effectively solve the problem of real-time detection of ground multi-scale targets in aerial images of swarm UAVs.
基金funded by Natural Science Foundation of Jiangsu Province,China,grant number is BK20180579。
文摘In order to solve the problem of poor fusion between the spots of deformation camouflage and the background,a small-spot deformation camouflage design algorithm based on background texture matching is proposed in this research.The combination of spots and textures improved the fusion of the spot pattern and the background.An adversarial autoencoder convolutional network was designed to extract background texture features.The image adversarial loss was added and the reconstruction loss was improved to improve the clarity of the generated texture pattern and the generalization ability of the model.The digital camouflage was formed by obtaining the mean value of the square area and replacing the main color.At the same time,the spots in the square area with a side length of 2 s were subjected to simple linear iterative clustering to form irregular small-spot camouflage.A dataset with a scale of 1050 was established in the experiment.The training results of three different loss functions were investigated.The results showed that the proposed loss function could enhance the generalization of the model and improve the quality of the generated texture image.A variety of digital camouflages with main colors and irregular small-spot camouflage were generated,and their efficiency was tested.On the one hand,intuitive evaluation was given by personnel observing the camouflage pattern embedded in the background and its contour map calculated by the canny operator.On the other hand,objective comparison result was formed by calculating the 4 evaluation indexes between the camouflage pattern and the background.Both results showed that the generated pattern had a high degree of fusion with the background.This model could balance the relationship between the spot size,the number of main colors and the actual effect according to actual needs.