A method of micro-scanning location adaptive calibration was proposed, which was real- ized by the digital image micro-displacement estimation. With geometric calculation, this calibration method used the displacement...A method of micro-scanning location adaptive calibration was proposed, which was real- ized by the digital image micro-displacement estimation. With geometric calculation, this calibration method used the displacement estimation of two thermal microscope images to get the size and direc- tion of each scanning location calibration angle. And each location calibration process was repeated according to the offset given by the system beforehand. The comparison experiments of sequence oversampling reconstruction before and after the micro-scanning location calibration were done. The results showed that the calibration method effectively improved the thermal microscope imaging qual- ity.展开更多
Ultrathin flat metalenses have emerged as promising alternatives to conventional diffractive lenses,offering new possibilities for myriads of miniaturization and interfacial applications.Graphene-based materials can a...Ultrathin flat metalenses have emerged as promising alternatives to conventional diffractive lenses,offering new possibilities for myriads of miniaturization and interfacial applications.Graphene-based materials can achieve both phase and amplitude modulations simultaneously at a single position due to the modification of the complex refractive index and thickness by laser conversion from graphene oxide into graphene like materials.In this work,we develop graphene oxide metalenses to precisely control phase and amplitude modulations and to achieve a holistic and systematic lens design based on a graphene-based material system.We experimentally validate our strategies via demonstrations of two graphene oxide metalenses:one with an ultra-long(~16λ)optical needle,and the other with axial multifocal spots,at the wavelength of 632.8 nm with a 200 nm thin film.Our proposed graphene oxide metalenses unfold unprecedented opportunities for accurately designing graphene-based ultrathin integratable devices for broad applications.展开更多
To improve the performance of the scale invariant feature transform （ SIFT）, a modified SIFT （M-SIFT） descriptor is proposed to realize fast and robust key-point extraction and matching. In descriptor generation, ...To improve the performance of the scale invariant feature transform （ SIFT）, a modified SIFT （M-SIFT） descriptor is proposed to realize fast and robust key-point extraction and matching. In descriptor generation, 3 rotation-invariant concentric-ring grids around the key-point location are used instead of 16 square grids used in the original SIFT. Then, 10 orientations are accumulated for each grid, which results in a 30-dimension descriptor. In descriptor matching, rough rejection mismatches is proposed based on the difference of grey information between matching points. The per- formance of the proposed method is tested for image mosaic on simulated and real-worid images. Experimental results show that the M-SIFT descriptor inherits the SIFT＇ s ability of being invariant to image scale and rotation, illumination change and affine distortion. Besides the time cost of feature extraction is reduced by 50% compared with the original SIFT. And the rough rejection mismatches can reject at least 70% of mismatches. The results also demonstrate that the performance of the pro- posed M-SIFT method is superior to other improved SIFT methods in speed and robustness.展开更多
To improve the quality of the infrared image and enhance the information of the object,a dual band infrared image fusion method based on feature extraction and a novel multiple pulse coupled neural network(multi-PCNN)...To improve the quality of the infrared image and enhance the information of the object,a dual band infrared image fusion method based on feature extraction and a novel multiple pulse coupled neural network(multi-PCNN)is proposed.In this multi-PCNN fusion scheme,the auxiliary PCNN which captures the characteristics of feature image extracting from the infrared image is used to modulate the main PCNN,whose input could be original infrared image.Meanwhile,to make the PCNN fusion effect consistent with the human vision system,Laplacian energy is adopted to obtain the value of adaptive linking strength in PCNN.After that,the original dual band infrared images are reconstructed by using a weight fusion rule with the fire mapping images generated by the main PCNNs to obtain the fused image.Compared to wavelet transforms,Laplacian pyramids and traditional multi-PCNNs,fusion images based on our method have more information,rich details and clear edges.展开更多
The visible-light imaging system used in military equipment is often subjected to severe weather conditions, such as fog, haze, and smoke, under complex lighting conditions at night that significantly degrade the acqu...The visible-light imaging system used in military equipment is often subjected to severe weather conditions, such as fog, haze, and smoke, under complex lighting conditions at night that significantly degrade the acquired images. Currently available image defogging methods are mostly suitable for environments with natural light in the daytime, but the clarity of images captured under complex lighting conditions and spatial changes in the presence of fog at night is not satisfactory. This study proposes an algorithm to remove night fog from single images based on an analysis of the statistical characteristics of images in scenes involving night fog. Color channel transfer is designed to compensate for the high attenuation channel of foggy images acquired at night. The distribution of transmittance is estimated by the deep convolutional network DehazeNet, and the spatial variation of atmospheric light is estimated in a point-by-point manner according to the maximum reflection prior to recover the clear image. The results of experiments show that the proposed method can compensate for the high attenuation channel of foggy images at night, remove the effect of glow from a multi-color and non-uniform ambient source of light, and improve the adaptability and visual effect of the removal of night fog from images compared with the conventional method.展开更多
Satellite vibrations during exposure will lead to pixel aliasing of remote sensors, resulting in the deterioration of image quality. In this paper, we expose the problem and discuss the characteristics of satellite vi...Satellite vibrations during exposure will lead to pixel aliasing of remote sensors, resulting in the deterioration of image quality. In this paper, we expose the problem and discuss the characteristics of satellite vibrations, and then present a pixel mixing model. The idea of mean mixing ratio （MMR） is proposed. MMR computations for different frequencies are implemented. In the mixing model, a coefficient matrix is introduced to estimate each mixed pixel. Thus, the simulation of degraded image can be performed when the vibration attitudes are known. The computation of MMR takes into considera- tion the influences of various frequencies and amplitudes. Therefore, the roles of these parameters played in the degradation progress are identified. Computations show that under the same vibration amplitude, the influence of vibrations fluctuates with the variation of frequency. The fluctuation becomes smaller as the frequency rises. Two kinds of vibration imaging experiments are performed： different amplitudes with the same frequency and different frequencies with the same amplitude. Results are found to be in very good agreement with the theoretical results. MMR has a better description of image quality than modulation transfer function （MTF）. The influence of vibrations is determined mainly by the amplitude rather than the frequency. The influence of vibrations on image quality becomes gradually stable with the increase of frequency.展开更多
Inverse design focuses on identifying photonic structures to optimize the performance of photonic devices.Conventional scalar-based inverse design approaches are insufficient to design photonic devices of anisotropic ...Inverse design focuses on identifying photonic structures to optimize the performance of photonic devices.Conventional scalar-based inverse design approaches are insufficient to design photonic devices of anisotropic materials such as lithium niobate(LN).To the best of our knowledge,this work proposes for the first time the inverse design method for anisotropic materials to optimize the structure of anisotropic-material based photonics devices.Specifically,the orientation dependent properties of anisotropic materials are included in the adjoint method,which provides a more precise prediction of light propagation within such materials.The proposed method is used to design ultra-compact wavelength division demultiplexers in the X-cut thin-film lithium niobate(TFLN)platform.By benchmarking the device performances of our method with those of classical scalar-based inverse design,we demonstrate that this method properly addresses the critical issue of material anisotropy in the X-cut TFLN platform.This proposed method fills the gap of inverse design of anisotropic materials based photonic devices,which finds prominent applications in TFLN platforms and other anisotropicmaterial based photonic integration platforms.展开更多
Based on the characteristics that human eyes are sensitive to brightness and color, the lightness information of visible image and degree of linear polarization and polarization angle were fused in hue-saturation- va...Based on the characteristics that human eyes are sensitive to brightness and color, the lightness information of visible image and degree of linear polarization and polarization angle were fused in hue-saturation- value（HSV） space. To meet the observation of human eyes, hue adjustment based on color transfer was carried out to the fused image and hue was adjusted by polynomial fitting method. Hue adjustment method was improved considering the complicated real mapping relationship between hue gray scale of fused image and reference template image. The result shows that the color fusion method presented in this paper is superior to the traditional pseudo-color method and it is helpful to recognize the target from the environment correctly. The fusion result can reflect the difference of object＇s polarization characteristic, and get a natural fused image effect.展开更多
Optical neural networks have significant advantages in terms of power consumption,parallelism,and high computing speed,which has intrigued extensive attention in both academic and engineering communities.It has been c...Optical neural networks have significant advantages in terms of power consumption,parallelism,and high computing speed,which has intrigued extensive attention in both academic and engineering communities.It has been considered as one of the powerful tools in promoting the fields of imaging processing and object recognition.However,the existing optical system architecture cannot be reconstructed to the realization of multi-functional artificial intelligence systems simultaneously.To push the development of this issue,we propose the pluggable diffractive neural networks(P-DNN),a general paradigm resorting to the cascaded metasurfaces,which can be applied to recognize various tasks by switching internal plug-ins.As the proof-of-principle,the recognition functions of six types of handwritten digits and six types of fashions are numerical simulated and experimental demonstrated at near-infrared regimes.Encouragingly,the proposed paradigm not only improves the flexibility of the optical neural networks but paves the new route for achieving high-speed,low-power and versatile artificial intelligence systems.展开更多
Extreme ultraviolet(EUV)lithography with high numerical aperture(NA)is a future technology to manufacture the integrated circuit in sub-nanometer dimension.Meanwhile,source mask co-optimization(SMO)is an extensively u...Extreme ultraviolet(EUV)lithography with high numerical aperture(NA)is a future technology to manufacture the integrated circuit in sub-nanometer dimension.Meanwhile,source mask co-optimization(SMO)is an extensively used approach for advanced lithography process beyond 28 nm technology node.This work proposes a novel SMO method to improve the image fidelity of high-NA EUV lithography system.A fast high-NA EUV lithography imaging model is established first,which includes the effects of mask three-dimensional structure and anamorphic magnification.Then,this paper develops an efficient SMO method that combines the gradient-based mask optimization algorithm and the compressivesensing-based source optimization algorithm.A mask rule check(MRC)process is further proposed to simplify the optimized mask pattern.Results illustrate that the proposed SMO method can significantly reduce the lithography patterning error,and maintain high computational efficiency.展开更多
Color metasurface holograms are powerful and versatile platforms for modulating the amplitude,phase,polarization,and other properties of light at multiple operating wavelengths.However,the current color metasurface ho...Color metasurface holograms are powerful and versatile platforms for modulating the amplitude,phase,polarization,and other properties of light at multiple operating wavelengths.However,the current color metasurface holography can only realize static manipulation.In this study,we propose and demonstrate a multiplexing metasurface technique combined with multiwavelength code-division multiplexing(CDM)to realize dynamic manipulation.Multicolor code references are utilized to record information within a single metasurface and increase the information capacity and security for anticracks.A total of 48 monochrome images consisting of pure color characters and multilevel color video frames were reconstructed in dual polarization channels of the birefringent metasurface to exhibit high information density,and a video was displayed via sequential illumination of the corresponding code patterns to verify the ability of dynamic manipulation.Our approach demonstrates significant application potential in optical data storage,optical encryption,multiwavelengthversatile diffractive optical elements,and stimulated emission depletion microscopy.展开更多
基金Supported by Beijing Natural Science Foundation(4062029)Ministry of Science and Technology Innovation Foundation for Small and Medium-sized Enterprises (06KW1051)North China University of Technology Dr. Start-up Fund for 2013
文摘A method of micro-scanning location adaptive calibration was proposed, which was real- ized by the digital image micro-displacement estimation. With geometric calculation, this calibration method used the displacement estimation of two thermal microscope images to get the size and direc- tion of each scanning location calibration angle. And each location calibration process was repeated according to the offset given by the system beforehand. The comparison experiments of sequence oversampling reconstruction before and after the micro-scanning location calibration were done. The results showed that the calibration method effectively improved the thermal microscope imaging qual- ity.
基金Hongtao Wang acknowledges the support from National Key Research and Development Program of China(2017YFB0403602)China Scholarship Council.Baohua Jia acknowledges the support from the Australian Research Council through the Discovery Projects(DP150102972,DP190103186)+5 种基金the Industrial Transformation Training Centres scheme(Grant No.IC180100005)support from Defence Science Institute(DSI)and Defence Science and Technology Group(DSTG).C.W.Q.acknowledges the support from the National Research Foundation,Prime Minister’s Office,Singapore,under its Competitive Research Programme(CRP award NRF CRP22-2019-0006)Advanced Research and Technology Innovation Centre(ARTIC)under the grant(R-261-518-004-720)A STAR under Advanced Manufacturing and Engineering(AME)Individual Research Grant(IRG A2083c0060)Tian Lan acknowledges National Key Basic Research Program 973 Project(2013CB329202)National Major Scientific Instruments and Equipments Development Project supported by National Natural Science Foundation of China(No.61827814).
文摘Ultrathin flat metalenses have emerged as promising alternatives to conventional diffractive lenses,offering new possibilities for myriads of miniaturization and interfacial applications.Graphene-based materials can achieve both phase and amplitude modulations simultaneously at a single position due to the modification of the complex refractive index and thickness by laser conversion from graphene oxide into graphene like materials.In this work,we develop graphene oxide metalenses to precisely control phase and amplitude modulations and to achieve a holistic and systematic lens design based on a graphene-based material system.We experimentally validate our strategies via demonstrations of two graphene oxide metalenses:one with an ultra-long(~16λ)optical needle,and the other with axial multifocal spots,at the wavelength of 632.8 nm with a 200 nm thin film.Our proposed graphene oxide metalenses unfold unprecedented opportunities for accurately designing graphene-based ultrathin integratable devices for broad applications.
基金Supported by the National Natural Science Foundation of China(60905012)
文摘To improve the performance of the scale invariant feature transform （ SIFT）, a modified SIFT （M-SIFT） descriptor is proposed to realize fast and robust key-point extraction and matching. In descriptor generation, 3 rotation-invariant concentric-ring grids around the key-point location are used instead of 16 square grids used in the original SIFT. Then, 10 orientations are accumulated for each grid, which results in a 30-dimension descriptor. In descriptor matching, rough rejection mismatches is proposed based on the difference of grey information between matching points. The per- formance of the proposed method is tested for image mosaic on simulated and real-worid images. Experimental results show that the M-SIFT descriptor inherits the SIFT＇ s ability of being invariant to image scale and rotation, illumination change and affine distortion. Besides the time cost of feature extraction is reduced by 50% compared with the original SIFT. And the rough rejection mismatches can reject at least 70% of mismatches. The results also demonstrate that the performance of the pro- posed M-SIFT method is superior to other improved SIFT methods in speed and robustness.
基金Supported by the National Natural Science Foundation of China(60905012,60572058)
文摘To improve the quality of the infrared image and enhance the information of the object,a dual band infrared image fusion method based on feature extraction and a novel multiple pulse coupled neural network(multi-PCNN)is proposed.In this multi-PCNN fusion scheme,the auxiliary PCNN which captures the characteristics of feature image extracting from the infrared image is used to modulate the main PCNN,whose input could be original infrared image.Meanwhile,to make the PCNN fusion effect consistent with the human vision system,Laplacian energy is adopted to obtain the value of adaptive linking strength in PCNN.After that,the original dual band infrared images are reconstructed by using a weight fusion rule with the fire mapping images generated by the main PCNNs to obtain the fused image.Compared to wavelet transforms,Laplacian pyramids and traditional multi-PCNNs,fusion images based on our method have more information,rich details and clear edges.
基金supported by a grant from the Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology (Grant No. GZZKFJJ2020004)the National Natural Science Foundation of China (Grant Nos. 61875013 and 61827814)the Natural Science Foundation of Beijing Municipality (Grant No. Z190018)。
文摘The visible-light imaging system used in military equipment is often subjected to severe weather conditions, such as fog, haze, and smoke, under complex lighting conditions at night that significantly degrade the acquired images. Currently available image defogging methods are mostly suitable for environments with natural light in the daytime, but the clarity of images captured under complex lighting conditions and spatial changes in the presence of fog at night is not satisfactory. This study proposes an algorithm to remove night fog from single images based on an analysis of the statistical characteristics of images in scenes involving night fog. Color channel transfer is designed to compensate for the high attenuation channel of foggy images acquired at night. The distribution of transmittance is estimated by the deep convolutional network DehazeNet, and the spatial variation of atmospheric light is estimated in a point-by-point manner according to the maximum reflection prior to recover the clear image. The results of experiments show that the proposed method can compensate for the high attenuation channel of foggy images at night, remove the effect of glow from a multi-color and non-uniform ambient source of light, and improve the adaptability and visual effect of the removal of night fog from images compared with the conventional method.
基金supported by the National Basic Research Program of China(Grant No.2013CB329202)the Basic Industrial Technology Project of China(Grant No.J312012B002)
文摘Satellite vibrations during exposure will lead to pixel aliasing of remote sensors, resulting in the deterioration of image quality. In this paper, we expose the problem and discuss the characteristics of satellite vibrations, and then present a pixel mixing model. The idea of mean mixing ratio （MMR） is proposed. MMR computations for different frequencies are implemented. In the mixing model, a coefficient matrix is introduced to estimate each mixed pixel. Thus, the simulation of degraded image can be performed when the vibration attitudes are known. The computation of MMR takes into considera- tion the influences of various frequencies and amplitudes. Therefore, the roles of these parameters played in the degradation progress are identified. Computations show that under the same vibration amplitude, the influence of vibrations fluctuates with the variation of frequency. The fluctuation becomes smaller as the frequency rises. Two kinds of vibration imaging experiments are performed： different amplitudes with the same frequency and different frequencies with the same amplitude. Results are found to be in very good agreement with the theoretical results. MMR has a better description of image quality than modulation transfer function （MTF）. The influence of vibrations is determined mainly by the amplitude rather than the frequency. The influence of vibrations on image quality becomes gradually stable with the increase of frequency.
基金supported from the Major Key Project of PCLthe National Talent Program。
文摘Inverse design focuses on identifying photonic structures to optimize the performance of photonic devices.Conventional scalar-based inverse design approaches are insufficient to design photonic devices of anisotropic materials such as lithium niobate(LN).To the best of our knowledge,this work proposes for the first time the inverse design method for anisotropic materials to optimize the structure of anisotropic-material based photonics devices.Specifically,the orientation dependent properties of anisotropic materials are included in the adjoint method,which provides a more precise prediction of light propagation within such materials.The proposed method is used to design ultra-compact wavelength division demultiplexers in the X-cut thin-film lithium niobate(TFLN)platform.By benchmarking the device performances of our method with those of classical scalar-based inverse design,we demonstrate that this method properly addresses the critical issue of material anisotropy in the X-cut TFLN platform.This proposed method fills the gap of inverse design of anisotropic materials based photonic devices,which finds prominent applications in TFLN platforms and other anisotropicmaterial based photonic integration platforms.
基金Sponsored by the National High Technology Research and Development Program of China ("863"Program) (2006AA09Z207)
文摘Based on the characteristics that human eyes are sensitive to brightness and color, the lightness information of visible image and degree of linear polarization and polarization angle were fused in hue-saturation- value（HSV） space. To meet the observation of human eyes, hue adjustment based on color transfer was carried out to the fused image and hue was adjusted by polynomial fitting method. Hue adjustment method was improved considering the complicated real mapping relationship between hue gray scale of fused image and reference template image. The result shows that the color fusion method presented in this paper is superior to the traditional pseudo-color method and it is helpful to recognize the target from the environment correctly. The fusion result can reflect the difference of object＇s polarization characteristic, and get a natural fused image effect.
基金The authors acknowledge the funding provided by the National Key R&D Program of China(2021YFA1401200)Beijing Outstanding Young Scientist Program(BJJWZYJH01201910007022)+2 种基金National Natural Science Foundation of China(No.U21A20140,No.92050117,No.62005017)programBeijing Municipal Science&Technology Commission,Administrative Commission of Zhongguancun Science Park(No.Z211100004821009)This work was supported by the Synergetic Extreme Condition User Facility(SECUF).
文摘Optical neural networks have significant advantages in terms of power consumption,parallelism,and high computing speed,which has intrigued extensive attention in both academic and engineering communities.It has been considered as one of the powerful tools in promoting the fields of imaging processing and object recognition.However,the existing optical system architecture cannot be reconstructed to the realization of multi-functional artificial intelligence systems simultaneously.To push the development of this issue,we propose the pluggable diffractive neural networks(P-DNN),a general paradigm resorting to the cascaded metasurfaces,which can be applied to recognize various tasks by switching internal plug-ins.As the proof-of-principle,the recognition functions of six types of handwritten digits and six types of fashions are numerical simulated and experimental demonstrated at near-infrared regimes.Encouragingly,the proposed paradigm not only improves the flexibility of the optical neural networks but paves the new route for achieving high-speed,low-power and versatile artificial intelligence systems.
基金financially supported by National Natural Science Foundation of China (No. 62274181,62204257 and 62374016)Chinese Ministry of Science and Technology (No. 2019YFB2205005)+4 种基金Guangdong Province Research and Development Program in Key Fields (No. 2021B0101280002)the support from Youth Innovation Promotion Association Chinese Academy of Sciences (No. 2021115)Beijing Institute of ElectronicsBeijing Association for Science and Technology as well,the support from University of Chinese Academy of Sciences (No. 118900M032)China Fundamental Research Funds for the Central Universities (No. E2ET3801)
文摘Extreme ultraviolet(EUV)lithography with high numerical aperture(NA)is a future technology to manufacture the integrated circuit in sub-nanometer dimension.Meanwhile,source mask co-optimization(SMO)is an extensively used approach for advanced lithography process beyond 28 nm technology node.This work proposes a novel SMO method to improve the image fidelity of high-NA EUV lithography system.A fast high-NA EUV lithography imaging model is established first,which includes the effects of mask three-dimensional structure and anamorphic magnification.Then,this paper develops an efficient SMO method that combines the gradient-based mask optimization algorithm and the compressivesensing-based source optimization algorithm.A mask rule check(MRC)process is further proposed to simplify the optimized mask pattern.Results illustrate that the proposed SMO method can significantly reduce the lithography patterning error,and maintain high computational efficiency.
基金the National Key R&D Program of China(2021YFA1401200)Beijing Outstanding Young Scientist Program(BJJWZYJH01201910007022)+2 种基金National Natural Science Foundation of China(No.U21A20140,No.92050117)Beijing Municipal Science&Technology Commission,Administrative Commission of Zhongguancun Science Park(No.Z211100004821009)X.Li acknowledges the support from Beijing Institute of Technology Research Fund Program for Young Scholars(XSQD-201904005).
文摘Color metasurface holograms are powerful and versatile platforms for modulating the amplitude,phase,polarization,and other properties of light at multiple operating wavelengths.However,the current color metasurface holography can only realize static manipulation.In this study,we propose and demonstrate a multiplexing metasurface technique combined with multiwavelength code-division multiplexing(CDM)to realize dynamic manipulation.Multicolor code references are utilized to record information within a single metasurface and increase the information capacity and security for anticracks.A total of 48 monochrome images consisting of pure color characters and multilevel color video frames were reconstructed in dual polarization channels of the birefringent metasurface to exhibit high information density,and a video was displayed via sequential illumination of the corresponding code patterns to verify the ability of dynamic manipulation.Our approach demonstrates significant application potential in optical data storage,optical encryption,multiwavelengthversatile diffractive optical elements,and stimulated emission depletion microscopy.
