摘要
热成像技术具有广泛的应用领域,随着红外焦平面探测器及数字图像处理技术的发展,新型热成像模式及其图像处理技术成为国内外发展的重要方向。介绍了近年来研究的几个典型进展,其中改进的基于场景特征的时域高通与空域低通滤波结合的非均匀性校正方法能够有效滤除制冷热成像系统观察低温天空场景时的水波纹固定图案噪声,并在FPGA硬件平台上实现了算法移植;研制出红外分焦平面偏振片阵列,实现了中波制冷和长波非制冷红外焦平面探测器的耦合成像,并通过考虑偏振片效应的偏振成像模型,滤除光路中偏振片的辐射影响;研制出基于常规制冷长波红外焦平面探测器的超频高动态热成像系统,在FPGA实现了多积分时间图像融合-细节增强级联的HDR图像融合方法,实现了对高动态场景的实时成像;研究了“田”字型四孔径和“十”字型四/五孔径等三类紧凑型视场部分重叠仿生复眼热成像模式,研制了2套实验系统来验证该方法的有效性;提出一种基于双生成对抗网络的非配对热红外-可见光图像转换算法TIV-Net,该方法能够将热图像有效地转化为类彩色可见光图像,并在无人机等平台实现了不低于20 Hz的实时处理。以上具有创新性的技术突破或已获得应用或展现良好的应用前景,将是进一步研究完善的重要方向。
Significance Infrared thermal imaging technology has a wide range of applications in military and civilian fields,and realtime digital image processing,as a key link of infrared imaging systems,has become an important part of thermal imaging technology research in China and abroad.With the development of infrared focal plane detectors(IRFPA)and intelligent image processing technologies,new thermal imaging modes and corresponding image processing methods have been continuously innovated,which have achieved some effective results.Progress We review the research and application of the research team in the new thermal imaging modes and their image processing technologies.1)The non-uniformity correction(NUC)method combining scene-based time-domain high-pass and air-domain low-pass filtering,namely ITHP&GM is proposed,which can effectively correct the"water streak"non-uniformity noise that the existing algorithm fails to effectively deal with,and the algorithm transplantation has been realized on the FPGA hardware platform and applied in a mid-wave infrared cooling thermal imaging camera.2)The focal plane infrared polarizer arrays with 4-polarization and 3-polarization+1 intensity division are designed and developed,and the coupling and imaging with the refrigerated MW-IRFP movement(320 pixel×256 pixel,25μm)and the uncooled LWIRFPA movement(640 pixel×512 pixel,17μm)are realized.A correction model of the front polarizer-based polarization thermal imaging system is proposed,which can effectively reduce the radiation and reflection effects of the polarizer in the optical path.3)The overclocked high dynamic range(HDR)thermal imaging experimental system based on 256×256 longwave IRFPA is developed and combined with the HDR image fusion method of multi-integration time image fusion-detail enhancement cascade,and real-time HDR thermal imaging(with delay less than 40 ms)is realized,which can normally observe and identify targets under the background of strong radiation such as the sun,jamming bombs,and flames.4)The bionic compound eye thermal imaging mode with the partially overlapped field of view of four apertures and four/five apertures is proposed,and the experimental system of four-aperture bionic compound eye thermography based on 640×480 and 80×80 uncooled IRFPA is built,which realizes variable spatial resolution imaging with a large field of view searching and high-resolution imaging of central field of view and verifies the characteristics and effectiveness of bionic compound eye thermography.5)The TIV-Net algorithm for the conversion of thermal infrared to visible color images is proposed.75000 pairs of image datasets are completed,and the real-time processing that is not less than 20 Hz is realized on platforms such as vehicle platforms and drones.The real-time conversion of day and night thermal images to natural color visible light images through deep learning methods is proven,which effectively improves the situational awareness ability of day and night human eye vision through thermal imagers.Conclusions and Prospects The research progress of the research team in new thermal imaging modes and image processing technologies is reviewed,including the NUC method combining scene-based time-domain high-pass and airspace low-pass filtering,correction model of division of focal plane infrared polarizer arrays based on infrared polarization imaging,front polarizer-based polarization thermography system,overclocking HDR thermal imaging experimental system of longwave IRFPA,bionic compound eye thermal imaging mode and its experimental system with the partially overlapped field of view of four apertures and four/five apertures,TIV-Net algorithm converting thermal infrared to visible color images,etc.Such technology research has made innovative technological breakthroughs or has been applied,showing a wide range of application prospects,which can be an important direction for further research and expansion.
作者
金伟其
李力
王霞
Jin Weiqi;Li Li;Wang Xia(Key Lab of Photoelectronic Imaging Technology and System,Ministry of Education,School of Optoelectronics,Beijing Institute of Technology,Beijing 100081,China)
出处
《光学学报》
EI
CAS
CSCD
北大核心
2023年第15期132-144,共13页
Acta Optica Sinica
基金
国家自然科学基金面上项目(61871034)
装备预先研究领域基金(61404140513)。
关键词
图像处理
热成像
高动态范围
偏振成像
仿生复眼
彩色化
image processing
thermal imaging
high dynamic range
polarization imaging
bionic compound eye
colorization
作者简介
通信作者:金伟其,jinwq@bit.edu.cn。
