期刊文献+

利用双通道卷积神经网络的图像超分辨率算法 被引量:18

Image super-resolution using two-channel convolutional neural networks
原文传递
导出
摘要 目的图像超分辨率算法在实际应用中有着较为广泛的需求和研究。然而传统基于样本的超分辨率算法均使用简单的图像梯度特征表征低分辨率图像块,这些特征难以有效地区分不同的低分辨率图像块。针对此问题,在传统基于样本超分辨率算法的基础上,提出双通道卷积神经网络学习低分辨率与高分辨率图像块相似度进行图像超分辨率的算法。方法首先利用深度卷积神经网络学习得到有效的低分辨率与高分辨率图像块之间相似性度量,然后根据输入低分辨率图像块与高分辨率图像块字典基元的相似度重构出对应的高分辨率图像块。结果本文算法在Set5和Set14数据集上放大3倍情况下分别取得了平均峰值信噪比(PSNR)为32.53 d B与29.17 d B的效果。结论本文算法从低分辨率与高分辨率图像块相似度学习角度解决图像超分辨率问题,可以更好地保持结果图像中的边缘信息,减弱结果中的振铃现象。本文算法可以很好地适用于自然场景图像的超分辨率增强任务。 Objective All traditional example-based super-resolution methods adopt image-gradient features for low-resolution images and thus, these methods are unable to characterize the low-resolution space satisfactorily. To address this issue, this paper proposes a novel unified framework for image super-resolution that effectively combines example-based method with deep learning models. Method The proposed method consists of three main stages : lowand high-resolution similarity- learning, high-resolution patch-dictionary-learning, and high-resolution patch-generating stages. At the first stage, two different convolutional neural networks are proposed for learning a novel similarity metric between high- and low-resolution image patches. At the second stage, the high-resolution patch dictionaries are learned from training sets. At the last stage, the high- resolution patches are generated based on learned similarities between the input low-resolution patch and the atoms in the high-resolution patch dictionary. Result Experimental results on several commonly adopted datasets show that the proposed two-channel model quantitatively and qualitatively achieves improved performance compared with other methods. Conclusion The proposed two-channel model can preserve more detailed information and reduce ringing artifacts in the resulting images.
出处 《中国图象图形学报》 CSCD 北大核心 2016年第5期556-564,共9页 Journal of Image and Graphics
基金 国家重点基础研究发展计划(973)基金项目(2012CB316302) 国家自然科学基金项目(61322209 61175007)~~
关键词 图像超分辨率 Pair—wise卷积神经网络 双通道卷积神经网络 图像块相似度学习 image super resolution Pair-wise convolutional neural networks two-channel convolutional neural networks patch similarity learning
作者简介 徐冉(1992-),男,2013年于中国科学院自动化研究所模式识别实验室攻读硕士学位,主要研究方向为图像处理、图像超分辨率。E-mail:ran.xu@nlpr.ia.ac.cn
  • 相关文献

参考文献21

  • 1Tsai R, Huang T. Multiple frame image restoration and registra- tion[ C ]/,/Advances in Computer Vision and Image Processing. Greenwich, CT: JAI Press Inc. , 1984: 317-339.
  • 2Komatsu T, Aizawa K, Igarashi T, et al. Signal-processing based method for acquiring very high resolution images with multiple cameras and its theoretical analysis [ J ]. IEEE Proceedings of Communications, Speech and Vision, 1993, 140 ( 1 ) : 19-24. [DOI: 10. 1049/ip-i-2. 1993. 0005 ].
  • 3Ur H, Gross D. Improved resolution from subpixel shifted pic- tures [ J ]. CVGIP: Graphical Models and Image Processing, 1992, 54 (2) : 181-186. [DOI: 10. 1016/1049-9652 (92) 90065-6].
  • 4Komatsu T, Igarashi T, Aizawa K, et al. Very high resolution imaging scheme with multiple different-aperture cameras [ J ]. Signal Processing: Image Communication, 1993, 5 ( 5-6 ) : 511- 526. [ DOI: 10. 1016/0923-5965(95)90014-K].
  • 5Tappen M F, Russell B C, Freeman W T. Exploiting the sparse derivative prior for super-resolution and image demosalcing[ C ]// Proceedings of the IEEE Workshop on Statistical and Computa- tional Theories of Vision. Washington, DE : IEEE, 2003.
  • 6Kim K I, Kwon Y. Single-image super-resolution using sparse re- gression and natural image prior[ J]. IEEE Transactions on Pat- tern Analysis and Machine Intelligence, 2010, 32 (6): 1127- 1133. [DOI: 10. 1109/TPAMI. 2010.25].
  • 7Dai S Y, Han M, Xu W, et al. Soft edge smoothness prior for al- pha channel super resolution [ C ]//Proceedings of the IEEE Con- ference on Computer Vsion and Pattern Recognition. Minneapo- lis, MN: IEEE, 2007: 1-8. [DOI: 10. ll09/CVPR. 2007. 383028 ].
  • 8Dai S Y, Han M, Xu W, et al. Softcuts: a soft edge smoothness prior for color image super-resolution [ J ]. IEEE Transactions on Image Processing, 2009, 18(5) : 969-981. [DOI: 10. 1109/ TIP. 2009. 2012908 ].
  • 9Chang H, Yeung D Y, Xiong Y M. Super-resolution through neighbor embedding[ C ]//Proceedings of the IEEE Computer So- ciety Conference on Computer Vision and Pattern Recognition. Washington, DC: IEEE, 2004: I. [ DOI: 10. l109/CVPR. 2004. 1315043 ].
  • 10Yang J C, Wright J, Huang T S, et al. Image super-resolution via sparse representation [ J ]. IEEE Transactions on Image Pro- cessing, 2010, 19 ( 11 ) : 2861-2873. [ DOI: 10. l109/TIP. 2010.2050625 ].

同被引文献91

引证文献18

二级引证文献208

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部