摘要
基于迭代优化的传统视频压缩感知重构算法运行时间长,参数的自适应性较低,限制了其实用性和泛化能力.利用神经网络强大的计算能力和运行速度快、参数可学习的优点,本文首先提出了帧间组稀疏网络(VGSR-Net),用神经网络将图像块组映射到更高维的稀疏表示域中,并利用可学习的阈值提取帧间相关特征.在此基础上,提出了两阶段混合递归增强重构网络(2sRER-VGSR-Net).首先,利用VGSR-Net对初始重构结果进行初步增强;然后,引入STMC-Net实现运动估计,并利用残差重构网络进一步重构当前帧丢失的信息,得到更高质量的重构结果.在第二阶段重构过程中采用混合递归结构,充分利用已有的高质量重构帧信息.仿真结果表明,所提算法与现有最优迭代优化重构算法SSIM-InterF-GSR相比重构性能提升了1.99dB;和基于深度学习的重构网络CSVideoNet相比,性能提升了4.60dB.
The traditional iterative optimized based video compression sensing algorithms are limited by long running time and low adaptability of parameters,resulting in low practicability and generalization.Taking advantage of the powerful computing power,fast speed and learnable parameters of neural networks,this paper first proposes a group sparse representation network(VGSR-Net),which maps the image block group to a higher-dimensional sparse domain through convolution,and uses a learnable threshold to denoise and extract inter-frame correlation.On this basis,a two-stage recursive enhance reconstruction network(2sRER-VGSR-Net)is proposed.First,we perform VGSR-Net to preliminarily enhance the initial reconstruction and then introduce STMC-Net as motion estimation,and the compensated frames are fed into the residual reconstruction network to further extract the missing detail and enhance the current frame.The second stage of reconstruction adopts a hybrid recursive structure with the aim of making full use of the existing better quality reconstructed frames.The simulation results show that the proposed algorithm improves the PSNR(Peak Signal to Noise Ratio)by 1.99dB compared with the existing state-of-art traditional compressed video sensing reconstruction algorithms SSIM-InterF-GSR,while improves the PSNR by 4.60dB with the comparation of the network-based algorithm CSVideoNet.
作者
禤韵怡
杨春玲
XUAN Yun-yi;YANG Chun-ling(School of Electronic and Information Engineering,South China University of Technology,Guangzhou,Guangdong 510640,China)
出处
《电子学报》
EI
CAS
CSCD
北大核心
2021年第3期435-442,共8页
Acta Electronica Sinica
基金
广东省自然科学基金-重点(No.2017A030311028)
广东省自然科学基金(No.2019A1515011949)。
关键词
视频压缩感知
深度学习
帧间组稀疏表示
混合递归网络
运动估计
增强重构
compressed video sensing
deep learning
group based sparse representation
hybrid recursive network
motion estimation
enhancement reconstruction
作者简介
禤韵怡,女,1995年生于广东佛山,华南理工大学电子与信息学院研究生,研究方向:视频压缩感知,E-mail:eeyyxuan@mail.scut.edu.cn;通信作者:杨春玲,女,1970年生于河南新乡,华南理工大学电子与信息学院博士生导师,研究方向:图像/视频压缩编码,图像质量评价,E-mail:eeclyang@scut.edu.cn。
