摘要
面部表情生成是通过某种表情计算方法生成带有表情的人脸图像,在人脸编辑、影视制作和数据扩增等方面应用广泛。随着生成对抗网络的出现,面部表情生成取得了显著的进步,但是生成的面部表情图像会出现重叠、模糊等现象,缺乏真实感。为了解决上述问题,提出了一种带有混合注意力机制组残差块的生成对抗网络(group residuals with attention mechanism-generative adversarial network,GRA-GAN)用于生成高质量的面部表情图像。在生成网络进行下采样前和上采样后,分别嵌入混合注意力机制来自适应地学习关键区域特征,增强对图像关键区域的学习。将分组的思想融入到残差网络中,提出了带有混合注意力机制的组残差块来实现更好的生成效果。在公开数据集RaFD进行了实验验证。实验结果表明,GRA-GAN模型在定性评估和定量分析指标上均优于相关方法。
Facial expression generation is the generation of facial images with expressions through a certain expression calculation method,which is widely used in face editing,film and television production,and data augmentation.With the advent of generative adversarial network(GAN),facial expression generation has made significant progress,but problems such as overlapping,blurring,and lack of realism still occur in facial expression generation images.In order to address the above issues,group residuals with attention mechanism generative adversarial network(GRA-GAN)is proposed to generate high-quality facial expressions.Firstly,an adaptive mixed attention mechanism(MAT)is embedded in the generative network before downsampling and after upsampling to adaptively learn the key region features and enhance the learning of key regions of the image.Secondly,the idea of grouping is integrated into the residual network,and the group residuals block with attention mechanism(GRA)module is proposed to achieve better generation effect.Finally,the experimental verification is carried out on the public dataset RaFD.The experimental results show that the proposed GRA-GAN outper-forms the related methods in both qualitative and quantitative analysis.
作者
林本旺
赵光哲
王雪平
李昊
LIN Benwang;ZHAO Guangzhe;WANG Xueping;LI Hao(School of Electrical and Information Engineering,Beijing University of Civil Engineering and Architecture,Beijing 102616,China)
出处
《计算机工程与应用》
CSCD
北大核心
2024年第5期240-249,共10页
Computer Engineering and Applications
基金
国家自然科学基金(62176018)。
关键词
生成对抗网络
表情生成
注意力机制
组残差块
generative adversarial network(GAN)
expression generation
attention mechanism
group residual block
作者简介
林本旺(1996-),男,硕士研究生,研究方向为机器学习、计算机视觉、人脸生成;赵光哲(1979-),男,博士,教授,研究方向为计算机视觉与图像处理、模式识别、人工智能;通信作者:王雪平(1990-),女,博士,CCF会员,研究方向为模式识别与图像处理、情感计算,E-mail:wangxueping@bucea.edu.cn;李昊(1997-),男,硕士研究生,研究方向为计算机视觉、机器学习。
