摘要
目的利用计算机视觉算法自动生成各种类型的糖尿病视网膜病变(DR)眼底图像。方法提出一种基于生成对抗网络(GAN)的眼底图像生成方法。该方法以眼底图像的血管脉络图像和病灶点的文字描述作为生成的约束条件,对文字使用长短记忆网络(LSTM)进行编码,血管脉络图像用卷积神经网络(CNN)进行编码,对二者信息合并,再使用生成对抗网络生成眼底图像。结果模型生成的眼底图像中包含清晰的视盘、血管、黄斑等特征,但是由于文字编码的循环神经网络(RNN)损失函数不能很好地收敛,所以生成图像细节特征不明显。结论使用GAN可以生成逼真的DR眼底图像,在扩充医疗数据方面具有一定的应用价值,但在小区域细节特征的生成方面仍需改进。
Objective To generate various types of diabetic retinopathy (DR) fundus images automatically by computer vision algorithm. Methods A method based on deep learning to generate fundus images was proposed,which used the vascular vein of the fundus image and the text description of lesions as the constraint conditions to generate fundus image.The text description was encoded by using a long short-term memory (LSTM),and the vascular vein image was encoded by a convolutional neural network (CNN).Then the encoded information was combined and used to generate a fundus image by generative adversarial networks (GAN). Results The results showed that the algorithm can generate realistic fundus images.However,the image detail features were not obvious because the text-encoded recurrent neural network (RNN) loss function did not converge well. Conclusions Using the GAN can generate realistic DR fundus images,which has certain application value in expanding medical data.However,the generation of detail features in small areas still needs improvement.
作者
万程
周鹏
吴陆辉
吴一全
沈建新
叶辉
Wan Cheng;Zhou Peng;Wu Luhui;Wu Yiquan;Shen Jianxin;Ye Hui(College of Electronic and Information Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,China;Department of Ophthalmology,Jiangsu Province Hospital,Nanjing 210029,China)
出处
《中华实验眼科杂志》
CAS
CSCD
北大核心
2019年第8期613-618,共6页
Chinese Journal Of Experimental Ophthalmology
基金
国家自然科学基金项目(GBA1604401)
江苏省自然科学基金项目(PAF16022)
江苏高校优势学科建设工程项目.
关键词
生成对抗网络
眼底图像
图像生成
卷积神经网络
Generative adversarial networks
Fundus images
Image generation
Convolutional neural network
作者简介
通信作者:叶辉,Email:yehui_mail@163.com.
