Experimental Science
Diabetic retinopathy fundus image generation based on generative adversarial networks
Cheng Wan, Peng Zhou, Luhui Wu, Yiquan Wu, Jianxin Shen, Hui Ye
Published 2019-08-10
Cite as Chin J Exp Ophthalmol, 2019, 37(8): 613-618. DOI: 10.3760/cma.j.issn.2095-0160.2019.08.005
Abstract
ObjectiveTo generate various types of diabetic retinopathy (DR) fundus images automatically by computer vision algorithm.
MethodsA method based on deep learning to generate fundus images was proposed, which used the vascular vein of the fundus image and the text description of lesions as the constraint conditions to generate fundus image.The text description was encoded by using a long short-term memory (LSTM), and the vascular vein image was encoded by a convolutional neural network (CNN). Then the encoded information was combined and used to generate a fundus image by generative adversarial networks (GAN).
ResultsThe results showed that the algorithm can generate realistic fundus images.However, the image detail features were not obvious because the text-encoded recurrent neural network (RNN) loss function did not converge well.
ConclusionsUsing the GAN can generate realistic DR fundus images, which has certain application value in expanding medical data.However, the generation of detail features in small areas still needs improvement.
Key words:
Generative adversarial networks; Fundus images; Image generation; Convolutional neural network
Contributor Information
Cheng Wan
College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
Peng Zhou
College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
Luhui Wu
College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
Yiquan Wu
College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
Jianxin Shen
College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
Hui Ye
Department of Ophthalmology, Jiangsu Province Hospital, Nanjing 210029, China
本文基金项目中“国家自然科学基金项目（GBA1604401）；江苏省自然科学基金项目（PAF16022）”应更正为“国家自然科学基金项目（61603182）；江苏省自然科学基金项目（BK20160803）”更正的同时表示歉意！