Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization
| Autor(a) principal: | |
|---|---|
| Data de Publicação: | 2024 |
| Outros Autores: | , , , , , |
| Tipo de documento: | Artigo |
| Idioma: | eng |
| Título da fonte: | Repositório Institucional da UNESP |
| Texto Completo: | http://dx.doi.org/10.1016/j.bspc.2024.106263 https://hdl.handle.net/11449/304275 |
Resumo: | Deep learning applications for assessing medical images are limited because the datasets are often small and imbalanced. The use of synthetic data has been proposed in the literature, but neither a robust comparison of the different methods nor generalizability has been reported. Our approach integrates a retinal image quality assessment model and StyleGAN2 architecture to enhance Age-related Macular Degeneration (AMD) detection capabilities and improve generalizability. This work compares ten different Generative Adversarial Network (GAN) architectures to generate synthetic eye-fundus images with and without AMD. We combined subsets of three public databases (iChallenge-AMD, ODIR-2019, and RIADD) to form a single training and test set. We employed the STARE dataset for external validation, ensuring a comprehensive assessment of the proposed approach. The results show that StyleGAN2 reached the lowest Fréchet Inception Distance (166.17), and clinicians could not accurately differentiate between real and synthetic images. ResNet-18 architecture obtained the best performance with 85% accuracy and outperformed the two human experts (80% and 75%) in detecting AMD fundus images. The accuracy rates were 82.8% for the test set and 81.3% for the STARE dataset, demonstrating the model's generalizability. The proposed methodology for synthetic medical image generation has been validated for robustness and accuracy, with free access to its code for further research and development in this field. |
| id |
UNSP_41d77d827cbef60102030a59fcce6f1f |
|---|---|
| oai_identifier_str |
oai:repositorio.unesp.br:11449/304275 |
| network_acronym_str |
UNSP |
| network_name_str |
Repositório Institucional da UNESP |
| repository_id_str |
2946 |
| spelling |
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalizationAge-related macular degenerationData augmentationDeep learningGenerative Adversarial NetworksMedical imagesStyleGAN2Deep learning applications for assessing medical images are limited because the datasets are often small and imbalanced. The use of synthetic data has been proposed in the literature, but neither a robust comparison of the different methods nor generalizability has been reported. Our approach integrates a retinal image quality assessment model and StyleGAN2 architecture to enhance Age-related Macular Degeneration (AMD) detection capabilities and improve generalizability. This work compares ten different Generative Adversarial Network (GAN) architectures to generate synthetic eye-fundus images with and without AMD. We combined subsets of three public databases (iChallenge-AMD, ODIR-2019, and RIADD) to form a single training and test set. We employed the STARE dataset for external validation, ensuring a comprehensive assessment of the proposed approach. The results show that StyleGAN2 reached the lowest Fréchet Inception Distance (166.17), and clinicians could not accurately differentiate between real and synthetic images. ResNet-18 architecture obtained the best performance with 85% accuracy and outperformed the two human experts (80% and 75%) in detecting AMD fundus images. The accuracy rates were 82.8% for the test set and 81.3% for the STARE dataset, demonstrating the model's generalizability. The proposed methodology for synthetic medical image generation has been validated for robustness and accuracy, with free access to its code for further research and development in this field.Department of Biotechnology, Ministry of Science and Technology, IndiaFundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)Stiftelsen PromobiliaEngineering and Physical Sciences Research CouncilSchool of Sciences São Paulo State UniversitySchool of Engineering Royal Melbourne Institute of TechnologyCentre of Eye Research University of MelbourneSchool of Sciences São Paulo State UniversityFAPESP: #2013/07375-0FAPESP: #2014/12236-1FAPESP: #2018/15597-6FAPESP: #2019/00585-5FAPESP: #2019/02205-5FAPESP: #2019/07665-4FAPESP: #2023/10823-6CNPq: #307066/2017-7CNPq: #309439/2020-5CNPq: #427968/2018-6CNPq: #88887.606573/2021-00Stiftelsen Promobilia: 2019Engineering and Physical Sciences Research Council: EP/T021063/1Stiftelsen Promobilia: P-134Universidade Estadual Paulista (UNESP)Royal Melbourne Institute of TechnologyUniversity of MelbourneOliveira, Guilherme C. [UNESP]Rosa, Gustavo H. [UNESP]Pedronette, Daniel C.G. [UNESP]Papa, João P. [UNESP]Kumar, HimeeshPassos, Leandro A. [UNESP]Kumar, Dinesh2025-04-29T19:34:27Z2024-08-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttp://dx.doi.org/10.1016/j.bspc.2024.106263Biomedical Signal Processing and Control, v. 94.1746-81081746-8094https://hdl.handle.net/11449/30427510.1016/j.bspc.2024.1062632-s2.0-85189663195Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengBiomedical Signal Processing and Controlinfo:eu-repo/semantics/openAccess2025-04-30T13:52:55Zoai:repositorio.unesp.br:11449/304275Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestrepositoriounesp@unesp.bropendoar:29462025-04-30T13:52:55Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
| dc.title.none.fl_str_mv |
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization |
| title |
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization |
| spellingShingle |
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization Oliveira, Guilherme C. [UNESP] Age-related macular degeneration Data augmentation Deep learning Generative Adversarial Networks Medical images StyleGAN2 |
| title_short |
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization |
| title_full |
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization |
| title_fullStr |
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization |
| title_full_unstemmed |
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization |
| title_sort |
Robust deep learning for eye fundus images: Bridging real and synthetic data for enhancing generalization |
| author |
Oliveira, Guilherme C. [UNESP] |
| author_facet |
Oliveira, Guilherme C. [UNESP] Rosa, Gustavo H. [UNESP] Pedronette, Daniel C.G. [UNESP] Papa, João P. [UNESP] Kumar, Himeesh Passos, Leandro A. [UNESP] Kumar, Dinesh |
| author_role |
author |
| author2 |
Rosa, Gustavo H. [UNESP] Pedronette, Daniel C.G. [UNESP] Papa, João P. [UNESP] Kumar, Himeesh Passos, Leandro A. [UNESP] Kumar, Dinesh |
| author2_role |
author author author author author author |
| dc.contributor.none.fl_str_mv |
Universidade Estadual Paulista (UNESP) Royal Melbourne Institute of Technology University of Melbourne |
| dc.contributor.author.fl_str_mv |
Oliveira, Guilherme C. [UNESP] Rosa, Gustavo H. [UNESP] Pedronette, Daniel C.G. [UNESP] Papa, João P. [UNESP] Kumar, Himeesh Passos, Leandro A. [UNESP] Kumar, Dinesh |
| dc.subject.por.fl_str_mv |
Age-related macular degeneration Data augmentation Deep learning Generative Adversarial Networks Medical images StyleGAN2 |
| topic |
Age-related macular degeneration Data augmentation Deep learning Generative Adversarial Networks Medical images StyleGAN2 |
| description |
Deep learning applications for assessing medical images are limited because the datasets are often small and imbalanced. The use of synthetic data has been proposed in the literature, but neither a robust comparison of the different methods nor generalizability has been reported. Our approach integrates a retinal image quality assessment model and StyleGAN2 architecture to enhance Age-related Macular Degeneration (AMD) detection capabilities and improve generalizability. This work compares ten different Generative Adversarial Network (GAN) architectures to generate synthetic eye-fundus images with and without AMD. We combined subsets of three public databases (iChallenge-AMD, ODIR-2019, and RIADD) to form a single training and test set. We employed the STARE dataset for external validation, ensuring a comprehensive assessment of the proposed approach. The results show that StyleGAN2 reached the lowest Fréchet Inception Distance (166.17), and clinicians could not accurately differentiate between real and synthetic images. ResNet-18 architecture obtained the best performance with 85% accuracy and outperformed the two human experts (80% and 75%) in detecting AMD fundus images. The accuracy rates were 82.8% for the test set and 81.3% for the STARE dataset, demonstrating the model's generalizability. The proposed methodology for synthetic medical image generation has been validated for robustness and accuracy, with free access to its code for further research and development in this field. |
| publishDate |
2024 |
| dc.date.none.fl_str_mv |
2024-08-01 2025-04-29T19:34:27Z |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
| format |
article |
| status_str |
publishedVersion |
| dc.identifier.uri.fl_str_mv |
http://dx.doi.org/10.1016/j.bspc.2024.106263 Biomedical Signal Processing and Control, v. 94. 1746-8108 1746-8094 https://hdl.handle.net/11449/304275 10.1016/j.bspc.2024.106263 2-s2.0-85189663195 |
| url |
http://dx.doi.org/10.1016/j.bspc.2024.106263 https://hdl.handle.net/11449/304275 |
| identifier_str_mv |
Biomedical Signal Processing and Control, v. 94. 1746-8108 1746-8094 10.1016/j.bspc.2024.106263 2-s2.0-85189663195 |
| dc.language.iso.fl_str_mv |
eng |
| language |
eng |
| dc.relation.none.fl_str_mv |
Biomedical Signal Processing and Control |
| dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
| eu_rights_str_mv |
openAccess |
| dc.source.none.fl_str_mv |
Scopus reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
| instname_str |
Universidade Estadual Paulista (UNESP) |
| instacron_str |
UNESP |
| institution |
UNESP |
| reponame_str |
Repositório Institucional da UNESP |
| collection |
Repositório Institucional da UNESP |
| repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
| repository.mail.fl_str_mv |
repositoriounesp@unesp.br |
| _version_ |
1834482387729252352 |