Data Augmentation in Histopathological Classification: An Analysis Exploring GANs with XAI and Vision Transformers

• Main Author: Rozendo, Guilherme Botazzo [UNESP]
• Publication Date: 2024
• Other Authors: Garcia, Bianca Lançoni de Oliveira [UNESP], Borgue, Vinicius Augusto Toreli [UNESP], Lumini, Alessandra, Tosta, Thaína Aparecida Azevedo, Nascimento, Marcelo Zanchetta do, Neves, Leandro Alves [UNESP]
• Format: Article
• Language: eng
• Source: Repositório Institucional da UNESP
• Download full: http://dx.doi.org/10.3390/app14188125; https://hdl.handle.net/11449/303070
• topic: data augmentation; explainable artificial intelligence; GAN training; generative adversarial networks; histopathological classification; vision transformers

Generative adversarial networks (GANs) create images by pitting a generator (G) against a discriminator (D) network, aiming to find a balance between the networks. However, achieving this balance is difficult because G is trained based on just one value representing D’s prediction, and only D can access image features. We introduce a novel approach for training GANs using explainable artificial intelligence (XAI) to enhance the quality and diversity of generated images in histopathological datasets. We leverage XAI to extract feature information from D and incorporate it into G via the loss function, a unique strategy not previously explored in this context. We demonstrate that this approach enriches the training with relevant information and promotes improved quality and more variability in the artificial images, decreasing the FID by up to 32.7% compared to traditional methods. In the data augmentation task, these images improve the classification accuracy of Transformer models by up to 3.81% compared to models without data augmentation and up to 3.01% compared to traditional GAN data augmentation. The Saliency method provides G with the most informative feature information. Overall, our work highlights the potential of XAI for enhancing GAN training and suggests avenues for further exploration in this field.