Combined learning for decentralized neural network training with data privacy preservation

Detalhes bibliográficos
Ano de defesa: 2024
Autor(a) principal: Ioste, Aline Rodrigheri
Orientador(a): Não Informado pela instituição
Banca de defesa: Não Informado pela instituição
Tipo de documento: Tese
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Biblioteca Digitais de Teses e Dissertações da USP
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
Link de acesso: https://www.teses.usp.br/teses/disponiveis/45/45134/tde-11112024-095141/
Resumo: This thesis presents CoLN (Combined Learning Network), a new approach to decentralized machine learning that employs a non-convex model focused on privacy preservation. Unlike traditional methods used in federated learning, which rely on simple parameter aggregations like weighted averages, CoLN explores solutions beyond the convex space, addressing the complexities of non-identically distributed data commonly found in deep learning scenarios. CoLN stands out as an efficient alternative for collaborative learning in industrial and research contexts, particularly due to its applicability in scenarios with limited participants, where data centralization is not feasible due to privacy or regulatory constraints. The model enables effective collaboration between distinct parties, maintaining confidentiality and delivering consistent performance in a few iterations, even in environments with few participants. This is especially relevant for shared objectives that require collaboration among different stakeholders, enhancing participants\' overall performance without the need to share raw data for centralized model training. Empirical tests demonstrate that CoLN can approximate the performance of centralized models, showing robustness across distinct neural network architectures, even with substantial variations in data among local models. With a simplified implementation, rapid adaptation to imbalanced datasets, and the ability to achieve combined generalization in few iterations, CoLN emerges as a promising alternative for collaborative learning.