SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks
| Autor(a) principal: | |
|---|---|
| Data de Publicação: | 2023 |
| Outros Autores: | , |
| Tipo de documento: | Artigo |
| Idioma: | eng |
| Título da fonte: | Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| Texto Completo: | https://hdl.handle.net/10316/112074 https://doi.org/10.1145/3583133.3596399 |
Resumo: | Spiking Neural Networks (SNNs) have attracted recent interest due to their energy efficiency and biological plausibility. However, the performance of SNNs still lags behind traditional Artificial Neural Networks (ANNs), as there is no consensus on the best learning algorithm for SNNs. Best-performing SNNs are based on ANN to SNN conversion or learning with spike-based backpropagation through surrogate gradients. The focus of recent research has been on developing and testing different learning strategies, with hand-tailored architectures and parameter tuning. Neuroevolution (NE), has proven successful as a way to automatically design ANNs and tune parameters, but its applications to SNNs are still at an early stage. DENSER is a NE framework for the automatic design and parametrization of ANNs, based on the principles of Genetic Algorithms (GA) and Structured Grammatical Evolution (SGE). In this paper, we propose SPENSER, a NE framework for SNN generation based on DENSER, for image classification on the MNIST and Fashion-MNIST datasets. SPENSER generates competitive performing networks with a test accuracy of 99.42% and 91.65% respectively. |
| id |
RCAP_c2e6cd01aa2a593290943f51d115cd70 |
|---|---|
| oai_identifier_str |
oai:estudogeral.uc.pt:10316/112074 |
| network_acronym_str |
RCAP |
| network_name_str |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| repository_id_str |
https://opendoar.ac.uk/repository/7160 |
| spelling |
SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networksspiking neural networksneuroevolutionDENSERcomputer visionSpiking Neural Networks (SNNs) have attracted recent interest due to their energy efficiency and biological plausibility. However, the performance of SNNs still lags behind traditional Artificial Neural Networks (ANNs), as there is no consensus on the best learning algorithm for SNNs. Best-performing SNNs are based on ANN to SNN conversion or learning with spike-based backpropagation through surrogate gradients. The focus of recent research has been on developing and testing different learning strategies, with hand-tailored architectures and parameter tuning. Neuroevolution (NE), has proven successful as a way to automatically design ANNs and tune parameters, but its applications to SNNs are still at an early stage. DENSER is a NE framework for the automatic design and parametrization of ANNs, based on the principles of Genetic Algorithms (GA) and Structured Grammatical Evolution (SGE). In this paper, we propose SPENSER, a NE framework for SNN generation based on DENSER, for image classification on the MNIST and Fashion-MNIST datasets. SPENSER generates competitive performing networks with a test accuracy of 99.42% and 91.65% respectively.Portuguese Recovery and Resilience Plan (PRR) through project (C645008882-00000055) and grant 2022.11314.BD.Association for Computing Machinery, Inc2023-05-18info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articlehttps://hdl.handle.net/10316/112074https://hdl.handle.net/10316/112074https://doi.org/10.1145/3583133.3596399engBranquinho, HenriqueLourenço, NunoCosta, Ernestoinfo:eu-repo/semantics/openAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2024-07-23T13:08:00Zoai:estudogeral.uc.pt:10316/112074Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-29T06:04:24.324032Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse |
| dc.title.none.fl_str_mv |
SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks |
| title |
SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks |
| spellingShingle |
SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks Branquinho, Henrique spiking neural networks neuroevolution DENSER computer vision |
| title_short |
SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks |
| title_full |
SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks |
| title_fullStr |
SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks |
| title_full_unstemmed |
SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks |
| title_sort |
SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks |
| author |
Branquinho, Henrique |
| author_facet |
Branquinho, Henrique Lourenço, Nuno Costa, Ernesto |
| author_role |
author |
| author2 |
Lourenço, Nuno Costa, Ernesto |
| author2_role |
author author |
| dc.contributor.author.fl_str_mv |
Branquinho, Henrique Lourenço, Nuno Costa, Ernesto |
| dc.subject.por.fl_str_mv |
spiking neural networks neuroevolution DENSER computer vision |
| topic |
spiking neural networks neuroevolution DENSER computer vision |
| description |
Spiking Neural Networks (SNNs) have attracted recent interest due to their energy efficiency and biological plausibility. However, the performance of SNNs still lags behind traditional Artificial Neural Networks (ANNs), as there is no consensus on the best learning algorithm for SNNs. Best-performing SNNs are based on ANN to SNN conversion or learning with spike-based backpropagation through surrogate gradients. The focus of recent research has been on developing and testing different learning strategies, with hand-tailored architectures and parameter tuning. Neuroevolution (NE), has proven successful as a way to automatically design ANNs and tune parameters, but its applications to SNNs are still at an early stage. DENSER is a NE framework for the automatic design and parametrization of ANNs, based on the principles of Genetic Algorithms (GA) and Structured Grammatical Evolution (SGE). In this paper, we propose SPENSER, a NE framework for SNN generation based on DENSER, for image classification on the MNIST and Fashion-MNIST datasets. SPENSER generates competitive performing networks with a test accuracy of 99.42% and 91.65% respectively. |
| publishDate |
2023 |
| dc.date.none.fl_str_mv |
2023-05-18 |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
| format |
article |
| status_str |
publishedVersion |
| dc.identifier.uri.fl_str_mv |
https://hdl.handle.net/10316/112074 https://hdl.handle.net/10316/112074 https://doi.org/10.1145/3583133.3596399 |
| url |
https://hdl.handle.net/10316/112074 https://doi.org/10.1145/3583133.3596399 |
| dc.language.iso.fl_str_mv |
eng |
| language |
eng |
| dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
| eu_rights_str_mv |
openAccess |
| dc.publisher.none.fl_str_mv |
Association for Computing Machinery, Inc |
| publisher.none.fl_str_mv |
Association for Computing Machinery, Inc |
| dc.source.none.fl_str_mv |
reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia instacron:RCAAP |
| instname_str |
FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia |
| instacron_str |
RCAAP |
| institution |
RCAAP |
| reponame_str |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| collection |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| repository.name.fl_str_mv |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia |
| repository.mail.fl_str_mv |
info@rcaap.pt |
| _version_ |
1833602567714635776 |