Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO network

Detalhes bibliográficos
Autor(a) principal: Karimi, Narges
Data de Publicação: 2024
Outros Autores: Mishra, Mayank, Lourenço, Paulo B.
Tipo de documento: Artigo
Idioma: eng
Título da fonte: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
Texto Completo: https://hdl.handle.net/1822/92741
Resumo: Cultural heritage (CH) constructions involve the use of diverse masonry materials. Under natural and human influences, masonry materials can undergo various types of damages, with crack damages being most prevalent. Developing a robust model capable of detecting cracks in various CH materials is crucial for applying deep learning (DL) methods. In this study, we compared the performance of the DL method You Only Look Once (YOLO) object detection network based on images in different masonry materials (stone, brick, cob, and tile) with that in a modern material (concrete). The dataset used in the study comprised 1213 brick, 1116 concrete, 955 cob, 882 stone, and 208 tile images. YOLOv5 architecture, transfer learning, and object detection models were utilized for detecting cracks to observe and compare their performance in different materials. This study represents the first comparison of this kind using an original dataset. The model achieved mean average precision values of 94.4%, 93.9%, 92.7%, 87.2%, 83.4%, 81.6%, and 70.3% for concrete; concrete and cob, cob; stone; stone and brick; brick; and tile, respectively. The findings of this study indicate considerable potential for the widespread use of DL techniques in identifying cracks from images and detecting more damages across various materials.
id RCAP_c8ea7eb4a5be1fa26da1fa5af0590b41
oai_identifier_str oai:repositorium.sdum.uminho.pt:1822/92741
network_acronym_str RCAP
network_name_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository_id_str https://opendoar.ac.uk/repository/7160
spelling Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO networkHistoric buildingsAutomatic crack detectionYOLODeep LearningConvolutional neural networksEngenharia e Tecnologia::Engenharia CivilCultural heritage (CH) constructions involve the use of diverse masonry materials. Under natural and human influences, masonry materials can undergo various types of damages, with crack damages being most prevalent. Developing a robust model capable of detecting cracks in various CH materials is crucial for applying deep learning (DL) methods. In this study, we compared the performance of the DL method You Only Look Once (YOLO) object detection network based on images in different masonry materials (stone, brick, cob, and tile) with that in a modern material (concrete). The dataset used in the study comprised 1213 brick, 1116 concrete, 955 cob, 882 stone, and 208 tile images. YOLOv5 architecture, transfer learning, and object detection models were utilized for detecting cracks to observe and compare their performance in different materials. This study represents the first comparison of this kind using an original dataset. The model achieved mean average precision values of 94.4%, 93.9%, 92.7%, 87.2%, 83.4%, 81.6%, and 70.3% for concrete; concrete and cob, cob; stone; stone and brick; brick; and tile, respectively. The findings of this study indicate considerable potential for the widespread use of DL techniques in identifying cracks from images and detecting more damages across various materials.This research has been partly funded by the European Unions Horizon research and innovation program under the Marie Skodowska-Curie grant agreement No 101063722. This work was partly financed by FCT/MCTES through national funds (PIDDAC) under the R & D Unit Institute for Sustainability and Innovation in Structural Engineering (ISISE), under reference UIDB/04029/2020 (doi.org/10.54499/UIDB/04029/2020), and under the Associate Laboratory Advanced Production and Intelligent Systems ARISE under reference LA/P/0112/2020.Taylor and FrancisUniversidade do MinhoKarimi, NargesMishra, MayankLourenço, Paulo B.2024-07-172024-07-17T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/1822/92741engKarimi, N., Mishra, M., & Lourenço, P. B. (2024, July 17). Automated Surface Crack Detection in Historical Constructions with Various Materials Using Deep Learning-Based YOLO Network. International Journal of Architectural Heritage. Informa UK Limited. http://doi.org/10.1080/15583058.2024.23761771558-30581558-306610.1080/15583058.2024.2376177https://www.tandfonline.com/doi/full/10.1080/15583058.2024.2376177info:eu-repo/semantics/openAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2024-08-10T01:23:34Zoai:repositorium.sdum.uminho.pt:1822/92741Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-28T18:47:36.974335Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse
dc.title.none.fl_str_mv Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO network
title Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO network
spellingShingle Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO network
Karimi, Narges
Historic buildings
Automatic crack detection
YOLO
Deep Learning
Convolutional neural networks
Engenharia e Tecnologia::Engenharia Civil
title_short Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO network
title_full Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO network
title_fullStr Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO network
title_full_unstemmed Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO network
title_sort Automated surface crack detection in historical constructions with various materials using deep learning-based YOLO network
author Karimi, Narges
author_facet Karimi, Narges
Mishra, Mayank
Lourenço, Paulo B.
author_role author
author2 Mishra, Mayank
Lourenço, Paulo B.
author2_role author
author
dc.contributor.none.fl_str_mv Universidade do Minho
dc.contributor.author.fl_str_mv Karimi, Narges
Mishra, Mayank
Lourenço, Paulo B.
dc.subject.por.fl_str_mv Historic buildings
Automatic crack detection
YOLO
Deep Learning
Convolutional neural networks
Engenharia e Tecnologia::Engenharia Civil
topic Historic buildings
Automatic crack detection
YOLO
Deep Learning
Convolutional neural networks
Engenharia e Tecnologia::Engenharia Civil
description Cultural heritage (CH) constructions involve the use of diverse masonry materials. Under natural and human influences, masonry materials can undergo various types of damages, with crack damages being most prevalent. Developing a robust model capable of detecting cracks in various CH materials is crucial for applying deep learning (DL) methods. In this study, we compared the performance of the DL method You Only Look Once (YOLO) object detection network based on images in different masonry materials (stone, brick, cob, and tile) with that in a modern material (concrete). The dataset used in the study comprised 1213 brick, 1116 concrete, 955 cob, 882 stone, and 208 tile images. YOLOv5 architecture, transfer learning, and object detection models were utilized for detecting cracks to observe and compare their performance in different materials. This study represents the first comparison of this kind using an original dataset. The model achieved mean average precision values of 94.4%, 93.9%, 92.7%, 87.2%, 83.4%, 81.6%, and 70.3% for concrete; concrete and cob, cob; stone; stone and brick; brick; and tile, respectively. The findings of this study indicate considerable potential for the widespread use of DL techniques in identifying cracks from images and detecting more damages across various materials.
publishDate 2024
dc.date.none.fl_str_mv 2024-07-17
2024-07-17T00:00:00Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://hdl.handle.net/1822/92741
url https://hdl.handle.net/1822/92741
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Karimi, N., Mishra, M., & Lourenço, P. B. (2024, July 17). Automated Surface Crack Detection in Historical Constructions with Various Materials Using Deep Learning-Based YOLO Network. International Journal of Architectural Heritage. Informa UK Limited. http://doi.org/10.1080/15583058.2024.2376177
1558-3058
1558-3066
10.1080/15583058.2024.2376177
https://www.tandfonline.com/doi/full/10.1080/15583058.2024.2376177
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Taylor and Francis
publisher.none.fl_str_mv Taylor and Francis
dc.source.none.fl_str_mv reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron:RCAAP
instname_str FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron_str RCAAP
institution RCAAP
reponame_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
collection Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository.name.fl_str_mv Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
repository.mail.fl_str_mv info@rcaap.pt
_version_ 1833597665833648128