Forensic analysis of microtraces using image recognition through machine learning

• Main Author: Rodrigues, Caio Henrique Pinke
• Publication Date: 2024
• Other Authors: Sousa, Milena Dantas da Cruz, dos Santos, Michele Avila, Filho, Percio Almeida Fistarol, Velho, Jesus Antonio, Leite, Vitor Barbanti Pereira [UNESP], Bruni, Aline Thais
• Format: Article
• Language: eng
• Source: Repositório Institucional da UNESP
• Download full: http://dx.doi.org/10.1016/j.microc.2024.111780; https://hdl.handle.net/11449/300883
• topic: Computer vision; Convolutional Neural Network; Evidence; Forensic Science; Statistical analysis

Traces found at a crime scene can be interpreted as vectors of information that help describe the possible dynamics of the crime. However, some analyses show that pattern recognition, especially in materials, is subjective, as it depends on the analyst's references. Based on this problem, the work aimed to use different statistical methods to establish pattern recognition in silver tapes. For this, two approaches were used, one based on deep learning (convolutional neural networks) and the other using a different method (Pearson's correlation, distance metrics, and Principal Component Analysis). The dataset comprised four brands of silver-tape available in the retail market in the crime scene region, and fragments of tape originating after the detonation of a handmade explosive device. These materials were analyzed using a Leica DVM6 microscope. In both approaches, it was possible to recognize patterns. In deep learning, it was possible to establish that the fragments came from a common origin. The best model demonstrated that 92.1 % of the real materials questioned were the same silver-tape, with a confidence level of 0.94. By combining the methods, it was possible to observe a trend among the results. These responses demonstrated that using images in a computer vision context could remove the subjectivity of forensic analysis and correlate the microtraces found at a crime scene. In this way, these techniques can open new perspectives for the forensic area, making the interpretation more objective and transparent in its responses to society.