A Comparison Study of Deep Learning Methodologies for Music Emotion Recognition

• Main Author: Louro, Pedro Lima
• Publication Date: 2024
• Other Authors: Redinho, Hugo, Malheiro, Ricardo Manuel da Silva, Paiva, Rui Pedro, Panda, Renato
• Format: Article
• Language: eng
• Source: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
• Download full: https://hdl.handle.net/10316/114560; https://doi.org/10.3390/s24072201
• topic: music information retrieval; music emotion recognition; deep learning

Classical machine learning techniques have dominated Music Emotion Recognition. However, improvements have slowed down due to the complex and time-consuming task of handcrafting new emotionally relevant audio features. Deep learning methods have recently gained popularity in the field because of their ability to automatically learn relevant features from spectral representations of songs, eliminating such necessity. Nonetheless, there are limitations, such as the need for large amounts of quality labeled data, a common problem in MER research. To understand the effectiveness of these techniques, a comparison study using various classical machine learning and deep learning methods was conducted. The results showed that using an ensemble of a Dense Neural Network and a Convolutional Neural Network architecture resulted in a state-of-the-art 80.20% F1 score, an improvement of around 5% considering the best baseline results, concluding that future research should take advantage of both paradigms, that is, combining handcrafted features with feature learning.