Vector representation of texts applied to prediction models

• Ano de defesa: 2020
• Autor(a) principal: Stern, Deborah Bassi
• Tipo de documento: Dissertação
• Tipo de acesso: Acesso aberto
• Idioma: eng
• Instituição de defesa: Biblioteca Digitais de Teses e Dissertações da USP
• Palavras-chave em Português: Modelos de predição; Natural language processing; Neural networks; Prediction models; Processamento de linguagem natural; Redes neurais; Representação vetorial de palavras; WordVectors
• Link de acesso: https://www.teses.usp.br/teses/disponiveis/104/104131/tde-10062020-102333/

Natural Language Processing has gone through substantial changes over time. It was only recently that statistical approaches started receiving attention. The Word2Vec model is one of these. It is a shallow neural network designed to fit vectorial representations of words according to their syntactic and semantic values. The word embeddings acquired by this method are stateof- art. This method has many uses, one of which is the fitting of prediction models based on texts. It is common in the literature for a text to be represented as the mean of its word embeddings. The resulting vector is then used in the predictive model as an explanatory variables. In this dissertation, we propose getting more information of text by adding other summary statistics besides the mean, such as other moments and quantiles. The improvement of the prediction models is studied in real datasets.