Uso de Seleção de Características da Wikipedia na Classificação Automática de Textos.
Saved in:
| Main Author: | |
|---|---|
| Publication Date: | 2012 |
| Format: | Master thesis |
| Language: | por |
| Source: | Repositório Institucional da UFG |
| Download full: | http://repositorio.bc.ufg.br/tede/handle/tde/2870 |
Summary: | The traditional methods of text classification typically represent documents only as a set of words, also known as "Bag of Words"(BOW). Several studies have shown good results on making use of thesauri and encyclopedias as external information sources, aiming to expand the BOW representation by the identification of synonymy and hyponymy relationships between present terms in a document collection. However, the expansion process may introduce terms that lead to an erroneous classification. In this paper, we propose the use of feature selection measures in order to select features extracted from Wikipedia in order to improve the efectiveness of the expansion process. The study also proposes a feature selection measure called Tendency Factor to One Category (TF1C), so that the experiments showed that this measure proves to be competitive with the other measures Information Gain, Gain Ratio and Chisquared, in the process, delivering the best gains in microF1 and macroF1, in most experiments. The full use of features selected in this process showed to be more stable in assisting the classification, while it showed lower performance on restricting its insertion only to documents of the classes in which these features are well punctuated by the selection measures. When applied in the Reuters-21578, Ohsumed first - 20000 and 20Newsgroups collections, our approach to feature selection allowed the reduction of noise insertion inherent in the expansion process, and improved the results of use hyponyms, and demonstrated that the synonym relationship from Wikipedia can also be used in the document expansion, increasing the efectiveness of the automatic text classification. |
Similar Items: Uso de Seleção de Características da Wikipedia na Classificação Automática de Textos.
- Variações do método kNN e suas aplicações na classificação automática de textos
- Mineração de dados para o reconhecimento da origem e do tipo de alimentos e outras substâncias com base em sua composição química
- Classificação automática de documentos: seleção customizada do classificador
- Mineração de dados para classificação e caracterização de alguns vinhos Vitis Vinífera da América do Sul
- Abordagem de seleção de características baseada em AUC com estimativa de probabilidade combinada a técnica de suavização de La Place
- Abordagem de seleção de características baseada em AUC com estimativa de probabilidade combinada a técnica de suavização de La Place