文本特征提取方案的研究与设计

s the rapid development of the internet and the advent of big data, the technology of data mining becomes the hot topic in academia as well as industry. Text Classification technology is great important for knowledge mining, but a huge mass of data causes the dimensional curse for text classifier, and then the performance of classifier drops significantly. This paper analyzes the mainstream methods of feature selection in text classification. Based CHI method, we propose an automatic method for feature selection in text classification. Extensive experiments on Sougou Lab's dataset illustrate the effectiveness of the algorithm.