| 文本分类中TF-IDF算法的改进研究 |
点此下载全文 |
| 引用本文:吴宗卓.文本分类中TF-IDF算法的改进研究[J].计算技术与自动化,2022,(2):84-86 |
| 摘要点击次数: 766 |
| 全文下载次数: 0 |
|
|
| 中文摘要:文本分类中的一个主要问题是如何提高分类准确性。为了提高分类准确性,提出了一种基于TF-IDF的新的加权方法TF-IDF-IF。此方法引入了一个新的参数来表示类内特征,它用来计算一个类中文档中的术语频率。实验使用CHI卡方统计特征选择方法在数据集中选择1000个特征,然后使用TF-IDF、TF-IDF-CF、LTC和TFC方法在一些常用的分类器如朴素贝叶斯、贝叶斯网络、KNN、SVM中进行实验。实验结果表明,这种方法可以取得很好的效果。 |
| 中文关键词:文本分类 特征选择 CHI平方统计 TFIDF 分类准确性 |
| |
| Research on Improvement of TF-IDF Algorithm in Text Classification |
|
|
| Abstract:A major issue in text categorization is how to improve classification accuracy. In order to improve the classification accuracy, a new weighting method TF-IDF-IF based on TF-IDF is proposed. This method introduces a new parameter to represent in-class features, which is used to calculate the frequency of terms in a document in a class. The experiment uses the CHI chi-square statistical feature selection method to select 1000 features in the data set, and then use TF-IDF, TF-IDF-CF, LTC, and TFC methods respectively in some commonly used classifiers such as Nave Bayes, Bayesian networks, KNN, SVM experiments. From the experimental results, this method can achieve good results. |
| keywords:text categorization feature selection CHI square statistics TFIDF categorization accuracy |
| 查看全文 查看/发表评论 下载pdf阅读器 |
|
|
|