which attribute selection measure is best in data mining
In this tutorial, we will learn about the followings;
Information Gain.
Gain Ratio.
Gini index.
Attribute Selection Measure
There are different attribute selection measures. Some of them are as follows;
- Information Gain
- Gain ratio
- Gini index
Information gain | Gain ratio | Gini index |
Biased towards the multi-valued attribute. | Unbalanced splits. | Biased towards the multi-valued attribute. |
Difficult to manage a large number of classes. | ||
Partitions are equal. |
Next Similar Tutorials
- Decision tree induction on categorical attributes – Click Here
- Decision Tree Induction and Entropy in data mining – Click Here
- Overfitting of decision tree and tree pruning – Click Here
- Attribute selection Measures – Click Here
- Computing Information-Gain for Continuous-Valued Attributes in data mining – Click Here
- Gini index for binary variables – Click Here
- Bagging and Bootstrap in Data Mining, Machine Learning – Click Here
- Evaluation of a classifier by confusion matrix in data mining – Click Here
- Holdout method for evaluating a classifier in data mining – Click Here
- RainForest Algorithm / Framework – Click Here
- Boosting in data mining – Click Here
- Naive Bayes Classifier – Click Here