A validation method for comparing classifiers on imbalanced datasets Dengesi̇z veri̇ kümeleri̇ üzeri̇nde siniflandiricilarin karşilaştirilmasi i̇çi̇n bi̇r sinama yöntemi̇
2012 20th Signal Processing and Communications Applications Conference, SIU 2012, Fethiye, Mugla, Türkiye, 18 - 20 Nisan 2012, (Tam Metin Bildiri)
- Yayın Türü: Bildiri / Tam Metin Bildiri
- Doi Numarası: 10.1109/siu.2012.6204733
- Basıldığı Şehir: Fethiye, Mugla
- Basıldığı Ülke: Türkiye
- Boğaziçi Üniversitesi Adresli: Evet
Özet
In this study, to compare the robustness and learning capability of the classifiers on imbalanced datasets, a cross validation method that generates class-imbalanced training sets is proposed. The method will also be used to evaluate the accuracies of methods developed for dealing with the class-imbalance problem. The proposed method is used to generate imbalanced datasets from three biomedical datasets. Then, k-Nearest Neighbor, Support Vector Machines and Multi Layer Perceptron classifiers are compared using various settings of their hyper-parameters that affect their complexities. The experimental results show that SVMs are simply the most robust of all when applied to imbalanced datasets. © 2012 IEEE.