Comparison of kernel estimators, perceptrons and radial-basis functions for OCR and speech classification
Neural Computing & Applications, cilt.3, sa.1, ss.38-49, 1995 (Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 3 Sayı: 1
- Basım Tarihi: 1995
- Doi Numarası: 10.1007/bf01414175
- Dergi Adı: Neural Computing & Applications
- Derginin Tarandığı İndeksler: Scopus
- Sayfa Sayıları: ss.38-49
- Anahtar Kelimeler: Back-propagation, Kernel estimators, Optical character recognition, Perceptrons, Radial-basis functions, Speech recognition
- Boğaziçi Üniversitesi Adresli: Evet
Özet
We compare kernel estimators, single and multi-layered perceptrons and radial-basis functions for the problems of classification of handwritten digits and speech phonemes. By taking two different applications and employing many techniques, we report here a two-dimensional study whereby a domain-independent assessment of these learning methods can be possible. We consider a feed-forward network with one hidden layer. As examples of the local methods, we use kernel estimators like k-nearest neighbour (k-nn), Parzen windows, generalised k-nn, and Grow and Learn (Condensed Nearest Neighbour). We have also considered fuzzy k-nn due to its similarity. As distributed networks, we use linear perceptron, pairwise separating linear perceptron and multi-layer perceptrons with sigmoidal hidden units. We also tested the radial-basis function network, which is a combination of local and distributed networks. Four criteria are taken for comparison: correct classification of the test set; network size; learning time; and the operational complexity. We found that perceptrons, when the architecture is suitable, generalise better than local, memory-based kernel estimators, but require a longer training and more precise computation. Local networks are simple, leant very quickly and acceptably, but use more memory. © 1995 Springer-Verlag London Limited.