Distributed and local neural classifiers for phoneme recognition
Pattern Recognition Letters, cilt.15, sa.11, ss.1111-1118, 1994 (Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 15 Sayı: 11
- Basım Tarihi: 1994
- Doi Numarası: 10.1016/0167-8655(94)90126-0
- Dergi Adı: Pattern Recognition Letters
- Derginin Tarandığı İndeksler: Scopus
- Sayfa Sayıları: ss.1111-1118
- Anahtar Kelimeler: Artificial neural networks, Back-propagation, Distributed neural network, Grow and learn method, k-nearest neighbor rule, Learning vector quantization, Local networks, Speech recognition
- Boğaziçi Üniversitesi Adresli: Evet
Özet
The comparative performances of distributed and local neural networks for the speech recognition problem are investigated. We consider a feed-forward network with one or more hidden layers. Depending on the response characteristics of the hidden units, we name the network distributed or local. If the hidden units use the sigmoid non-linearity, then hidden units have a global response and we call such networks distributed. If each hidden unit responds only to inputs in a certain local region in the input space, then the network is local. Neighbor and prototype based approaches are of this type. As examples of the distributed approach with sigmoidal units, we employ the back-propagation rule with three error measures: mean square error, cross entropy, and combinational performance. As for the local methods, we use k-nearest neighbor, learning vector quantization, grow and learn, and Gaussian-based weighted approximation methods. Phoneme recognition experiments are conducted using the /b, d, g, m, n, N/ set of the Japanese vocabulary for the speaker dependent case. Three criteria are taken for comparison: correct classification of the test set, network size, and learning time. We found that distributed networks generalize better than local networks but require longer training and more precise computation. Local networks learn very quickly, but do not generalize well and use more memory. © 1994.