Parameter quantization effects in Gaussian potential function neural networks


Karakuş E., Öǧrenci A. S., DÜNDAR G.

Advances in Neural Networks and Applications, ss.247-252, 2001 (Scopus) identifier

  • Yayın Türü: Makale / Tam Makale
  • Basım Tarihi: 2001
  • Dergi Adı: Advances in Neural Networks and Applications
  • Derginin Tarandığı İndeksler: Scopus
  • Sayfa Sayıları: ss.247-252
  • Anahtar Kelimeler: Gaussian potential function neural networks, Training, Weight quantization
  • Boğaziçi Üniversitesi Adresli: Evet

Özet

In hardware implementations of Gaussian Potential Function Neural Networks (GPFNN), deviation from ideal network parameters is inevitable because of the techniques used for parameter storage and implementation of the functions electronically, resulting in loss of accuracy. This loss in accuracy can be represented by quantization of the network parameters. In order to predict this effect, theoretical approaches are proposed. One-input, one-output GPFNN with one hidden layer have been trained as function approximators using the Gradient Descent algorithm. After the training, the network parameters (means and standard deviations of the hidden units and the connection weights) are quantized up to 16-bits in order to observe the percentage error on network output stemming from parameter quantization. Simulation results are compared with the predictions of the theoretical approach. Consequently, the behaviour of the network output has been given with combined and separate parameter quantizations. Moreover, given the allowed percentage error for the network, a method is proposed where the minimum number of bits required for quantization of each parameter could be determined based on the theoretical predictions.