Approximating Number of Hidden layer neurons in Multiple Hidden Layer BPNN Architecture

  ijett-book-cover  International Journal of Engineering Trends and Technology (IJETT)          
  
© 2012 by IJETT Journal
Volume-3 Issue-6                       
Year of Publication : 2012
Authors :  Saurabh Karsoliya

Citation 

Saurabh Karsoliya. "Approximating Number of Hidden layer neurons in Multiple Hidden Layer BPNN Architecture". International Journal of Engineering Trends and Technology (IJETT). V3(6):714-717 Nov-Dec 2012. ISSN:2231-5381. www.ijettjournal.org. published by seventh sense research group

Abstract

Hidden layers plays a vital role in the performance of Back Propagation Neural Network especially in the case where problems related to arbitrary decision boundary to arbitrary accuracy with rational activation functions are encountered. Also, multiple hidden layer can approximate any smooth mapping to any accuracy . The process of deciding the number of hidden layers and number of neurons in each hidden layer is still confusing. In this paper , an survey is made in order to resolved the problem of number of neurons in each hidden layer and the number of hidden layers required

References

[1] Boger, Z., and Guterman, H., 1997, "Knowledge extraction from artificial neural network models," IEEE Systems, Man, and Cybernetics Conference , Orlando, FL, USA
[2] Berry, M.J.A., and Linoff, G. 1997, Data Mining Techniques , NY: John Wiley & Sons
[3] Kazuhiro Shin - ike , “ A Two Phase Method for Determining the Number of Neurons in the Hidden Layer of a 3 - Layer Neural Network ” , SICE Annual Conference 2010, August 18 - 21, 20 1 0, The Grand Hotel, Taipei, Taiwan.
[4] http://www.heatonresearch.com/node/707
[5] Stuti Asthana and Rakesh K Bhujade , “ Handwritten Multiscript Pin Code Recognition System having Multiple hidden layers using Back Propagation Neural Network ” , International Journal of Electronics Communication and Computer Engineering, ISSN(Online): 2249 - 071X, Volume 2, Issue 1, Sep 2011
[6] Blum, A., 1992, Neural Networks in C++, NY: Wiley.
[7] Rivals I. & Personnaz L. “A statistical procedure for determining the optimal number of hidden neurons of a neuralmodel”, Second International Symposium on Neural Computation (NC’200 0), Berlin, May 23 - 26 2000.
[8] Fnaiech, F., Fnaiech, N., Najim, M., 2001 “A new feedforward neural network hidden layer neuron pruning algorithm ”IEEE International Conference on Acoustics, Speech, and Signal Processing, 2001. Proceedings. (ICASSP `01).
[9] Y inyin Liu, Janusz A. Starzyk, Zhen Zhu, “Optimizing Number Of Hidden Neurons in Neural Networks”, http://www.ohio.edu/people/starzykj/network/Research/Papers/ Recent%20conferences../Hidden%20Neurons%20AIA2007_549 - 204.pdf
[10] Jacques de Villiers and Etienne Barn ard, 1992, “ Backpropagation Neural Nets with One and Two Hidden Layers ”, IEEE Transactions o n Neural Networks, Vol. 4, No. 1

Keywords
Neural Network , BPNN, Hidden Layer, Neurons,