Open Access Open Access  Restricted Access Subscription or Fee Access

Radial Basis Function Network Construction Using Modified Gram Schmidt Algorithm

V. V. Ranade, S. S. Sayyad, A. N. Mulla

Abstract


The Neural network provides the frame work of self-learning system. It allows the user to design the work around huge amount of data, in dynamic and nonlinear form. By using this system, experts, technical peoples and developers in this domain are trying to make the widely used system in form of autonomous system. The Radial Basis Function Neural Network is come under the supervised type learning neural network. It has been widely used in neural network problems like classification, signal processing, pattern recognition, fault diagnosis etc. The construction of any type of neural network is very an important task. Network must be constructed in such way that it can adapt to any of problem and learn the network with computational efficient and compact manner. While building initial model of Radial Basis Function Network important issues are to determine of hidden layer parameters (center and width) and output weights. A proposed algorithm for Radial Basis Function Neural Network construction is suggested to deal with important issues of Network construction. It is designed for classification problem. A suggested algorithm is mainly divided into four parts that are K-mean algorithm, initial model construction, and performance evaluation and based on MSE value initially computed output weights are optimized using Particle Swarm Optimization method. Again the optimized Radial Basis Function network is constructed based new value of output weights. Final, part is performance evaluation of optimized model and initial model. To do the analysis of both models it is trained and tested on datasets from UCI repositories. Analysis of both networks is carried out on testing samples. The performance of training, testing phases of network are measured based upon classification accuracy, number of samples misclassified and time required for computation.


Keywords


Artificial Neural Network (ANN), K-means, Mean Squared Error (MSE), Particle Swarm Optimization (PSO), Radial Basis Function Neural (RBFN) Network

Full Text:

PDF

References


Long Zhang, Kang Li and Haibo He, “A New Discrete Continuous Algorithm for Radial basis Function Network Construction”, IEEE Trans. Neural Netw. and Learning. vol. 24, no. 11, Nov, 2013.

Esmaeili N. Mozayani “Adjusting the Parameters of Radial Basis Function Networks Using Particle Swarm Optimization” CIMSA 2009 - International Conference on Computational Intelligence for Measurement Systems and Applications Hong Kong}. China May 11-13, 2009.

S. Chen, C. E. S. Chng and K Alkadhmini, “Regularized orthogonal least square algorithm for constructing Radial Basis Function ”, Int. J. Control, vol. 2, no. 2, pp. 302309, 1991

S. Chen, C. F. N. Cowan and P. M. Grant, “Orthogonal least squares Learning algorithm for radial basis function networks ”, IEEE Trans. Neural Netw., vol. 2, no. 2, pp. 302309, 1991.

S. Chen, S. A. Billings and W. Luo “Orthogonal least squares Methods and their application to nonlinear system identification ”, Int. J. Control, vol. 50, no. 5, pp. 18731896, 1989.

M. Carlin,”Radial basis function networks and nonlinear data modeling”, Neural Netw. Conf. Their Appl. in Proc. Neuro-Nimes. 1992, pp. 623633.

Ms.Jayshri D.Dhande, S.L.Badjate and D.R.Dandekar, “Performance Improvement of Ann Classifiers using PSO”, National Conference on Innovative Paradigms in Engineering and Technology NCIPET 2012.

Mehmet Korurek, Berat Dog, “ ECG Beat Classification Using Particle Swarm Optimization And Radial Basis Function Neural Network”, Elsevier Ltd. Expert Systems with Applications 37 2010, 7563-7569.

Ali Khazaee, “Heart Beat Classification Using Particle Swarm Optimization”, I.J. Intelligent Systems and Applications 2013, 06, 25-33.

Poonam Kataria, Navpreet Rupal and Rahul Sharma, “Comparative Analysis of Clustering by using Optimization Algorithms”, International Journal of Computer Science and Information Technologies Vol. 5 (2), 2014, 1076-1081.

Sarita Mahapatra, Alok Kumar Jagadev and Bighnaraj Naik, Performance Evaluation of PSO Based Classifier for Classification of Multidimensional Data with Variation of PSO Parameters in Knowledge Discovery Database” International Journal of Advanced Science and Technology Vol. 34, September, 2011.

G. Cawley and N. Talbot. (2004). UCI Repository of Marchine Learing Databases [Online]. Available: http://theoval.cmp.uea.ac.uk/ gcc/matlab/

J. Peng, K. Li, and G. W. Irwin, “A novel continuous forward algorithm for RBF neural network”, IEEE Trans. Autom. control. vol. 52, no. 1, pp. 117122, Jan. 2007.

S. N. Deepa, “A Book on Principles Of Soft Computing” Int. J. Control, vol. 50, no. 5, pp. 1873–1896, 1989.

Simon Haykin, “A Book on Neural Network and Learning Machines”

http://chem-eng.utoronto.ca/~datamining/dmc/artificial_neural_network.htm

https://www.doc.ic.ac.uk/~nd/surprise_96/journal/vol4/cs11/report.html

http://pages.cs.wisc.edu/~bolo/shipyard/neural/local.html

http://www.psych.utoronto.ca/users/reingold/courses/ai/cache/neural3.html.

http://mnemstudio.org/particle-swarm-introduction.htm.

Jaco F. Schutte “The Particle Swarm Optimization Algorithm Pdf” EGM 6365 - Structural Optimization Fall 2005

Farzaneh Abdollahi “Neural Networks pdf Lecture 4: Radial Bases Function Networks H.A Talebi” Department of Electrical Engineering, Amirkabir University of Technology, Winter 2011.

David S. Touretzky “Radial Basis Functions Artificial Neural Networks” 15-486/782, Fall 2006.


Refbacks

  • There are currently no refbacks.