Journal of Computers, Vol 6, No 9 (2011), 1949-1954, Sep 2011
doi:10.4304/jcp.6.9.1949-1954

A Method for Building Partially Connected Neural Network

Gang Li, Xingsan Qian, Chunming Ye, Lin Zhao

Abstract


This paper focuses mainly on application of Partial Connected Back Propagation Neural Network (PCBP) instead of typical fully connected neural network (FCBP), as  PCBP with less connections learns faster than FCBP. The initial neural network is fully connected, after training with sample data, a clustering method is employed to cluster weights between input to hidden layer and from hidden to output layer, and connections that are relatively unnecessary are deleted, thus the initial network becomes a PCBP network. PCBP can be used in prediction or data mining by training it with data that comes from database. At the end of this paper, several experiments are conducted to illustrate the effects of PCBP using the submersible pump repair data set.


Keywords


Neural Network; FCBP; PCBP; pruning

References


[1] Changchien, S.W.&Lu T. Mining association rules procedure to support on-line recommendation by customer and products fragmentation. Expert Systems with Applications, 20, 2001,pp:325-335.
http://dx.doi.org/10.1016/S0957-4174(01)00017-3

[2] D. Rumelhart, G. Hinton, and R. Williams, Parallel Distributed Processing. MIT Press,Cambridge, MA, 1986.

[3] D. Sarkar, “Methods to speed up error back propagation learning algorithm,” ACM Computing Surveys, vol. 27, no. 4, pp. 519–542, 1995.
http://dx.doi.org/10.1145/234782.234785

[4] Sanggil Kang, Can Isik. Patially Connected Feedforward Neural Network Structured by Input Types. IEEE Transactions on Neural Networks, Vol.16, No.1, January 2005.
http://dx.doi.org/10.1109/TNN.2004.839353
PMid:15732397

[5] D. E. Duckro, D. W. Quinn, and S. J. Gardner, “Neural network pruning with Tuckey Kramer multiple comparison procedure,” Neural Computat., vol. 14, pp. 1149–1168, 2002.
http://dx.doi.org/10.1162/089976602753633420
PMid:11972911

[6] Lang K.J and Witbrock M.J. Learning to tell two spirals apart. In proc. of the 1988 Connectionist Summer School, pp:52-59. Morgan Kaufmann, San Mateo, CA.

[7] A.Van Ooyen. Improving the Covergence of the Back-Propagation Algorithm. Neural Networks, Vol.5, 1992, pp:465-471.
http://dx.doi.org/10.1016/0893-6080(92)90008-7


Full Text: PDF


Journal of Computers (JCP, ISSN 1796-203X)

Copyright @ 2006-2012 by ACADEMY PUBLISHER – All rights reserved.