Journal of Computers, Vol 6, No 9 (2011), 1962-1970, Sep 2011
doi:10.4304/jcp.6.9.1962-1970

A Double Margin Based Fuzzy Support Vector Machine Algorithm

Kai Li, Xiaoxia Lu

Abstract


Although fuzzy support vector machine introduces the fuzzy membership degree in maximizing the margin and improves performance of classifier, it has not fully considered the position of training samples in the margin. In this paper, a double margin (rough margin) based fuzzy support vector machine (RFSVM) algorithm is presented by introducing rough set into fuzzy support vector machine. Firstly, we compute the degree of fuzzy membership of each training sample. Secondly, the data with fuzzy memberships are trained to obtain the decision hyperplane that maximizing rough margin method which contains the lower margin and the upper margin. In this algorithm, points in the lower margin have major penalty than those in the boundary in the rough margin. Finally, experiments on several benchmark datasets show that the RFSVM algorithm is very effective and feasible relative to the existing support vector machines.


Keywords


fuzzy support vector machine;double margin;classification;accuracy

References


1] V. N. Vapnik, “The Nature of Statistical Learning Theory.” New York: Springer-Verlag New York. 1995. “ISBN:0-387-94559-8”

[2] C. Cortes, and V. N. Vapnik, “Support-Vector Networks.” Machine Learning, vol. 20, pp. 273-297, 1995. “doi:10.1023/A:1022627411411”
http://dx.doi.org/10.1023/A:1022627411411

[3] C. J. C. Burges, “A tutorial on support vector machines for pattern recognition.” Data Mining and Knowledge Discovery, vol. 2, no. 2, pp. 121-167, June 1998. “doi:10.1023/A:1009715923555”
http://dx.doi.org/10.1023/A:1009715923555

[4] A. Blumer, A. Ehrenfeucht, D. Haussler, and M. K. Warmuth, “Learnability and the Vapnik-Chervonenkis Dimension.” Journal of the Association for Computing Machinery, vol. 36, no. 4, pp. 929-965, 1989. “doi:10.1145/76359.76371”
http://dx.doi.org/10.1145/76359.76371

[5] C. Hsu, and C. Lin, “A Comparison of Methods for Multiclass Support Vector Machines.” IEEE transactions on neural networks, vol. 13, no. 2, pp. 415-425, March 2002. “doi:10.1109/72.991427”
http://dx.doi.org/10.1109/72.991427
PMid:18244442

[6] T. Inoue S., and Abe, “Fuzzy Support Vector Machines for Pattern Classification.” International Joint Conference on Neural Networks, pp.1449-1454, July 2001. “doi:101109/IJCNN.2001.939575”

[7] X. F. Jiang, Z. Yi, and J. C. Lv, “Fuzzy SVM with a new fuzzy membership function.” Neural Computing and Applications, vol. 15, no. 3-4, pp. 268-276, 2006. “doi:10.1007/s00521-006-0028-z”
http://dx.doi.org/10.1007/s00521-006-0028-z

[8] W. Yan, and Q. He, “Multi-class Fuzzy Support Vector Machine Based on Dismissing Margin.” Proceedings of the Eighth International Conference on Machine Learning and Cybernetics, vol. 2, pp. 1139-1144, July 2009. “doi:10.1109/ICMLC.2009.5212368”
http://dx.doi.org/10.1109/ICMLC.2009.5212368

[9] C. F. Lin, and S. D. Wang, “Fuzzy Support Vector Machines.” IEEE transactions on neural works, vol. 13, no. 2, pp. 464-471, March 2002. “doi:10.1109/72.991432”

[10] B. Jin, Y. C. Tang, and Y. Q. Zhang, “Support vector machines with genetic fuzzy feature transformation for biomedical data classification.” Information Sciences, vol. 177, pp. 476-489, 2007. “doi:10.1016/j.ins.2006.03015”
http://dx.doi.org/10.1016/j.ins.2006.03015

[11] Q. Wu, and R. Law, “Fuzzy support vector regression machine with penalizing Gaussian noises on triangular fuzzy number space.” Expert Systems with Applications, vol.37, no. 12, 2010. “doi:10.1016/j.eswa.2010.04061”
http://dx.doi.org/10.1016/j.eswa.2010.04061

[12] Z. Pawlak, “Rough sets.” International Journal of Parallel Programming, vol. 11, no. 5, pp. 341-356, 1982. “doi:10.1007/BF01001956”
http://dx.doi.org/10.1007/BF01001956

[13] J. H. Zhang, and Y. Y. Wang, “A Rough Margin based Support Vector Machine.” Information Sciences, vol. 178, pp. 2204-2214, 2008. “doi:10.1016/j.ins.2007.12.012”
http://dx.doi.org/10.1016/j.ins.2007.12.012

[14] B. Scholkopf, A. J.Smola, R. C. Williamson, and P. L. Bartlett, “New Support Vector Algorithms.” Neural Computation, vol. 12, no. 5, pp. 1207–1245, 2000. “doi:10.1162/089976600300015565”
http://dx.doi.org/10.1162/089976600300015565

[15] C. C. Chang, and C. J. Lin, “Training v-Support Vector Classifiers: Theory and Algorithms.” Neural Computation, vol. 13, pp. 2119–2147, 2001. “doi:10.1162/089976601750399335”
http://dx.doi.org/10.1162/089976601750399335
PMid:11516360

[16] P. H. Chen, C. J. Lin, and B. Scholkopf, “A Tutorial on [nu]-Support Vector Machines.” Applied Stochastic Models in Business and Industry, vol. 21, no. 2, pp. 111-136, 2002. “doi:10.1002/asm.537”
http://dx.doi.org/10.1002/asm.537

[17] C. L. Blake, and C. J. Merz, UCI Repository of machine learning databases [http://www.ics.uci.edu/~mlearn/MLRepository.html]. Irvine, CA: University of California. Department of Information and Computer Science, 1998.

[18] R. D. King, C. Feng, and A. Sutherland, “Statlog:Comparison of classification algorithms on large real-world problems.” Applied Artificial Intelligence, vol. 9, no. 3, pp. 289-333, 1995. “doi:10.1080/08839519508945477”
http://dx.doi.org/10.1080/08839519508945477

[19] T. K. Ho, and E. M. Klernberg, “Building projectable classifiers of arbitrary complexity.” Proceeding of the 13th International Conference on Pattern Recognition, vol. 2, pp. 880-885, 1996. “doi:10.1109/ICPR.1996.547202”
http://dx.doi.org/10.1109/ICPR.1996.547202


Full Text: PDF


Journal of Computers (JCP, ISSN 1796-203X)

Copyright @ 2006-2012 by ACADEMY PUBLISHER – All rights reserved.