Computer–aided diagnosis of diabetes using least square support vector machine
About this article
Abstract
Diabetes incidence is one of the most serious health challenges in both industrial and developing countries; however, it is for sure that the early detection and accurate diagnosis of this disease can decrease the risk of affiliation to other relevant disease in diabetes patients. Because of the effective classification and high diagnostic capability, expert systems and machine learning techniques are now gaining popularity in this field. In this study, Least square support vector machine (LS-SVM) was used for diabetes diagnosis. The effectiveness of the LS-SVM is examined on Pima Indian diabetes dataset using k-fold cross validation method. Compared to thirteen well-known methods for the diabetes diagnosis in the literature, the study results showed the effectiveness of the proposed method.
References
[1] Ehab I. Mohamed, R. Linderm, G. Perriello, N. Di Daniele, S. J. Poppl, and A. De Lorenzo, “Predicting type 2 diabetes using an electronic nose-base artificial neural network analysis”, Diabetes Nutrition & Metabolism, Vo.15, No. 4, 2002, pp.215–221.
[2] Kemal Polat, Salih Gunes, and Ahmet Aslan, “A cascade learning system for classification of diabetes disease: Generalized discriminant analysis and least square support vector machine”, Expert Systems with Applications, Vol. 34, No.1, 2008, pp. 214–221.
[3] Rajendra Acharya, Peck Ha Tan, Tavintharan Subramaniam, Toshiyo Tamura, Kuang Chua Chua, Seach Chyr Ernest Goh, Choo Min Lim, Shu Yi Diana Goh, Kang Rui Conrad Chung, and Chelsea Law, “Automated identification of diabetic type 2 subjects with and without neuropathy using wavelet transform on pedobarograph”, Journal of Medical Systems, Vol. 32, No.1, 2008, pp. 21–29.
[4] David West, Paul Mangiameli, Rohit Rampal, and Vivian West, “Ensemble strategies for a medical diagnosis decision support system: A breast cancer diagnosis application”, European Journal of Operational Research, Vol. 162, No. 2, 2005, pp. 532–551.
[5] Kemal Polat and Salih Güneş, “Breast cancer diagnosis using least square support vector machine”, Digital Signal Processing, Vol. 17, No.4, 2007, pp. 694–701.
View more references (37)
[6] Hui-Ling Chen, Bo Yang, Jie Liu, and Da-You Liu, “A support vector machine classifier with rough set-based feature selection for breast cancer diagnosis”, Expert Systems with Applications, Vol. 38, No.7, 2011, pp. 9014–9022.
[7] Mehmet Fatih Akay, “Support vector machines combined with feature selection for breast cancer diagnosis”, Expert systems with applications, Vol. 36, No.2, 2009, pp. 3240–3247.
[8] Vladimir N. Vapnik, “Statistical Learning Theory”, New York: Wiley, 1998.
[9] Bernhard Scholkopf, Sung Kah-Kay, Christopher J. Burges, Federico Girosi, Partha Niyogi, Tomaso Poggio, and Vladimir Vapnik, “Comparing support vector machines with Gaussian kernels to radial basis function classifiers”, IEEE Transactions on Signal Processing, Vol. 45, No.11, 1997, pp. 2758–2765.
[10] MassimilianoPontil and Alessandro Verri, “Support vector machines for 3-D object recognition”, IEEE Transactions on Pattern Analysis and Machine Intelligence , Vol. 20, No. 6, 1998, pp. 637–646.
[11] Vincent Wan and William M. Campbell, “Support vector machines for speaker verification and identification”, Proceedings of IEEE Workshop Neural Networks for Signal Processing, 2000, pp. 775–784.
[12] Edgar Osuna, Robert Freund, and Federico Girosi, “Training support vector machines: Application to face detection”, In Proceedings of computer vision and pattern recognition, 1997, pp. 130–136.
[13] Thorsten Joachims, “ Transductive inference for text classification using support vector machines”, In Proceedings of international conference machine learning, vol. 99, 1999, pp. 200–209.
[14] Johan A. K. Suykens, Tony Van Gestel, Jos De Brabanter, Bart De Moor, and Joos Vandewalle, “Least squares support vector machines”, World Scientific Publishing, 2002, Singapore.
[15] Johan A. K. Suykens, Joos Vandewalle, and Bart. De Moor, “Optimal control by least squares support vector machines”, Neural Networks, Vol.14, No.1, 2001, pp. 23–35.
[16] Deng, D., & Kasabov, N. (2001). On-line pattern analysis by evolving self-organizing maps. In Proceedings of the fifth biannual conference on artificial neural networks and expert systems (ANNES) (pp. 46–51).
[17] Kayaer, K., & Yıldırım, T. (2003). Medical diagnosis on Pima Indian diabetes using general regression neural networks. In Proceedings of the international conference on artificial neural networks and neural information processing (ICANN/ICONIP) (pp. 181–184).
[18] Hasan Temurtas, Nejat Yumusak, Feyzullah Temurtas, “A comparative study on diabetes disease diagnosis using neural networks,” Expert Systems with Applications, vol. 36, pp. 8610–8615, 2009.
[19] Smith, J.W., J. E. Everhart, et al.- “Using the ADAP learning algorithm to forecast the onset of diabetes mellitus”, Proceedings of the Symposium on Computer Applications and Medical Care (Washington, DC). R.A. Greenes. Los Angeles, CA, IEEE Computer Society Press, 1988, pp. 261-265.
[20] Quinlan, J.R. “C4.5: programs for machine learning”, San Mateo, Calif., Morgan Kaufmann Publishers, 1993.
[21] S.Sahan, K.Polat, H. Kodaz, and S. Gunes, “The medical applications of attribute weighted artificial immune system (awais): Diagnosis of heart and diabetes diseases”, in ICARIS, 2005,p. 456-468.
[22] V. Anuja Kumari, R.Chitra, “Classification Of Diabetes Disease Using Support Vector Machine”, International Journal of Engineering Research and Applications, Vol. 3, No. 2, 2013, pp.1797-1801.
[23] Santi Wulan Purnami, Abdullah Embong, Jasni Mohd Zain and S. P. Rahayu, “A New Smooth Support Vector Machine and Its Applications in Diabetes Disease Diagnosis”, Journal of Computer Science, Vol. 5, No. 12, 2009, pp.1003-1008,.
[24] Bernhard E. Boser, Isabelle M Guyon, and Vladimir N. Vapnik, “A training algorithm for optimal margin classifiers”, In Fifth annual workshop on computational learning theory, 1992, pp. 144–152.
[25] Corinna Cortes and Vladimir Vapnik, “Support-vector networks”, Machine Learning, Vol. 20, No.3, 1995, pp. 273–297.
[26] Nello Cristianini and John Shawe-Taylor, “An introduction to support vector machines: And other kernel-based learning methods”, Cambridge, UK: Cambridge University Press, 2000.
[27] Alexander J. Smola, “Learning with kernels: Support vector machines, regularization, optimization, and beyond”, The MIT Press, 2002.
[28] Johan A. K. Suykens, “Support vector machines: a nonlinear modeling and control perspective”, European J. of Control, Vol. 7, No. 2–3, 2001, pp. 311–327.
[29] Chen-Chia Chuang, “Fuzzy weighted support vector regression with a fuzzy partition,” IEEE Transaction on System, Man, Cybern. B, Cybern., Vol. 37, No. 3, 2007, pp. 630–640.
[30] Xinjun Peng and Yifei Wang, “A geometric method for model selection in support vector machine”, Expert Systems with Applications, Vol. 36, No.3, 2009, pp. 5745–5749.
[31] Shuzhou Wang, Bo Meng, “Parameter selection algorithm for support vector machine”, Procedia Environmental Sciences, Vol. 11, 2011, pp. 538–544.
[32] Olivier Chapelle, Vladimir N. Vapnik, Olivier Bousquet, and Sayan Mukherjee, “Choosing multiple parameters for support vector machines”, Machine Learning, Vol. 46, No. 1, 2002, pp. 131–159.
[33] S. Sathiya Keerthi, “Efficient Tuning of SVM Hyperparameters Using Radius/Margin Bound and Iterative Algorithms”, IEEE Transaction on Neural Networks, Vol. 13, No. 5, pp.1225–1229.
[34] Peter Williams, Sheng Li, Jianfeng Feng, and Si Wu, “A geometrical method to improve performance of the support vector machine”, IEEE Transaction on Neural Networks, Vol. 18, No. 3, 2007,pp. 942–947.
[35] Sheng Ding and Xiaoming Liu, “Evolutionary computing optimization for parameter determination and feature selection of support vector machines”, IEEE Conference on Computational Intelligence and Software Engineering, 2009, pp. 1-5.
[36] Chih-Wei Hsu, Chih-Chung Chang, and Chih-Jen Lin, “A practical guide to support vector classification”, Technical report, Department of Computer Science and Information Engineering, National Taiwan University, Taipei, 2003. Available at http://www.csie.ntu.edu.tw/cjlin/libsvm/.
[37] Christopher J. Merz and Patrick M. Murphy, “UCI repository of machine learning databases”, http:www.ics.uci.edu:~mlearn:MLRepository.html, 1996.
[38] S. Sathiya keerthi and Chih-Jen Lin, “Asymptotic behavior of support vector machines with Gaussion kenerl”, Neural Computation, Vol. 15, No. 7, 2003, pp.1667–1689.
[39] Hsuan-Tien Lin and Chih-Jen Lin, “A study on sigmoid kernels for SVM and the training of non-PSD kernels by SMO –type methods”, Technical report, Department of Computer Science , National Taiwan University, 2003, pp. 1–32.
[40] Antoine Bordes, Seyda Ertekin , Jason Weston, and Leon Bottou ,“Fast Kernel Classifiers with Online and Active Learning”, The Journal of Machine Learning Research, Vol. 6 , 2005, pp. 1579–1619.
[41] Jiancheng Sun, Chongxun Zheng, Xiaohe Li, and Yatong Zhou, “Analysis of the Distance Between Two Classes for Tuning SVM Hyperparameters,” IEEE Transaction on Neural Networks, Vol. 21, NO. 2, 2010, pp. 305–318.
[42] Jeff Schneider’s home page, http://www.cs.cmu.edu/~schneide/tut5/node42. html, last accessed August 2006.