Applications of Support Vector Machines in the Exploratory Phase of Petroleum and Natural Gas: a Survey
About this article
Abstract
This paper presents an overview of support vector machines (SVM) as one of the most promising intelligent techniques for data analysis found in the published literature, as theoretical approaches and sophisticated applications developed for various research areas and problem domains. This work is an attempt to provide a survey of the applications of SVM for oil and gas exploration to professionals, researchers and academics involved with the hydrocarbons industry. The applications of SVM have been grouped and summarized in the different areas of the exploration phase, which can be used as a guide to assess the effectiveness of SVM over other data mining algorithms. It also provides a better understanding of the various applications that have been developed for an area that offers a glimpse of innovative applications in other domains of the industry.
References
[1] N. Ayat, M. Cheriet, C. Suen, ”Automatic model selection for the optimization of SVM kernels”, Pattern Recognition 38 (10) (2005) 1733–1745.
[2] Sun Bing-Yu, D.S. Huang, H.T. Fang, ”Lidar Signal Denoising Using Least-Squares Support Vector Machine”, IEEE Signal processing letters, vol.12 (2) (2005) 101-104.
[3] B. E. Boser, I. M. Guyon, V. N. Vapnik, ”A training algorithm for optimal margin classifiers”, 5th Annual ACM Workshop on COLT (ed. Haussler, D.) (1992) 144–152, ACM Press, Pittsburgh, PA.
[4] C. J. Burges, ”A tutorial on support vector machines for pattern recognition”, Data Min Know Disco v2 (1998) 121–167.
[5] Y. D. Cai, J. W. Gong, I. R. Gan, L. S. Yao, ”Hydrocarbon reservoir prediction using artificial nerve network method”, Oil Geophys Prospect 28 (1993) 634–638.
View more references (63)
[6] J. X. Cao, ”Seismic Print Analysis”, Twenty-sixth Annual Meeting of the Chinese Geophysical Society, 2010.
[7] O. Chapelle, V. Vapnik, O. Bousquet, S. Mukherjee, ”Choosing multiple parameters for support vector machines”, Machine Learning 46 (1–3) (2002) 131–159.
[8] Lin Chih-Jen et al, ”Libsvm: A Library for Support Vector Machines”, URL: http://www.csie.ntu.edu.tw/~cjlin/libsvm/. Revised 2005. Accessed April 13, 2013.
[9] Z. Chunhong, J. Licheng, ”Automatic parameters selection for SVM based on GA”, Proceedings of the 5th World Congress on Intelligent Control and Automation, (2004) 1869–1872.
[10] G. Cohen, M. Hilario, A. Geissbuhler, ”Model selection for support vector classifiers via genetic algorithms. An application to medical decision support”, Proceedings of the 5th International Symposium on Biological and Medical Data Analysis, (2004) 200–211.
[11] S. Crisler, M. Morrissey, M. Anch, D. Barnett, ”Sleep-stage scoring in the rat using a support vector machine”, Journal of Neuroscience Methods 168 (2008) 524–534.
[12] N. Cristianini, C. Campbell, J. Shawe-Taylor, ”Dynamically adapting kernels in support vector machines”, Neural Inf Process Syst, Vol. 2(1998) 204–210.
[13] W. F. de la Vega, M. Karpinski, C. Kenyon, Y. Rabani, ”Approximation schemes for clustering problems”, In Proc. 35th Annu. ACM Sympos. Theory Comput., (2003) 50–58.
[14] X. Y. Deng, Y. Li, ”Support Vector Regression Based on Ricker Wavelet Kernel Function and its Application to Seismic Prospecting Signal Denoising”, Journal of Jilin University (Earth Science Edition), Vol. 37(4) (2007) 821-827.
[15] X. Y. Deng, Y. Li, ”Study of parameters setting for least square support vector machine based on Ricker wavelet kernel in the denoising applications of seismic prospecting signals”, Progress in geophysics, Vol.22(3) (2007) 953-959.
[16] Xiaoying Deng, Dinghui Yang, Baojun Yang, ”LS-SVR with Variant Parameters and its Practical Applications for Seismic Prospecting Data Denoising”, IEEE, (2008) 1060–1063.
[17] C. P. Diehl, G. Cauwenberghs, ”SVM incremental learning, adaptation and optimization”, Proceedings of the International Joint Conference on NeuralNetworks, (2003) 2685–2690 .
[18] B.F. de Souza et al., Multiclass SVM model selection using particle swarm optimization”, Proceedings of the 6th International Conference on Hybrid Intelligent Systems, (2006) 31–34.
[19] C. Domeniconi, D. Gunopulos, ”Incremental support vector machine construction”, Proceedings of the International Conference on Data Mining, (2001) 589–592.
[20] S. Geman, E. Bienenstock, ”Neural networks and the bias-variance dilemma”, Neural Comput 4 (1992)1–58.
[21] I. Guyon, A. Elisseeff, ”An introduction to variable and feature selection”, J. Mach. Learn. Res. 3 (2003) 1157–1182.
[22] I. Guyon, V. Vapnik, B. Boser, L. Bottou, S, A. Solla, ”Structural risk minimization for character recognition”, Adv Neural Inf Process Syst, Vol 4 (1992) 471–479.
[23] L. Hongdong, L. Yizeng, X. Qingsong, ”Support vector machines and its applications in chemistry”, Chemometrics and Intelligent Laboratory Systems, Vol 95 (2009) 188–198.
[24] Li Hongqi, Guo Haifeng, Guo Haimin, Meng Zhaoxu, ”Data Mining Techniques for Complex Formation Evaluation in Petroleum Exploration and Production: A Comparison of Feature Selection and Classification Methods”, 2008 IEEE Pacific-Asia Workshop on Computational Intelligence and Industrial Application, (2008) 37–43.
[25] C. M. Huang, Y. J. Lee, D. K. Lin, V. Huang, ”Model selection for support vector machines via uniform design”, Computational Statistics & Data Analysis 52 (1) (2007) 335–346.
[26] C. W. Hsu, C. J. Lin,”A comparison of methods for multiclass support vector machines”, IEEE Transactions on Neural Networks 13 (2) (2002) 415–425.
[27] Y. Jin, J. Branke, ”Evolutionary optimization in uncertain environments - A survey”, IEEE Transactions on Evolutionary Computation 9 (3) (2005) 303–317.
[28] M. Jiang, X. Yuan, ”Construction and application of PSO-SVM model for personal credit scoring”, Proceedings of the International Conference on Computational Science, Lecture Notes in Computer Science, (2007) 158–161.
[29] I. Kononenko, ”Estimating attributes: Analysis and extensions of RELIEF”, Proc. European Conf. on Machine Learning (Catania, April 1994)
[30] Kozielski, S., Wrembel, R. New Trends in data Warehousing and Data Analysis. USA. Springer; 2009.
[31] L.C.F. da Silva, R.C.M. Portella, A.A. Emerick, N.F.F. Ebecken, ”Predective Data Mining Technologies for Oil Production Prediction in Petroleum”, 2007 SPE Latin American and Caribbean Petroleum Engineering Conference, (2007) 1–5.
[32] Jian Li, Haode Liao, Bing Wang, Bihua Xu, ”The Design and Implementation of Web-based OLAP Drilling Analysis System”, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery, (2010) 2570–2573.
[33] Mingzhi Li, Yong Liu, Junhua Wang, ”A New Parameter Optimization Algorithm of SVM”, Proceedings of AI 2011, (2011) 174-178.
[34] Hamel Lutz, Knowledge Discovery with Support Vector Machines, John Wiley & Sons, Inc., Canada, 2009.
[35] W. Ma, X. Zhang, F. Luan, H. Zhang, R. Zhang, M. Liu, Z. Hu, B.T. Fan, ”Support vector machine and the heuristic method to predict the solubility of hydrocarbons in electrolyte”, J Phys Chem A 109 (2005) 3485–3492.
[36] Moraes, DRS, Espíndola, RP, Evsukoff, AG, Ebecken, NEF “Cluster analysis of 3D seismic data for oil and gas exploration”. Data mining VII, data, text and web mining and their business applications, Brazil, 2007.
[37] P. Pai, W. Hong, ”Forecasting regional electricity load based on recurrent support vector machines with genetic algorithms”, Electric Power Systems Research, 74(3) (2005) 417-425.
[38] John Platt, ”Using Analytic QP and Sparseness to Speed Training of Support Vector Machines”, MIT Press, (1999) 557-563.
[39] Wang Quanhai, Miao Fang, ”The Support Vector Machine And Its Application To Hydrocarbon Discriminant In Oil And Gas Exploration”, International Conference Systems and Informatics (ICSAI 2012), (2012) 2337-2341.
[40] A. Rukshan, T. Menik, F. Chandrika, ”Data Mining Applications: Promise and Challenges”, Chapter 2, Data Mining and Knowledge Discovery in Real life Applications. (2009); 201–214, Springer.
[41] B. Scholkopf, C. J. C. Burges, A. J. Smola, Advances in Kernel Methods: Support Vector Learning, 1999.
[42] B. Scholkopf, A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. The MIT Press Cambridge, Massachusetts, London, England, 2002.
[43] M. Shaheen, M. Shahbaz, Z. Rehman, A. Guergachi, ”Data mining applications in hydrocarbon exploration”, Artif Intell Rev, (2011) 1–18.
[44] H. Bhavsar, A. Ganatra, ”Variations of Support Vector Machine Classification : A survey”, International Journal of Advanced Computer Research, Volume 2, Number 4, Issue 6 (2012) 230–236.
[45] Guangren Shi,”Four Classifiers Used in Data Mining and Knowledge Discovery for Petroleum Exploration and Development”, CS. Canada. Advances in Petroleum Exploration and Development, (2011) 12–23.
[46] A. Shilton, M. Palaniswami, D. Ralph, A. C. Tsoi, ”Incremental training of support vector machines”, IEEE Transactions on Neural Networks ,16 (2005) 114-131.
[47] Shigeo Abe., Support Vector Machines for Pattern Classifications, Second Edition. Springer, Londres; 2010.
[48] Han Shunjie, Cao Qubo, Han Meng, ”Parameter selection in SVM with RBF kernel function”, World Automation Congress (WAC) (2009) 1-4.
[49] A. J. Smola, B. Scholkopf, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press Cambridge, MA, USA, 2001.
[50] A. J. Smola, B. Scholkopf, ”A tutorial on support vector regression”, Stat Comput 14 (2004) 199–222.
[51] B.Y. Sun, D.S. Huang, H.T. Fang, ”Lidar Signal Denoising Using Least-Squares Support Vector Machine”, IEEE Signal processing letters, vol.12 (2) (2005) 101-104.
[52] T. Suttorp, C. Igel, ”Multi-objective optimization of support vector machines”, Multi-Objective, Machine Learning, Vol. 16 of Studies in Computational Intelligence, Springer, (2006) 199–220.
[53] F. Tay, L. Cao, ”Application of support vector machines in financial time series forecasting”, Omega, 29 (2001) 309-317
[54] Ren-Fei Tian, Jun-Xing Cao, ”Application of support vector machine method for predicting hydrocarbon in the reservoir”, Computational and Information Sciences (ICCIS), International Conference, (2011) 529–532.
[55] S. Tripathi, V. Srinivas, R. Nanjundiah, ”Downscaling of precipitation for climate change scenarios: A support vector machine approach”, Journal of Hydrology 330, (2006) 621–640.
[56] V. N. Vapnik, The Nature of Statistical Learning Theory. Springer, N.Y., 1995, ISBN 0-387-94559-8.
[57] V. N. Vapnik, Statistical Learning Theory. New York. Wiley, 1998.
[58] G. Valentini, ”An experimental bias-variance analysis of SVM ensembles based on resampling techniques”, IEEE Transactions on Systems Man and Cybernetics Part B 35 (6) (2005) 1252–1271.
[59] M. Venkatadri, C. Lokanatha, ”A Review on Data mining from Past to the Future”, International Journal of Computer Applications, Volume 15– No.7 (2011).
[60] C. Y. Xiao, B. W. Zhu, ”A fuzzy mathematical method for predicting hydrocarbon accumulation area by comprehensively analysing multiple kinds of seismic information”, OGP,Vol.25 (1990) 191-200.
[61] Li Xiongyan, Li Hongqi, Wu Zhuang, ”A Model-Driven Data Mining in the Oil & Gas Exploration and Production”, 2009 Second International Symposium on Knowledge Acquisition and Modeling, (2009) 20–24.
[62] Jianhua Xu, Xuegong Zhang, Yanda Li, ”Application of kernel Fisher discriminating technique to prediction of hydrocarbon reservoir”, OGP, 37(2) ( 2002) 170-174.
[63] J.H. Xu, R. Cai, ”Application of supervised SOM neural network to oil and gas prediction”, Geophys Prospect Petrol 37 (1996) 71–76.
[64] K. Yao, W. Lu, S. Zhang, H. Xiao, Y. Li, ”Feature expansion and feature selection for general pattern recognition problems”, IEEE international conference neural networks and signal processing Nanjing, China, Vol. 1 (2003) 29–32.
[65] K. Yao, W. Lu, S. Zhang, H. Xiao, Y, Li, ”Hydrocarbon reservoir prediction using support vector machines”, LNCS, Springer, Berlin, Vol 3173 (2004), 537–542 .
[66] P. Yu, J. Han, C. Faloutsos, Link Mining: Models, Algorithms, and Applications, Springer, 2010.
[67] Shihong Yue, Ping Li, Peiyi Hao, ”SVM Classification: Its Contents and Challenges”, Appl. Math. J. Chinese Univ. Ser. B, Vol.18 (3) (2003) 332-342.
[68] K.W. Wong, Y.S. Ong, D. Tamas et al., ”Reservoir characterization using support vector machines”, Proceedings of the 2005 IEEE international conference on computational intelligence for modelling, control and automation, and international conference on intelligent agents, web technologies and internet commerce (CIMCA-IAWTIC’05).