Measurement of R&D efficiency in NT and BT fields using DEA:a case in Korea
About this article
Abstract
Since the Korean government has increased the R&D budget for both BT and NT areas, it needs to measure R&D efficiency and to manage the budget. The purpose of this study is to measure the efficiency of more than 2,000 BT and NT related projects supported by four basic research programs with the BCC-O model of the DEA method. Two input and five output variables are considered to determine the efficiency. The average efficiencies of both fields are low (0.3532 in the BT and 0.4677 in the NT) and the DEA projection results show that all output measures should be improved as much as 240% to 423% to be at efficiency 1. Also, correlation analysis is used to determine which variables strongly affect the efficiency in the BT and NT areas. This study could facilitate the development of better processes for project selection and many types of evaluation, provided the quantitative method such as the DEA could become widely acceptable for researchers.
References
[1] N. Adler, E. Yazhemsky, “Improving discrimination in data envelopment analysis: PCA-DEA or variable reduction”, European Journal of Operational Research, 202, (2010), 273-284.
[2] R.D. Banker, A. Charnes, W.W. Cooper, “Some models for estimating technology and scale inefficiencies in Data Envelopment Analysis”, Management Science, 30(9), (1984), 1078-1092.
[3] J. Bound, C. Cumins, Z. Griliches, H.H. Hall, A. Jaffe, R&D, Patent, and Productivity, University of Chicago Press, Chicago, 1984.
[4] A. Boussofiane, R.G. Dyson, E. Thanassoulis, “Applied data envelopment analysis”, European Journal of Operational Research, 52, (1991), 1-15.
[5] A. Charnes, W.W. Cooper, E. Rhodes, “Measuring the efficiency of decision making units”, European Journal of Operational Research, 2, (1978), 429-444.
View more references (31)
[6] L. Cherchye, A.P. Vanden, “On research efficiency: A micro-analysis of Dutch university research in Economics and Business Management”, Research Policy, 34, (2005), 495-516.
[7] W.W. Cooper, L.M. Seiford, K. Tone, Data Envelopment Analysis: Theory, Methodology, and Applications, References and DEA-Solver Software. Kluwer Academic Publishers, Boston, 2000.
[8] W.W. Cooper, L.M. Seiford, K. Tone, Data Envelopment Analysis. second edition, Springer, 2006.
[9] E.A. Corley, “A use-and-transformation model for evaluating public R&D: Illustrations from polycystic ovarian syndrome (PCOS) research”, Evaluation and Program Planning, 30, (2007), 21-35.
[10] S. Erdogmus, M. Kapanoglu, E. Koc, “Evaluating high-tech alternatives by using analytic network process with BOCR and multiactors”, Evaluation and Program Planning, 28, (2005), 391-399.
[11] Y.J. Feng, H. Lu, K. Bi, “An AHP/DEA method for measurement of the efficiency of R&D management activities in universities”, International Transactions in Operational Research, 11, (2004), 181-191.
[12] H.O. Fried, C.A.K. Lovell, S.S. Schmidt, S. Yaisawarng, “Accounting for Environmental Effects and Statistical Noise in Data Environmental Analysis”, Journal of Productivity Analysis, 17, (2002), 157-174.
[13] K.C. Garg, B.M. Gupta, T. Jamal, S. Roy, S. Kumar, “Assessment of impact of AICTE funding on R&D and educational development”, Scientometrics, 65(2), (2005), 151-160.
[14] W. Glanzel, P. Zhou, “Publication activity, citation impact and bi-directional links between publications and patents in biotechnology”, Scientometrics, 86(2), (2011), 505-525.
[15] Z. Griliches, “Patent Statistics as Economic Indicator: A Survey”, Journal of Economic Literature, 28, (1990), 1661-1707.
[16] A. Hullmann, “Measuring and assessing the development of nanotechnology”, Scientometrics, 70(3), (2007), 739-758.
[17] A. Hullmann, M. Meyer, “Publications and patents in nanotechnology”, Scientometrics, 58(3), (2003), 507–527.
[18] W.C. Hung, L.C. Lee, M.H. Tsai, “An international comparison of relative contributions to academic productivity”, Scientometrics, 81(3), (2009), 703–718.
[19] U. Jung, D.W. Seo, “An ANP approach for R&D project evaluation based on interdependencies between research objectives and evaluation criteria”, Decision Support Systems, 49, (2010), 335-342.
[20] C.T. Kuah, K.Y. Wong, “Efficiency assessment of universities through data envelopment analysis”, Procedia Computer Science, 3, (2011), 499-506.
[21] H.Y. Lee, Y.T. Park, “An International Comparison of R&D Efficiency: DEA Approach”, Asian Journal of Technology Innovation, 13(2), (2005), 207-222.
[22] H.Y. Lee, Y.T. Park, H.G. Choi, “Comparative evaluation of performance of national R&D programs with heterogeneous objectives: A DEA approach”, European Journal of Operational Research, 196, (2009), 847-855.
[23] MOST/MOE, Master plan for the promotion of basic research 2006∼2010, MOST(Ministry of Science and Technology)/MOE(Ministry of Education), Republic of Korea, 2005.
[24] MEST/NRF, Performance analysis report for the national R&D program of MEST(Ministry of Education, Science and Technology), NRF (National Research Foundation of Korea), Republic of Korea, 2011.
[25] H.J. Noh, Multivariate analysis through SPSS 10.0, second edition, Hyungseol, Seoul, Republic of Korea, 2004.
[26] NSTC, Master plan for the promotion of Basic research, NSTC (National Science and Technology Commission in South Korea), 2009.
[27] J.C. Paradi, S. Smith, C. Schaffnit-Chatterjee, “Knowledge Worker Performance Analysis Using DEA: An Application to Engineering Design Teams at Bell Canada”, IEEE Transactions on Engineering Management, 49(1), (2002), 161-171.
[28] E. Pavitt, “Patent statistics as indicators of innovative activities: possibilities and problems”, Scientometrics, 7(1), (1985), 77-99.
[29] A.I. Pudovkin, E. Garfield, “Rank-normalized impact factor: A way to compare journal performance across subject categories”, Proceedings of the 67th ASIS&T Annual Meeting, 41, (2004), 507-515.
[30] A.M. Ramirez, E.O. Garcia, A.D. Rio, “Renormalized impact factor”, Scientometrics, 47(1), (2000), 3-9.
[31] M. Rossner, H.V. Epps, E. Hill, “Show me the data”, Journal of Cell Biology, 179(6), (2007), 1091-1092.
[32] F.M. Scherer, “The propensity to patent”, International Journal of Industrial Organization, 1(1), (1983), 107-128.
[33] S. Sharma, V.J. Thomas, “Inter-country R&D efficiency analysis: An application of data envelopment analysis”, Scientometrics, 76(3), (2008), 483-501.
[34] S.Y. Sohn, Y.G. Joo, H.K. Han, “Structural equation model for the evaluation of national funding on R&D project of SMEs in consideration with MBNQA criteria”, Evaluation and Program Planning, 30, (2007), 10-20.
[35] N. Sombatsompop, T. Markpin, “Making an Equality of ISI Impact Factors for Different Subject Fields”, Journal of the American Society for Information Science and Technology, 56(7), (2005), 676-683.
[36] E.C. Wang, W. Huang, “Relative efficiency of R&D activities: A cross-country study accounting for environmental factors in the DEA approach”, Research Policy, 36, (2007), 260-273.