Map reduce technique for parallel-automata analysis of large scale rainfall data
Keywords:Big Data, Hadoop, Map Reduce, Rainfall Forecast, Regression Automata.
Vast scale rainfall information assumes an imperative part in farming field thus early expectation of rainfall is important for the better finan-cial development of a nation. Rainfall expectation is an expert among the most troublesome issue far and wide in a year back. This data is generally secured in the unstructured course of action. Along these, tremendous measure of data has been accumulated and archived. Thus, storage and handling of such tremendous information for accurate rainfall forecast are a major test. Big Data innovation like Hadoop have developed to fathom the difficulties and issues of huge information utilizing distributed computing. Till date few examinations have been accounted for on the preparing of vast scale rainfall information utilizing MapReduce. In this paper, the huge scale rainfall information is anticipated by utilizing MapReduce system which plays out the capacities which are required and diminishes the task to get proficient ar-rangements through taking the information and isolating into smaller tasks. At that point, the three Regression Automata (RA) algorithms such as Linear Regression automata, Support Vector Regression Automata and Logistic Regression Automata. are utilized to forecast the future esteem of large scale rainfall data. The proposed framework serves as a tool that takes in the rainfall information from diminished information as input and predicts the future rainfall. The outcomes obviously demonstrate that the all the three RA models can anticipate the rainfall productively in different terms, such as, error rate, coefficients and mean square error.
 N. Sethi, and K. Garg, â€œExploiting data mining technique for rainfall predictionâ€, International Journal of Computer Science and Information Technologies, Vol.5, No.3, pp.3982-3984, 2014.
 P.S. Dutta, and H. Tahbilder, â€œPrediction of rainfall using data mining technique over Assamâ€, Indian Journal of Computer Science and Engineering (IJCSE), Vol.5, No.2, pp.85-90, 2014.
 M. Kannan, S. Prabhakaran, and P. Ramachandran, â€œRainfall forecasting using data mining techniqueâ€, International Journal of Engineering and Technology, Vol.2, No.6, pp.397-401, 2010.
 A. Gautam, and P. Bedi, â€œMR-VSM: Map Reduce based vector Space Model for user profiling-an empirical study on News dataâ€, In International Conference on Advances in Computing, Communications and Informatics (ICACCI), Kochi, pp. 355-360, 2015. https://doi.org/10.1109/ICACCI.2015.7275635.
 A. Gautam, R. Dhingra, and P. Bedi, â€œUse of NoSQL database for handling semi structured data: an empirical study of news RSS feedsâ€, Emerging Research in Computing, Information, Communication and Applications, New Delhi, pp.253-263, 2015.
 S. Navadia, P. Yadav, J. Thomas, and S. Shaikh, â€œWeather prediction: A novel approach for measuring and analyzing weather data,â€ In International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud)(I-SMAC), pp.414-417, 2017.
 D. V. Sahasrabuddhe, and P. Jamsandekar. "Data structure for representation of big data of weather forecasting: a review." International Journal of Computer Science Trends and Technology (IJCST) vol, 3, no. 6, pp. 48-56, 2015.
 V. Dagade, M. Lagali, S. Avadhani, P. Kalekar, â€œBig Data Weather Analytics Using Hadoopâ€, International Journal of Emerging Technology in Computer Science & Electronics (IJETCSE), Vol.14 No.2, 2015.
 L. Li, F. Noorian, D.J. Moss, and P.H. Leong, â€œRolling window time series prediction using MapReduce,â€ In 15th International Conference on Information Reuse and Integration (IRI), pp.757-764, 2014.
 Y. Chen, Z. Wu, Z. Li, and Y. Zhang, â€œResearch on time series forecasting model based on moore automataâ€, In Proc. of International Conf. On Advanced Data Mining and Applications, pp.98-105, Springer, Berlin, Heidelberg, 2010. https://doi.org/10.1007/978-3-642-17316-5_9.
 S. Mehrmolaei, and M.R. Keyvanpour, â€œTime series forecasting using improved ARIMAâ€, In Proc. of International Conf. On Artificial Intelligence and Robotics (IRANOPEN), pp.92-97 2016.
 R.M. Nabilah, Z. Othman, and B. A. Azuraliza, â€œApproaches of Handling Uncertain Time Series Data towards Predictionâ€, International Journal of Future Computer and Communication, Vol.5, No.6, pp.233, 2016. https://doi.org/10.18178/ijfcc.2016.5.6.477.
 N.F.M. Radzuan, Z. Othman, and A.A. Bakar, â€œUncertain time series in weather predictionâ€, Procedia Technology, Vol.11, pp.557-564, 2013. https://doi.org/10.1016/j.protcy.2013.12.228.
 M. Joshi, S. Shaikh, P. Waghmode, and P. Mali, â€œFarmer Buddy-Weather Prediction and Crop Suggestion using Artificial Neural Network on Map-Reduce Frameworkâ€, International Journal of Computer Applications, Vol.159, No.7, 2017.
 K.A. Ismail, M.A. Majid, J.M. Zain, and N.A.A. Bakar, â€œBig Data prediction framework for weather Temperature based on MapReduce algorithmâ€, In Open Systems (ICOS), 2016 IEEE Conference, pp.13-17, 2016.
 K. Namitha, A. Jayapriya, and G. Santhosh Kumar, â€œRainfall Prediction using Artificial Neural Network on Map-Reduce Framework,â€ Proceedings of the Third International Symposium on Women in Computing and Informatics. ACM, 2015.
 C. P. Shabariram, K. E. Kannammal, and T. Manojpraphakar, "Rainfall analysis and rainstorm prediction using MapReduce Framework." Computer Communication and Informatics (ICCCI), 2016 International Conference on. IEEE, 2016.
 A. Nair, Gurjeet Singh, and U. C. Mohanty. "Prediction of Monthly Summer Monsoon Rainfall Using Global Climate Models Through Artificial Neural Network Technique." Pure and Applied Geophysics, vol. 175, no. 1, pp. 403-419, 2018. https://doi.org/10.1007/s00024-017-1652-5.
 S. Shajitha Banu, S. Manjula, S. Swathi Priya, V. Yamuna Devi, M. Thangamani, â€œPredictive Analysis of Rainfall Data to Help the Farmersâ€, International Journal of Advanced Research in Computer Science and Software Engineering, Vol.6, No.3, 2016.
 A. Kaur, â€œBig Data: A Review of Challenges, Tools and Techniquesâ€, International journal of scientific research in science, engineering and technology, Vol.2, No.2, pp. 1090-1093, 2016.
 K. Morton, M. Balazinska and D. Grossman, â€œParatimer: a progress indicator for MapReduce DAGsâ€, In Proceedings of the 2010 international conference on Management of data, pp.507-518, 2010.
 W. Lu, Y. Shen, S. Chen, and B.C. Ooi, â€œEfficient processing of k nearest neighbor joins using mapreduceâ€, Proceedings of the VLDB Endowment, Vol.5, No.10, pp.1016-1027, 2012. https://doi.org/10.14778/2336664.2336674.
 P. Riyaz, and S.M. Varghese, â€œLeveraging map reduce with hadoop for weather data analyticsâ€, IOSR Journal of Computer Engineering, Vol.17, No.3, 2015.
 B. Anurag, M. Prakash, V. Kanna, P. Choudhary, â€œWeather Forecasting using Map-Reduceâ€, International Journal of Innovative Research in Computer and Communication Engineering, Vol.5, No.9, 2017.
 G.J. MartÃnez, J.C. Seck-Tuoh-Mora, and H. Zenil, â€œWolframâ€™s classification and computation in cellular automata Classes III and IVâ€, In Proc. of International Conf. On Irreducibility and Computational Equivalence, Berlin, Heidelberg, pp.237-259, 2013. https://doi.org/10.1007/978-3-642-35482-3_17.
 A. Kavousi-Fard, H. Samet, and F. Marzbani, â€œA new hybrid modified firefly algorithm and support vector regression model for accurate short term load forecastingâ€, Expert systems with applications, Vol.41, No.13, pp.6047-6056, 2014. https://doi.org/10.1016/j.eswa.2014.03.053.
 A. Belayneh, J. Adamowski, B. Khalil, and B. Ozga-Zielinski, â€œLong-term SPI drought forecasting in the Awash River Basin in Ethiopia using wavelet neural network and wavelet support vector regression modelsâ€, Journal of Hydrology, Vol.508, pp.418-429, 2014. https://doi.org/10.1016/j.jhydrol.2013.10.052.
 A.R. Imon, M.C. Roy, and S.K. Bhattacharjee, â€œPrediction of rainfall using logistic regressionâ€, Pakistan Journal of Statistics and Operation Research, Vol.8, No.3, pp.655-667, 2012. https://doi.org/10.18187/pjsor.v8i3.535.
 Geetha, A. and Nasira, G.M., 2016. Time-series modelling and forecasting modelling of rainfall prediction using ARIMA model. International Journal of Society Systems Science, 8(4), pp.361-372. https://doi.org/10.1504/IJSSS.2016.081411.