Multimedia Big Data Processing Techniques: a Survey

  • Authors

    • Chaithra .
    • Roshan Fernandes
    https://doi.org/10.14419/ijet.v7i3.34.19575
  • Hadoop, MapReduce, HDFS, Apache Hadoop, Apache Spark
  • Massive amount of multimedia information are used in day to day life, especially in social media such as Facebook, Whatsapp, Instagram etc. Along with this, most of the real time applications, produce large scale video data which has to be continuously monitored, analysed and processed, so that easier interpretation of required patterns can be done, and real time applications such as detecting traffic flow, predicting weather can be eased out. In this paper, the various existing work done on multimedia big data processing using Hadoop have been discussed. A review on Hadoop-MapReduce system along with HDFS and how multimedia processing has been done in a parallel and distributed manner using it, have also been examined and discussed. In addition to that, the availability and benefits of Real time big data processing tools, methods, and framework such as Apache Spark is been highlighted, and need for the discovery of much more better real time multimedia big data processing framework  have been talked about.

     

     

  • References

    1. [1] U. S. N. Raju, N. K. Varma, H. Pariveda and K. A. Reddy, "Query Object Detection in Big Video Data on Hadoop Framework," 2015 IEEE International Conference on Multimedia Big Data, Beijing, 2015, pp. 284-285.

      [2] M. Husain, Meena S M, A. K. Sabarad, H. Hebballi, S. M. Nagaralli and S. Shetty, "Counting occurrences of textual words in lecture video frames using Apache Hadoop Framework," 2015 IEEE International Advance Computing Conference (IACC), Banglore, 2015, pp. 1144-1147.

      [3] D. Singh, C. Vishnu and C. K. Mohan, "Visual Big Data Analytics for Traffic Monitoring in Smart City," 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA), Anaheim, CA, 2016, pp. 886-891.

      [4] E. Toropov, L. Gui, S. Zhang, S. Kottur and J. M. F. Moura, "Traffic flow from a low frame rate city camera," 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, 2015, pp. 3802-3806.

      [5] B. C. Sunny, Ramesh R, A. Varghese and V. Vazhayil, "Map-Reduce based framework for instrument detection in large-scale surgical videos," 2015 International Conference on Control Communication & Computing India (ICCC), Trivandrum, 2015, pp. 606-611.

      [6] Jose Herrera, German Molto, “Detecting Events in Streaming Multimedia with Big Data Techniquesâ€, 2016 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

      [7] G. M. Alves and P. E. Cruvinel, "Big Data Environment for Agricultural Soil Analysis from CT Digital Images," 2016 IEEE Tenth International Conference on Semantic Computing (ICSC), Laguna Hills, CA, 2016, pp. 429-4.

      [8] S. Sarraf and M. Ostadhashem, "Big data application in functional magnetic resonance imaging using apache spark," 2016 Future Technologies Conference (FTC), San Francisco, CA, 2016, pp. 281-284.

      [9] R. Rajak, D. Raveendran, M. C. Bh and S. S. Medasani, "High Resolution Satellite Image Processing Using Hadoop Framework," 2015 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM), Bangalore, 2015, pp. 16-21.

      [10] H. Xu, M. Fang, L. Li, Y. Tian and Y. Li, "The value of data mining for surveillance video in big data era," 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA)(, Beijing, 2017, pp. 202-206.

      [11] B. Venkitesh, P. K. R. K and M. G. Chandra, "Sequential Multilinear Subspace Based Event Detection in Large Video Data Sequences," 2015 IEEE 22nd International Conference on High Performance Computing Workshops, Bangalore, 2015, pp. 48-51.

      [12] S. Arsh, A. Bhatt and P. Kumar, "Distributed image processing using Hadoop and HIPI," 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Jaipur, 2016, pp. 2673-2676.

      [13] Fernández, R. Casado and R. Usamentiaga, "A Real-Time Big Data Architecture for Glasses Detection Using Computer Vision Techniques," 2015 3rd International Conference on Future Internet of Things and Cloud, Rome, 2015, pp. 591-596..

      [14] X. Zhao, H. Ma, H. Zhang, Y. Tang and Y. Kou, "HVPI: Extending Hadoop to Support Video Analytic Applications," 2015 IEEE 8th International Conference on Cloud Computing, New York City, NY, 2015, pp. 789-796.

      [15] C. Ryu, D. Lee, M. Jang, C. Kim and E. Seo, "Extensible Video Processing Framework in Apache Hadoop," 2013 IEEE 5th International Conference on Cloud Computing Technology and Science, Bristol, 2013, pp. 305-310.

      [16] Manju and P. Valarmathie, "Organizing multimedia big data using semantic based video content extraction technique," 2015 International Conference on Soft-Computing and Networks Security (ICSNS), Coimbatore, 2015, pp. 1-4.

      [17] Sozykin and T. Epanchintsev, "MIPr - a framework for distributed image processing using Hadoop," 2015 9th International Conference on Application of Information and Communication Technologies (AICT), Rostov on Don, 2015, pp. 35-39.

      [18] S. Vemula and C. Crick, "Hadoop Image Processing Framework," 2015 IEEE International Congress on Big Data, New York, NY, 2015, pp. 506-513.

      [19] Tongke Fan, “Research and implementation of user clustering based on MapReduce in multimedia big dataâ€, Multimedia Tools and Applications, Springer, 2017

      [20] M. MazharRathore, Awais , Anand, Seungmin Rho, “Exploiting encrypted and tunneled multimedia calls in high-speed big data environmentâ€, Multimedia Tools and Applications, 2018, Volume 77, Number 4, Page 4959,Springer.

      [21] Kyoungsoo, Jaemin, Jongtae, Yeonwoo, Jaesoo, “An efficient MapReduce scheduling scheme for processing large multimedia dataâ€, Multimedia Tools and Applications, 2017, Volume 76, Number 16, Page 17273 , Springer.

      [22] [22] David Mera, Michael and Pavel, “Speeding up the multimedia featureextraction: a comparative study on the big data approachâ€, Multimedia Tools and Applications, 2017, Volume 76, Number 5, Page 7497 , Springer.

      [23] [23] M. MazharRathore, Hojae Son, Awais Ahmad, Anand Paul, GwanggilJeon, “Real-Time Big Data Stream Processing Using GPU with Spark Over Hadoop Ecosystemâ€, International Journal of Parallel Programming, 2017, Page 1,Springer.

  • Downloads

  • How to Cite

    ., C., & Fernandes, R. (2018). Multimedia Big Data Processing Techniques: a Survey. International Journal of Engineering & Technology, 7(3.34), 855-859. https://doi.org/10.14419/ijet.v7i3.34.19575