A Survey on Intermediate Data Management for Big Data and Internet of Things

  • Authors

    • Marwah Nihad
    • Alaa Hassan
    • Nadia Ibrahim
    2018-12-13
    https://doi.org/10.14419/ijet.v7i4.37.23622
  • Big Data, Data Management, Intermediate Data, Internet of Things (IoT).
  • The field internet of things and Big Data has become a necessity in our everyday lives due to the broadening of its technology and the exponential increase in devices, services, and applications that drive different types of data. This survey shows the study of Internet of Things (IoT), Big Data, data management, and intermediate data. The survey discusses intermediate data on Big Data and Internet of Things (IoT) and how it is managed. Internet of Things (IoT) is an essential concept of a new technology generation. It is a vision that allows the embedded devices or sensors to be interconnected over the Internet. The future Internet of Things (IoT) will be greatly presented by the massive quantity of heterogeneous networked embedded devices that generate intensively "Big data". Referring to the term intermediate data as the information that is provoked as output data along the process. However, this data is temporary and is erased as soon as you run a model or a sample tool. Also, the existence of intermediate data in both of the Internet of Things (IoT) and Big Data are explained. Here, various aspects of the internet of things, Big Data, intermediate data and data management will be reviewed. Moreover, the schemes for managing this data and its framework are discussed.

     

     

  • References

    1. [1] Abdullah, M. N., Hassan, A., & Naef, N. (2016). Knowledge-Based Analysis of Web Data Extraction. Paper presented at the The Fifth International Conference on Informatics and Applications (ICIA2016).

      [2] Abdullah, M. N., Khafagy, M. H., & Omara, F. A. (2014). Home: Hiveql optimization in multi-session environment. Paper presented at the 5th European Conference of Computer Science (ECCS’14).

      [3] Abu-Elkheir, M., Hayajneh, M., & Ali, N. A. (2013). Data management for the internet of things: Design primitives and solution. Sensors, 13(11), 15582-15612.

      [4] Aggarwal, C. C., Ashish, N., & Sheth, A. (2013). The internet of things: A survey from the data-centric perspective Managing and mining sensor data (pp. 383-428): Springer.

      [5] Alpaydin, E. (2014). Introduction to machine learning: MIT press.

      [6] Big data. https://en.wikipedia.org/wiki/Big_data. Retrieved from https://en.wikipedia.org/wiki/Big_data

      [7] Chen, M., Mao, S., & Liu, Y. (2014). Big data: A survey. Mobile networks and applications, 19(2), 171-209.

      [8] Chen, M., Mao, S., Zhang, Y., & Leung, V. C. (2014). Big data: related technologies, challenges and future prospects: Springer.

      [9] Dean, J., & Ghemawat, S. (2008). MapReduce: simplified data processing on large clusters. Communications of the ACM,51(1),107-113.

      [10] Dumbill, E. (2012). What is big data? An introduction to the big data landscape. oreilly. com, http://radar. oreilly. com/2012/01/what-is-big-data. html.

      [11] Grobelnik, M. (2012). Big data tutorial. Kalamaki: Jožef Stefan Institute.

      [12] Gubbi, J., Buyya, R., Marusic, S., & Palaniswami, M. (2013). Internet of Things (IoT): A vision, architectural elements, and future directions. Future generation computer systems, 29(7), 1645-1660.

      [13] The Hadoop Map/Reduce Framework.http://hadoop. apache. org/ mapreduce/

      [14]

      [15] Hassanalieragh, M., Page, A., Soyata, T., Sharma, G., Aktas, M., Mateos, G., . . . Andreescu, S. (2015). Health monitoring and management using Internet-of-Things (IoT) sensing with cloud-based processing: Opportunities and challenges. Paper presented at the Services Computing (SCC), 2015 IEEE International Conference on.

      [16] HDFS. The Hadoop Distributed File System. http://hadoop.apache.org/common/docs/r0.20.1/hdfs_design.html

      [17] Ko, S. Y., Hoque, I., Cho, B., & Gupta, I. (2009). On Availability of Intermediate Data in Cloud Computations. Paper presented at the HotOS.

      [18] Moise, D., Trieu, T.-T.-L., Bougé, L., & Antoniu, G. (2011). Optimizing intermediate data management in MapReduce computations. Paper presented at the Proceedings of the first international workshop on cloud computing platforms.

      [19] Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015). Deep learning applications and challenges in big data analytics. Journal of Big Data, 2(1), 1.

      [20] Oussous, A., Benjelloun, F.-Z., Lahcen, A. A., & Belfkih, S. (2017). Big Data Technologies: A Survey. Journal of King Saud University-Computer and Information Sciences.

      [21] Pujolle, G. (2006). An autonomic-oriented architecture for the internet of things. Paper presented at the Modern Computing, 2006. JVA'06. IEEE John Vincent Atanasoff 2006 International Symposium on.

      [22] Ray, J., & Koopman, P. (2009). Data management mechanisms for embedded system gateways. Paper presented at the Dependable Systems & Networks, 2009. DSN'09. IEEE/IFIP International Conference on.

      [23] Roe, B., & Beech, R. Intermediate and continuing care–policy and practice.

      [24] Sahal, R., Nihad, M., Khafagy, M. H., & Omara, F. A. (2018). iHOME: Index-Based JOIN Query Optimization for Limited Big Data Storage. Journal of Grid Computing, 1-36.

      [25] Wan, J., Humar, I., & Zhang, D. (2016). Industrial IoT Technologies and Applications: Springer.

      [26] Wang, Y., Kung, L., & Byrd, T. A. (2018). Big data analytics: Understanding its capabilities and potential benefits for healthcare organizations. Technological Forecasting and Social Change,126,3-13.

      [27] Yu, J., & Buyya, R. (2005). A taxonomy of scientific workflow systems for grid computing. ACM Sigmod Record, 34(3), 44-49.

  • Downloads

  • How to Cite

    Nihad, M., Hassan, A., & Ibrahim, N. (2018). A Survey on Intermediate Data Management for Big Data and Internet of Things. International Journal of Engineering & Technology, 7(4.37), 86-89. https://doi.org/10.14419/ijet.v7i4.37.23622