Advancing communication networks: integrating ‎enhanced knowledge mapping with hybrid deep ‎recurrent neural networks for dynamic spectrum ‎access

  • Authors

    • Sravana Kumar Yelithoti Research Scholar, School of Electronics, KIIT Deemed to be University, Bhubaneswar, India
    • Tapaswini Samant Associate Professor, School of Electronics, KIIT Deemed to be University, Bhubaneswar, India
    • Swati Swayamsiddha Associate Professor, School of Electronics, KIIT Deemed to be University, Bhubaneswar, India
    https://doi.org/10.14419/5y394g91

    Received date: April 17, 2025

    Accepted date: May 9, 2025

    Published date: May 12, 2025

  • Hybrid Deep Recurrent Neural Networks; Deep Learning; Knowledge Map; Heterogeneous Networks; Dynamic Spectrum Access; Reinforcement ‎Learning; Real Time Analysis

  • Abstract

    By merging knowledge mapping using Hybrid Deep Recurrent Neural Networks (RNNs), our suggested method maximizes dynamic ‎spectrum access in diverse networks. Optimizing the assignment of spectrum resources while enabling different device characteristics ‎and network circumstances is our approach to addressing the issues of spectrum allocation in different network situations. Improved ‎processing capabilities at the network's edge enable real time monitoring of patterns in spectrum consumption. In order to dynamically ‎allocate spectrum according to user demands and network dynamics, our dynamic spectrum access technology employs reinforcement ‎learning algorithms. Hybrid Deep RNNs take use of both deep learning as well as recurrent neural networks to enhance feature ‎extraction and behavioral dependence modeling in spectrum data. In order to guarantee the system's reliability and resilience in real ‎world applications, assessment indicators are used to analyze its performance and efficiency. Consistent with our hypothesis, the ‎results demonstrate significant gains in spectrum utilization effectiveness and allocation accuracy, validating our approach to ‎maximizing resource consumption and facilitating faultless functioning in diverse network settings‎.

  • References

    1. Khadem Mina, Ansarifard, M., Mokari, N., Javan, M.R., Saeedi, H., & Jorswieck E.A. "Dynamic Fairness-Aware ‎Spectrum Auction for Enhanced Licensed Shared Access in 6G Networks." IEEE Transactions on ‎Communications, vol. 46, no. 1, 2023,pp 1-13, https://doi.org/10.1109/TCOMM.2024.3486985.
    2. Poshattiwar, Sadhana D., and S. B. "Dynamic Spectrum Sensing for 5G Cognitive Radio Networks Using ‎Optimization Technique." Journal of Electrical Systems, 2024.
    3. Kopyto, David Jonas, Lindner, S., Schulz, L., Stolpmann, D., Bauch, G., & Timm-Giel, A. "Deep Learning-Based ‎Dynamic Spectrum Access for Coexistence of Aeronautical Communication Systems." Proceedings of the 2022 ‎IEEE 96th Vehicular Technology Conference (VTC2022-Fall), 2022, pp. 1–5. ‎https://doi.org/10.1109/VTC2022-Fall57202.2022.10012932.
    4. Zhang, Xu, Chen, P., Yu, G., & Wang, S. "Deep Reinforcement Learning Heterogeneous Channels for Poisson ‎Multiple Access." Mathematics, vol. 11, no. 4, 2023, p. 992. MDPI, https://doi.org/10.3390/math11040992.
    5. Atimati, E., Crawford, D. H., and Stewart, R. W. "Intelligent Shared Spectrum Coordination in Heterogeneous ‎Networks." Proceedings of the 2023 IEEE Virtual Conference on Communications (VCC), 2023, pp. 252–257.‎ ‎https://doi.org/10.1109/VCC60689.2023.10474686.
    6. Xu, Y Lou, J., Wang, T., Shi, J., Zhang, T., Paul, A., & Wu, Z. "Multiple Access for Heterogeneous Wireless ‎Networks with Imperfect Channels Based on Deep Reinforcement Learning." Electronics, vol. 12, no. 23, 2023, ‎p. 4845. MDPI, https://doi.org/10.3390/electronics12234845.
    7. Park, J, Jin, H., Joo, J., Choi, G., & Kim, S.C. "Double Deep Q-Learning Based Backhaul Spectrum Allocation in ‎Integrated Access and Backhaul Network." Proceedings of the 2023 International Conference on Artificial ‎Intelligence in Information and Communication (ICAIIC), 2023, pp. 706–708 , ‎https://doi.org/10.1109/ICAIIC57133.2023.10067029.
    8. Gnanaselvam, R., and Vasanthi, M. S. "Dynamic Spectrum Access-Based Augmenting Coverage in Narrow Band ‎Internet of Things." International Journal of Communication Systems, vol. 37, 2023. ‎ https://doi.org/10.1002/dac.5629.
    9. Devipriya, S., Leo Manickam, J. M., and Jasmine Mystica, K. "A Deep-Learning Based Approach to Resource ‎Allocation in NOMA Based Cogni-tive Radio Network with Heterogeneous IoT Users." Proceedings of the ‎‎2022 IEEE International Conference on Distributed Computing and Elec-trical Circuits and Electronics ‎‎(ICDCECE), 2022, pp. 1–6. https://doi.org/10.1109/ICDCECE53908.2022.9793269.
    10. Zhang, Y., Li, X., Ding, H., & Fang, Y. “A Joint Scheme on Spectrum Sensing and Access with Partial Observation: ‎A Multi-Agent Deep Rein-forcement Learning Approach”. In Proceedings of the 2023 IEEE/CIC International ‎Conference on Communications in China (ICCC), pp. 1-6. https://doi.org/10.1109/ICCC57788.2023.10233366.
    11. Kumar, Ratnesh, Singh, C.K., Upadhyay, P.K., Salhab, A.M., Nasir, A.A., & Masood, M. "IoT-Inspired ‎Cooperative Spectrum Sharing with Ener-gy Harvesting in UAV-Assisted NOMA Networks: Deep Learning ‎Assessment." IEEE Internet of Things Journal, vol. 10, no. 24, 2023, pp. 22182–22196. IEEE, ‎https://doi.org/10.1109/JIOT.2023.3304126.
    12. Yang, Tao, Zhang, W., Bo, Y., Sun, J., & Wang, C. "Dynamic Spectrum Sharing Based on Federated Learning and ‎Multi-Agent Actor-Critic Rein-forcement Learning." Proceedings of the 2023 International Wireless ‎Communications and Mobile Computing Conference (IWCMC), 2023, pp. 947–952. IEEE,‎ https://doi.org/10.1109/IWCMC58020.2023.10182572.
    13. Zhang, Liang, and Ying-Chang Liang. "Deep Reinforcement Learning for Multi-Agent Power Control in ‎Heterogeneous Networks." IEEE Transac-tions on Wireless Communications, vol. 20, no. 4, 2021, pp. 2551–‎‎2564. IEEE, https://doi.org/10.1109/TWC.2020.3043009.
    14. Zhang, Hao, Leng, S., Zhao, P., & He, J. "A Dynamic Consensus Scheme for Unlicensed Spectrum Sharing in ‎Heterogeneous Networks." Proceed-ings of the 2023 IEEE 23rd International Conference on Communication ‎Technology (ICCT), 2023, pp. 803–808. IEEE, https://doi.org/10.1109/ICCT59356.2023.10419465.
    15. Chew, Daniel, and Andrew Cooper. "Spectrum Sensing in Interference and Noise Using Deep Learning." ‎Proceedings of the 2020 54th Annual Conference on Information Sciences and Systems (CISS), 2020, pp. 1–6. ‎IEEE, https://doi.org/10.1109/CISS48834.2020.1570617443.
    16. Ahmed, Ramsha, Chen, Y., Hassan, B., Du, Du, L., Hassan, T., & Dias, J"Hybrid Machine-Learning-Based Spectrum ‎Sensing and Allocation with Adaptive Congestion-Aware Modeling in CR-Assisted IoV Networks." IEEE ‎Internet of Things Journal, vol. 9, no. 22, 2022, pp. 25100–25116. IEEE, https://doi.org/10.1109/JIOT.2022.3195425.
    17. Ali, Hussen Yesuf, Sun Goulin, and Abegaz Mohammed Seid. "Autonomous RACH Resource Slicing for ‎Heterogeneous IoT Devices Communica-tion Using Deep Reinforcement Learning." 2021 International ‎Conference on Information and Communication Technology for Development for Africa (ICT4DA), 2021, pp. ‎‎125–130. IEEE, ‎https://doi.org/10.1109/ICT4DA53266.2021.9672226.
    18. Kim, Donghyun, Kwon, S.S., Jung, H., & Lee, I. "Deep Learning-Based Resource Allocation Scheme for ‎Heterogeneous NOMA Networks." IEEE Access, vol. 11, 2023, pp. 89423–89432. IEEE, ‎https://doi.org/10.1109/ACCESS.2023.3307407.
    19. S. Mirbolouk, M. Valizadeh, M. C. Amirani, and S. Ali, “Relay selection and power allocation for energy efficiency ‎maximization in hybrid satel-lite-UAV networks with CoMP-NOMA transmission,” IEEE Transactions on ‎Vehicular Technology, vol. 71,2022, no. 5, pp. 5087–5100, ‎https://doi.org/10.1109/TVT.2022.3152048.
    20. Yu, Yifan, Soung Chang Liew, and Tao Wang. "Multi-Agent Deep Reinforcement Learning Multiple Access for ‎Heterogeneous Wireless Networks With Imperfect Channels." IEEE Transactions on Mobile Computing, vol. ‎‎21, no. 11, 2022, pp. 3718–3730. IEEE, https://doi.org/10.1109/TMC.2021.3057826.
    21. Lu, Lan, Gong, X., Ai, B., Wang, N., & Chen, W. "Deep Reinforcement Learning for Multiple Access in Dynamic ‎IoT Networks Using Bi-GRU." Proceedings of the 2022 IEEE International Conference on Communications ‎‎(ICC), 2022, pp. 3196–3201. IEEE, https://doi.org/10.1109/ICC45855.2022.9838614.
    22. Allahham, Mhd Saria, Abdellatif, A.A., Mhaisen, N., Mohamed, A., Erbad, A.M., & Guizani, M. "Multi-Agent ‎Reinforcement Learning for Net-work Selection and Resource Allocation in Heterogeneous Multi-RAT ‎Networks." IEEE Transactions on Cognitive Communications and Network-ing, vol. 8, no. 2, 2022, pp. 1287–‎‎1300. IEEE, https://doi.org/10.1109/TCCN.2022.3155727.
    23. Janiar, S. B., and V. Pourahmadi. "Deep-Reinforcement Learning for Fair Distributed Dynamic Spectrum Access in ‎Priority Buffered Heterogene-ous Wireless Networks." IET Communications, vol. 15, no. 6, 2021, pp. 674–682. ‎IET, ‎https://doi.org/10.1049/cmu2.12098.
    24. Liston, M. J., and K. R. Dandekar. "Entropy-Based Exploration in Cognitive Radio Networks Using Deep ‎Reinforcement Learning for Dynamic Spectrum Access." Proceedings of the 2021 IEEE 21st Annual Wireless ‎and Microwave Technology Conference (WAMICON), 2021, pp. 1–5. IEEE, ‎https://doi.org/10.1109/WAMICON47156.2021.9444294.
    25. Li, Y., Wang, Y., Li, Y., & Shen, B "Multi-User Dynamic Spectrum Access Based on LRQ Deep Reinforcement ‎Learning Network." Proceedings of the 2023 25th International Conference on Advanced Communication ‎Technology (ICACT), 2023, pp. 79–84. IEEE, https://doi.org/10.23919/ICACT56868.2023.10079537.
    26. Kaur, Amandeep, Thakur, J., Thakur, M., Kumar, K., Prakash, A., & Tripathi, R.K. "Deep Recurrent Reinforcement ‎Learning-Based Distributed Dynamic Spectrum Access in Multichannel Wireless Networks with Imperfect ‎Feedback." IEEE Transactions on Cognitive Communications and Networking, vol. 9, no. 1, 2023, pp. 281–‎‎292. IEEE, https://doi.org/10.1109/TCCN.2023.3234276.
    27. Schulz, Lennart, Kopyto, D., Stolpmann, D., Lindner, S., Bauch, G., & Timm-Giel, A. "Hidden Node-Aware ‎Dynamic Spectrum Access Using Deep Learning for Coexisting Aeronautical Communication Systems." ‎Proceedings of the 2023 IEEE 98th Vehicular Technology Conference (VTC2023-Fall) , 2023, pp. 1–5. IEEE, ‎https://doi.org/10.1109/VTC2023-Fall60731.2023.10333681.
    28. Chen, H., Zhao, H., Zhou, L., Zhang, J., Liu, Y., Pan, X., Liu, X., & Wei, J. "A Dueling Deep Recurrent Q-‎Network Framework for Dynamic Mul-tichannel Access in Heterogeneous Wireless Networks." Wireless ‎Communications and Mobile Computing, vol. 2022, 2022, pp. 1–13.Hindawi, https://doi.org/10.1155/2022/9446418.‎
    29. Huang, J., Peng, J., Xiang, H., Li, L., & Yang, Y. "Hybrid Spectrum Access for V2V Heterogeneous Networks ‎with Deep Reinforcement Learn-ing." Proceedings of the 2022 14th International Conference on Wireless ‎Communications and Signal Processing (WCSP), 2022, pp. 1091–1095. IEEE, ‎https://doi.org/10.1109/WCSP55476.2022.10039356.
    30. Wang, Y., Li, X., Wan, P., & Shao, R. "Intelligent Dynamic Spectrum Access Using Deep Reinforcement Learning ‎for VANETs." IEEE Sensors Journal, vol. 21, no. 15, 2021, pp. 15554–15563. IEEE, ‎https://doi.org/10.1109/JSEN.2021.3056463.
    31. Chen, M., Liu, A., Liu, W., Ota, K., Dong, M., & Xiong, N. "RDRL: A Recurrent Deep Reinforcement Learning ‎Scheme for Dynamic Spectrum Access in Reconfigurable Wireless Networks." IEEE Transactions on Network ‎Science and Engineering, vol. 9, no. 1, 2022, pp. 364–376. IEEE, https://doi.org/10.1109/TNSE.2021.3117565.
    32. Xu, Y., Yu, J., and Buehrer, R. "The Application of Deep Reinforcement Learning to Distributed Spectrum Access ‎in Dynamic Heterogeneous En-vironments with Partial Observations." IEEE Transactions on Wireless ‎Communications, vol. 19, no. 7, 2020, pp. 4494–4506. IEEE, https://doi.org/10.1109/TWC.2020.2984227.
    33. Ye, X., Yu, Y., and Fu, L. "Multi-Channel Opportunistic Access for Heterogeneous Networks Based on Deep ‎Reinforcement Learning." IEEE Transactions on Wireless Communications, vol. 21, no. 3, 2021, pp. 794–807. ‎IEEE, https://doi.org/10.1109/TWC.2021.3099495.
    34. Jiang, Z., and Han, L. "DRL-Based Dynamic Spectrum Access for Cognitive Radio Networks in Mobility ‎Scenarios." Proceedings of the 2023 5th International Academic Exchange Conference on Science and ‎Technology Innovation (IAECST), 2023, pp. 1–5. IEEE, ‎https://doi.org/10.1109/IAECST60924.2023.10503376.
    35. Liu, Z., Wang, X., Zhang, Y., & Chen, X. "Meta Reinforcement Learning for Generalized Multiple Access in ‎Heterogeneous Wireless Networks." Proceedings of the 21st International Symposium on Modeling and ‎Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt), 2023, pp. 570–577. IEEE, ‎https://doi.org/10.23919/WiOpt58741.2023.10349896.

  • Downloads

  • How to Cite

    Yelithoti, S. K., Samant, T. ., & Swayamsiddha , S. . (2025). Advancing communication networks: integrating ‎enhanced knowledge mapping with hybrid deep ‎recurrent neural networks for dynamic spectrum ‎access. International Journal of Basic and Applied Sciences, 14(1), 291-303. https://doi.org/10.14419/5y394g91