Implementing Bidirectional Encoder Representations fromTransformers and Gated ‎Recurrent Units in a Chatbot for Student Support Services

  • Authors

    • Ronilyn M. Telan School of Graduate Studies, AMA University, Quezon City, Philippines
    • Jake Libed School of Graduate Studies, AMA University, Quezon City, Philippines
    https://doi.org/10.14419/9hchw096

    Received date: October 15, 2025

    Accepted date: November 19, 2025

    Published date: December 4, 2025

  • BERT; GRU; NLP; Seq2seq Architecture; Domain–Specific Chatbot; Student Support System; ‎Contextual Understanding.

  • Abstract

    Establishing efficient communication among students, faculty, and administrators is imperative ‎to the effective operation of educational institutions. Understanding students’ expectations for ‎fast, flexible, and personalized access to support services can improve satisfaction and strengthen ‎institutional performance. The increasing demand for prompt solutions in question–and–answer ‎services has led to the emergence of intelligent automation, particularly AI–powered chatbots, to ‎address existing educational challenges. This study developed and evaluated a web–based ‎student support system featuring a chatbot that integrates Bidirectional Encoder Representations ‎from Transformers (BERT) and Gated Recurrent Units (GRU) to enhance student support ‎services. The NLP–driven chatbot provides real–time, automated responses to student inquiries, ‎such as enrollment, schedules, tuition, and academic policies. Experimental results showed that ‎the BERT model effectively identified user intent, achieving precision, recall, and F1 scores of ‎‎0.87 and above. The GRU–based decoder generated coherent and contextually relevant replies, ‎validated through ROUGE metrics. Usability testing based on ISO 9241–11:2018 yielded mean ‎scores above 4.5, confirming the system’s effectiveness and user satisfaction. Overall, the ‎BERT–GRU chatbot demonstrates a practical and scalable solution for providing 24/7 student ‎assistance and improving institutional support. Recommendations were proposed to enhance the ‎implementation, effectiveness, and future development of BERT–GRU chatbot systems in ‎educational settings‎.

  • References

    1. Martinez–Requejo, S., Jimenez–García, E., Redondo–Duarte, S., Ruiz–Lázaro, J., Puertas–Sanz, E., & Mariscal–Vivas, G. (2024, March). AI–driven student assistance: Chatbots redefining university support. In Proceedings of the 18th International Technology, Education and Development Conference (INTED 2024) (pp. 617–625). IATED Academy. https://doi.org/10.21125/inted.2024.0221.
    2. Oghenekaro, L. U., & Okoro, C. O. (2024). Artificial intelligence–based chatbot for student mental health support. OALib, 11(5), 1. https://doi.org/10.4236/oalib.1111511.
    3. Al–Abdullatif, A. M., Al–Dokhny, A. A., & Drwish, A. M. (2023). Implementing the Bashayer chatbot in Saudi higher education: Measuring the influence on students’ motivation and learning strategies. Frontiers in Psychology, 14, 1129070. https://doi.org/10.3389/fpsyg.2023.1129070.
    4. Duduka, J., Reis, A., Pereira, R., Pires, E., Sousa, J., & Pinto, T. (2023). The impact of artificial intelligence on chatbot design. In Technology and innovation in learning, teaching and education (Vol. 302, pp. 481–486). Springer Nature. https://doi.org/10.1007/978-3-031-22918-3_39.
    5. Benayache, S., & Mourad, B. (2024). Influences of personalisation and student engagement in the AI era: Exploring effects and influences. International Journal of Innovative Science and Research Technology, 9(9), 2771–2782. https://doi.org/10.38124/ijisrt/IJISRT24SEP1667.
    6. Pereira, D. S. M., Falcão, F., Costa, L., Lunn, B. S., Pêgo, J. M., & Costa, P. (2023). Here’s to the future: Conversational agents in higher education – A scoping review. International Journal of Educational Research, 122, 102233. https://doi.org/10.1016/j.ijer.2023.102233.
    7. Ramandanis, D., & Xinogalos, S. (2023). Investigating the support provided by chatbots to educational institutions and their students: A systematic literature review. Multimodal Technologies and Interaction, 7(11), 103. https://doi.org/10.3390/mti7110103.
    8. Mikael, K., Öz, C., Rashid, T. A., & Nariman, G. S. (2025). A hybrid chatbot model for enhancing administrative support in education: Comparative analysis, integration, and optimization. IEEE Access, 13, 3552501. https://doi.org/10.1109/ACCESS.2025.3552501.
    9. Peyton, K., Unnikrishnan, S., & Mulligan, B. (2025). A review of university chatbots for student support: FAQs and beyond. Discover Education Review. https://doi.org/10.1007/s44217-025-00397-7.
    10. Attigeri, G., Agrawal, A., & Kolekar, S. V. (2024). Advanced NLP models for technical university information chatbots: Development and comparative analysis. IEEE Access, 12, 29633–29647. https://doi.org/10.1109/ACCESS.2024.3368382.
    11. Hailu, G. Y., Hailu, H., & Welay, S. (2024, January 26). Deep learning based Amharic chatbot for FAQs in universities (arXiv preprint arXiv:2402.01720v1). arXiv.
    12. Razak, M. S. A., Kumar, M. V. M., Nirmala, C. R., Naseer, R., Prashanth, B. S., & Sneha, H. R. (2024). Enhancing student support with AI: A college assistance chatbot using NLP and ANN. In Proceedings of the 2024 Second International Conference on Networks, Multimedia and Information Technology (NMITCON) (pp. 1–8). IEEE. https://doi.org/10.1109/NMITCON62075.2024.10699279.
    13. Wang, K., Ramos, J., & Lawrence, R. (2023, December 29). ChatEd: A chatbot leveraging ChatGPT for an enhanced learning experience in higher education (arXiv:2401.00052) [Preprint]. arXiv.
    14. Kingchang, T., Chatwattana, P., & Wannapiroon, P. (2024). Artificial intelligence chatbot platform for educational recommendations in higher education. International Journal of Information and Education Technology, 14(1), 35–42. https://www.ijiet.org/vol14/IJIET–V14N1–2021.pdf. https://doi.org/10.18178/ijiet.2024.14.1.2021.
    15. Modiba, M. T., & Shekgola, M. M. (2024, June 20). Utilising artificial intelligence chatbots for student support at comprehensive open distance e–learning higher learning institutions in the Fifth Industrial Revolution. Journal of Education, Society & Multiculturalism, 5(1), 26–48. https://doi.org/10.2478/jesm-2024-0003.
    16. Oliveira, P. F., & Matos, P. (2023). Introducing a chatbot to the web portal of a higher education institution to enhance student interaction. ASEC 2023, 128. https://doi.org/10.3390/ASEC2023-16621.
    17. Gardazi, N. M., Daud, A., Malik, M. K., Bukhari, A., Alsahfi, T., & Alshemaimri, B. (2025). BERT applications in natural language processing: A review. Artificial Intelligence Review, 58, 166. https://doi.org/10.1007/s10462-025-11162-5.
    18. Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., & Artzi, Y. (2019). BERTScore: Evaluating text generation with BERT. arXiv.
    19. Devlin, J., Chang, M.–W., Lee, K., & Toutanova, K. (2018). BERT: Pre–training of deep bidirectional transformers for language understanding. arXiv.
    20. Bano, S., Khalid, S., Tairan, N. M., Shah, H., & Khattak, H. A. (2023). Summarization of scholarly articles using BERT and BiGRU: Deep learning–based extractive approach. Journal of King Saud University–Computer and Information Sciences, 35(9), 101739. https://doi.org/10.1016/j.jksuci.2023.101739.
    21. Zhang, X., Wang, M., & Li, J. (2025). A context and sequence–based recommendation framework using GRU networks. Artificial Intelligence Review. Advance online publication. https://doi.org/10.1007/s10462-025-11174-1.
    22. Lou, W., Yang, W., & Wei, F. (2023). DialogCIN: Contextual inference networks for emotional dialogue generation. Applied Sciences, 13(15), 8629. https://doi.org/10.3390/app13158629.
    23. Noh, S.–H. (2021). Analysis of gradient vanishing of RNNs and performance comparison. Information, 12(11), 442. https://doi.org/10.3390/info12110442.
    24. Barbella, M., & Tortora, G. (2022). ROUGE metric evaluation for text summarization techniques. SSRN. https://doi.org/10.2139/ssrn.4120317.
    25. Lin, C. Y. (2004). ROUGE: A package for automatic evaluation of summaries. In Text summarization branches out: Proceedings of the ACL–04 Workshop (pp. 74–81). Association for Computational Linguistics.
    26. International Organization for Standardization. (2018). ISO 9241–11:2018: Ergonomics of human–system interaction—Part 11: Usability: Definitions and concepts (2nd ed.). ISO. https://www.iso.org/standard/63500.html.
    27. Hurana, D., Koli, A., Khatter, K., & others. (2023). Natural language processing: State of the art, current trends and challenges. Multimedia Tools and Applications, 82, 3713–3744. https://doi.org/10.1007/s11042-022-13428-4.
    28. Rayhan, A., Kinzler, R., & Rayhan, R. (2023, August). Natural language processing: Transforming how machines understand human language. ResearchGate.
    29. Shaik, T., Sreerama, K., Daram, S. R., Khayyat, M., Alshdadi, A. A., & Alnuaim, A. A. (2022). A review of the trends and challenges in adopting natural language processing methods for education feedback analysis. IEEE Access, 10, 56720–56739. https://doi.org/10.1109/ACCESS.2022.3177752.
    30. Torfi, A., Shirvani, R. A., Keneshloo, Y., Tavaf, N., & Fox, E. A. (2021). Natural language processing advancements by deep learning: A survey (arXiv:2003.01200). arXiv.
    31. Chandrawat, V. S., & Researcher, III. (2025, January). Designing context–aware chatbot systems using AI techniques for enhanced user interaction and problem–solving. ResearchGate, 6(1), 9–21. https://www.researchgate.net/publication/389791536.
    32. Karegowda, A. G., Bhat, S., Akshatha, C. S., & Naidu, V. S. (2025). Enriching learning experience using Gemma—the intelligent chat companion. In Proceedings of the International Conference on Smart Systems for Applications in Electrical Sciences (ICSSES 2025). IEEE. https://doi.org/10.1109/ICSSES64899.2025.11009459.
    33. Oni, O. (2025). Memory–enhanced conversational AI: A generative approach for context–aware and personalized chatbots. Communication in Physical Sciences, 12(2), 649–657. https://doi.org/10.4314/cps.v12i2.28.
    34. Ascama, B. J., Mendoza, A. E., & Ruiz, P. A. (2024, July). Application of an intelligent virtual assistant for student support services in universities. In Proceedings of the 22nd LACCEI International Multi–Conference for Engineering, Education and Technology. https://doi.org/10.18687/LACCEI2024.1.1.1376.
    35. Bhoyar, M. (2023, October). Generative AI and the evolution of conversational agents. International Research Journal of Engineering and Technology (IRJET), 10(10). https://www.irjet.net/.
    36. Davis, M., Martin, O., & Hoover, R. (2025, January). The role of NLP in personalized learning: Tailoring education to individual student needs. ResearchGate. https://www.researchgate.net/publication/389463567.
    37. Olujimi, P. A., & Ade–Ibijola, A. (2023). NLP techniques for automating responses to customer queries: A systematic review. Discover Artificial Intelligence, 3, 20. https://doi.org/10.1007/s44163-023-00065-5.
    38. Karyotaki, M., Drigas, A., & Skianis, C. (2022). Chatbots as cognitive, educational, advisory & coaching systems. Technium Social Sciences Journal, 30(1), 6277. https://doi.org/10.47577/tssj.v30i1.6277.
    39. Abdallah, A. K., Alkaabi, A. M., Mehiar, D., & Jaradat, Z. A. (2024). Chatbots in classrooms: Tailoring education and boosting engagement. In Applications of artificial intelligence in higher education (Chapter 12). IGI Global. https://doi.org/10.4018/979–8–3693–0880–6.ch012
    40. Davar, N. F., Dewan, M. A. A., & Zhang, X. (2025). AI chatbots in education: Challenges and opportunities. Information, 16(3), 235. https://doi.org/10.3390/info16030235.
    41. Kooli, C. (2023). Chatbots in education and research: A critical examination of ethical implications and solutions. Sustainability, 15(7), 5614. https://doi.org/10.3390/su15075614.
    42. Mathew, A. N., Rohini, V., & Paulose, J. (2021). NLP–based personal learning assistant for school education. International Journal of Electrical and Computer Engineering, 11(5), 4522–4530. https://doi.org/10.11591/ijece.v11i5.pp4522-4530.
    43. Peyton, K., Unnikrishnan, S., & Mulligan, B. (2025). A review of university chatbots for student support: FAQs and beyond. Discover Education Review. https://doi.org/10.1007/s44217-025-00397-7.
    44. Sophia, E. (2025, March). The effectiveness of AI–powered chatbots in student support services. ResearchGate. https://www.researchgate.net/publication/390033254.
    45. Han, D., Tohti, T., & Hamdulla, A. (2022). Attention–based Transformer–BiGRU for question classification. Information, 13(5), 214. https://doi.org/10.3390/info13050214.
    46. Gao, Y., Wang, R., & Zhou, E. (2021). Stock prediction based on optimized LSTM and GRU models. Journal of Healthcare Engineering, 2021, 4055281. https://doi.org/10.1155/2021/4055281.
    47. Yiğit, G., & Amasyali, M. F. (2021). Simple but effective GRU variants. In Proceedings of the 2021 International Conference on Innovations in Intelligent Systems and Applications (INISTA) (pp. 1–6). IEEE. https://doi.org/10.1109/INISTA52262.2021.9548535.
    48. Ding, M., Zhou, C., Yang, H., & Tang, J. (2020). CogLTX: Applying BERT to long texts. Advances in Neural Information Processing Systems, 33, 12792–12804.
    49. Cahuantzi, R., Chen, X., & Güttel, S. (2023). A comparison of LSTM and GRU networks for learning symbolic sequences. In K. Arai (Ed.), Intelligent computing (Vol. 739, pp. 771–785). Springer. https://doi.org/10.1007/978-3-031-37963-5_53.
    50. Yang, S., Yu, X., & Zhou, Y. (2020). LSTM and GRU neural network performance comparison study: Taking Yelp review dataset as an example. In Proceedings of the 2020 International Workshop on Electronic Communication and Artificial Intelligence (IWECAI) (pp. 98–101). IEEE. https://doi.org/10.1109/IWECAI50956.2020.00027.
    51. Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv. https://arxiv.org/abs/1412.3555.
    52. Sultani, M., & Daneshpour, N. (2025). Extracting urgent questions from MOOC discussions: A BERT–based multi–output classification approach. Arabian Journal for Science and Engineering, 50(1), 1169–1190. https://doi.org/10.1007/s13369-024-09090-7.
    53. Tian, Y. (2023). Multi–label text classification combining BERT and Bi–GRU based on the attention mechanism. Journal of Network Intelligence, 8(1). https://bit.kuas.edu.tw/~jni/2023/vol8/s1/12.JNI–0392.pdf.
    54. Khodeir, N. A. (2021). Bi–GRU urgent classification for MOOC discussion forums based on BERT. IEEE Access, 9, 58243–58255. https://doi.org/10.1109/ACCESS.2021.3072734.
    55. Zhang, N. N., & Xing, Y. (2021, February). Questions and answers on legal texts based on BERT–BiGRU. In Journal of Physics: Conference Series (Vol. 1828, Issue 1, Article 012035). IOP Publishing. https://doi.org/10.1088/1742-6596/1828/1/012035.
    56. Jayakumar, V. M., Rajakumari, R., Sarwar, S., Syed, D. M., Prema, S., Boddupalli, S., & El–Ebiary, Y. A. B. (2024). Advancing automated and adaptive educational resources through semantic analysis with BERT and GRU in English language learning. International Journal of Advanced Computer Science and Applications, 15(4), 869–878. https://doi.org/10.14569/IJACSA.2024.01504109.
    57. Yao, S., & Bi, J. (2024). Sentiment analysis based on the BERT and bidirectional GRU model. In Proceedings of the 2024 IEEE 7th International Conference on Information Systems and Computer Aided Education (ICISCAE) (pp. 290–295). IEEE. https://doi.org/10.1109/ICISCAE62304.2024.10761342.
    58. Zhang, X., Wu, Z., Liu, K., Zhao, Z., Wang, J., & Wu, C. (2023). Text sentiment classification based on BERT embedding and sliced multi–head self–attention Bi–GRU. Sensors, 23(3), 1481. https://doi.org/10.3390/s23031481.
    59. Horne, L., Matti, M., Pourjafar, P., & Wang, Z. (2020). GRUBERT: A GRU–based method to fuse BERT hidden layers for Twitter sentiment analysis. In Proceedings of the 1st Conference of the Asia–Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing: Student Research Workshop (pp. 130–138). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.aacl-srw.19.
    60. Sana, E., & Akhtar, N. (2023). Improving multi–document summarization with GRU–BERT network. In Proceedings of the 2023 International Conference on Recent Advances in Electrical, Electronics & Digital Healthcare Technologies (REEDCON) (pp. 503–507). IEEE. https://doi.org/10.1109/REEDCON57544.2023.10151372.
    61. Yi, R., & Hu, W. (2020). Pre–trained BERT–GRU model for relation extraction. In Proceedings of the 2019 8th International Conference on Computing and Pattern Recognition (pp. 453–457). ACM. https://doi.org/10.1145/3373509.3373533.
    62. Oni, O. (2025). Memory–Enhanced Conversational AI: A Generative Approach for Context–Aware and Personalized Chatbots. Communication in Physical Sciences, 12(2), 649–657. https://doi.org/10.4314/cps.v12i2.28.
    63. Nugraha, F. M. E., & Setiyawan, M. (2025). Implementation of the ADDIE model in chatbot development using DiagramFlow. Journal of Technology and System Information, 2(2), 9. https://doi.org/10.47134/jtsi.v2i2.3758.
    64. Branch, R. M. (2010). Instructional design: The ADDIE approach (1st ed.). Springer US. https://doi.org/10.1007/978-0-387-09506-6.
    65. Molenda, M. (2003). In search of the elusive ADDIE model. Performance Improvement, 42(5), 34–36. https://doi.org/10.1002/pfi.4930420508.
    66. Maroengsit, W., Piyakulpinyo, T., Phonyiam, K., Pongnumkul, S., Chaovalit, P., & Theeramunkong, T. (2019, March). A survey on evaluation methods for chatbots. In Proceedings of the 2019 7th International Conference on Information and Education Technology (ICIET 2019) (pp. 111–119). ACM. https://doi.org/10.1145/3323771.3323824.
    67. Følstad, A., & Brandtzaeg, P. B. (2020). Users’ experiences with chatbots: Findings from a questionnaire study. International Journal of Human–Computer Studies, 132, 103409. https://doi.org/10.1007/s41233-020-00033-2.
    68. Lewis, J. R., & Sauro, J. (2021). Usability and user experience: Design and evaluation. In G. Salvendy & W. Karwowski (Eds.), Handbook of human factors and ergonomics (5th ed., pp. 972–1015). Wiley. https://doi.org/10.1002/9781119636113.ch38.
    69. Bevan, N., Carter, J., & Harker, S. (2015). ISO 9241–11 revised: What have we learnt about usability since 1998? In M. Kurosu (Ed.), Human–Computer Interaction: Design and Evaluation (Vol. 9169, pp. 143–151). Springer. https://doi.org/10.1007/978-3-319-20901-2_13.

  • Downloads

  • How to Cite

    Telan, R. M., & Libed, J. . . (2025). Implementing Bidirectional Encoder Representations fromTransformers and Gated ‎Recurrent Units in a Chatbot for Student Support Services. International Journal of Basic and Applied Sciences, 14(8), 121-127. https://doi.org/10.14419/9hchw096