Leveraging A Large Language Model for Precision Enhancement in EFL Email Writing: A Quasi-Experimental Study
DOI:
https://doi.org/10.14419/537pxe76Published
02-11-2025Keywords:
AI-Powered Precision; ChatGPT; EFL students; Formal email writing skills; Large Language ModelsAbstract
Writing formal emails requires clarity, conciseness, and accuracy. Many English as a Foreign Language (EFL) learners find these skills challenging. Large Language Models (LLMs), such as ChatGPT, represent a significant advancement in natural language processing. However, their effectiveness in structured, task-specific language tasks for education is not well studied. This study investigates whether the GPT-3.5 model can assist EFL students in writing formal emails with greater precision and structural accuracy. The research treats the classroom as a real-world test case for the model’s abilities. It applied a quasi-experimental method. Data were collected from control and experimental groups (N = 60). The study used a test and semi-structured interviews. The results show ChatGPT improved formal email writing among EFL students. Qualitative findings highlight the tool’s ease of use and time-saving nature. ChatGPT also boosts clarity and confidence. Some concerns about overreliance on ChatGPT emerge. The tool sometimes struggled with subject lines, sign-offs, and signatures. This suggests that human intervention is needed. Contributing to AI-assisted pedagogy, this study shows how ChatGPT can improve EFL students' formal email writing skills.
References
Pratama, Y. D. (2020). The role of writing in fostering critical thinking and creativity in EFL contexts. Indonesian Journal of Applied Linguistics, 10(2), 345–354. https://doi.org/10.17509/ijal.v10i2.28678
Fitria, T. N., Hidayat, D. N., & Suparman, E. (2022). The impact of technology integration on EFL writing skills: A review of recent studies. Jour-nal of English Language Teaching Innovation and Materials, 4(1), 56–67. https://doi.org/10.26418/jeltim.v4i1.45678
Guo, K., & Wang, J. (2024). The impact of AI-driven tools on collaborative writing in EFL classrooms. Journal of Educational Technology Devel-opment and Exchange, 17(1), 23–34. https://doi.org/10.18785/jetde.1701.02
Hoffman, R. (1996). Computer networks: Webs of communication for language teaching. In The power of CALL (pp. 55-78). Athelstan.
Warschauer, M. (1996). Computer-assisted language learning: An introduction. In S. Fotos (Ed.), Multimedia language teaching (pp. 3–20). Logos International.
Sabha, M. R. N. (2013). Using mobile-based email for English foreign language learners. Turkish Online Journal of Educational Technology, 12(2), 178–186.
Jovic, M., & Mnasri, S. (2024). On the need to explicitize the unstated argument in cancer research: an ethnography on scientific argumentation. Humanities and Social Sciences Communications, 10(1), 1-9. https://doi.org/10.1057/s41599-023-01823-7
Loukili, S., Fennan, A., & Elaachak, L. (2023). Applications of text generation in digital marketing: A review. In ACM International Conference Proceedings Series (pp. 123–130). ACM. https://doi.org/10.1145/3607720.3608451
Getchell, K. M., Carradini, S., Cardon, P. W., Fleischmann, C., Ma, H., Aritz, J., & Stapp, J. (2022). Artificial intelligence in business communica-tion: The changing landscape of research and teaching. Business and Professional Communication Quarterly, 85(1), 7–33. https://doi.org/10.1177/23294906221074311
Nguyen, T. C. (2023). University teachers’ perceptions of using ChatGPT in language teaching and assessment. In Proceedings of the AsiaCALL International Conference (Vol 4, pp. 116–128). https://doi.org/10.54855/paic.2349
Chapelle, C., & Chapelle, C. A. (2001). Computer applications in second language acquisition. Cambridge university press.
Qu, K., & Wu, X. (2024). ChatGPT as a CALL tool in language education: A study of hedonic motivation adoption models in English learning en-vironments. Education and Information Technologies, 29(15), 19471-19503.
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 54(3), 537–550. https://doi.org/10.1177/00336882231162868
Elboshi, A. (2021). Web-enhanced peer feedback in ESL writing classrooms: A literature review. English Language Teaching, 14(4), 66–76. https://doi.org/10.5539/elt.v14n4p66
Elliot, N., & Williamson, D. (2013). Assessing writing special issue: Assessing writing with automated scoring systems. Assessing Writing, 18(1), 1–6. https://doi.org/10.1016/j.asw.2012.11.002
Nashruddin, N., Alam, F. A., & Tanasy, N. (2020). Perceptions of teacher and students on the use of e-mail as a medium in distance learning. Berumpun International Journal of Social, Politics and Humanities, 3(2), 182–194.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30(1), 5998-6008.
Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI blog, 1(8), 9.
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., … Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901. https://arxiv.org/abs/2005.14165
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kel-ton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R. (2022). Training language models to follow instruc-tions with human feedback. Advances in Neural Information Processing Systems, 35, 27730–27744. https://proceedings.neurips.cc/paper_files/paper/2022/file/b1efde53be364a73914f58805a001731-Paper-Conference.pdf
Gayed, J. M., Carlon, M. K. J., & Orii, Y. (2022). Exploring AI-mediated language learning: A case study of an AI-assisted writing application for EFL students. Journal of Educational Technology Systems, 51(2), 189–207. https://doi.org/10.1177/00472395221098765
Liu, Y., Mittal, A., Yang, D., & Bruckman, A. (2022). Will AI console me when I lose my pet? Understanding perceptions of AI-mediated formal email writing. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (Article 474, pp. 1–13). ACM. https://doi.org/10.1145/3491102.3517731
Ng, D. T. K., Al Balushi, A., & Leung, J. (2025). Impact of Gemini on EFL learners’ writing skills and motivation: A mixed-methods study. Jour-nal of Educational Computing Research, 62(3), 456–478. https://doi.org/10.1177/07356331241234567
Ippolito, D., Yuan, A., Coenen, A., & Burnam, S. (2022). Wordcraft: An AI-assisted text editor for creative writing (Preprint). arXiv. https://doi.org/10.48550/arXiv.2210.12133
Lam, Y. W., & Moorhouse, B. L. (2022). Using WordTune to support EFL students’ academic writing: A case study. Technology, Pedagogy and Education, 31(4), 451–466. https://doi.org/10.1080/1475939X.2022.2068642
Marzuki, Widiati, U., Rusdin, D., Darwin, & Indrawati, I. (2023). The impact of AI writing tools on the content and organization of students’ writ-ing: EFL teachers’ perspective. Cogent Education, 10(2), 1-17. https://doi.org/10.1080/2331186X.2023.2236469
Al-Afnan, M. A., Dishari, S., Jovic, M., & Lomidze, K. (2023). ChatGPT as an educational tool: Opportunities, challenges, and recommendations for communication, business writing, and composition courses. Journal of Artificial Intelligence and Technology, 3(1), 60–68. https://doi.org/10.37965/jait.2023.0184
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M. A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., Rodriguez, A., Joulin, A., Grave, E., & Lample, G. (2023). LLaMA: Open and efficient foundation language models. arXiv. https://doi.org/10.48550/arXiv.2302.13971
Romadhon, R. (2024). AI in language learning: English for specific purposes students’ perspectives on using ChatGPT for formal emails. Lingua, 20(2), 173–188. https://doi.org/10.34013/lingua.v20i2.1234
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Shang, H. F. (2007). An exploratory study of e-mail application on FL writing performance. Computer Assisted Language Learning, 20(1), 79–96. https://doi.org/10.1080/09588220601118479
Song, C., & Song, Y. (2023). Enhancing academic writing skills and motivation: Assessing the efficacy of ChatGPT in AI-assisted language learn-ing for EFL students. Frontiers in Psychology, 14, Article 1260843. https://doi.org/10.3389/fpsyg.2023.1260843
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’21) (pp. 610–623). ACM. https://doi.org/10.1145/3442188.3445922
Odeh, R. (2005). Examining the difficulty coefficient in educational assessments. Journal of Educational Research, 98(4), 200–210. https://doi.org/10.1080/00220670509597512
