Environment and Social Psychology

Analyzing written performance of learners with AI assistance: Challenges, Limitations, and perceived effectiveness

John M. Tan

Teacher Education Department, Northwest Samar State University- San Jorge, San Jorge, Samar, 6707, Philippines

DOI: https://doi.org/10.59429/esp.v10i4.3275

Keywords: AI-assisted learning; English language learning; perceived effectiveness; technology in education; writing

---

Abstract

There is growing attention towards the use of artificial intelligence (AI) in improving students’ writing performance. In this qualitative exploration, perceptions of higher education institution (HEI) teachers regarding the effect of AI support on writing quality and performance outcomes are undertaken. There were 25 teachers from Samar, Philippines surveyed to explore the perceived benefits and challenges of using AI tools in the writing process. Findings indicated that AI had the potential to enhance grammar, syntax, and structure, thereby reducing writing inefficiencies and building confidence of students. In contrast, they noted that overreliance on AI was problematic, alongside the increased likelihood of academic dishonesty and the weakening of critical thinking and independent writing abilities. From these findings, the need for balance in this process surfaced as well, where AI tools supplemented traditional teaching approaches such as teacher feedback and peer review. The identified benefits included increased writing efficiency, boosted confidence, and greater student engagement in writing activities. However, challenges also emerged, such as concerns about AI accuracy in assessments, the occurrence of academic dishonesty, and the need for students to master AI command prompts. The study concluded that AI could serve as a valuable tool in supporting student writing, but it required careful introduction and an understanding of its limitations. While considering both the potential benefits and emerging issues associated with AI support, teachers were encouraged to leverage its power to enhance learning without compromising the integrity and quality of education.

---

References

[1]. 1.Garil, B. A. (2024). Socio-cultural factors affecting reading comprehension levels and demographic-based grammatical competence of higher education students. Forum for Linguistic Studies, 6(3), 184–197. https://doi.org/10.30564/fls.v6i3.6564

[2]. 2.Correnti, R., Matsumura, L. C., Wang, E. L., Litman, D., & Zhang, H. (2022). Building a validity argument for an automated writing evaluation system (eRevise) as a formative assessment. Computers and Education Open, 3, 100084. https://doi.org/10.1016/j.caeo.2022.100084

[3]. 3.Calzada, K. P. D. (2024). Anti-dependency teaching strategy for innovation in the age of AI among technology-based students. Environment and Social Psychology, 9(8). https://doi.org/10.59429/esp.v9i8.3026

[4]. 4.Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of Artificial Intelligence powered digital writing assistant in higher education: randomized controlled trial. Heliyon, 7(5), e07014. https://doi.org/10.1016/j.heliyon.2021.e07014

[5]. 5.Alam, A. (2022). Employing adaptive learning and intelligent tutoring robots for virtual classrooms and smart campuses: Reforming Education in the age of Artificial Intelligence. In Lecture notes in electrical engineering (pp. 395–406). https://doi.org/10.1007/978-981-19-2980-9_32

[6]. 6.Hwang, G., Xie, H., Wah, B. W.,&Gašević, D. (2020). Vision, challenges, roles and research issues of Artificial Intelligence in Education. Computers and Education Artificial Intelligence, 1, 100001. https://doi.org/10.1016/j.caeai.2020.100001

[7]. 7.Carpio, L. B., Caburnay, A. L. S., Nolledo, S. M., Ongchua, C. A., & Orquia, J. A. (2024). Technology-based teaching among nursing instructors: Confidence and apprehension in using simulation equipment for training. Environment and Social Psychology, 9(8). https://doi.org/10.59429/esp.v9i8.2591

[8]. 8.Sajja, R., Sermet, Y., Cikmaz, M., Cwiertny, D.,&Demir, I. (2024). Artificial Intelligence-Enabled Intelligent Assistant for Personalized and Adaptive Learning in Higher Education. Information, 15(10), 596. https://doi.org/10.3390/info15100596

[9]. 9.Marquis, Y. A., Oladoyinbo, T. O., Olabanji, S. O., Olaniyi, O. O., & Ajayi, S. A. (2024). Proliferation of AI tools: a multifaceted evaluation of user perceptions and emerging trend. Asian Journal of Advanced Research and Reports, 18(1), 30–35. https://doi.org/10.9734/ajarr/2024/v18i1596

[10]. 10.Marzuki, Widiati, U., Rusdin, D., Darwin,&Indrawati, I. (2023). The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective. Cogent Education, 10(2). https://doi.org/10.1080/2331186x.2023.2236469

[11]. 11.Bondoc, R. S., Jr. (2024). ICT-Driven instructional and assessment strategies for physical education in the new normal. Environment and Social Psychology, 9(4). https://doi.org/10.54517/esp.v9i4.2155

[12]. 12.Celik, I., Dindar, M., Muukkonen, H.,&Järvelä, S. (2022). The Promises and Challenges of Artificial Intelligence for Teachers: a Systematic Review of Research. TechTrends, 66(4), 616–630. https://doi.org/10.1007/s11528-022-00715-y

[13]. 13.Castro, F. L. T., Ventura, B. L. O., Estajal, R. S., Timpangco-Macario, J., Limen, M. V., Garil, B. A., & Chavez, J. V. (2024). Teachers handling multiple subject areas: Difficulties and adaptive attributes in the delivery of instructions. Environment and Social Psychology, 9(9). https://doi.org/10.59429/esp.v9i9.2520

[14]. 14.Bucoy, R. M., Enumerabellon, K. M., Amilhamja, A. J., Sisnorio, C. B., Manalo, R., Chavez, J. V., Sabbaha, N. A., & Albani, S. E. (2024). Knowledge deficits and analysis on comprehension of teachers on their common legal rights as teachers. Environment and Social Psychology, 9(9). https://doi.org/10.59429/esp.v9i9.2559

[15]. 15.Hwang, G.,&Tu, Y. (2021). Roles and Research Trends of Artificial Intelligence in Mathematics Education: A Bibliometric mapping analysis and Systematic review. Mathematics, 9(6), 584. https://doi.org/10.3390/math9060584

[16]. 16.Jafari, F.,&Keykha, A. (2023). Identifying the opportunities and challenges of artificial intelligence in higher education: a qualitative study. Journal of Applied Research in Higher Education, 16(4), 1228–1245. https://doi.org/10.1108/jarhe-09-2023-0426

[17]. 17.Del Mundo, M. A., Reyes, E. F. D., Gervacio, E. M., Manalo, R. B., Book, R. J. A., Chavez, J. V., Espartero, M. M., & Sayadi, D. S. (2024). Discourse analysis on experience-based position of science, mathematics, and Tech-Voc educators on generative AI and academic integrity. Environment and Social Psychology, 9(8). https://doi.org/10.59429/esp.v9i8.3028

[18]. 18.Seyyedrezaei, M. S., Amiryousefi, M., Gimeno-Sanz, A., & Tavakoli, M. (2022). A meta-analysis of the relative effectiveness of technology-enhanced language learning on ESL/EFL writing performance: retrospect and prospect. Computer Assisted Language Learning, 1–34. https://doi.org/10.1080/09588221.2022.2118782

[19]. 19.De Leon, A., Jumalon, R., Chavez, J., Kairan, M., Abbas, K., Radjuni, A., Kadil, H., Sahirul, J., Tantalie, E., Hussin, A., Amlih, M.,&Albani, S. (2024a). Analysis on the implementation of inclusive classroom: perception on compliances and obstructions of selected public-school teachers. Environment and Social Psychology, 9(9). https://doi.org/10.59429/esp.v9i9.2537

[20]. 20.Hwang, G.,&Chien, S. (2022). Definition, roles, and potential research issues of the metaverse in education: An artificial intelligence perspective. Computers and Education Artificial Intelligence, 3, 100082. https://doi.org/10.1016/j.caeai.2022.100082

[21]. 21.Almasri, F. (2024). Exploring the Impact of Artificial intelligence in teaching and learning of Science: A Systematic Review of Empirical research. Research in Science Education, 54(5), 977–997. https://doi.org/10.1007/s11165-024-10176-3

[22]. 22.Espartero, M. M., Caldaza, K. P. D., & Del Prado, R. T. (2024). Analyzing the level of interest of high school students in solving mathematical problems in the modular and face-to-face learning. Environment and Social Psychology, 9(4). https://doi.org/10.54517/esp.v9i4.2167

[23]. 23.Ma, B., Chen, L.,&Konomi, S. (2024). Enhancing Programming Education with ChatGPT: A Case Study on Student Perceptions and Interactions in a Python Course. In Communications in computer and information science (pp. 113–126). https://doi.org/10.1007/978-3-031-64315-6_9

[24]. 24.Inoferio, H. V., Espartero, M., Asiri, M., Damin, M., & Chavez, J. V. (2024). Coping with math anxiety and lack of confidence through AI-assisted Learning. Environment and Social Psychology, 9(5). https://doi.org/10.54517/esp.v9i5.2228

[25]. 25.Chavez, J., & Lamorinas, D. D. (2023). Reconfiguring assessment practices and strategies in online education during the pandemic. International Journal of Assessment Tools in Education, 10(1), 160–174. https://doi.org/10.21449/ijate.1094589

[26]. 26.Chavez, J. V. (2022). Narratives of Bilingual Parents on the Real-Life Use of English Language: Materials for English Language Teaching Curriculum. Arab World English Journal, 13(3), 325–338. https://doi.org/10.24093/awej/vol13no3.21

[27]. 27.Fu, Q., Lin, C., Hwang, G.,&Zhang, L. (2019). Impacts of a mind mapping-based contextual gaming approach on EFL students’ writing performance, learning perceptions and generative uses in an English course. Computers&Education, 137, 59–77. https://doi.org/10.1016/j.compedu.2019.04.005

[28]. 28.Zhai, X., Chu, X., Chai, C. S., Jong, M. S. Y., Istenic, A., Spector, M., Liu, J., Yuan, J.,&Li, Y. (2021). A Review of Artificial Intelligence (AI) in Education from 2010 to 2020. Complexity, 2021, 1–18. https://doi.org/10.1155/2021/8812542

[29]. 29.Chavez, J. V., Adalia, H. G., & Alberto, J. P. (2023). Parental support strategies and motivation in aiding their children learn the English language. Forum for Linguistic Studies, 5(2), 1541-1541.

[30]. 30.Gupta, A. S.,&Mukherjee, J. (2022). Long-term changes in consumers' shopping behavior post-pandemic: an exploratory study. International Journal of Retail&Distribution Management, 50(12), 1518-1534.

[31]. 31.Olawale, S. R., Chinagozi, O. G.,&Joe, O. N. (2023). Exploratory research design in management science: A review of literature on conduct and application. International Journal of Research and Innovation in Social Science, 7(4), 1384-1395.

[32]. 32.Turner, D., Ting, H., Wong, M. W., Lim, T. Y.,&Tan, K. L. (2021). Applying qualitative approach in business research. Asian Journal of Business Research, 11(3), 1-13.

[33]. 33.Chavez, J. V., & Cuilan, J. T. (2023). Gender mainstreaming campaign as a casualty of the online gender-based humor: A discourse analysis. Environment and Social Psychology, 9(2).

[34]. 34.Chavez, J. V. & Prado, R. T. D. (2023). Discourse analysis on online gender-based humor: Markers of normalization, tolerance, and lens of inequality. Forum for Linguistic Studies, 5(1), 55–71. https://doi.org/10.18063/fls.v5i1.1530

[35]. 35.Comeros, N. A., Cuilan, J. T., & Chavez, J. V. (2024). Parental Discretionary Influence on Their Children’s Manner of Learning English Language. Forum for Linguistic Studies, 6(4), 284-299.

[36]. 36.Campbell, S., Greenwood, M., Prior, S., Shearer, T., Walkem, K., Young, S., ...&Walker, K. (2020). Purposive sampling: complex or simple? Research case examples. Journal of research in Nursing, 25(8), 652-661.

[37]. 37.Barratt, M. J., Ferris, J. A.,&Lenton, S. (2015). Hidden populations, online purposive sampling, and external validity: Taking off the blindfold. Field methods, 27(1), 3-21.

[38]. 38.George, T. (2022). Types of Interviews in Research | Guide&Examples. Scribbr [Online]. https://www.scribbr.com/methodology/interviews-research/ (accessed on 21 July 2023)

[39]. 39.Sikov, J. (2020). Asking the Right Question: Qualitative Research Design and Analysis. Boston University[PowerPoint]. https://www.bumc.bu.edu/crro/files/2020/02/RPNQualitativePresentation-2.11.20.pdf (accessed on 21 July 2023)

[40]. 40.Kallio, H., Pietilä, A. M., Johnson, M.,&Kangasniemi, M. (2016). Systematic methodological review: developing a framework for a qualitative semi‐structured interview guide. Journal of advanced nursing, 72(12), 2954-2965.

[41]. 41.Gani, A., Imtiaz, N., Rathakrishnan, M.,&Krishnasamy, H. N. (2020). A pilot test for establishing validity and reliability of qualitative interview in the blended learning English proficiency course. Journal of critical reviews, 7(05), 140-143.

[42]. 42.Monday, T. U. (2020). Impacts of interview as research instrument of data collection in social sciences. Journal of Digital Art&Humanities, 1(1), 15-24.

[43]. 43.Pope, C.,&Mays, N. (Eds.). (2020). Qualitative research in health care (pp. 111-133). Oxford, UK: Wiley-Blackwell.

[44]. 44.Quinney, L., Dwyer, T.,&Chapman, Y. (2016). Who, where, and how of interviewing peers: Implications for a phenomenological study. Sage Open, 6(3), 2158244016659688.

[45]. 45.Elhami, A.,&Khoshnevisan, B. (2022). Conducting an Interview in Qualitative Research: The Modus Operandi. Mextesol Journal, 46(1), 1-7.

[46]. 46.Chavez, J. V., & Ceneciro, C. C. (2023). Discourse analysis on same-sex relationship through the lens of religious and social belief systems. Environment and Social Psychology, 9(1).

[47]. 47.Taherdoost, H. (2022). How to conduct an effective interview; a guide to interview design in research study. International Journal of Academic Research in Management, 11(1), 39-51.

[48]. 48.Benlahcene, A.,&Ramdani, A. (2020). The process of qualitative interview: Practical insights for novice researchers. European Proceedings of Social and Behavioural Sciences.

[49]. 49.Braun, V.,&Clarke, V. (2023). Toward good practice in thematic analysis: Avoiding common problems and be (com) ing a knowing researcher. International journal of transgender health, 24(1), 1-6.

[50]. 50.Chavez, J. V. (2020). The effects of English as a second language on bilingual parents’ English language dispositions. International Journal of Novel Research in Education and Learning, 7(1), 12-25.

[51]. 51.Braun, V.,&Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in psychology, 3(2), 77-101.

[52]. 52.Braun, V.,&Clarke, V. (2012). Thematic analysis. American Psychological Association. APA Handbook of Research Methods in Psychology, 2, 57-71.

[53]. 53.Terry, G., Hayfield, N., Clarke, V.,&Braun, V. (2017). Thematic analysis. The SAGE handbook of qualitative research in psychology, 2(17-37), 25.

[54]. 54.Chavez, J. V., & Vicente, M. B. (2025). Halal compliance behaviors of food and accommodation businesses in the Zamboanga Peninsula, Philippines. Multidisciplinary Science Journal, 7(5), 2025259-2025259.