DEVELOPMENT OF THE METHODS OF CREATING LANGUAGE EXAM QUESTIONS USING ARTIFICIAL INTELLIGENCE: A CASE STUDY
DOI:
https://doi.org/10.37547/ijasr-04-12-49Keywords:
Artificial intelligence, assessment, exam questionsAbstract
This paper explores the application of artificial intelligence (AI) in generating classroom foreign language tests, aiming to identify the challenges and opportunities encountered during item creation. Employing a case study, a qualitative research method, this study used data from a single subject to investigate the process of generating classroom assessment items using an AI system in a real-world setting. The findings highlighted several opportunities and challenges faced by the participant when utilizing AI. Analysis of the feedback revealed three major benefits of using AI: practicality, customization, and efficiency. Conversely, four significant challenges were identified: readability, validity, insufficient data for other languages, and issues of ownership.
Downloads
References
Darvishi, A., Khosravi, H., Sadiq, S., & Gasevic, D. (2022). Incorporating AI and Learning Analytics to Build Trustworthy Peer Assessment Systems. British Journal of Educational Technology, 53 (4), 844-875. https://doi.org/10.1111/bjet.13233
Dumont, G. (2023). Immersion in Organizational Ethnography: Four Methodological Requirements to Immerse Oneself in the Field. Organizational Research Methods, 26 (3), 441-458. https://doi.org/10.1177/10944281221075365
Eaton, S. E., Mindzak, M., & Morrison, R. (2021, May 29 - June 3). Artificial Intelligence, Algorithmic Writing & Educational Ethics [Paper Presentation]. Canadian Society for the Study of Education Societe canadienne pour l'etude de l'education, Edmonton, AB, Canada. http://hdl.handle.net/1880/113569
4. Ferrara, S., Lai, E., Reilly, A., & Nichols, P. D. (2017). Principled Approaches to Assessment Design, Development, and Implementation in A. A. Rupp & J. P. Leighton (Eds.), The Handbook of Cognition and Assessment: Frameworks, Methodologies, and Applications. 41-72. Hoboken: Wiley and Sons. https://doi.org/10.1002/9781118956588.ch3
Freddi, M. (2021). Reflection on Digital Language Teaching, Learning, and Assessment in Times of Crisis: A View from Italy. In N. Radic, А. Atabekova, M. Freddi & J. Schmied (Eds.), The World Universities’ Response to COVID-19: Remote Online Language Teaching, 279-293. Research-publishing.net. https://doi.org/10T4705/rpnet.2021.52.1278
Fyfe, P. (2022). How to Cheat on Your Final Paper: Assigning AI for Student Writing. AI & Society. https://doi.org/10.1007/s00146-022-01397-z
Garcia-Penalvo, F. J., Corell, A., Abella-Garcia, V., & Grande-de-Prado, M. (2021). Recommendations for Mandatory Online Assessment in Higher Education During the COVID-19 Pandemic. In D. Burgos, A. Tlili, & A. Tabacco (Eds.), Radical Solutions for Education in a Crisis Context: COVID-19 as an Opportunity for Global Learning (pp. 85-98). Berlin: Springer. https://doi.org/10.1007/978-981-15-7864-3_7
Gardner, J., O’Leary, M., & Yuan, L. (2021). Artificial intelligence in educational assessment: “Breakthrough? or buncombe and ballyhoo?” Journal of Computer Assisted Learning, 37(5), 1207-1216. https://doi.org/10.1111/jcal.12577
Griffee, D. T. (2012). An introduction to second language research methods: Design and data. Dale T. Griffee. TESL-EJ Publications. http://www.tesl- ej.org/pdf/ej60/sl_research_methods.pdf
Godwin-Jones, R. (2022). Partnering with AI: Intelligent Writing Assistance and Instructed Language Learning. Language Learning & Technology, 26(2), 5-24. http://doi.org/10125/73474
Mackey, A., & Gass, S. M. (2022). Second Language Research: Methodology and Design (3rd ed.). Oxfordshire: Routledge. ISBN 9781032036632
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Nodirbek Yuldashev Abdumannob O’g’li, Dr. Danish Ather
This work is licensed under a Creative Commons Attribution 4.0 International License.
