The use of artificial intelligence in educational assessment in language universities

Aim of the article is to describe the possibilities of artificial intelligence for the formation of assessment funds on the example of the discipline “Practical course of English language” in language universities in the aspects of incoming control and formative assessment.
Methodology. The following methods were used in the course of the research and writing of the article: the method of theoretical analysis of pedagogical sources, systematization and generalization of the information obtained. In the practical part of the research, empirical methods of observation, testing, pedagogical experiment and the method of scaling and ranking in the course of interpreting the results were used to create control tasks for incoming and formative assessment.
Results. The described features of using artificial intelligence in the GPT online chat format demonstrate the possibilities of its application in the work of a teacher in English classes. The use of artificial intelligence for the formation of assessment funds and tasks of incoming control significantly reduces the time of preparation of language material and simplifies the subsequent evaluation process. Given the technical limitations of artificial intelligence at the present stage of development, its introduction into the educational process can be considered only as an additional methodological tool.
Theoretical and/or practical significance. The research presented in this article has a certain theoretical and practical significance. Where, the theoretical significance lies in the fact that the obtained results expand the understanding of the role of artificial intelligence in the methodology of teaching foreign languages. From the point of view of practical significance, it can be noted that the obtained results can be applied to teaching English in a language university, as well as used as illustrative material in lectures on the methodology of teaching a foreign language.
Conclusions. The proposed ways of using artificial intelligence for the formation of the fund of assessment means have shown effectiveness in the work of foreign language classes, and also allow to reduce the methodological load of the teacher. Based on the analyzed mechanism of GPT chat, the ways of making a correct user request to avoid technical difficulties in working with the chat were described. In the course of the study, the technical capabilities of the GPT chat room were tested in the process of forming the fund of assessment means, which was reflected in the screenshots. It was concluded that the functionality of the GPT chat allows for the evaluation of both multiple choice assignments and more extensive written assignments, taking into account the clear criteria and evaluation parameters set by the teacher. Composing incoming control assignments with the help of artificial intelligence also had positive results provided the user specified clarifying information: level of difficulty, list of lexical units, grammatical structures and functional style. It is noted that the effectiveness of introducing artificial intelligence in the educational process is possible only if it is used as an additional tool that requires further checking and correction of the results by the teacher.

1. Avramenko A. P., Ahmedova A. S., Bulanova E. R. [Chatbot technology as a means of developing foreign language grammatical competence in self-study]. In: Vestnik Tambovskogo universiteta [Bulletin of Tambov University], 2023, no. 2, pp. 386–394. DOI: 10.20310/1810-0201-2023-28-2-386-394.

2. Bogolepova S. V., Babasyan E. R. [Possibilities of artificial intelligence for developing educational and assessment tasks in foreign languages]. In: Prepodavatel' XXI vek [Teacher XXI century], 2024, no. 1, pt. 1, pp. 137–154. DOI: 10.31862/2073-9613-2024-1-137-154.

3. Voevoda E. V., Shpynova A. I. [Application of artificial intelligence technologies in studying business English (using written assignments as an example)]. In: Mir nauki, kul'tury i obrazovaniya [The World of Science, Culture and Education], 2023, no. 5 (102), pp. 237–240. DOI: 10.24412/1991-5497-2023-5102-237-240.

4. Evstigneev M. N. [Key issues of teaching a foreign language based on artificial intelligence]. In: Inostrannye yazyki v shkole [Foreign languages at school], 2024, no. 3, pp. 18–24.

5. Isaeva T. E., Shefieva E. Sh. [Use of artificial intelligence in the educational process of higher educational institutions (using teaching foreign languages as an example)]. In: Obshchestvo: sociologiya, psihologiya, pedagogica [Society: sociology, psychology, pedagogy], 2020, no. 10, pp. 1–7. DOI: 10.24158/spp.2020.10.15.

6. Kadeeva O. E., Syricina V. N. [Chatbots and Features of Their Use in Education]. In: Informatika v shkole [Computer Science at School], 2020, no. 10 (163), pp. 45–53.

7. Rynkevich A. V., Lizina M. A. [Didactic Potential of ChatGPT in the Foreign Language Educational Process in Non-Linguistic Universities]. In: Pedagogicheskiĭ zhurnal [Pedagogical Journal], 2023, vol. 13, no. 10-1, pp. 474–480. DOI: 10.34670/AR.2023.87.66.064.

8. Sysoev P. V., Filatov E. M. [ChatGPT in students' research work: to prohibit or to teach?]. In: Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki [Bulletin of Tambov University. Series: Humanities], 2023, vol. 28, no. 2, pp. 276–301. DOI: https://doi.org/10.20310/1810-0201-2023-28-2-276-301.

9. Sysoev P.V., Filatov E.M., Evstigneev M.N.[Matrix of artificial intelligence tools in linguomethodological training of future foreign language teachers]. In: Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki [Bulletin of Tambov University. Series: Humanities], 2024, vol. 29, no. 3, pp. 559– 588. DOI: https://doi.org/10.20310/1810-0201-2024-29-3-559-588.

10. Sysoev P. V., Filatov E. M. [Methods of teaching pupils and students to write essays in the triad “student - teacher - artificial intelligence”]. In: Vestnik Moskovskogo universiteta. Ser. 19. Lingvistika i mezhkul'turnaya kommunikaciya [Bulletin of Moscow University. Ser. 19. Linguistics and intercultural communication], 2024, no. 2, pp. 38–54. DOI: 10.55959/MSU-2074-1588-19-27-2-3.

11. Sysoev P. V., Filatov E. M. [Chatbots in teaching a foreign language: advantages and controversial issues]. In: Vestnik Tambovskogo universiteta. Seriya: Gumanitarnye nauki [Bulletin of Tambov University. Series: Humanities], 2023, vol. 28, no. 1 (202), pp. 66–72. DOI: 10.20310/1810-0201-2023-28-1-66-72.

12. Titova S. V. [Competence Map of a Foreign Language Teacher in the Context of Digitalization of Education]. In: Pedagogika vysshej shkoly [Pedagogy of Higher Education], 2022, no. 5, pp. 134–147. DOI: 10.31992/0869-3617-2022-31-5-133-149.

13. Titova S. V. [Experimental Implementation of a Model for Organizing Formative and Current Control of Written and Speech Skills Based on Mobile Technologies of Students of a Non-Linguistic University]. In: Vestnik Tambovskogo universiteta [Bulletin of Tambov University], 2018, no. 172, pp. 35–42. DOI: 10.20310/1810-0201-2018-23-172-35-42.

14. Titova S. V., Staroverova M. V. [Stages of digitalization of language education in the XX-XXI centuries]. In: Vestnik Moskovskogo universiteta [Bulletin of Moscow University], 2023, no. 3, pp. 25–45. DOI: 10.55959/MSU-2074-1588-19-26-3-2.

15. Harlamenko I. V. [Chatbots in teaching English]. In: Inostrannye yazyki v shkole [Foreign languages at school], 2023, no. 3, pp. 55–59.

16. Alexandara H., Role of AI in Education. In: Injuruty: Interdiciplinary Journal and Humanity, 2023, vol. 2, no. 3, pp. 260–268.

17. Jiahui H., Salmiza S., Yufei L. A Review on Artificial Intelligence in Education. In: Academic Journal of Interdisciplinary Studies, 2021, no. 3, pp. 206–217. DOI: https://doi.org/10.36941/ajis-2021-0077.

18. Lazar K., Veljko A., Marija K. Artificial Intelligence in Education: A Review. In: Technics and Informatics in Education, 2023, no. 1, pp. 223–228. DOI: 10.46793/TIE22.223K.

19. Selwyn N. On the Limits of Artificial Intelligence (AI) in Education. In: Nordisk tidsskrift for pedagogikk og kritikk, 2024, no. 10, pp. 3–14. DOI https://doi.org/10.23865/ntpk.v10.6062.