Academic Journal
Evaluating the Evaluators: A Comparative Study of AI and Teacher Assessments in Higher Education
| العنوان: | Evaluating the Evaluators: A Comparative Study of AI and Teacher Assessments in Higher Education |
|---|---|
| اللغة: | English |
| المؤلفون: | Tugra Karademir Coskun (ORCID |
| المصدر: | Digital Education Review. 2024 (45):124-139. |
| الاتاحة: | Universitat de Barcelona. Passeig de la Vall d'Hebron 171, Edifici Llevant P3, Barcelona, 08035 Spain. e-mail: der@greav.net; Web site: http://revistes.ub.edu/index.php/der |
| Peer Reviewed: | Y |
| Page Count: | 16 |
| تاريخ النشر: | 2024 |
| نوع الوثيقة: | Journal Articles Reports - Research |
| Descriptors: | Artificial Intelligence, Visual Aids, Video Technology, Tests, Test Format, Test Reliability, Active Learning, Student Projects, Evaluation, Technology Uses in Education |
| تدمد: | 2013-9144 |
| مستخلص: | This study aims to examine the potential differences between teacher evaluations and artificial intelligence (AI) tool-based assessment systems in university examinations. The research has evaluated a wide spectrum of exams including numerical and verbal course exams, exams with different assessment styles (project, test exam, traditional exam), and both theoretical and practical course exams. These exams were selected using a criterion sampling method and were analyzed using Bland-Altman Analysis and Intraclass Correlation Coefficient (ICC) analyses to assess how AI and teacher evaluations performed across a broad range. The research findings indicate that while there is a high level of proficiency between the total exam scores assessed by artificial intelligence and teacher evaluations; medium consistency was found in the evaluation of visually based exams, low consistency in video exams, high consistency in test exams, and low consistency in traditional exams. This research is crucial as it helps to identify specific areas where artificial intelligence can either complement or needs improvement in educational assessment, guiding the development of more accurate and fair evaluation tools. |
| Abstractor: | As Provided |
| Entry Date: | 2024 |
| رقم الانضمام: | EJ1434329 |
| قاعدة البيانات: | ERIC |
| تدمد: | 2013-9144 |
|---|