Academic Journal
Competency model development: The backbone of successful stealth assessments
| العنوان: | Competency model development: The backbone of successful stealth assessments |
|---|---|
| المؤلفون: | Rahimi, Seyedahmad, Almond, Russell, Ramírez‐Salgado, Andrea, Wusylko, Christine, Weisberg, Lauren, Song, Yukyeong, Lu, Jie, Myers, Ted, Wang, Bowen, Wang, Xiaomaon, Francois, Marc, Moses, Jennifer, Wright, Eric |
| المصدر: | Journal of Computer Assisted Learning ; ISSN 0266-4909 1365-2729 |
| بيانات النشر: | Wiley |
| سنة النشر: | 2024 |
| المجموعة: | Wiley Online Library (Open Access Articles via Crossref) |
| الوصف: | Background Stealth assessment is a learning analytics method, which leverages the collection and analysis of learners' interaction data to make real‐time inferences about their learning. Employed in digital learning environments, stealth assessment helps researchers, educators, and teachers evaluate learners' competencies and customize the learning experience to their specific needs. This adaptability is closely intertwined with theories related to learning, engagement, and motivation. The foundation of stealth assessment rests on evidence‐cantered design (ECD), consisting of four core models: the Competency Model (CM), Evidence Model, Task Model, and Assembly Model. Objective The first step in designing a stealth assessment entails producing operational definitions of the constructs to be assessed. The CM establishes a framework of latent variables representing the target constructs, as well as their interrelations. When developing the CM, assessment designers must produce clear descriptions of the claims associated with the latent variables and their states, as well as sketch out how the competencies can be measured using assessment tasks. As the designers elaborate on the assessment model, the CM definitions need to be revisited to make sure they work with the scope and constraints of the assessment. Although this is the first step, problems at this stage may result in an assessment that does not meet the intended purpose. The objective of this paper is to elucidate the necessary steps for CM development and to highlight potential challenges in the process, along with strategies for addressing them, particularly for designers without much formal assessment experience. Method This paper is a methodological exposition, showcasing five examples of CM development. Specifically, we conducted a qualitative retrospective analysis of the CM development procedure, wherein participants unfamiliar with ECD applied the framework and showcased their work. In a stealth assessment course, four groups of students ... |
| نوع الوثيقة: | article in journal/newspaper |
| اللغة: | English |
| DOI: | 10.1111/jcal.13025 |
| الاتاحة: | http://dx.doi.org/10.1111/jcal.13025 https://onlinelibrary.wiley.com/doi/pdf/10.1111/jcal.13025 |
| Rights: | http://onlinelibrary.wiley.com/termsAndConditions#vor |
| رقم الانضمام: | edsbas.57194D1D |
| قاعدة البيانات: | BASE |
| DOI: | 10.1111/jcal.13025 |
|---|