Academic Journal
Toward CS1 Content Subscales: A Mixed-Methods Analysis of an Introductory Computing Assessment
| العنوان: | Toward CS1 Content Subscales: A Mixed-Methods Analysis of an Introductory Computing Assessment |
|---|---|
| المؤلفون: | Parker, Miranda C., Davidson, Matt J., Kao, Yvonne S., Margulieux, Lauren, Tidler, Zachary, Vahrenhold, Jan |
| المصدر: | Learning Sciences Faculty Publications |
| بيانات النشر: | ScholarWorks @ Georgia State University |
| سنة النشر: | 2023 |
| المجموعة: | Scholar Works @ Georgia State University |
| مصطلحات موضوعية: | assessment, CS1, subscales, concepts, factor analysis, Education, Instructional Media Design |
| الوصف: | Background and Context. There is a constant, demonstrated need for valid and reliable assessments in computing education research. While there exist assessments at a course-based level (e.g., CS1, Data Structures, Discrete math, etc.), instructors and researchers would also like concept-based subscales that are more fine-grained. However, assessments designed and validated at the course level need additional work to determine whether they can reliably and validly measure individual concepts. Objectives. In this paper, we explore the content and factor structure of an existing CS1 assessment, the Second CS1 (SCS1) assessment, which consists of nine CS1 concepts and three question types (definitional, code tracing, and code completion). We investigate the underlying structure of the assessment in terms of these concepts and question types to determine whether the assessment could be separated into subscales. Method. We used a mixed-methods approach to answer our research question. We first investigated the designer-intended subscales of concepts and question types using confirmatory factor analysis, constructing multiple models using data from 547 students.We then qualitatively coded the assessment using an established framework to better understand our findings. Finally, we used a combination of exploratory and confirmatory factor analysis to take a data-driven approach to understanding the underlying factor structure. Findings. We argue that SCS1 cannot discretely measure student knowledge in terms of the concepts or question types. However, more work is needed before the assessment can be split into reliable, valid, and useful subscales. Implications. We discuss the future work needed to create a CS1 assessment to fit the needs of the computer science education community; namely, the need to revise and expand SCS1 to more appropriately measure its intended constructs and to be used outside of controlled experiments. |
| نوع الوثيقة: | text |
| وصف الملف: | application/pdf |
| اللغة: | unknown |
| Relation: | https://scholarworks.gsu.edu/ltd_facpub/53; https://scholarworks.gsu.edu/context/ltd_facpub/article/1052/viewcontent/SCS1_Subscales_Koli_2023.pdf |
| DOI: | 10.1145/3631802.3631828 |
| الاتاحة: | https://scholarworks.gsu.edu/ltd_facpub/53 https://doi.org/10.1145/3631802.3631828 https://scholarworks.gsu.edu/context/ltd_facpub/article/1052/viewcontent/SCS1_Subscales_Koli_2023.pdf |
| Rights: | http://creativecommons.org/licenses/by-nc/4.0/ |
| رقم الانضمام: | edsbas.D3B54B22 |
| قاعدة البيانات: | BASE |
| DOI: | 10.1145/3631802.3631828 |
|---|