Academic Journal
Latent Skill Mining and Labeling from Courseware Content
العنوان: | Latent Skill Mining and Labeling from Courseware Content |
---|---|
اللغة: | English |
المؤلفون: | Matsuda, Noboru, Wood, Jesse, Shrivastava, Raj, Shimmei, Machi, Bier, Norman |
المصدر: | Journal of Educational Data Mining. 2022 14(2):1-31. |
الاتاحة: | International Educational Data Mining. e-mail: jedm.editor@gmail.com; Web site: https://jedm.educationaldatamining.org/index.php/JEDM |
Peer Reviewed: | Y |
Page Count: | 31 |
تاريخ النشر: | 2022 |
Sponsoring Agency: | National Science Foundation (NSF) |
Contract Number: | 1623702 2016966 |
نوع الوثيقة: | Journal Articles Reports - Research |
Descriptors: | Skills, Models, Identification, Courseware, MOOCs, Natural Language Processing, Data Analysis, Task Analysis, Program Evaluation, Automation |
تدمد: | 2157-2100 |
مستخلص: | A model that maps the requisite skills, or knowledge components, to the contents of an online course is necessary to implement many adaptive learning technologies. However, developing a skill model and tagging courseware contents with individual skills can be expensive and error prone. We propose a technology to automatically identify latent skills from instructional text on existing online courseware called SMART (Skill Model mining with Automated detection of Resemblance among Texts). SMART is capable of mining, labeling, and mapping skills without using an existing skill model or student learning (aka response) data. The goal of our proposed approach is to mine latent skills from assessment items included in existing courseware, provide discovered skills with human-friendly labels, and map didactic paragraph texts with skills. This way, mapping between assessment items and paragraph texts is formed. In doing so, automated skill models produced by SMART will reduce the workload of courseware developers while enabling adaptive online content at the launch of the course. In our evaluation study, we applied SMART to two existing authentic online courses. We then compared machine-generated skill models and human-crafted skill models in terms of the accuracy of predicting students' learning. We also evaluated the similarity between machine-generated and human-crafted skill models. The results show that student models based on SMART-generated skill models were equally predictive of students' learning as those based on human-crafted skill models--as validated on two OLI (Open Learning Initiative) courses. Also, SMART can generate skill models that are highly similar to human-crafted models as evidenced by the normalized mutual information (NMI) values. |
Abstractor: | As Provided |
Entry Date: | 2023 |
رقم الانضمام: | EJ1362652 |
قاعدة البيانات: | ERIC |
تدمد: | 2157-2100 |
---|