In Press

Sao Pedro, M., Baker, R., Gobert, J., Montalvo, O., & Nakama, A. (in press). Using Machine-Learned Detectors of Systematic Inquiry Behavior to Predict Gains in Inquiry Skills. Submitted to User Modeling and User-Adapted Interaction.

Abstract. We present work toward automatically assessing and estimating science inquiry skills as middle school students engage in inquiry within a physical science microworld. To do so, we generated machine-learned models that can detect when students test their articulated hypotheses, design controlled experiments, and engage in planning behaviors using two inquiry support tools. Models were trained using labels generated through a new method of manually hand-coding log files, “text replay tagging”. This approach led to detectors that can automatically and accurately identify these inquiry skills under student-level cross-validation. The resulting detectors can be applied at run-time to drive scaffolding intervention. They can also be leveraged to automatically score all practice attempts, rather than hand-classifying them, and build models of latent skill proficiency. As part of this work, we also compared two approaches for doing so, Bayesian Knowledge-Tracing and an averaging approach that assumes static inquiry skill level. These approaches were compared on their efficacy at predicting skill before a student engages in an inquiry activity, predicting performance on a paper-style multiple choice test of inquiry, and predicting performance on a transfer task requiring data collection skills. Overall, we found that both approaches were effective at estimating student skills within the environment. Additionally, the models’ skill estimates were significant predictors of the two types of inquiry transfer tests.

Keywords: scientific inquiry, exploratory learning environment assessment, skill prediction, machine-learned models, microworlds, behavior detection, designing and conducting experiments, Bayesian Knowledge-Tracing

ISLS logo

Related Articles

ISLS 2024 Reviewer Invitations

The ISLS 2024 team is thrilled to have received a large number of papers, posters, and symposia for this year’s annual meeting, a total of 893 submissions! We have currently sent out reviewer invitations to prior reviewers and 2024 submitters. If you fall under either of those categories and have NOT received an invitation and would like to volunteer, please check your email and spam folders.

JLS Outstanding Paper (2022): Utilizing dance resources for learning and engagement in STEM

This paper authored by Folashadé Solomon, Dionne Champion, Mariah Steele and Tracey Wright received the Outstanding Paper Award from the Journal of the Learning Sciences. As the selection panel comments, “By employing culturally responsive pedagogy, the authors established a connection between the learning of physics and dance education, thereby promoting access and equity…The meticulous analysis provided insights into how dance, as an embodied form of knowledge, facilitated a transformation in the black girls’ relationship with physics.”