Machine learning analysis of student frames in open-structure lab courses

ORAL

Abstract

Many physics departments have recently reformed their laboratory curricula to open up the lab structure in order to teach students more authentic research practices. Yet some students still expect to confirm a particular theory, and some expect to have a low level of decision-making agency as they plan their experiments. We study these expectations through the theoretical construct of frames, where a frame is defined as a person's stable set of expectations about the activity taking place. We identify evidence of different frames in student written coursework. These frames include \textit{worksheet frame} (low decision-making agency, evidenced by a low degree of original experimental design ideas or justification and high overlap to the structure of the lab manual), \textit{confirmation frame} (low epistemic agency, evidenced by arguments that focus on confirming a particular theoretical result), and \textit{original investigation frame} (high epistemic and decision-making agency, evidenced by high degree of original argumentation and conclusion-making and independent and justified design ideas). We apply supervised and unsupervised machine learning methods to the students' written work to facilitate qualitative analysis and determine trends in student framing.

Authors

  • Rebeckah Fussell

    • Cornell University
  • Ruijie Jiang

    • Tufts University
  • Shuchin Aeron

    • Tufts University
  • N. G. Holmes

    • Cornell University