Applying a resources framework to analysis of the Force and Motion Conceptual Evaluation

We suggest one redefinition of common clusters of questions used to analyze student responses on the Force and Motion Conceptual Evaluation. Our goal is to propose a methodology that moves beyond an analysis of student learning defined by correct responses, either on the overall test or on clusters of questions defined solely by content. We use the resources framework theory of learning to define clusters within this experimental test that was designed without the resources framework in mind. We take special note of the contextual and representational dependence of questions with seemingly similar physics content. We analyze clusters in ways that allow the most common incorrect answers to give as much, or more, information as the correctness of responses in that cluster. We show that false positives can be found, especially on questions dealing with Newton’s third law. We apply our clustering to a small set of data to illustrate the value of comparing students’ incorrect responses which are otherwise identical on a correct or incorrect analysis. Our work provides a connection between theory and experiment in the area of survey design and the resources framework.

Figure 1

Questions 1–7 of the FMCE 3: contained within original Force (Newton I and II) cluster and revised Force Sled cluster.

Figure 2

Questions 14–21 of the FMCE 3: contained within original Force (Newton I and II) cluster and revised Force Graphs cluster.

Figure 3

Questions 8–13 of the FMCE 3: contained within original Force (Newton I and II) cluster and revised Reversing Direction cluster.

Figure 4

The mass dependence and action dependence resources may be derived from universal primitives and observations of a scenario.

Figure 5

Responses $f$ and $g$ for the Acceleration Graphs cluster.

Figure 6

Questions involving collisions within the Newton III cluster of the FMCE. Please note that question 33 is not included within analysis of the FMCE. 14

Figure 7

The mass dependence and action dependence resources may be used together to cancel out some of their effects based on the situation (as in question 31).

Figure 8

Questions involving one vehicle pushing another within the Newton III cluster of the FMCE. Please note that questions 35 and 37 are not included within analysis of the FMCE (Ref. 14).

Figure 9

Responses $c$ and $h$ for the Velocity Graphs cluster.