Design and Implementation of Online Reasoning Chain Construction Assessment (ORCCA) tools

Author(s):
Megan Nagel
Chancellor and Chief Academic Officer
Penn State Greater Allegheny

In this talk, we will describe a multi-institutional interdisciplinary research project in which we are developing Online Reasoning Chain Construction Assessment (ORCCA) tools. These tools allow students to build an explanation for the answer to a question by selecting from a number of true statements about the task at hand. The use of these tasks leads students to generate richer explanations than may be present in traditional assessment formats, while not impacting the overall distribution of student conclusions. These explanations can provide teachers and researchers with insights into what information students deem helpful and relevant for responding to a prompt. These insights are wholly lacking from traditional free-response implementations of the same question. In this talk, we will describe how ORCCA tasks are constructed and provide illustrations of research questions that these tools can be used to answer.

Coauthors

Beth Lindsey, bal23@psu.edu; Mitchell Bruce, mbruce@maine.edu; Mila Kryjevskaia, mila.kryjevskaia@ndsu.edu; Caleb Speirs, caleb.speirs@gmail.com; MacKenzie Stetzer, mackenzie.stetzer@maine.edu; Alexey Leontyev, alexey.leontyev@ndsu.edu