The Use of Process Data in Large-Scale Assessments: A Literature Review

Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: [email protected]; Web site: https://link.springer.com/

Y

33

Educational Assessment; Test Validity; Test Items; Reaction Time; Problem Solving; Test Wiseness; Writing (Composition); Information Technology; Scores; Behavior Patterns; Student Behavior

10.1186/s40536-024-00202-1

2196-0739

As the use of process data in large-scale educational assessments is becoming more common, it is clear that data on examinees' test-taking behaviors can illuminate their performance, and can have crucial ramifications concerning assessments' validity. A thorough review of the literature in the field may inform researchers and practitioners of common findings as well as existing gaps. This literature review used topic modeling to identify themes in 221 empirical studies using process data in large-scale assessments. We identified six recurring topics: response time models, response time-general, aberrant test-taking behavior, action sequences, complex problem-solving, and digital writing. We also discuss the prominent theories used by studies in each category. Based on these findings, we suggest directions for future research applying process data from large-scale assessments.

As Provided

2024

EJ1423259