A Comparison of Video-Based and Interaction-Based Affect Detectors in Physics Playground

Item request has been placed! ×
Item request cannot be made. ×
loading   Processing Request
Read Online Read More Add to Saved list
  • Additional Information
    • Availability:
      International Educational Data Mining Society. e-mail: [email protected]; Web site: http://www.educationaldatamining.org
    • Peer Reviewed:
      N
    • Source:
      8
    • Sponsoring Agency:
      National Science Foundation (NSF)
      Bill and Melinda Gates Foundation
    • Contract Number:
      DRL 1235958
    • Education Level:
      Grade 8
      Junior High Schools
      Middle Schools
      Elementary Education
      Secondary Education
      Grade 9
      High Schools
    • Subject Terms:
      Video Technology; Interaction; Physics; Affective Behavior; Educational Technology; Technology Uses in Education; Science Instruction; Nonverbal Communication; Student Behavior; Games; Measurement Techniques; Prediction; Grade 8; Grade 9; Pretests Posttests; Observation; Coding; Scientific Principles; Concept Formation; Scientific Concepts; Statistical Analysis
    • Abstract:
      Increased attention to the relationships between affect and learning has led to the development of machine-learned models that are able to identify students' affective states in computerized learning environments. Data for these affect detectors have been collected from multiple modalities including physical sensors, dialogue logs, and logs of students' interactions with the learning environment. While researchers have successfully developed detectors based on each of these sources, little work has been done to compare the performance of these detectors. In this paper, we address this issue by comparing interaction-based and video-based affect detectors for a physics game called Physics Playground. Specifically, we report on the development and detection accuracy of two suites of affect and behavioral detectors. The first suite of detectors applies facial expression recognition to video data collected with webcams, while the second focuses on students' interactions with the game as recorded in log-files. Ground-truth affect and behavior annotations for both face- and interaction-based detectors were obtained via live field observations during game-play. We first compare the performance of these detectors in predicting students' affective states and off-task behaviors, and then proceed to outline the strengths and weakness of each approach. [For complete proceedings, see ED560503.]
    • Abstract:
      As Provided
    • Number of References:
      41
    • Publication Date:
      2015
    • Accession Number:
      ED560544