Which Data Sets Are Preferred by University Students in Learning Analytics Dashboards? A Situated Learning Theory Perspective

Institute for Operations Research and the Management Sciences (INFORMS). 5521 Research Park Drive Suite 200, Catonsville, Maryland 21228. Tel: 800-446-3676; Tel: 443-757-3500; Fax: 443-757-3515; e-mail: [email protected]; Web site: https://pubsonline.informs.org/journal/ited

Y

18

Learning Analytics; Learning Management Systems; Independent Study; Undergraduate Students; Foreign Countries; Situated Learning; Visual Aids; Graduate Students; Learner Engagement; Learning Theories; Student Attitudes; Data Analysis; Evaluation Methods

10.1287/ited.2023.0289

1532-0545

Scholarly interests in developing personalized learning analytics dashboards (LADs) in universities have been increasing. LADs are data visualization tools for both teachers and learners that allow them to support student success and improve teaching and learning. In most LADs, however, a teacher-centric, institutional view drives their designs, treating students only as passive end-users, which results in LADs being less useful to students. To address this limitation, we used a card-sorting technique and asked 42 students at a university in Northern Ireland to construct dashboards that reflect their priorities. Using a situated theory of learning as a lens and with the help of multiple qualitative methods, we collected data on what constitutes useful dashboards. Findings suggest that situated learning data sets, such as information on how students learn by talking and listening to others in their communities, need to be integrated into LADs. Students preferred to see the inclusion of qualitative narratives, self-directed learning data and financial information (money spent versus resources utilized) in LADs. As well as raising new questions on how such LADs could be designed, this study challenges institutional overreliance on measurable digital footprints as proxies for academic success. We call for recognizing the wider social learning that happens in landscapes of practice so that LADs become more useful to students.

As Provided

2024

EJ1426005