Addressing Common Concerns about Online Student Ratings of Instruction: A Research-Informed Approach

Canadian Society for the Study of Higher Education. P.O. Box 34091, RPO Fort Richmond, Winnipeg, MB R3T 5T5, Canada. Tel: 204-474-6404; Fax: 204-474-7561; e-mail: [email protected]; Web site: http://csshe-scees.ca/publications/canadian-journal-of-higher-education/

Y

17

Academic Achievement; Student Evaluation of Teacher Performance; Foreign Countries; Questionnaires; Undergraduate Students; Comparative Analysis; Correlation; Intellectual Disciplines; Response Rates (Questionnaires); Rating Scales; Electronic Learning

0316-1218

Concerns over the usefulness and validity of student ratings of instruction (SRI) have continued to grow with online processes. This paper presents seven common and persistent concerns identified and tested during the development and implementation of a revised SRI policy at a Canadian research-intensive university. These concerns include bias due to insufficient sample size, student academic performance, polarized student responses, disciplinary differences, class size, punishment of rigorous instructor standards, and timing of final exams. We analyzed SRI responses from two mandatory Likert scale questions related to the course and instructor, both of which were consistent over time and across all academic units at our institution. The results show that overall participation in online SRIs is representative of the student body, with academically stronger students responding at a higher rate, and the SRIs, themselves, providing evidence that may moderate worries about the concerns.

As Provided

39

2017

EJ1128616