The Role of Time on Performance Assessment (Self, Peer and Teacher) in Higher Education: Rater Drift

Authors : Hikmet Şevgin, Mehmet Şata

Pages : 98-118

Doi:10.17275/per.23.77.10.5

View : 102 | Download : 66

Publication Date : 2023-09-01

Article Type : Research Article

Abstract :This study aimed to investigate the change in teacher candidates\' oral presentation skills over time through self, peer, and teacher assessments using the rater drift method. A longitudinal descriptive research model was used as a quantitative research approach to achieve this aim. The study group consisted of 47 teacher candidates receiving formation education at a state university in the Eastern Anatolia Region and an instructor teaching the course. An analytical rubric was used as a data collection tool to evaluate the candidates\' oral presentation skills. The data collection process lasted six weeks in total. Since the performance evaluation process aimed to examine the change over time, the many-facet Rasch model was used. When the findings of the study were examined, it was determined that the rater behavior of teacher candidates had statistically significant differences at the group level over time. It was found that 26 out of 48 peer raters had rater drift in their evaluations. It was also found that the majority of rater drift over time was positive, meaning that evaluators became more generous over time. Another result obtained in the study was that teacher assessment did not show rater drift over time, with similar ratings for six weeks. The study’s findings were discussed with previous studies in the literature, and recommendations were made to researchers.
Keywords : Rater drift, presentation skills, many-facet rasch, reliability, validity