Design of Assessment Task Analytics Dashboard Based on Elo Rating in E-Assessment


Keskin S., Aydın F., Yurdugül H.

Assessment Analytics in Education , Muhittin Sahin,Dirk Ifenthaler, Editör, Springer Nature, Mannheim, ss.173-188, 2024

  • Yayın Türü: Kitapta Bölüm / Araştırma Kitabı
  • Basım Tarihi: 2024
  • Yayınevi: Springer Nature
  • Basıldığı Şehir: Mannheim
  • Sayfa Sayıları: ss.173-188
  • Editörler: Muhittin Sahin,Dirk Ifenthaler, Editör
  • Van Yüzüncü Yıl Üniversitesi Adresli: Evet

Özet

Elo Rating’s simplicity and ease of use in formative assessment appeals to researchers and practitioners since there is a growing need for practical algorithms that rely on few assumptions. Originally developed as a model for pairwise ratings of chess players, Elo is also used in educational contexts. In formative assessment environments where students can assess their own learning, students are challenged with assessment tasks. As a result of this challenge, if the student successfully completes the assessment task, it can be considered that the student has won the struggle against the assessment task, and if not, it can be considered that the student has lost. This study aimed to present an innovative e-assessment system in which students are challenged with questions, and the grades of both learners and assessment tasks are determined by the Elo Rating algorithm. As a result of the duels between students and assessment tasks, the dynamically calculated scores for both sides were discussed in the context of assessment analytics. Elo rating facilitates the simultaneous estimation of both learner skill and task difficulty, offering an approach for dynamically recalculating and updating these parameters during the interaction with tasks. Moreover, the results obtained are presented through a comprehensive dashboard, providing educators with valuable insights into individual and group performance. The study suggests considering Elo for immediate solutions with smaller sample sizes and employing more complex methods for heightened sensitivity in e-assessment. The authors propose potential modifications, such as adjusting the k factor and exploring intermediate values for success-failure parameters, for future research.