Designing a Usability Assessment Process for Adaptive Intelligent Tutoring Systems: A Case Study


ERÜMİT A. K., ÇETİN İ., KOKOÇ M., KÖSA T., NABİYEV V., AYGÜN E. s.

Turkish Online Journal of Qualitative Inquiry, vol.10, no.1, pp.141-179, 2019 (Peer-Reviewed Journal) identifier

  • Publication Type: Article / Article
  • Volume: 10 Issue: 1
  • Publication Date: 2019
  • Journal Name: Turkish Online Journal of Qualitative Inquiry
  • Journal Indexes: TR DİZİN (ULAKBİM)
  • Page Numbers: pp.141-179
  • Ondokuz Mayıs University Affiliated: Yes

Abstract

This study aims at examining the usability evaluation process of ArtiBos, an adaptive intelligenttutoring system specifically designed for teaching of problem solving, and proposing usabilityevaluation recommendations accordingly. The study group consists of 90 students selected from 3different secondary education institutions and 30 experts from the fields of Computer Education andInstructional Technology and Mathematics Teaching. The usability of ArtiBos is evaluated accordingto the criteria of effectiveness, efficiency, and satisfaction included in the definition of usability by theInternational Standards Organization (ISO). In this study, quantitative and qualitative data were usedfor triangulation. Study data included users’ screenshots during performance of the instructed tasks inArtiBos, sound recordings taken from the think aloud technique, interviews with students, andopinions of experts. The study elaborates the procedure of usability tests of ArtiBos and makessuggestions for usability evaluation processes of similar systems. The results are expected to guideresearchers planning to carry out similar systems’ usability studies.