The challenges of implementing computerized adaptive testing in Indonesia
Okky Riswandha Imawan
Educational Research and Evaluation, Universitas Negeri Yogyakarta, Special Region of Yogyakarta, and Mathematics Education, Universitas Cenderawasih, Papua, Indonesia.
https://orcid.org/0000-0002-9162-3822
Heri Retnawati
Mathematics Education, Universitas Cenderawasih, Papua, Indonesia.
https://orcid.org/0000-0002-1792-5873
Haryanto
Educational Research and Evaluation, Universitas Negeri Yogyakarta, Special Region of Yogyakarta, Indonesia.
https://orcid.org/0000-0003-3322-904X
Raoda Ismail
Educational Research and Evaluation, Universitas Negeri Yogyakarta, Special Region of Yogyakarta, and Mathematics Education, Universitas Cenderawasih, Papua, Indonesia.
https://orcid.org/0000-0003-0327-5766
DOI: https://doi.org/10.20448/jeelr.v12i2.6677
Keywords: Challenge, Computerized adaptive testing, Difficulty, Evaluation, Mathematics, Prospective elementary school teachers, Technology.
Abstract
This study explores the challenges of implementing computerized adaptive testing (CAT) for mathematics assessment among prospective elementary school teachers in Indonesia. It aims to describe (1) assessment practices of mathematics lecturers and (2) challenges in adopting CAT. Using a qualitative phenomenological approach, data were collected from 17 mathematics lecturers across Indonesia through questionnaires followed by in-depth interviews with four lecturers unfamiliar with or struggling to use CAT. Findings indicate that paper-and-pencil tests and computer- based testing (CBT) dominate university assessments. Key barriers to CAT adoption include limited lecturer knowledge and skills, technical constraints, inadequate infrastructure, and incompatibility with essay-based assessments. Despite these challenges, lecturers express interest in a more accessible and cost-effective CAT. The study concludes that lecturers acknowledge CAT’s potential to enhance fairness and accuracy in testing while they face difficulties in its implementation. A targeted CAT development program aligned with lecturers' needs with institutional support is essential for successful integration. CAT has the potential to improve assessment effectiveness and efficiency in Indonesian universities aligning with technological advancements and 21st-century education trends.