Title: A comparison of a computerised adaptive test for mathematics instruction with the classical test

Authors: Jiyou Jia; Yuyue Zhang; Huixiao Le

Addresses: Department of Educational Technology, Graduate School of Education, Peking University, Beijing, China ' Department of Educational Technology, Graduate School of Education, Peking University, Beijing, China ' Department of Educational Technology, Graduate School of Education, Peking University, Beijing, China

Abstract: The computerised adaptive test (CAT) may enable individualised and adaptive homework and assessment which seem difficult to be practised in traditional school settings. The authors developed a web-based mathematics intelligent assessment and tutoring system (MIATS) assessing the learner's math content mastery status by a CAT. This research uses a simulation experiment to simulate the performance of 53 middle school students who used all questions included in the MIATS with their authentic answers in the CAT. The data analysis shows that the trait values measured by a CAT have significantly strong and positive coefficients with the correctness rates measured by a classical test with the same questions from the CAT. The data visualisation of questions used in the CAT and the question sequences demonstrate that all the examinees complete the CAT with differentiated questions and various pathways. This research innovatively provides convincing evidence for the effectiveness and equality of the CAT.

Keywords: computerised adaptive test; CAT; personalised assessment; mathematics assessment; mathematics intelligent assessment and tutoring system; MIATS; assessment result; personalised homework.

DOI: 10.1504/IJMLO.2024.139640

International Journal of Mobile Learning and Organisation, 2024 Vol.18 No.3, pp.270 - 284

Received: 12 Oct 2022
Accepted: 06 Dec 2022
Published online: 05 Jul 2024 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article