Advance
Preprints are early versions of research articles that have not been peer reviewed. They should not be regarded as conclusive and should not be reported in news media as established information.
FULL MMANUSCRIPT.pdf (645.2 kB)
Download file

Simulated Computer Adaptive Testing Administration with Remote Proctoring for Offsite Assessment in Mathematics

Download (645.2 kB)
preprint
posted on 2021-10-28, 22:57 authored by Jumoke OladeleJumoke Oladele, Mdutshekelwa Ndlovu

This study examines remote proctoring as emerging practice for ascertaining the validity of offsite test administration regarding test security. While Computer Adaptive Testing (CAT) has the potentials for greater precision in determining examinees ability level, its gains can be jeopardized with off-site testing if the test is not ensured. This study simulated CAT assessment while focusing on item administration, varying the option of using pre-test items and how it impacts students' ability estimation and item exposure. Monte-Carlo simulation was employed to generate data for answering the research questions raised for the study. The study's findings revealed that CAT administration was more consistent with no pre-test items once tightly controlled at ±2theta level, upon which recommendations were made. This finding is particularly germane, with more institutions moving their assessments online and rapidly becoming a new normal as an aftermath of the Covid-19 pandemic.


The data for this study were generated from computer simulations using SimulCAT, a free software package designed by Dr. K. C. T. Han of Graduate Management Admission Council.

History

Declaration of conflicts of interest

None

Corresponding author email

jumokeo@uj.ac.za

Lead author country

  • South Africa

Lead author job role

  • Higher Education Researcher

Human Participants

  • No

Ethics statement

This study was exempted from obtaining informed consent by the Faculty of Education Research Ethics Committee of the University of Johannesburg because the data for the analysis were computer-simulated.

Comments (2)

Log in to write your comment here...

Interesting study! You may want to submit this as a chapter on the forthcoming book: "Socioeconomic Inclusion During an Era of Online Education" to be published by IGI Global, USA. More information here: https://www.igi-global.com/publish/call-for-papers/call-details/5573

Agreed terms and conditions name style

Usage metrics

    Advance: Social Sciences & Humanities

    Licence

    Exports