允许检查并修改答案的计算机化自适应测验  

Research on Computerized Adaptive Testing that Allows Reviewing and Changing Answers

作　　者：陈平[1] 丁树良[2] 

机构地区：[1]北京师范大学发展心理研究所,北京100875 [2]江西师范大学计算机信息工程学院,南昌330027

出　　处：《心理学报》2008年第6期737-747,共11页Acta Psychologica Sinica

基　　金：国家自然科学基金项目(60263005);江西省教育厅科技项目(GJJ08154);江西省高校人文社科研究项目(JY06201);全国教育考试科研规划项目(2006JKS3063);卫生部课题(KY200704,JM20060070)资助

摘　　要：采用计算机模拟程序对允许检查并修改答案的计算机化自适应测验(CAT)进行研究,并采用新的评分方式对付Wainer策略。结果表明:综合考虑被试的两次作答信息可以得到更精确的能力估计值。大部分被试进行了修改,只有少部分答案被修改,在被修改的答案中大部分是由错误改为正确;综合Wainer策略CAT的后验分布期望值(EAP)和极大似然估计值(MLE)可以"粗糙"对付Wainer策略。In the past decade, some paper - and - pencil （P＆P） tests have been replaced by computerized adaptive testing （CAT） within many large - scale standardized testing programs. However, many researches and applications on CAT had limitations because most of the CAT did not allow examinees to review and change their answers. Among the operative CAT applications, there was only one that incorporated item review. Not allowing examinees to review and change their answers would result in test pressure and affect their performances. Moreover, a majority of examinees manifested a clear preference for item review because they believed that the inclusion of item review made the test fairer and considered it to be a disadvantage if review was disallowed. The CAT test organizers did not allow examinees to review and change answers mainly because they were apprehensive that examinees would use the deceptive Wainer strategy in the review stage to obtain positively biased ability estimates, consequently affecting the fairness and precision of the test. If we could provide a solution that not only allowed examinees to review and change answers but that was also able to dealwith the Wainer strategy, the meaning would be great for the development of CAT. Until now, there have been few relevant studies on this topic worldwide. Moreover, the previous studies had a nonnegligible disadvantage, in that the researchers only recorded the answers of the review stage and used them as a basis for scoring, without considering the answers of the adaptive stage. We assumed that comprehensively considering the answers before and after review could produce a more accurate ability estimation. Therefore, this paper employed a new scoring method and attempted to deal with the Wainer strategy：Vaj=Beta×Uaj＋（1-Beta）×Ua,j＋m This study involved two experiments. Experiment 1 used the Monte Carlo method to simulate the entire process of CAT that allows the reviewing and changing of answers, with the aim of investigating the influence o

关 键 词：计算机化自适应测验 项目检查 Wainer策略 蒙特卡洛模拟 

分 类 号：B841.7[哲学宗教—基础心理学]