认知诊断模型题目功能差异检验方法的健壮性比较  

A Comparison of Robustness of Differential Item Functioning Detection Methods inCognitive Diagnostic Models

作　　者：尹昊 周蔓 刘彦楼[2] 辛涛[3] YIN Hao;ZHOU Man;LIU Yanlou;XIN Tao(Qingdao University,Qingdao 266071,China;Qufu Normal University,Jining 273165,China;Beijing Normal University,Beijing 100875,China)

机构地区：[1]青岛大学,山东青岛266071 [2]曲阜师范大学,山东济宁273165 [3]北京师范大学,北京100875

出　　处：《中国考试》2021年第3期36-44,共9页journal of China Examinations

基　　金：山东省教育科学“十三五”规划2020年度教育招生考试专项“命题理论及试题库建设策略研究”(2020K2D009)。

摘　　要：在认知诊断模型中进行题目功能差异(DIF)的检测,目的在于保证测验的质量与效果。在以往研究的基础上,本研究重点探索在CDMs框架下,MH、LR、CSIBTEST、WObs、WSw、WXPD 6种DIF检测方法在Q矩阵是否正确设定以及有关DIF影响因素等条件下的表现。结果表明:在Q矩阵正确设定时,WObs、WSw和WXPD统计量表现要好于MH、LR和CSIBTEST方法;在Q矩阵错误设定时,6种方法都会出现Ⅰ类错误率膨胀和统计检验力较低的现象。相对而言,MH、LR和CSIBTEST方法的表现比较稳定,WObs、WSw和WXPD统计量的表现变化较大,WObs、WSw和WXPD统计量的Ⅰ类错误率和统计检验力的结果依然好于MH、LR、CSIBTEST方法。The purpose of detecting differential item functioning(DIF)in cognitive diagnosis models(CDMs)is to ensure the quality and effectiveness of the test.Based on the previous research,this research focuses on exploring the performance of the six DIF detection methods of MH,LR,CSIBTEST,WObs,WSw,WXPD under the conditions that Q-matrix is correctly specified or not and related DIF influencing factors in CDMs.The results show that WObs,WSw,WXPD methods have the best performance in controlling TypeⅠerror and power when Qmatrix is correctly specified.And when Q-matrix is misspecified,TypeⅠerror is inflated and low power among the six methods in this study.Relatively speaking,the performance of MH,LR and CSIBTEST methods is relatively stable,while the performance of WObs,WSw,WXPD is not.However,the performance of WObs,WSw,WXPD is still better than those of the MH,LR and CSIBTEST.

关 键 词：认知诊断模型 题目功能差异 测验质量 Q矩阵错误设定 Wald统计量 

分 类 号：G405[文化科学—教育学原理]