多值评分CD-CAT的选题策略研究  

Research on Item Selection Algorithm of Polytomous Scored Cognitive Diagnostic Computerized Test

作　　者：高旭亮 王芳 赵鹏娟 Gao Xuliang;Wang Fang;Zhao Pengjuan(School of Psychology,Mental Health Education and Counseling Center,Guizhou Normal University,Guiyang,550025)

机构地区：[1]贵州师范大学心理学院,贵州师范大学心理健康教育与咨询中心,贵阳550025

出　　处：《心理科学》2023年第2期461-469,共9页Journal of Psychological Science

基　　金：贵州省科技计划项目(黔科合基础-ZK[2021]一般123);贵州省教育厅高校人文社会科学研究项目(2020QN018)的资助。

摘　　要：认知诊断计算机化自适应测验(Cognitive diagnosis computerized adaptive testing, CD-CAT)为心理和教育评估测验的发展提供了新的视角。目前,关于CD-CAT的研究主要是基于二值评分的模型展开,但是,在实际应用领域,存在很多多值评分数据。高效的选题方法是CD-CAT程序成功的核心要素,本研究提出了两种新的多值评分CD-CAT(polytomous CDCAT, PCD-CAT)的选题方法,期望后验方差(expected posterior variance, EPV)和最大期望距离(maximum expected distance,MED)。通过模拟实验比较了EPV和MED在PCD-CAT的效果。实验结果表明,与传统的选题方法相比,EPV和MED具有更高的测验精度和测验效率。最后,通过一个PISA数据分析检验了PCD-CAT在实际应用中的效果及其优势。The development of cognitive diagnostic computerized adaptive test(CD-CAT)provides a new perspective for obtaining information about students'mastery or nonmastery of a set of skills in the field of knowledge.In recent years,CD-CAT has received more and more attention in the field of educational evaluation and psychological evaluation.Effective item selection algorithm is the key to the success of CD-CAT system.To date,various item selection methods of CD-CAT have been proposed based on dichotomous cognitive diagnosis model(CDM).There are very few studies on the item selection algorithm of polytomous CD-CAT(PCD-CAT).However,in educational assessment,psychological evaluation and many other disciplines,there are a lot of polytomously scored data.The article explored the CD-CAT item-selection algorithm based on general polytomous diagnosis model,and proposed two PCD-CAT item selection algorithms,namely the maximum expected posterior variance(EPV),and the maximum expected distance(MED).The performance of the proposed item selection algorithms was evaluated through two simulation studies and compared with the KL,PWKL,and HKL algorithms in fixedlength and variable-length PCD-CAT.In the simulation experiment,the size of the item bank was 315,and the maximum score of each item was fixed at 3.The number of attributes was fixed to K=6.There were 64 possible attribute mastery vectors.For each attribute vector,1000 examinees were generated,and a total of 6400 examinees were simulated.In the first study,we manipulated three factors:the test length(10,15 and 20),item bank quality(high vs.low),and item selection algorithms(KL,PWKL,HKL,EPV and MED).The results of Study 1 showed that the pattern correct classification rate(PAR)of EPV and MED was significantly higher than that of KL,PWKL and HKL methods.The EPV and MED had similar PAR under most experimental conditions,but when the test length was short(for example,10 items),regardless of the quality of the item bank,the PAR of EPV was higher than that of MED.Under all conditions,

关 键 词：认知诊断 计算机化自适应测验 多值评分 

分 类 号：B842.1[哲学宗教—基础心理学]