考虑题目选项信息的非参数认知诊断计算机自适应测验  

Nonparametric cognitive diagnostic computerized adaptive testing using multiple-choice option information

作　　者：孙小坚 郭磊[3,4] SUN Xiaojian;GUO Lei(School of Mathematics and Statistics,Southwest University,Chongqing 400715,China;Basic Education Research Centre,Southwest University,Chongqing 400715,China;Southwest University Branch,Collaborative Innovation Center of Assessment for Basic Education Quality,Chongqing 400715,China;Faculty of Psychology,Southwest University,Chongqing 400715,China)

机构地区：[1]西南大学数学与统计学院 [2]西南大学基础教育研究中心 [3]中国基础教育质量监测协同创新中心西南大学分中心 [4]西南大学心理学部,重庆400715

出　　处：《心理学报》2022年第9期1141-1154,共14页Acta Psychologica Sinica

基　　金：国家自然科学基金青年项目(31900793);中央高校基本科研业务费专项资金(SWU2109222);中国科普研究所委托项目(210105ESR056);2020年度重庆市博士后特别资助项目资助。

摘　　要：选择题中的作答选项能提供额外诊断信息,为充分利用选项信息,研究提出认知诊断计算机自适应测验(CD-CAT)中两种处理选择题选项信息的非参数选题策略和变长终止规则。模拟研究的结果发现:(1)定长条件下两种非参数选题策略的分类准确性整体要高于参数选题策略;(2)两种非参数选题策略较参数选题策略具有更加均衡的题库使用情况;(3)非参数选题策略在两种新的变长终止规则下具有更高的分类准确率;(4)两种非参数选题策略均适用于选择题CD-CAT情境,使用者可任选其一进行测验分析。Most existing cognitive diagnostic computerized adaptive testing(CD-CAT)item selection methods ignore the diagnostic information that distractors provide for multiple-choice(MC)items.Consequently,some useful information is missed and resources are wasted.To overcome this,researchers proposed the Jensen-Shannon divergence(JSD)strategy to select items with the MC-DINA model.However,the JSD strategy needs large samples to obtain reliable estimates of the item parameters before the formal test,and this could compromise the items in the bank.By contrast,the nonparametric method does not require any parameter calibration before the formal test and can be used in small educational programs.The current study proposes two nonparametric item selection methods(i.e.,HDDmc and JDDmc)for CD-CAT with MC items as well as two termination rules(i.e.,MR and DR)for variable-length CD-CAT with MC items.Two simulation studies were conducted to examine the performance of these nonparametric item selection methods and termination rules.The first study examined the performance of the HDDmc and JDDmc with fixed-length CD-CAT.In this study,six factors were manipulated:the number of attributes(K=4 vs.6),the structure of the Q-matrix(simple vs.complex),the quality of the item bank(high vs.low vs.mixed),the distribution of the attribute profile(multivariate normal threshold model vs.discrete uniform distribution),the test length(two vs.three vs.four times of K),and the item selection methods(HDDmc vs.JDDmc vs.JSD).Of these,item selection method was the within-group variable,and the rest were between-group variables.The results showed that:(1)the HDDmc and JDDmc produced higher attribute pattern matched ratios(PMRs)than the JSD method for most conditions;(2)the HDDmc and JDDmc produced similar PMRs for all conditions;(3)the HDDmc and JDDmc produced more even distributions of item exposure than the JSD method.The second simulation study investigated the performance of the MR and DR with variable-length CD-CAT.Six factors were also manipulated i

关 键 词：认知诊断计算机自适应测验 题目选项信息 非参数选题策略 变长终止规则 

分 类 号：B841[哲学宗教—基础心理学]