基于题目作答时间信息的认知诊断模型  

Cognitive Diagnosis Modelling Based on Response Times

作　　者：郑天鹏 周文杰 郭磊 Zheng Tianpeng;Zhou Wenjie;Guo Lei(Faculty of Psychology,Southwest University,Chongqing,400715;Hanhong College,Southwest University,Chongqing,400715;Southwest University Branch,Collaborative Innovation Center of Assessment toward Basic Education Quality,Chongqing,400715)

机构地区：[1]西南大学心理学部,重庆400715 [2]西南大学含弘学院,重庆400715 [3]中国基础教育质量监测协同创新中心西南大学分中心,重庆400715

出　　处：《心理科学》2023年第2期478-490,共13页Journal of Psychological Science

基　　金：国家自然科学基金项目(31900793);中央高校基本科研业务费专项资金(SWU2109222);北京师范大学中国基础教育质量监测协同创新中心重大成果培育性项目(2019-06-023-BZPK01);国家级大学生创新创业训练计划项目(202010635073)的资助。

摘　　要：在认知诊断评估中利用过程性数据,如作答时间信息,能进一步提升诊断精度。通过建立被试正确作答概率与个体速度参数之间的回归模型,开发了更简洁的新模型:RRT-DINA模型。采用实证与模拟研究,与JRT-DINA模型比较,探讨了新模型的性能。PISA2012数据研究表明,RRT-DINA模型的拟合效果更好。模拟研究结果表明:(1)RRT-DINA模型可采用MCMC算法实现参数估计,估计精度较高。(2)当以RRT-DINA生成数据时,RRT-DINA的题目参数估计精度优于JRTDINA;当以JRT-DINA生成数据时,JRT-DINA的题目参数估计精度稍微优于RRT-DINA。(3)当以RRT-DINA生成数据时,RRT-DINA的判准率优于JRT-DINA模型;当以JRT-DINA生成数据时,JRT-DINA的判准率稍微优于RRT-DINA,且差距较小。The development of computer-based assessments can collect process data for different test evaluation purposes.In current psychological measurement modeling,response time is the most frequently studied process data in log files.The use of response time in cognitive diagnosis assessment can further improve the accuracy of diagnosis.However,almost all of the cognitive diagnosis models(CDMs),particularly those involving response time,pay little attention to process data.Recently,a few CDMs,concerning item response times,have been developed,such as the JRT-DINA model(Zhan,Jiao et al.,2018).In this paper,a more concise CDM,named the RRT-DINA(Reduced Response Times DINA)model was proposed via constructing a direct relationship between the probability of correct responses and person speed parameter.Furthermore,the MCMC algorithm was applied to estimate both item and person parameters of the RRT-DINA model.Firstly,an empirical study was conducted to compare the performances,which were evaluated by the PISA2012 data,of the RRT-DINA model and JRT-DINA model respectively.The results showed that comparing with JRT-DINA model,the new model had lower-2LL,AIC,BIC and DIC values,which indicated that the new model fitted this empirical data better.Secondly,to further verify the performance of the new model,four factors were investigated in the simulation study,i.e.,the sample size(500 examines,1000 examines,2000 examines),the test length(15 test items,30 test items),the number of cognitive attributes(3,5,7)and the types of data generation models(RRT-DINA and JRT-DINA).The results of simulation studies revealed that:(1)When using the RRT-DINA model to generate the data,the recovery of item parameters and person speed parameters of the new model was decent.Moreover,the accuracy of parameter estimation in both CDMs would be higher with the increase of the test length,on the whole.Meanwhile,the AACCR and PCCR values obtained from the RRT-DINA model were much more precise than those got from the JRT-DINA model.Under the biggest gap,the

关 键 词：过程性数据 题目作答时间 认知诊断模型 MCMC算法 PISA2012 

分 类 号：B842.1[哲学宗教—基础心理学]