改良单组设计下的跨年等值影响因素研究  

Influence Factors of Cross-Test-Cycles Linking:A Modified Single Group Design

作　　者：陈平 李潇 任赫 辛涛 Chen Ping;Li Xiao;Ren He;Xin Tao(Collaborative Innovation Center of Assessment for Basic Education Quality,Beijing Normal University,Beijing,100875)

机构地区：[1]北京师范大学中国基础教育质量监测协同创新中心,北京100875

出　　处：《心理科学》2023年第4期960-970,共11页Journal of Psychological Science

基　　金：汉考国际科研基金项目“基于我国大规模测评项目的跨年等值研究”(CTI2018B02);中国基础教育质量监测协同创新中心基础教育质量监测科研基金项目(2019-01-082-BZK01,2019-01-082-BZK02)的资助。

摘　　要：针对我国测评项目的高安全性需求,提出锚人与锚题相结合的新跨年等值设计,并采用基于实证数据的模拟研究方法探究等值方法、锚人数量、锚测验组卷方式和不同测验周期被试能力差异对等值精度的影响。结果表明:以上因素均影响等值精度且等值方法的影响突出。建议:(1)锚人较少时采用需量尺转换的等值方法;(2)锚测验组卷方式应与等值方法计算特点相匹配;(3)各周期被试能力差异较大时可酌情增加锚人或调整锚测验组卷方案。The implementation of the cross-test-cycles linking(CTCL)can achieve the longitudinal comparability of the test scores of each test cycle and then characterize the development trend of the examinee’s ability.The safety and efficiency of linking design,an important part of CTCL,is the premise to ensure the scientificity of CTCL scheme.International large-scale assessments(ILSAs)such as PISA,TIMSS and PIRLS all employ the non-equivalent groups anchor test(NEAT)design for CTCL.However,the NEAT design may have exposure risks.Thus it is unsuitable for LSAs in China that require a high level of test security.To this end,this study proposed a new CTCL design(i.e.,a modified single-group design)that is in line with the national conditions in China.The new design collected linking data by organizing some anchor examinees to answer some anchor items,that is,randomly selecting a linking sample from the examinees who took the new form to anwer the anchor test composed of items selected from the old form.For the new design,the equating method,the size of the linking sample,the length and item type of the anchor test,and the heterogeneity of examinee’s ability distribution across test cycles all will affect the equating precision of CTCL.Before applying it to practice,thus,this paper focused on delving into the five factors’influence on the equating precision of CTCL.To achieve this,a series of simulation studies were conducted by manipulating five factors.Specifically,four equating methods(fixed-parameter calibration[FPC],separate calibration&scale transformation[SC&ST],FPC&ST,and concurrent calibration&ST[CC&ST]),three levels of the linking sample size(1500,8000,and 18000),two levels of anchor test length(20 and 30),two item formats of the anchor test(mixed test consisting of multiple-choice and constructed-response items and only multiple-choice items),and two levels of mean difference of examinee’s ability distribution between the new and old forms(0.01and 0.25)were considered.The results showed that:(1)FPC&ST and

关 键 词：大规模测评项目 跨年等值方案 等值设计 项目反应理论(IRT)等值方法 

分 类 号：B841.7[哲学宗教—基础心理学]