大学英语四、六级考试分数等值研究——一个基于铆题和两参数IRT模型的解决方案  

A STUDY OF SCORE EQUATING IN THE COLLEGE ENGLISH TEST: A NEW APPROACH BASED ON "ANCHOR ITEMS" AND TWO-PARAMETER IRT MODEL

作　　者：朱正才[1] 

机构地区：[1]上海交通大学外国语学院,上海200030

出　　处：《心理学报》2005年第2期280-284,共5页Acta Psychologica Sinica

基　　金：全国大学英语四;六级考试委员会的支持;国家社科基金项目(03BYY016)的资助

摘　　要：对现有的大学英语四、六级考试分数等值模式中存在的若干问题进行了深入的分析,并提出了新的解决方案———一个基于铆题设计和两参数IRT模型的解决方案。主要包括: ( 1 )用两参数逻辑斯蒂模型替代原来的Rasch模型,以改进题目模型的适合性; (2)用共同题目的等值设计取代原来的共同被试等值设计,解决共同被试等值设计中,等值考生的动机水平难以控制的难题; (3)建立专用的等值用题库,并且一次性完成其中铆题的预测和参数标定工作,以解决原来等值模式中存在的误差累积问题。同时,由于铆题的保密工作难度较小,因此,等值专用题库对保证等值结果的可靠性也具有重大意义; (4)本文还对新的分数等值方案进行了真实的考试数据等值计算实验,并得到了一个令人满意的分数等值结果。In China's College English Test (CET), Rasch model has been used in the score equating procedure for 15 years and lots of score equating data have been accumulated. This paper discusses in detail some demerits of the score equating method based on Rasch model, and introduces a new score equating approach based on 'anchor items' and two-parameters IRT model (the Item Response Theory model). It is assumed that for the old score equating method based on Rasch model: 1)The students in the control group give equal attention to both the formal and the control papers. 2)There has been no leakage of the items in either paper. 3) All items have the same Discrimination Index. A failure in assumption 1) would usually occur because the students feel that the control paper test is an extra burden to them and they often do not give it the same importance as the formal paper. In this case their marks on the control paper would be lower than their true performance. If the two papers were, in fact, equally easy or difficult they would score lower marks on the control paper, thus making it appear harder. This would have the effect of making the formal paper seem to be relatively easier and in the process of equating the students' marks would be reduced. If assumption 2) is not true and the control paper has not truly been kept confidential, the effects would be in the opposite direction. The candidates would do better than they should on the control paper, causing their marks on that paper to be relatively high in comparison with the formal test. The latter test would therefore appear to the equating algorithm to be harder than it really is and all the students' marks would be increased. Note that this would be true even if only a few items were leaked. For example, if just one Reading passage were leaked, together with the associated items, those five items would be scored correct for students who might otherwise have failed at least in some of them. Since reading items have double weight, this could falsely increase th

关 键 词：项目反应理论 分数等值 逻辑斯蒂模型. 

分 类 号：B841[哲学宗教—基础心理学]