基于《量表》的英语口语测试开发及效度验证研究  

An Empirical Research on the Development and Validation of a CSE-based Speaking Test

作　　者：齐林意 邸爱英[1] 刘欣刚[1] 朱江芹 罗茂菊 周楠[1] QI Linyi;DI Aiying;LIU Xingang;ZHU Jiangqin;LUO Maoju;ZHOU Nan(University of Electronic Science and Technology of China,Chengdu 611731,China)

机构地区：[1]电子科技大学,成都611731

出　　处：《中国考试》2024年第5期79-89,共11页journal of China Examinations

基　　金：教育部考试中心-英国文化教育协会2020年英语测评科研课题“An Empirical Study into the Validity ofa CSE-based Placement test in China’s Transnational Higher Education”(考协[2020]263号)。

摘　　要：《中国英语能力等级量表》(以下简称《量表》)为我国各学段的英语教、学、评实践提供了理论指导。基于《量表》中口语分量表的口头表达能力描述框架及相应分量表三级到六级的描述语,开发面向西部某高校非英语专业新生的入学后英语口语测试及评分标准,并基于Weir的社会-认知效度验证理论开展多项效度研究。结果表明:《量表》的口语能力描述语对口语测试能力构念的界定和评分标准的研制具有较好的指导作用;基于《量表》开发的口语测试能够准确评估学生的口语水平;基于该测试的口语评定对学生后续英语课程的学业成绩具有良好的预测性。Since the issue of China's Standards of English Language Ability(CSE),considerable research has been conducted,yet scant attention has been paid to its application in speaking assessments.This study addresses this gap by developing a CSE-based speaking test and its corresponding marking scheme to assess the entry speaking levels of non-English majors at a first-class university.The empirical evidence for its validity is investigated using Weir's social-cognitive validity framework,exploring CSE's role in guiding the development of speaking tests and thus offering an empirical case study in this regard.The study unfolded in two stages:the development of the speaking test and its marking scheme followed by a validation process.In stageⅠ,the test was developed based on the can-do descriptors of levels 3-6 of CSE subscales for oral expression.The constructs were defined as description,narration,argumentation,exposition and interaction,covering topics ranging from personal experience,interests,daily life scenarios,study,life choices to hot social events.The test form was designed as an Oral Proficiency Interview,including conversations with one interlocutor,individual mini-presentation and paired discussion.An analytic marking scheme was developed by drawing on criteria features of spoken language from CSE-level descriptors and adding in more discriminative adjectives or adverbs and descriptions of negative language performances.The scheme covers communication and interaction,fluency and coherence,language,and pronunciation.Subsequently,112 freshmen out of 530 were selected using stratified sampling to sit the final test,which was video recorded and double-marked after rigorous training on standardization and pilot marking.In stageⅡ,the study applied Weir's social-cognitive validity framework to assess the contextual,theoretic,scoring and predictive(criterion-related)validity of the test.Contextual and theoretic validity were explored through a post-test questionnaire,to elicit test takers'reflections on contextua

关 键 词：《中国英语能力等级量表》 口语测试 口语评分标准 社会-认知效度验证框架 

分 类 号：G405[文化科学—教育学原理]