摘要
为提高对高分作弊者和低抄袭比例作弊者的检验力,模拟600名考生的作答,设置3种抄袭比例(60%,80%和100%)和3种抄袭源能力(能力百分等级为60%,80%和100%),设计两阶段作弊甄别法,第一阶段使用lz指数筛选个人拟合差的异常考生,第二阶段针对这些异常考生使用ω指数进行精确甄别。结果表明该法对高分作弊者和低抄袭比例作弊者的检验力优于仅使用答案抄袭检测法。
Answer copying detection method is one of the most widely used statistical methods in detecting cheaters,however,its power is unsatisfactory for cheaters with high scores or low amount of cheating.To overcome these weaknesses,a two-stage cheating detection method was proposed in this research by making use of information from both multiple-choice items that are easy to copy and constructive items that are difficult to copy.In the first stage of detection,personal fit detection method was used to detect discrepancy of ability information between two types of items on every examinee.Then,examinees performing excessive discrepancy could be regarded as cheating suspects who were going to be detected further in the second stage by the answer copying detection method.In this way,we could find cheaters more accurately.Present research simulated 600 responses of both common examinees and cheaters based on the item parameters estimated from the real data of the Beijing Art Combination Test of College Entrance Examination.To be precise,item parameters derived from 35 multiple choice items by Nominal Response Model and 13 constructive items by Partial Credit Model.600 examinees were distributed in 20 examination rooms with 30 examinees in each one.The ability of copiers were at least inferior to 50%of the other examinees,and they copied the answers from the source in the same examination room,with 3 levels of the ability(exceeding 100%,80%and 60%of the other examinees)and 3 levels of copy proportion(100%,80%and 60%).The two-stage cheating detection method with lz-index in the first stage andω-index in the second stage was used for evaluating personal fit according to the degree of discrepancy that examinees performed between multiple choice items and subjective items,then detecting the agreement in the responses of multiple-choice items of examinees with aberrant response in the first stage with other examinees.Results showed that the proportion of copying had a significant impact on the efficiency of the two stage cheating detection method,the higher the proportion of copying,the higher the correct detection rate,the lower the false rate.Compared to the detection result of onlyω-index,the twostage cheating detection method had a much better performance in the detection rate and false rate.As for cheaters with high scores or low proportion of cheating number,compared to a detection rate of only 7.8%~39.55%along with very high false rate in answer copy detection method only,this new method with two stage could achieve an impressive detection rate of 27%~62.1%along with very low false rate near 0.Overall,by integrating the information of both multiple choice and constructive items,making full use of the difference in cheating difficulty in two type of items,combining the advantage of answer copy detection method and personal fit methods,the two-stage cheating detection method increases detection rate and decreases the false rate,especially for cheaters with high scores or low proportion of cheating number.The thought of excluding common examinees in cheating detection widen the research approach and scope of application.To summarize,it is an important innovation to develop the detection method,no matter in the practice of real cheating detection examination or theory research.
作者
黄美薇
潘逸沁
骆方
Huang Meiwei;Pan Yiqin;Luo Fang(Collaborative Innovation Center of Assessment toward Basic Education Quality,Beijing Normal University,Beijing,100875;School of Psychology,Beijing Normal University,Beijing,100875)
出处
《心理科学》
CSSCI
CSCD
北大核心
2020年第1期75-80,共6页
Journal of Psychological Science
基金
国家自然科学基金青年科学基金项目(61807005)的资助.
关键词
两阶段作弊甄别方法
答案抄袭检测法
个人拟合检测法
选择题
主观题
two-stage cheating detection
answer copying detection method
personal fit detection method
multiple choice items
constructive questions
作者简介
通讯作者:骆方。E-mail:luof@bnu.edu.cn
