英语教育测量与评价.doc

研究生学位课程试卷院（系、所） 外国语学院 专业 英语 考试科目 英语教育测量与评价 第 二 学期研究生姓名 戎竞雄 学号 132300176 考试成绩 导师评语： 导师签字 年 月 日说 明一、凡学位课程考试试题、试卷必须与本封面一起装订。阅卷导师务必用红笔批卷，并在本封面规定位置打分、写完评语后在二周（论文考试一个月）内交院（系、所）办公室教务员，教务员及时做好成绩登记，在学期结束前或第二学期初将成绩单交研究生处统一整理归档。试题、试卷由院（系、所）办公室保管。二、学位课程考试用纸除计算机专用打字纸、16开小方格稿子纸外，一律使用研究生处统一印制的“学位课程考试纸”。三、该封面请用A4纸双面打印，将此说明打印于封面背面。上海师范大学标准试卷2013 2014 学年 第二学期 考试日期 2014 年8 月 日 科目：英语教育测量与评价学科教学课程与教学论 专业 硕士 13 年级 姓名 戎竞雄 学号 _132300176_项目一二三四五六七八总分分值4555100得分我承诺，遵守上海师范大学考场规则，诚信考试。签名：_戎竞雄_I. Answer in detail the following questions: ( 45%, 15 points for each)1. Suggest the differences between proficiency tests and achievement tests. Give examples if necessary.Answer: A proficiency test assesses the general knowledge or skills commonly required for entry into a group of similar institutions. One example is TOEFL. Proficiency tests are norm-referenced tests because NRTs have all the qualities desirable for proficiency decisions. While an achievement test must be designed with very specific reference to a particular course. And the achievement tests are often directly based on course objectives and will therefore be criterion-referenced. Such tests will typically be administered at the end of a course to determine how effectively students have mastered the instructional objectives. Achievement tests must be not only very specifically designed to measure the objectives of a given course but also flexible enough to help teachers readily respond to what they learn from the test about the students abilities, the students needs, and the students learning of the course objectives. One example is the tests at the end of the course.2. The following are two different kinds of score distribution. What information do these two figures convey us? (Discuss from the score distribution of NRT and that of CRT)Answer: The first figure conveys us that it is a norm-referenced test, which is designed to measure global language abilities (for instance, overall English language proficiency including listening ability, reading comprehension, and so on). Each students score on such a test is interpreted relative to the scores of all other students who took the test. Such comparisons are usually done with reference to the concept of the normal distribution (familiarly known as the bell curve). The purpose of an NRT is to spread students out along a continuum of scores so that those with poor language abilities are at one end of the normal distribution, while those with high abilities are at the other end (with the bulk of the students falling near the middle). The second figure shows it is a criterion-referenced test (CRT), which is usually produced to measure well-defined and fairly specific objectives. Often these objectives are specific to a particular course or program. Each students score is meaningful without reference to the other students scores. A students score on a particular objective indicates the percent of the knowledge or skill in that objective that the student has learned. Moreover, the distribution of scores on a CRT need not necessarily be normal. If all the students know 100% of the material on all the objectives, then all the students should receive the same score.The purpose of a CRT is to measure the amount of learning that a student has accomplished on each objective. In most cases, the students would know in advance what types of questions, tasks, and content to expect for each objective.3. What is reliability and validity? What is the relationship between reliability and validity? To assess a candidates oral language ability in an oral test, the examining body often asks two examiners to score that candidates performance. Similarly, when an examiner is grading a composition for a certain test, i.e. TEM4, the same composition can be marked by the same examiner on two occasions. Explain in detail why such measures should be taken.Answer: The test reliability is defined as the extent to which the results can be considered consistent or stable. Test validity is defined here as the degree to which a test measures what it claims, or purports, to be measuring.If teachers administer a placement test to their students on one occasion, they would like the scores to be very much the same if they were to administer the same test again. The degree to which a test is consistent, or reliable can be estimated by calculating a reliability coefficient, which can go as high as +1.0 for a perfectly reliable test or as low as 0 when the results on the test are totally unreliable. Once the tests are administered twice and the pairs of scores for each student are lined up, simply calculate a Pearson product-moment correlation coefficient between the two sets of scores. The correlation coefficient will provide a conservative estimate (that is underestimate) of the reliability of the test over time. This reliability estimate can be interpreted as the percent of reliable variance on the test.Test validity is defined here as the degree to which a test measures what it claims, or purports, to be measuring. For example, if a test claims to measure proficiency in German listening comprehension, that is just what it should assess.II. Discussion (55%, 17 points for 1 and 2, 21 points for 3)1. Look at the following table and answer the questions that follow: 1) Calculate the total standard scores for the two students 2) Compare the total standard scores between the two students, see which student scored higher, and explain briefly why a teacher had better use the total standard scores instead of the total raw scores. SubjectMeanSDStudent AStudent BPsychology8168580Writing8598091Listening Comprehension7057685Reading74109366Literature8839095Total424417Answer :1)SubjectMeanSDStudent AStandard scoresStudent BStandard scoresPsychology816850.66780-0.17Writing85980-0.556910.667Listening Comprehension705761.2853Reading7410931.966-0.8Literature883900.667952.33Total4243.884175.032)从上图所计算出的标准分可以看出虽然学生A 的总分比学生B的总分高，但学生B的考试得分其中三项的标准分显然比学生A 要高，也就是大部分的标准分比学生A 要高。从标准分总分来看，学生A的标准分总分为3.88，学生B的标准分总分为5.03，高于学生A。所以学生B考得好些。不同考试是不同质的，把不同考试的分数求和是没有意义的，同时也难以真实反映学生的整体情况。所以正确的做法是先将各门课程的考分转换成标准分，再求和，标准分求和后的总分加以比较，从而判断学生A，B在考试中的优劣，这样才更科学。2. Use SPSS 16.0 (1) to calculate the correlation coefficient between two sets of writing scores marked by two teachers for the same group of students and then make the scatter plot. Discuss if there is any correlation between these two sets of scores. (2) to do the dependent sample T test to see whether there is any significant difference between the two teachers marking of the same paper. Report and discuss the result. If there exists significant difference, give suggestions as to how to solve this problem.(3) to calculate the correlation coefficient between three sets of writing scores marked by three teachers for the same group of students and make the scatter plot between Rater 1 and Rater 2; Rater 1 and Rater 3, and Rater 2 and Rater 3. Discuss if there is any correlation between these three sets of scores. (4) to do ANOVA to see whether there is any significant difference among the three teachers marking of the same paper (use LSD and SNK, and draw Means Plot). Report and discuss the result. （1）相关性A组教师B组教师A组教师Pearson 相关性1.321显著性（双侧）.073N3232B组教师Pearson 相关性.3211显著性（双侧）.073N3232从以上的相关性显著性值0.073,大于0.05，以及散点图，可以看出两位教师所批改的写作分数无相关。（2）成对样本检验成对差分tdfSig.(双侧)均值标准差均值的标准误差分的 95% 置信区间下限上限对 1A组教师 - B组教师-3.2508.3161.470-6.248-.252-2.21131.035从上表成对样本检验中的Sig.(双侧)值0.035，小于0.05，可以看出两位老师所打的分，有明显差异。可以通过算标准分来解决此问题。（3）相关性Rater1Rater2Rater3Rater1Pearson 相关性1.632*.599*显著性（双侧）.000.000N555555Rater2Pearson 相关性.632*1.652*显著性（双侧）.000.000N555555Rater3Pearson 相关性.599*.652*1显著性（双侧）.000.000N555555*. 在 .01 水平（双侧）上显著相关。从以上的相关值和散点图可以看出，Rater 1 and Rater 2的相关度不高；Rater 1 and Rater 3属于正相关；Rater 2 and Rater 3属于较强的正相关。（4）分数组别Nalpha = 0.05 的子集1Student-Newman-Keulsa35568.9515569.4025571.75显著性.302将显示同类子集中的组均值。a. 将使用调和均值样本大小 = 55.000。从以上表格中alpha的值为0.302，大于0.005，可以看