测试学期末论文评估试卷.doc

Evaluation of a Final Examination Text1 IntroductionThe test is from Xinhua college of Ningxia University. Object is the non-English major college student examination. Through the analysis of this test paper and statistics, we can get some informations from the test. The paper is divided into six types, reading comprehension, close, grammar, vocabulary, translation and writing. The paper contains a subjective and five objective problems. A total of 27 student use two hours finished the text. The purpose is testing students on university English III course knowledge and to measure the test takers study ability.II Evaluation on the Total Level The full marks are 100, which accounted for thirty percent of subjective, objective questions seventy percent.表2.1NValid27 Missing0Mean65.6667Median66.0000Mode60.00Std. Deviation11.15623Skewness-.956Std. Error of Skewness.448Range46.00Minimum35.00Maximum81.00表2.2FrequencyPercentValid PercentCumulative PercentValid35.0013.73.73.739.0013.73.77.460.00622.222.229.661.00311.111.140.762.0013.73.744.463.0013.73.748.166.0027.47.455.667.0013.73.759.369.0013.73.763.070.0013.73.766.773.0027.47.474.174.0027.47.481.575.0013.73.785.281.00414.814.8100.0Total27100.0100.0 表2.4表2.4Central Tendency and Dispersion of Total ScoresCentral TrendencyDispersionMeanMedianModeLowHighRangeSD65666635814644.8*Total score=100 N=27According to Brown (1988:66), central tendency refers to the typical behavior of a given group， while dispersion refers to how the performance of those individuals may vary from that typical behavior. To investigate central tendency, we must observe three different indications：mean, mode, and median. To investigate dispersion, we must observe two indicators: range and standard deviation (SD). By means of the statistical methods provided by Brown (ibid), we have computed the central tendency and dispersion of the final test. The data are displayed in Table 1.3.The data displayed in Table 1.3 indicate that about 56% of the students have scores above and including the mean, while 44% of them have scores below the mean. 78% of the scores occur in the range of mean plus or minus 1 standard deviation, and 93% of the scores occur in the range of mean plus or minus 2 standard deviations. Thus we can translate the above range into whole mark scores as following:Mean + 1SD to Mean - 1SD:Expected scores: 80% between 76.83 and 54.51Observed scores: 78% between 76.83 and 54.51Mean + 2SD to Mean - 2SD: Expected scores: 90% between 87.99 and 43.35Observed scores: 93% between 87.99 and43.35Compared with the criterion of normal distribution ( Brown, 1988:89), our testing for the normality of the reading test shows that the score distribution is a bit short at both ends and is negatively skewed.The data presented in Table 2.2 and Table 2.4 also indicate that although a few low scores on the test cause a wide range, most scores are tightly grouped around the mean, which proves that the group of students is quite homogeneous. The low SD can demonstrate this very clearly.In addition, the students did perform so well as we had expected. The mean of the test is 65.67, high to the pass mark 60. Moreover, the highest score of the group is 81, which is not so high as to meet our expectation. About 93% of the students might have received the scores. However, the lowest score of the group is only 35, which is far too low to reach the pass standard. We may explore the reasons for this unexpected situation later.III Evaluation on the Component LevelThe following will be from the reading comprehension, close, grammar, vocabulary, writing, these six aspects are analyzed all the data.阅读理解完型填空语法词汇翻译写作NValid272727272727 Missing000000Mean26.07416.51854.81485.00006.74075.1111Median28.00006.00003.00005.00008.00006.0000Mode20.00(a)6.002.004.008.505.00(a)Std. Deviation5.669932.778633.270353.100872.610522.56205Skewness-.752.426.242.301-1.115-.770Std. Error of Skewness.448.448.448.448.448.448Range24.0012.0010.0010.009.508.00Minimum10.001.00.00.00.00.00Maximum34.0013.0010.0010.009.508.001. Analysis reading comprehension 阅读理解 FrequencyPercentValid PercentCumulative PercentValid10.0013.73.73.720.00518.518.522.222.00311.111.133.324.0013.73.737.026.00311.111.148.128.00518.518.566.730.00414.814.881.532.0027.47.488.934.00311.111.1100.0Total27100.0100.0 According to analysis these data, we can get the test result was negative skewned. The mean of the test is 23, high to the pass mark 34. Std. Deviation is about 5.7. And the most of student get 20 scores. The range is 24 and it is large from highest score to lowest scores. 2. Analysis of close 完型填空 FrequencyPercentValid PercentCumulative PercentValid1.0013.73.73.73.0027.47.411.14.00414.814.825.95.0027.47.433.36.00622.222.255.67.00414.814.870.48.00311.111.181.510.0027.47.488.911.0027.47.496.313.0013.73.7100.0Total27100.0100.0 According to analysis these data, we can get the test result was normal skewned. The mean of the test is 7, high to the pass mark 13. Std. Deviation is about 2.8. And the most of student get 6 scores. The range is 12 and it is large from highest score to lowest scores. This shows that the close is little difficult to students.3. Analysis of Grammar语法 FrequencyPercentValid PercentCumulative PercentValid.0013.73.73.71.0027.47.411.12.00829.629.640.73.00311.111.151.95.0013.73.755.66.0013.73.759.37.00414.814.874.19.00622.222.296.310.0013.73.7100.0Total27100.0100.0 According to analysis these data, we can get the test result was normal skewned. The mean of the test is 5, high to the pass mark 10. Std. Deviation is about 3.3. And the most of student get 2 scores. The range is 10 and it is large from highest score to lowest scores. This shows that the close is little difficult to students.4. Analysis of Vocabulary词汇 FrequencyPercentValid PercentCumulative PercentValid.0027.47.47.41.0027.47.414.82.0027.47.422.23.0013.73.725.94.00622.222.248.15.00518.518.566.76.0027.47.474.17.0013.73.777.88.0013.73.781.510.00518.518.5100.0Total27100.0100.0 According to analysis these data, we can get the test result was normal skewned. The mean of the test is 5, high to the pass mark 10. Std. Deviation is about 3.1. And the most of student get 4 scores. The range is 10 and it is large from highest score to lowest scores. This shows that the close is little difficult to students.5. Analysis of Translation翻译 FrequencyPercentValid PercentCumulative PercentValid.0013.73.73.71.5013.73.77.42.0013.73.711.14.0013.73.714.84.5027.47.422.25.0013.73.725.95.5027.47.433.36.5013.73.737.07.0027.47.444.47.5013.73.748.18.00414.814.863.08.50518.518.581.59.0013.73.785.29.50414.814.8100.0Total27100.0100.0 According to analysis these data, we can get the test result was negative skewned. The mean of the test is 8, high to the pass mark 9. Std. Deviation is about 2.6. And the most of student get 9 scores. The range is 9.5 and it is large from highest score to lowest scores. 6. Analysis of Writing写作 FrequencyPercentValid PercentCumulative PercentValid.0027.47.47.41.0027.47.414.82.0027.47.422.24.0027.47.429.65.00518.518.548.16.00414.814.863.07.00518.518.581.58.00518.518.5100.0Total27100.0100.0 According to analysis these data, we can get the test result was negative skewned. The mean of the test is 5, high to the pass mark 8. Std. Deviation is about 2.6. And the most of student get 5 scores. The range is 8 and it is large from highest score to lowest scores. IV Analysis on the item Level 6ITEMGROUPOPTIONDP11 HLA B* C D Omit1 5 2 0 00 6 0 1 10.50.6812HLA B* C D Omit3 4 0 3 01 2 2 0 00.520.1113HLA B C* D Omit1 5 2 0 00 6 0 1 10.500.6914HLA B C* D Omit3 0 5 0 00 2 5 0 10.3750.6815HLA* B C D Omit8 3 0 3 01 2 1 4 10.620.5816HLA B C* D Omit0 2 1 9 03 3 0 3 00.610.7117HLA B C D* Omit1 3 2 6 03 3 2 5 00.560.6418HLA B C D* Omit5 2 1 6 14 2 4 5 00.600.6419HLA B* C D Omit3 3 5 2 01 4 3 2 00.430.6920HLA B C D* Omit5 3 1 3 04 6 4 9 00.570.64Distribution of Responses to Improper ItemsH=high score group L=low score group D=discriminability P=difficulty *=correct response N=24According to Henning(1987:49),one of the most important characteristics of an item to be accurately determined is its difficultly. The misfit of item difficulty to person ability will lead to low reliability. Item difficulty is determined as proportion of correct responses. It may range from zero to one .In general item difficulty is said to be most appropriate when it approaches the mid-point of the difficulty range,i,e.0.50.A rule of thumb of item rejection is between the difficulty range of 0.33-0.67(Tuckman,1978;qtd.in Henning,1987:50).From investigation of the above items indicates that Item13,16 , have reached a high level of ability. They are too difficulty for the students. Therefore, some adjustment ought to be implemented to keep the items in the proper difficulty range.V ConclusionTest on education has guiding function and supervision function, scientific evaluation of English writing test proposition quality, is an objective test of teaching the key. Through analysis we can draw a conclusion:1 ReliabilityRELIABILITY ANALYSIS - SCALE (SPLIT)Reliability CoefficientsN of Cases = 27.0 N of Items = 7Correlation between forms = .6541 Equal-length Spearman-Brown = .7909Guttman Split-half = .7713 Unequal-length Spearman-Brown = .7937 4 Items in part 1 3 Items in part 2Alpha for part 1 = .6376 Alpha for part 2 = .4936The result of the test is reliable.2 Validity Validity refers to the appropriateness of a given test or any of its component parts as a measure of what it is purported to measure. When closely examined, the concept of validity incorporates a number of aspects, each of which deserves our attention. They are face validity, content validity, construct validity, and criterion related validity. 3 SuggestionSome question types is too difficult to student. Therefore, some adjustment ought to be implemented to keep the items in the proper difficulty range.Based on the reliability and validity analysis, we can sure this paper is reasonable and reliable.AppendixStatistics总分 NValid27 Missing0Mean65.6667Median66.0000Mode60.00Std. Deviation11.15623Skewness-.956Std. Error of Skewness.448Range46.00Minimum35.00Maximum81.00总分 FrequencyPercentValid PercentCumulative PercentValid35.0013.73.73.7 39.0013.73.77.4 60.00622.222.229.6 61.00311.111.140.7 62.0013.73.744.4 63.0013.73.748.1 66.0027.47.455.6 67.0013.73.759.3 69.0013.73.763.0 70.0013.73.766.7 73.0027.47.474.1 74.0027.47.481.5 75.0013.73.785.2 81.00414.814.8100.0 Total27100.0100.0 FrequenciesStatistics 阅读理解完型填空语法词汇翻译写作NValid272727272727 Missing000000Mean26.07416.51854.81485.00006.74075.1111Median28.00006.00003.00005.00008.00006.0000Mode20.00(a)6.002.004.008.505.00(a)Std. Deviation5.669932.778633.270353.100872.610522.56205Skewness-.752.426.242.301-1.115-.770Std. Error of Skewness.448.448.448.448.448.448Range24.0012.0010.0010.009.508.00Minimum10.001.00.00.00.00.00Maximum34.0013.0010.0010.009.508.00a Multiple modes exist. The smallest value is shownFrequency Table阅读理解 FrequencyPercentValid PercentCumulative PercentValid10.0013.73.73.7 20.00518.518.522.2 22.00311.111.133.3 24.0013.73.737.0 26.00311.111.148.1 28.00518.518.566.7 30.00414.814.881.5 32.0027.47.488.9 34.00311.111.1100.0 Total27100.0100.0 完型填空 FrequencyPercentValid PercentCumulative PercentValid1.0013.73.73.7 3.0027.47.411.1 4.00414.814.825.9 5.0027.47.433.3 6.00622.222.255.6 7.00414.814.870.4 8.00311.111.181.5 10.0027.47.488.9 11.0027.47.496.3 13.0013.73.7100.0 Total27100.0100.0 语法 FrequencyPercentValid PercentCumulative PercentValid.0013.73.73.7 1.0027.47.411.1 2.00829.629.640.7