英语测试学论文.doc

Anqing Teachers College Term paper of Language Testing 2013-12-30 Instructor: Xiong HandongTesting reportPart 1 Introduction This test is designed by our class four, and class five did it in November18th. The testing subjects are 41 juniors (39 girls and 2 boys), who major in the teaching English Department of Anqing Teachers College. The examination paper contains one hundred multiple choice and one point a choice, so the total score is 100. The content of these items is from CET4, CET6 and TEM4 exam paper, which including many important grammars, like the use of article, preposition, verb and so on. It may seem to be easy in appearance, however, it costs too much efforts and devotions. The one hundred multiple choice were selected from 9 dormitories. Each dormitory should find out 50 items and then the final items were selected by study monitor. The test was taken in a big room205 within 40 minutes, with two study monitors and a teacher invigilated, which seems to be a little nervous. All in all, we all pass it smoothly. And after taking the examination, I felt to be a teacher and a student are not easy. Well, next, I will analyze this test results to you. Part 2 Data presentation and analysisIn this part, I will report the test scores and provide some statistics to analyze several factors concerning with assessing the paper. Such as mean score, median, mode, range, standard deviation, test reliability, item difficulty level and item discrimination. Since the reliability is too difficult and complicated, I will analyze it in the end. 1. Basic DataSo, to begin with, let me analyze the basic data to you. Class five did a good job in this test. The central tendency is as follows: The mean score is 56.97561, media is 55, mode is 66. The variability is as follows: the range is 39, the standard deviation is 10.55578 and the CV is 18.5268%. The hole data are presented as follows:Basic DataCentral TendencyScoreVariabilityScoreMean56.97561Max79Media55Min40Mode66Range39Standard Deviation10.55578CV18.5268%CV：差异系数 Standard deviation：标准差range：全距2. Score distributionAnd next is score distribution of the student: Score Distribution Score GroupFrequencyScore GroupFrequency30400607011405097080550601680900From the table and chart we can see that students score distribution is approximately around 40 and 80. It is concentrated and stable. The top score is 79 while the lowest score is 40.The whole trend is appeared as positive skewedness. 3. Option DistributionAnd then let us see the distribution of the option. The distribution of four option A, B, C, D is as follows. From the chart we can see that the four parts are almost equal. However, the option B is the highest one while the option C is the lowest one. Generally speaking, the options in this test are reasonable and advisable.Option DistributionOptionABCDFrequency24272227Percentage24%27%22%27%And next let me analyze the advanced data to you.4. Item Facility Value (FV)Item facility value is a measure of the ease of a test item, which is important in test analyzing. It is between 0 and 1, the smaller it is, the more difficult the item will be. The reasonable facility value is between 0.3 and 0.7.( R is refers to No. of correct answers N is refers to No. of students )And this examinations every item facility value is as follows:Item Facility ValueFV0.7Total num.115831Percentage11%58%31%FV0.7Item num.7.9.10.33.37.51.55.63.75.76.804.5.6.8.11.12.13.17.18.19.20.21.24.26.32.34.35.36.40.43.44.46.47.49.50.53.54.56.57.59.62.64.66.67.68.70.71.72.73.77.78.79.81.82.85.86.87.88.89.90.91.93.94.95.96.98.1001.2.3.14.15.16.22.23.25.27.28.29.30.31.38.39.41.42.45.48.52.58.60.61.65.69.74.83.92.97,99Percentage11%58%31%From the table above we can see that this papers FV mostly concentrated between 0.3 and 0.7. The percentage is 58%. That means the items in this text is adaptable. Most of the items are neither easy nor difficult. It suitable for our students have a test. However, there are also 11% of items are below 0.3, which means these items are a little difficult to answer. Let me give you an example:7. The writer his experience as a building worker for his writing.A. drew back fromB. drew inC. drew up D. drew onThis item is aim to test students verbal phrase. “draw” is the central word. Students may be confused by the preposition after “draw”. From this we can see students need do more practice about verbal phrase. And the second item is item 37.37. She was pulling my leg when she said I should propose to her. The underlined part means .A. kidding meB. frightening meC. forcing meD. hintingThis item is intended to test English slang. This item can test students knowledge scope. A little bit difficult for some part of the students. 55. This area is comparatively peaceful except for a few in the distance.A. skirmishesB. controversiesC. frictionsD. disturbItem 55 is about to test students vocabulary scope, which is also a little difficult for some students. To be honest, I cant do this item either. The correct answer is A. “skirmishes” means a small quarrel. From the analysis above, it seems that we all need to strengthen our language ability, enlarge our vocabulary and pay more attention to verb and verb phrases. We need more practice after class and need more tests like this.5. Item Discrimination Item discrimination is anther essential factor in test analyzing. Item discrimination refers to theability of a test item to separate good students from poor students in a particular aspect of the foreign language. The formula is: Item discrimination is between -1 to +1. 1 is the perfect item discrimination. In general, item discrimination is equivalent to or higher than 0.4 can be acceptable. Those are below 0.4 should be changed or improved. And the following chart is this tests item discrimination:Item DiscriminationID0.4Item num.1.48.53.62.63.79.82.1002.3.4.5.6.8.9.10.11.12.14.15.16.17.18.19.20.23.24.25.27.28.29.30.31.32.33.34.36.37.38.39.41.42.46.47.50.52.55.56.57.58.59.60.61.64.65.67.68.69.71.72.73.74.75.76.78.80.81.83.84.85.87.88.90.91.92.95.9913.21.26.35.40.43.44.45.49.51.54.70.77.86.89.93.94.96.97.98Percentage8%72%20%From the chart we can see that there are 20% items item discrimination is acceptable. And there are 8% items is under zero. It is unreasonable, I think these items need to change and improve. So, by the way, let me analyze this in detail, let see some items, first is item69. 63. According to official statistics, retail sales in China rose 10% and 12.2% in the first and the second quarter _ this year.A. accordinglyB. correspondinglyC. respectivelyD. individuallyThe correct answer is B. And students answers are as follows:GroupNo. of Correct AnswersFacility Value (FV)Top0-0.53846Bottom7We can see from the chart that none of the students that in the top group got the correct answer. But on the contrary, there are 7 students in bottom group got the correct answer, so the item discrimination is under zero. Therefore, this items discrimination is too low. Why this kind of phenomenon was appeared? Maybe students in top group are hesitated to make decision or they may hasty to make a choice, which led to the mistake. This item is intended to test the semantic of the sentence. Therefore, students need to improve their language sense.And next, I will give an anther example. See the item 40. 40. Which of the following italicized parts is used as an object?A. What do you think has happened to her ?B. Who do you think the visiting professor is?C. How much do you think he earns every month?D. How quickly would you say he would come? This item is aim to test students understanding of sentence structure and the correct answer is C. Students answers are as follows:GroupNo. of Correct AnswersFacility Value (FV)Top130.769231Bottom3We can see from the chart that there are 13 students that in the top group got the correct answer. And on the contrary, there are only 3 students in bottom group got the correct answer, so this items discrimination is higher than 0.4 which is reasonable. Therefore, we can say that this item have a high item discrimination which should be praise and adaptable. Then the next item2323. HesnomoreabletoreadJapanesethanIam.Thesentencemeans that . A.neitherhenorIamabletoreadJapanese.B.IcanreadJapanesebuthecant.C.myJapaneseisbetterthanhim. D.bothheandIareabletoreadJapanese.This items answer is A. And students answers are as follows:GroupNo. of Correct AnswersFacility Value (FV)Top110Bottom11This item test the meaning of the phrase “no more than”. This is an important phrase in English learning. And we can see from the chart that both top group students and bottom group students have the same number of correct answer. So the item discrimination is 0, which is not a good one.And the next item20 is the same. The correct answer is C.20. Time , he shall go outing.A. permittedB. permitsC. permittingD. would permitFrom this we can see, this kind of items is neither easy nor difficult, they all have very low item discrimination. But the item itself is deserved to have a test. They are all typical grammar which is essential part in English learning. 6. Reliability Reliability refers to the consistency of the scores from a test. Let me use spilt half reliability to analyze:Rank order correlation, the formula is:For this, first calculate the rank order correlation between the odd and he even halves of the test, and then use the Spearman Brown correction formula: = reliability= the correlation between the two halves of the test. Student IDScore on WholeScore on EvenScore on OddRank EvenRank Oddd154272725.519.5636248222636.52214.5210.25354302418.53112.5156.25442222036.538.52455829292117416655322313.533.52040076136257272040087037334.59.552594017234133.57.556.25105025253227525116129322111.59.590.25125126252927241340221836.540.54161451282323.533.510100154018224036.53.512.25165024263322111211753282523.5273.512.2518622933219.511.5132.251955322313.533.5204002054223236.511.525625216435299178642266323413.57.563623693336113.57.556.25244523223436.52.56.25256434301014.54.520.252678433515.54.520.25274520253927121442852262629227492956312516.52710.5110.25304626202938.59.590.25317637394.522.56.253272363673.53.512.25335526292917121443445271825.540.515225355126252927243657302718.519.511376736317136363866323413.57.5636397938412.511.52.25406838302.514.5121444166313516.55.511121N=41= 4170= 0.63675958The correlation between the two halves of the test is 0.63675958, so 0.63675958= = 0.77807344So the split half reliability index is 0.77807344. The reliability seems a little low in this test, however, it is the first time that our students trying our best to make up this test, though it not a perfect one, it definitely a successful one. We will improve our ability in the future. Part 3 ConclusionsFrom the data and analysis, we may draw a conclusion that this paper is suitable for our students to have a test. Though some items item discrimination is unreas