A Study on the Quality of Achievement Test Paper of Junior English 英语专业毕业论文.doc

a study on the quality of achievement test paper of junior english内容：abstract: based on the theory of bachman & palmers english language testing theory, this paper aims at analyzing the quality of achievement test papers of grade8 junior english from the perspective of test validity and reliability. then, it will make a further detail analysis about reading comprehension and propose some suggestions to improve this part.keywords: junior english testing, test validity, reliability1. introductionenglish language testing is one of the major parts in english teaching and a measurement of education, which assesses the language ability and knowledge according to the result. thus, english tests have been considered as an assessment mechanism that stimulates the students to achieve more in english and obtain higher scores as well as help the teacher better evaluate the students achievements in english. the author chooses the terminal test papers of junior english as its object of study and probes into analyzing the test validity and reliability of the test paper. the detail analyses are displayed as follows.2. analysis of the quality of test paperwhen designing a test, the quality of test is one of the most important issues that the teacher must pay more attention to. according to bachman & palmer (1999), the criteria for evaluating the quality of a test mainly include the five aspects such as reliability, validity, authenticity, interactiveness and impact. these five aspects are closely related to junior english teaching, and is also the key point of this paper. in this paper, the author is intended to analyze the validity and reliability of this terminal achievement test paper for grade8 junior english.2.1. content of the test paperthe whole test consists of five parts: listening comprehension, which occupies 20% of the total score. listening comprehension consists of three parts, sentence listening, dialogue listening and passage listening; multiple choice question, which occupies 15% of the total score; cloze, 10%; reading comprehension, 30%; task-based reading, 10%; and the last part, writing, which occupies 15% of the total score.2.2. reliability estimatereliability is the extent to which test scores are consistent: a quality assessing whether candidates can get the same results on different dates (assuming there is no change in their ability). reliability is a property of the test as a measuring instrument, but is also relative to the candidates taking the test: a test may be reliable with one population, but not with another. and next the author will make estimation about this test paper utilizing the instrument-spss.the following is the descriptive statistics of the results of the terminal junior test paper.graph1 统计量lcmcqclozerctbrwritingtsn有效40404040404040缺失0000000均值13.909.954.3025.004.505.8863.50中值14.009.504.0028.005.006.0066.50众数1793286867标准差3.4772.8642.2896.4213.2263.61814.915方差12.0928.2035.24141.23110.41013.087222.462偏度-.605-.712.164-1.840-.005.045-.916偏度的标准误.374.374.374.374.374.374.374峰度-.532.302-1.1052.720-1.203-.903.728峰度的标准误.733.733.733.733.733.733.733极小值63160024极大值1915830101387where: lc=listening comprehension, mcq=multiple choice question, rc=reading comprehension, tbr=task-based reading, ts=total score.and the following one is the normal distribution of the students total scores:graph2from the value of skewness and kurtosis, and the normal distribution of the total score, it can be discovered that the test scores are normally distributed. from the graph, it can be seen that the skewness is -0.916 and kurtosis 0.728, according to the english language testing theory, values for skewness and kurtosis of between -2 and+2 indicate a reasonable normal distribution. that is to say, the data of this paper is reliable. and the standard deviation of this test paper is 14.915, which indicates that the discrimination of students scores is big. therefore, we can say that the test results are reliable and can reflect test takers language ability and are also the basis for guarantee the whole test papers validity. however, the mean of the fourth part (reading comprehension) is 25point, whose total score is 30 point, and the highest score is 30 point, the lowest one is 6 point. it is because most of the students are familiar with the material of the selected articles in the fourth part. the kurtosis of rc is 2.720, it is a positive kurtosis and indicates that this part is a little easy, and the discrimination of students score is small. the detail analysis of this part will be analyzed later. 2.3. validity analysis briefly, the validity of a test is the extent to which it measures what it is supposed to measure and nothing else. every test, whether it is a short, informal classroom test or a public examination, should be as valid as the constructor can make it (heaton, 2000). there are several measures examining validity of a test such as face validity, content validity, concurrent validity, predicative validity, response validity and construct validity.the following graph shows the correlation coefficients among different parts as well as between each part and the total score of this test paper. graph3相关性lcmcqclozerctbrwritingtslcpearson 相关性1.453*.291.485*.644*.476*.829*显著性（双侧）.003.069.002.000.002.000n40404040404040mcqpearson 相关性.453*1.284.346*.158-.105.497*显著性（双侧）.003.076.029.330.521.001n40404040404040clozepearson 相关性.291.2841.391*.181-.020.475*显著性（双侧）.069.076.013.265.902.002n40404040404040rcpearson 相关性.485*.346*.391*1.248.363*.813*显著性（双侧）.002.029.013.124.021.000n40404040404040tbrpearson 相关性.644*.158.181.2481.515*.656*显著性（双侧）.000.330.265.124.001.000n40404040404040writingpearson 相关性.476*-.105-.020.363*.515*1.600*显著性（双侧）.002.521.902.021.001.000n40404040404040tspearson 相关性.829*.497*.475*.813*.656*.600*1显著性（双侧）.000.001.002.000.000.000n40404040404040*. 在 .01 水平（双侧）上显著相关。*. 在 0.05 水平（双侧）上显著相关。according to ferguson (2006), the correlation coefficients between each part and total score should be higher than 0.7 and the correlation between parts should be 0.30.6. the above graph shows that the part-total correlation coefficients of the test paper is not very satisfactory, only the correlation coefficients between reading comprehension or listening comprehension and the total score are above 0.7. what more, the correlation coefficients between parts is not satisfied with the standard of 0.3-0.6, which indicates that the construct validity of this test paper is very low. 3. detail analysis about reading comprehensionthis part consists of three passages, the first passage is just an introduction about the american museum of national history, the second one is a brief introduction about tea, and the third one is about the celebrity li shizhen. the total score of this part is 30 point, which occupies 30% of the total score. 3.1. data collectionin this paper, the author has selected 40 students as its object of study, which can guarantee the validity of the data in order that the further analysis can be carried out on the basis of these dates.graph4rc频率百分比有效百分比累积百分比有效625.05.05.01012.52.57.51637.57.515.02025.05.020.02212.52.522.52412.52.525.026717.517.542.5281435.035.077.530922.522.5100.0合计40100.0100.03.2. reliability analysisthe following graph is the descriptive statistics of the results of the part of reading comprehension. graph5统计量rcn有效40缺失0均值25.00中值28.00众数28标准差6.421方差41.231偏度-1.840偏度的标准误.374峰度2.720峰度的标准误.733极小值6极大值30from the above graph, it can be easily seen that, the medium, mode and mean is 28.00, 28, and 25.00. according to the above introduction, it is known to us all that the total score of reading comprehension is 30 point, therefore, the medium, mode and mean is very high. the skewnes of this part is -1.840 and the kurtosis 2.720. however, only if the values of skewness and kurtosis are between -2 and +2, which can indicate a normal distribution. whats more, the standard deviation is 6.421 indicating that the discrimination of students score is low. and it can also be inferred from the following graph6- the normal distribution of reading comprehension.graph6there are four variants of normal distribution, in terms of skewness, it can be classified into positively skewed distribution and negatively skewed distribution. the former one indicates that there are more scores below the mean and the test or the part is difficult, the latter one indicates that there are more scores above the mean and the test or the part is easy. and another two types are classified in terms of kurtosis, it can be classified into negative kurtosis and positive kurtosis. the former one indicates that the discrimination of students score is big while the latter one indicates that the discrimination of students score is small. from the graph4, graph5 and graph6, it is clearly seen that 75% of the scores of rc part is above the mean 25.00, the skewness is -1.840, approximating to -2 and the normal distribution is a negatively skewed one. all the evidences indicate that the reading comprehension part is easy; the discrimination of students score in this part is small.3.3. the detail analysis of reading comprehensionthis part consists of three passages. lets take one of the passages for example:passage athe american museum of national historyaddress: central park westside 70th st., new yorktelephone number: 212222-3500traffic: you can get there by bus, subway or car.parking: there is a small parking lot (停车场). you have to pay $7.75 per day, but it is often full. parking in the neighborhood is also limited (有限的).open hours: 10:00am - 5:45pm (sunday, monday, and tuesday)10:00am - 9:00 pm (wednesday, thursday, friday and saturday)the museum is open every day of the year except christmas day and thanksgiving day.ticket price: $3.20 for grown-ups, one-fourth (四分之一) for children, and free on friday and saturday evening from 5:00 pm to 9:00 pm.46. the american museum of national history is in_.a. florida b. washington c. boston d. new york47. you can reach the american museum of national history_a. by bus, train, or air b. by bus, subway, or car c. by bus, train, or ship d. by bus, subway, or shipit is clearly seen that this passage is easy, and the students can easily obtain some important and useful information directly from this passage. for example, the stem no.46 is just a question searching for the address of the american museum of national history. it is easy for students to find the answer in the first line of this passage. whats more, the design of the four options is very easy. it is the same case with the stem no. 47.and the following two passages in this part are also easy to understand. thats the reason why the kurtosis of this part exceeded the normal range of kurtosis (-22).in order to raise the validity of this part and improve the quality of junior english test paper, some suggestions are proposed in this paper as follows:in terms of selecting article, this part should include diversified kinds of articles, such as some easy economic, political articles and literary works. on one hand, it can reflect the requirements of the test and on the other hand, it can raise the discrimination degree of this part. consequently, it can test most of the students real english proficiency.whats more, when designing the options of every stem, first, some of the stems should not always be direct but can be technically designed; second, the options must include some distractions, and the distractions must be reasonable. thus, it can raise