Discovery Education ASSESSMENT

Transcription

1 Decline in Predictive Percent Proficient/Advanced on Discovery Education Assessment: Tennessee Test B for Selected Grades/Subjects Dear Tennessee Educators: A number of our Tennessee partner districts have provided valuable feedback regarding their observation of a downward trend in student proficiency from Test A to Test B for the school year. Discovery Education Assessment has conducted further analysis of its predicted percent of students who are proficient/advanced on the following 2012 Test A and Test B benchmarks: Grades 3-8: Reading, Mathematics, and Science End-of-Course: English 2, Algebra 1, and Biology Based on the results of our analysis, we are providing the following information for you to share with your educators. In addition, we will offer two webinar events to explain our analyses and address any concerns you may have. The webinar events will be recorded and posted at a link we will provide to you so you may access them on demand. Discovery Education Assessment uses a Continue-to-Learn Model in setting cut scores for its proficiency prediction. These cut scores are derived from an analysis of Discovery benchmark data and TCAP 2012 results. Based on customer demand, a certain percentage of test items were revised or replaced on these benchmarks for the school year. Cut score adjustments were made to account for these test revisions. With the Continue-to-Learn Model, Discovery expects the predicted percent proficient/advanced to be approximately the same on Test A and Test B. Slight increases or decreases in proficiency on Test B over Test A could reflect improvement or decline over the previous year. Both Test A and Test B predictions tend to be conservative and, in most cases, will under predict actual performance on TCAP. The results of Discovery s analysis are shown in the following tables, which present the predicted percent proficient/advanced for Test A and Test B interim benchmarks in Reading, Mathematics, and Science:

2 Reading Percent Prof/Adv Grade Grade Grade Grade Grade Grade English Math Percent Prof/Adv Grade Grade Grade Grade Grade Grade Algebra Science Percent Prof/Adv Grade Grade Grade Grade Grade Grade Biology

3 From this data, Discovery has noticed significant declines over expectations in predicted percent proficient/advanced on Test B in the following grades/subjects: Grade 3 Reading Grade 7 Reading English 2 EOC Grade 3 Math Grade 7 Math Grade 8 Math Grade 4 Science Grade 7 Science Grade 8 Science The declines on the above tests appear to be the result of a variety of factors: shifting standards within the state and a shift in when those standards are taught during the school year; an earlier test B window this year than last year; a higher item refresh rate than in previous school years based on customer demand; and conservative cut scores on Test A and B. Discovery has also analyzed the vertical scale score growth between Test A and Test B for and for Reading and Mathematics and the growth for for Science. Reading Scale Scores showed growth in all grades from Test A to Test B in except for Grade 5. The amount of growth was slightly smaller than for except for Grades 6 and 8. This pattern of slightly smaller growth could also contribute to proficiency predictions being lower on Test B for Grades 3, 7 and English 2. Reading Scale Scores 1213 Reading Scale Scores 1112 Test A Test B Growth B - A Test A Test Growth B - A B Grade Grade Grade Grade Grade Grade Grade Grade Grade Grade Grade Grade English English

4 On the other hand, growth in Mathematics benchmarks in from Test A to Test B was positive (except for Algebra 1) and higher than for 11-12, except for Grades 7 and 8 (with Grade 5 growth being very similar for the two time periods). The decrease in growth in these two grades could also affect the lower predicted percent proficient on Test B. Math Scale Scores 1213 Math Scale Scores 1112 Test A Test B Growth B - A Test Test Growth B - A Grade Grade Grade Grade Grade Grade Grade Grade Grade Grade Grade Grade Algebra Algebra This is the first year for vertical scaling of Discovery Science benchmarks. Growth between Test A and Test B in was strong in all grades except Grade 7 and 8. Science Scale Scores 1213 Test A Test B Growth B - A Grade Grade Grade Grade Grade Grade Biology Based on this analysis, we recommend focusing on the scale score growth that your students are achieving between tests while exercising caution when interpreting the decrease in percent proficient from Test A to Test B. In order to ensure the most accurate predictions on Discovery Test C, additional time for analysis of Test C data will be needed prior to releasing full reports for grades 3 through high school. We expect that sufficient data will be available for analysis approximately two weeks after the Test C window opens on Monday, January 28. We encourage you to test as early in the window as possible to ensure sufficient data is received in a timely manner.

5 We realize that educators rely on Test C results to best focus their instruction prior to TCAP and want to ensure that these results are as accurate as possible for our Tennessee educators. We sincerely appreciate the feedback you have provided and want to assure you that we take your concerns very seriously. We remain committed to providing you with high quality assessments and hope our explanations will be beneficial as you continue your post Test B instruction and decision-making. Please feel free to contact our customer support team at [email protected] or toll-free at , option 2, with any questions. Sincerely, Hardin Daniel Vice President, Discovery Education Assessment