28 Student Progress Monitoring & Data-Based Instruction in Special Education Graphing and Interpreting CBM Scores An overview (Sample presentation to present to students) How to Graph Scores Graphing student scores is vital. Graphs provide teachers with a straightforward way to: Review a student s progress. Monitor the appropriateness of student goals. Judge the adequacy of student progress. Compare and contrast successful and unsuccessful instructional aspects of a student s program. 2 1
How to Graph Scores Teachers can use computer graphing programs. Teachers can create their own graphs. A template can be created for student graphs. The same template can be used for every student in the classroom. Vertical axis shows the range of student scores. Horizontal axis shows the number of weeks. 3 How to Graph Scores 4 2
How to Graph Scores Student scores are plotted on the graph, and a line is drawn between the scores. 2 Digits Correct in 3 Minutes 2 1 1 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction How to Graph Scores How to create graphs in Microsoft Excel 1 2 3 4 6 7 8 9 1 Ashley 6 8 9 13 1 17 1 13 18 Ben 4 8 9 14 1 13 17 2 21 Carter 7 4 8 9 6 1 12 8 7 6 3
How to Graph Scores How to create graphs in Microsoft Excel CBM Graph 4 4 3 Digits Correct 3 2 2 1 1 1 2 3 4 6 7 8 9 1 Weeks Ashley 7 How to Set Ambitious Goals Once baseline data has been collected (best practice is to administer three probes and use the median score), the teacher decides on an end-of-year performance goal for each student. Three options for making performance goals: End-of-year benchmarking Intra-individual framework National norms 8 4
How to Set Ambitious Goals End-of-year benchmarking: For typically developing students, a table of benchmarks can be used to find the CBM end-of-year performance goal. 9 How to Set Ambitious Goals Reading Grade Kindergarten First Second Third Fourth Fifth Sixth Benchmark 4 letter sounds per minute (CBM LSF) 6 words correct per minute (CBM WIF) words correct per minute (CBM PRF) 7 words correct per minute (CBM PRF) 1 words correct per minute (CBM PRF) 2 correct replacements per 2. minutes (CBM Maze 2 correct replacements per 2. minutes (CBM Maze 3 correct replacements per 2. minutes (CBM Maze) 1
How to Set Ambitious Goals Math Grade Probe Maximum score Benchmark First Computation 3 2 digits First Data not yet available Second Computation 4 2 digits Second Concepts and Applications 32 2 blanks Third Computation 4 3 digits Third Concepts and Applications 47 3 blanks Fourth Computation 7 4 digits Fourth Concepts and Applications 42 3 blanks Fifth Computation 8 3 digits Fifth Concepts and Applications 32 1 blanks Sixth Computation 1 3 digits Sixth Concepts and Applications 3 1 blanks 11 How to Set Ambitious Goals Intra-individual framework: Weekly rate of improvement is calculated using at least eight data points. Baseline rate is multiplied by 1.. Product is multiplied by the number of weeks until the end of the school year. Product is added to the student s baseline rate to produce end-of-year performance goal. 12 6
How to Set Ambitious Goals First eight scores: 3, 2,, 6,,, 7, 4. Difference between medians: 3 = 2. Divide by (# data points 1): 2 (8-1) =.29. Multiply by typical growth rate:.29 1. =.43. Multiply by weeks left:.43 14 = 6.9. Product is added to the first median: 3 13 How to Set Ambitious Goals Reading National norms: For typically developing students, a table of median rates of weekly increase can be used to find the end-of-year performance Grade goal. 6.3.4 1 2 3 4 PRF 2. 1. 1..9. Maze.4.4.4.4.4 14 7
How to Set Ambitious Goals Math National norms: For typically developing students, a table of median rates of weekly increase can be used to find the end-of-year performance goal. Grade 1 2 3 4 6 Computation : Digits.3.3.3.7.7.4 Concepts and Applications : Blanks N/A.4.6.7.7.7 1 How to Set Ambitious Goals National norms: Median is 14. Fourth-grade Computation norm:.7. Multiply by weeks left: 16.7 = 11.2. Add to median: 11.2 + 14 = 2.2. The end-of-year performance Grade 1 2 3 4 Computation : Digits.3.3.3.7.7 Concepts and Applications : Blanks N/A.4.6.7.7 goal is 2. 6.4.7 16 8
How to Set Ambitious Goals National norms: Once the end-of-year performance goal has been created, the goal is marked on the student graph with an. A goal line is drawn between the median of the student s scores and the. 17 How to Set Ambitious Goals Drawing a goal-line: A goal-line is the desired path of measured behavior to reach the performance goal over time. Digits Correct in Minutes 2 2 1 1 The is the end-of-the-year performance goal. A line is drawn from the median of the first three scores to the performance goal. 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 18 9
How to Set Ambitious Goals After drawing the goal-line, teachers continually monitor student graphs. After seven or eight CBM scores, teachers draw a trend-line to represent actual student progress. A trend-line is a line drawn in the data path to indicate the direction (trend) of the observed behavior. The goal-line and trend-line are compared. The trend-line is drawn using the Tukey method. 19 How to Set Ambitious Goals Tukey Method Graphed scores are divided into three fairly equal groups. Two vertical lines are drawn between the groups. In the first and third groups: Find the median data point. Mark with an on the median instructional week. Draw a line between the first group and third group. This line is the trend-line. 2 1
How to Set Ambitious Goals 2 Digits Correct in Minutes 2 1 1 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 21 How to Set Ambitious Goals Practice graph 2 Digits Correct in Minutes 2 1 1 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 22 11
How to Set Ambitious Goals Practice graph 2 Digits Correct in Minutes 2 1 1 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 23 How to Set Ambitious Goals CBM computer management programs are available. Programs create graphs and aid teachers with performance goals and instructional decisions. Various types are available for varying fees. Programs are listed in CBM manuals. 24 12
How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals After trend-lines have been drawn, teachers use graphs to evaluate student progress and formulate instructional decisions. Standard decision rules help with this process. 2 How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals If at least 3 weeks of instruction have occurred and at least six data points have been collected, examine the four most recent consecutive points: If all four most recent scores fall above the goal-line, then the end-of-year performance goal needs to be increased. If all four most recent scores fall below the goal-line, then the student's instructional program needs to be revised. If the four most recent scores fall both above and below the goal-line, then continue collecting data (until the four-point rule can be used or a trend-line can be drawn). 26 13
How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals 3 Digits Correct in 7 Minutes 2 2 1 1 Most recent 4 points Goal-line 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 27 How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals 3 Digits Correct in 7 Minutes 2 2 1 1 Goal-line Most recent 4 points 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 28 14
How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals If the trend-line is steeper than the goal line, then the end-of-year performance goal needs to be increased. If the trend-line is flatter than the goal line, then the student s instructional program needs to be revised. If the trend-line and goal-line are fairly equal, then no changes need to be made. 29 How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals 3 Digits Correct in 7 Minutes 2 2 1 1 Trend-line Goal-line 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 3 1
How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals 3 2 Digits Correct in 7 Minutes 2 1 1 Trend-line Goal-line 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 31 How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals 3 Digits Correct in 7 Minutes 2 2 1 1 Trend-line Goal-line 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 32 16
Other Ways to Use the Curriculum- Based Measurement Database How to Use the Curriculum-Based Measurement Database to Accomplish Teacher and School Accountability and for Formulating Policy Directed at Improving Student Outcomes How to Incorporate Decision Making Frameworks to Enhance General Educator Planning How to Use Progress Monitoring to Identify Nonresponders Within a Response to Intervention Framework 33 How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes No Child Left Behind requires all schools to show Adequate Yearly Progress (AYP) toward a proficiency goal. Schools must determine measure(s) for AYP evaluation and the criterion for deeming an individual student proficient. CBM can be used to fulfill the AYP evaluation in mathematics. 34 17
How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes Using mathematics CBM: Schools can assess students to identify the number of initial students who meet benchmarks (initial proficiency). The discrepancy between initial proficiency and universal proficiency is calculated. 3 How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes Using mathematics CBM (continued): The discrepancy is divided by the number of years before the 213 214 deadline. This calculation provides the number of additional students who must meet benchmarks each year. 36 18
How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes Advantages of using CBM for AYP: Measures are simple and easy to administer. Training is quick and reliable. Entire student body can be measured efficiently and frequently. Routine testing allows schools to track progress during school year. 37 How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes Across-Year School Progress Number of Students Meeting CBM Benchmarks 4 3 2 1 (27) 24 2 26 27 28 29 21 211 212 213 214 End of School Year (498) 38 19
How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes Number of Students Meeting CBM Benchmarks 4 3 2 1 Within-Year School Progress Sept Oct Nov Dec Jan Feb Mar Apr May June 2 School-Year Month (281) 39 How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes Number Students on Track to Meet CBM Benchmarks 2 2 1 1 Within-Year Teacher Progress Sept Oct Nov Dec Jan Feb Mar Apr May June 2 School-Year Month 4 2
How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes Number Students on Track to Meet CBM Benchmarks Within-Year Special Education Progress 2 2 1 1 Sept Oct Nov Dec Jan Feb Mar Apr May June 2 School-Year Month 41 How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes CBM Score: Grade 3 Concepts and Applications 3 2 2 1 1 Within-Year Student Progress Sept Oct Nov Dec Jan Feb Mar Apr May June 2 School-Year Month 42 21
How to Incorporate Decision-Making Frameworks to Enhance General Educator Planning CBM reports prepared by computer can provide the teacher with information about the class: Student CBM raw scores Graphs of the low-, middle-, and highperforming students CBM score averages List of students who may need additional intervention 43 How to Incorporate Decision-Making Frameworks to Enhance General Educator Planning 44 22
How to Incorporate Decision-Making Frameworks to Enhance General Educator Planning 4 How to Incorporate Decision-Making Frameworks to Enhance General Educator Planning 46 23
How to Use Progress Monitoring to Identify Non- Responders Within a Response-to-Intervention Framework to Identify Disability Traditional assessment for identifying students with learning disabilities relies on intelligence and achievement tests. Alternative framework is conceptualized as nonresponsiveness to otherwise effective instruction. Dual-discrepancy: Student performs below level of classmates. Student s learning rate is below that of his or her classmates. 47 How to Use Progress Monitoring to Identify Non- Responders Within a Response-to-Intervention Framework to Identify Disability All students do not achieve the same degree of mathematics competence. Just because mathematics growth is low, the student doesn t automatically receive special education services. If the learning rate is similar to that of the other students, then the student is profiting from the regular education environment. 48 24
How to Use Progress Monitoring to Identify Non- Responders Within a Response-to-Intervention Framework to Identify Disability If a low-performing student is not demonstrating growth where other students are thriving, then special intervention should be considered. Alternative instructional methods must be tested to address the mismatch between the student s learning requirements and the requirements in a conventional instructional program. 49 Case Study: Alexis 3 2 Digits Correct in 2 Minutes 2 1 1 Alexis s trend-line Alexis s goal-line 1 2 3 4 6 7 8 9 1 11 12 13 14 Weeks of Instruction 2
Case Study 1: Alexis 1 Case Study: Sascha 2 26
Case Study: Sascha 3 Case Study: Harrisburg Elem. Using CBM towards reading AYP 378 students 12 met initial benchmarks Discrepancy between universal proficiency and initial proficiency is 23 students Discrepancy of 23 students is divided by number of years until 213-214 23 11 = 23 23 students need to meet CBM benchmarks each year to demonstrate AYP 4 27
Case Study: Harrisburg Elem. Harrisburg Elementary: Across-Year School Progress Number Students Meeting CBM Benchmarks 4 3 2 1 (378) 23 24 2 26 27 28 29 21 211 212 213 214 End of School Year Case Study: Harrisburg Elem. Harrisburg Elementary: Within-Year School Progress Number Students Meeting CBM Benchmarks 2 1 1 (148) (148) Sept Oct Nov Dec Jan Feb Mar Apr May June 24 School-Year Month 6 28
Case Study: Harrisburg Elem. Harrisburg Elementary: Mrs. Chin Teacher Graph Number Students On Track to Meet CBM Benchmarks 2 2 1 1 Sept Oct Nov Dec Jan Feb Mar Apr May June 24 School-Year Month 7 Case Study: Harrisburg Elem. Harrisburg Elementary: Mr. Elliott Teacher Graph Number Students On Track to Meet CBM Benchmarks 2 2 1 1 Sept Oct Nov Dec Jan Feb Mar Apr May June 24 School-Year Month 8 29
Case Study: Harrisburg Elem. Harrisburg Elementary: Special Education Graph Number Students On Track to Meet CBM Benchmarks 2 2 1 1 Sept Oct Nov Dec Jan Feb Mar Apr May June 24 School-Year Month 9 Case Study: Harrisburg Elem. Harrisburg Elementary: Hallie Martin Student Graph CBM Score: Grade 1 Word Identification Fluency 1 8 6 4 2 Sept Oct Nov Dec Jan Feb Mar Apr May June 24 School-Year Month 6 3
Case Study: Harrisburg Elem. Harrisburg Elementary: Davindra Sindy Student Graph 1 CBM Score: Grade 3 Passage Reading Fluency 8 6 4 2 Sept Oct Nov Dec Jan Feb Mar Apr May June 24 School-Year Month 61 Case Study: Mrs. Wilson 62 31
Case Study: Mrs. Wilson 63 Case Study: Mrs. Wilson 64 32
Case Study: Joshua PRF: Words Read Correctly Per Minute 2 18 16 14 12 1 8 6 4 2 instructional changes Joshua s trendlines 1 2 3 4 6 7 8 9 1 11 12 13 14 1 16 17 18 19 2 21 22 23 24 Weeks of Instruction Joshua s goal-line 6 Case Study: Joshua PRF: Words Read Correctly Per Minut 2 18 16 14 12 1 8 6 4 2 1 2 3 4 6 7 8 9 1 11 12 13 14 1 16 17 18 19 2 21 22 23 24 Weeks of Instruction High-performing readers Middle-performing readers Low-performing readers 66 33
Discussion How would you incorporate graphing and interpreting CBM scores into your curriculum? What assignments would you include in your syllabus? 67 Homework for tonight Design an assignment for the topic of progress monitoring and interpretation of scores. What resources do you need from AIR for this assignment? 68 34