Assessment of Oregon s Students with Disabilities: Information and Updates Oregon Department of Education Office of Learning Fall 2013 Welcome Introductions Structure of this session 1
Objectives Overview of Office of Learning and District Roles Oregon s Statewide Assessments Updates Office of Learning & District Roles 2
Office of Learning/Instruction, Standards, Assessment, and Accountability Collect and report data in accordance with federal accountability reporting requirements through NCLB to ensure that rigorous student expectations are upheld Manage the statewide assessment for all of Oregon s students by developing, maintaining, and supporting the OAKS System Ensure the reliability of reporting (source) data through system security and system consistency Office of Learning/Student Services Ensure that IDEA s tenets of support and equity for students with disabilities are upheld and incorporated in a system that is also governed by NCLB s tenets of accountability and high expectations for all Collect, monitor, and respond to student and district level data related to this role Provide evidence to USDE to demonstrate adequate and appropriate use of federal funds related to this role 3
Interaction Between Units Monitor and maintain NCLB and IDEA requirements related to statewide assessments Respond to development needs to ensure shared vision (fit) within the assessment system Collaborate on reports and reporting Engage in relevant grant opportunities Districts Roles and Responsibilities Assess students in accordance with federal and state regulation in the context of providing a free and appropriate public education Provide accurate and reliable data to ODE Use data appropriately when decision making For additional information see Oregon s Test Administration Manual at: http://www.ode.state.or.us/search/page/?=486) 4
Oregon s Statewide Assessments Assessment System General Assessments HS 8 7 6 5 4 3 Accommodated General Assessments Extended: Standard Administration HS 8 7 6 5 4 3 Extended: Scaffold Administration 5
General Assessments OAKS Online All Students Reading: Grades 3 8 & 11 Mathematics: Grades 3 8 & 11 Science: Grades 5, 8, & 11 Writing: Grade 11* (for 2013-2014) Format: Online Accommodations *Grade 12 retake option 6
Test Window See Current Test Schedule PDF at http://www.ode.state.or.us/search/results/?id=169 13 SPP/APR: Assessment of SWD (Indicator B3) Performance Indicator Participation and Performance 2011-12: Participation: 95%+ Math; Target: 95+%. Actual 98.1% ELA Target: 95+%. Actual 98.4% Performance Math; Target: 70%. Actual 30.4% ELA Target: 70%. Actual 40.9% 14 7
Extended Assessment: Alternate Assessment-Alternate Achievement Standards Extended Assessment Alternate Assessment based on Alternate Achievement Standards (AA-AAS) Allowances for a state to create an alternate assessment for students with the most significant cognitive disabilities. IEP team decides who participates Up to 1% of the students who are found proficient ( meets and/or Exceeds ) can count toward state AYP performance reports (see Guidance section on ODE s Extended Assessments website). 8
Extended Assessment Reading: Grades Bands (Elem, Middle, Grade 11*) Mathematics: Grades 3 8 & 11* Science: Grades 5, 8, & 11* Writing: Grade 11* (for 2013-2014) Format: Paper-Pencil Standard or Scaffold Test Window See Current Test Schedule PDF at http://www.ode.state.or.us/search/results/?id=169 * Beginning in 2013-14, the window for entering Extended Assessment data will now close a week earlier to allow for the submission and analysis of grade 12 students data who are using this assessment to demonstrate proficiency in some or all of the Essential Skills in fulfillment of graduation requirements. 18 9
Accommodations Assessment Accommodations Accommodations are practices and procedures in presentation, response, setting, and timing or scheduling that, when used in an assessment, provide equitable access to all students. Accommodations do not compromise the learning expectations, construct, grade-level standard, and/or measured outcome of the assessment. Accommodations are NOT Modifications. 10
Updates Regional Series Common Core in Action First series in October/November https://netforum.avectra.com/eweb/dynamicpage.aspx?si te=cosa&webcode=ccssrs 11
Focus on Implementation Resources Classroom Resources District/Administrator Resources Professional Development www.ode.state.or.us/go/commoncore Professional Development Resources Modules Engage educators over multiple sessions Include facilitator guides and handouts Tools & Guidance Materials educators may find useful as they consider their professional development needs related to the Common Core http://www.ode.state.or.us/search/page/?id=3988 12
Resources: CCSS Toolkit: http://www.ode.state.or.us/search/page/?id=2860 CCSS parent toolkit: http://www.ode.state.or.us/search/page/?id=3380 CCSS page application to Students with Disabilities : http://www.corestandards.org/assets/application-to-students-withdisabilities.pdf Implementation of the CCSS: Evaluating the alignment of materials, assessments, units, and lessons: http://www.achievethecore.org/leadership-tools-common-core/aligningmaterials/materials-evaluation-toolkit/ Professional development modules on the shifts in CCSS: http://www.achievethecore.org/leadership-tools-commoncore/professional-development/ Smarter Balanced Overview Accommodations and Accessibility Resources 13
Overview Next-Generation Assessments (Math and English Language Arts/Literacy) Rigorous assessments of progress toward college and career readiness Common cut scores across all Consortium states Information about grade-level achievement and growth Valid, reliable, and fair for all students (except those with significant cognitive disabilities ) Administered online, using multiple measures Fully operational in 2014-15 school year 14
A Balanced Assessment System Common Core State Standards specify K-12 expectations for college and career readiness Formative resources: Supporting classroombased assessments to improve instruction Summative: College and career readiness assessments for accountability Teachers and schools have information and tools they need to improve teaching and learning Interim: Flexible and open assessments, used for actionable feedback All students leave high school college and career ready Accommodations & Accessibility 15
Changes in Structure Why Original Guidelines document was long Original Guidelines document contained information for different audiences Original Guidelines document was repetitive Graphic representation was challenging to understand We needed a document with information about tools that was easy to use Needed more information on specific constructs Changes in Structure What Previous Version Current Version Included information on theoretical underpinnings Included information on Individual Student Assessment Accessibility Profile (ISAAP) Created a separate document: A&A Framework Module on ISAAP in contract 23 Over 80 pages long One graphic: triangle addressing student and tool structures 25 pages total Two graphics: triangle for student structure; new graph for tool structure 16
Overall New Document Introduction Purpose and intended audience Briefly addresses Framework and ISAAP, includes links Three main sections Universal Tools Designated Supports Documented Accommodations Resources (References) Appendices Summary of supports Research lessons Key Components 17
Universal Tools New Graphic Guidelines were adopted 9/10/13 by the Governing States of Smarter Balanced Embedded Breaks, Calculator, Digital Notepad, English Dictionary, English Glossary, Expandable Passages, Global Notes, Highlighter, Mark for Review, Math Tools, Spell Check, Strikethrough, Tabenter Navigation, Writing Tools, Zoom Designated Supports Embedded Color Contrast, Highlighter, Magnification, Masking, Text-to-speech, Translations (Glossary), Translations (Stacked), Turn off Any Universal Accessibility Tools Documented Accommodations Non embedded Breaks, English Dictionary, Protractor, Ruler, Scratch Paper, Thesaurus Non embedded Bilingual Dictionary, Color Contrast, Color Overlay, Read Aloud Scribe, Separate Setting, Translation (Glossary) Embedded American Sign Language, Braille, Closed Captioning, Speech-to-text, Text-tospeech Non embedded Abacus, Alternate Response Options, Calculator, Multiplication Table, Print on Demand, Read Aloud, Scribe Embedded General Table, Appendix A Universal Tools Breaks Calculator ' Digital Notepad English Dictionary 2 English Glossary Expandable Passages Global Notes Highlighter Mark for Review Math Tools 3 Spell Check 4 Strikethrough Tab-enter Navigation Writing Tools 5 Zoom Non-embedded Breaks English Dictionary 12 Protractor Ruler Scratch Paper Thesaurus 13 Designated Supports Color Contrast Highlighter Magnification Masking Text-to-speech 6 Translations (Giossary)1 Translations (Stacked) 8 Turn off Any Universal Tools Bilingual Dictionary 14 Color Contrast Color Overlay ReadAloud Scribe 15 Separate Setting Translations (Giossary)1 6 Documented Accommodations American Sign Language 9 Braille Closed captioning 10 Speech-to-Text Text-to-Speech 11 Abacus Alternate Response Options 17 Calculator 18 Multiplication Table 19 Print on Demand ReadAloud Scribe 18
Speech-to-Text Available as a documented accommodation on all math and ELA items: Available for students providing a response, as a documented accommodation included in an IEP or 504. Available to students when taking notes in preparation for a written response, included in an IEP or 504. Students to use own Assistive Technology (AT) device, with AT device certification Note: Word prediction and conventions are not a challenge to the construct. Images and ELA Listening Items Images will be embedded in listening stimuli Available for all students Included only with appropriate stimuli No text in the images Note: Not included in A&A Guidelines; instead, part of item specifications 19
American Sign Language Available for students who are hard of hearing or deaf as a documented accommodation Available on math items Available on ELA listening items Closed Captioning Available for students who are hard of hearing or deaf as a documented accommodation Available on ELA listening items 20
DRAFT Calculator Policy Calculators on the Smarter Balanced Math Assessments Grades 3 5 Calculator Policy Smarter Balanced summative mathematics assessments for grades 3 5 do NOT allow for calculator usage. Grades 6 8 Calculator Policy In grades 6 8, the Smarter Balanced summative mathematics assessments are divided into two sections: Calculator Available and Calculator Not Available. The Smarter Balanced summative mathematics assessment for grade 6 allows an online four-function calculator during the Calculator Available section. The Smarter Balanced summative mathematics assessments for grades 7 and 8 allow an online scientific calculator during the Calculator Available section. High School Calculator Policy In high school, the Smarter Balanced summative mathematics assessments are divided into two sections: Calculator Available and Calculator Not Available. The Smarter Balanced summative mathematics assessments for high school allow online calculators with scientific, regression, and graphing capabilities during the Calculator Available section. 21
Calculator Universal embedded calculator: available on items as per Smarter Balanced item specifications and targets Non embedded calculator is a documented accommodation (i.e., Braille calculator) Student can use own device Calculator is not allowed on non calculator items Decision based on intended construct to be measured by assessment targets. Reporting Score report Make notation of accommodations available to students on parent/guardian report Lawyers specializing in SWD related issues supported his approach Report, by determined level, can show percentage of students having access to text to speech accommodation on reading passages. 22
Resources: Smarter Balanced Webpage www.smarterbalanced.org Smarter Balanced Practice Test http://sbac.portal.airast.org/practice test/ Usability, Accessibility and Accommodations Guidelines http://www.smarterbalanced.org/wordpress/wpcontent/uploads/2013/09/smarterbalanced_guidelines_091113.pdf. Smarter Balanced Spanish Resources Webpage http://www.smarterbalanced.org/parents students/como ayudar a todos losestudiantes a que tengan exito/. Smarter Balanced Assessment: Grade specific scoring guides (Tasks in braille included): http://sbac.portal.airast.org/practice test/resources/#scoring Extended Assessment Currently a Tier II state with National Center and State Collaborative (NCSC) alternate assessment consortium (http://www.ode.state.or.us/search/page/?id=3709 ) Beta tester and Evaluator: Curriculum & Instruction; Professional Development information/modules/materials ODE is in the process of identifying a vendor to develop an alternate assessment aligned to Common Core State Standards. 23
Extended Assessment Writing Due to budgetary restrictions, the Writing Extended Assessment continues to be suspended for grades 4 and 7 for 2013-14. 47 Extended Assessment High School Retake Policy ODE has adopted a policy allowing students whose IEP indicates the OAKS Extended Assessments to retest in their 12 th grade year, if they did not meet the alternate achievement standard as 11 th graders, for any of the subject areas tested by this assessment (i.e., Reading, Mathematics, Science, and Writing). While retests are not mandatory, like those who participate in the OAKS statewide assessments, districts should have testing opportunities available for grade 12 students with disabilities who wish to retake an OAKS Extended Assessment(s)--especially those needing to demonstrate proficiency for the Essential Skills graduation requirement. 24
Kindergarten Assessment New for 2013-14: Districts are required to administer a Kindergarten Assessment. The Accommodations Manual now includes a table of accommodations available for use on the Kindergarten Assessment based on a determination of individual student need. Changes to Accommodation Manual In the 2013-2014 edition of the Accommodations Manual (http://www.ode.state.or.us/search/page/?=487) the following are the new accommodations or changes to current accommodations: Kindergarten Assessment Accommodations Signed Interpretation of Statewide Assessments Accommodation Provided additional tables of accommodations for Work Samples. 50 25
Signed Interpretation of Statewide Assessments Accommodation New for 2013-14: In February, 2013, ODE approved the use of the Sign Language Interpretation Accommodation during the OAKS and Extended assessments in all academic areas except Reading. Sign language interpreter qualifications Test Administration Manual Guidance regarding retake of Writing Performance Assessment for students enrolled in Grade 12. 26
Assessment Accommodations All documents on the ODE assessment accommodations webpage have been updated. http://www.ode.state.or.us/search/page/?=487 ODE Contacts Brad Lenhardt (Accommodations, Alternate Assessment) Brad.Lenhardt@state.or.us Derek Brown (Assessment of Essential Skills) Derek.Brown@state.or.us Karin Moscon (CCSS) Karin.Moscon@state.or.us 54 27