Preschool Early Literacy Indicators How Does It Assess the Critical Early Literacy Skills? 1
PELI Assesses the Critical Preschool Literacy Skills! Measures are indicators of children s skill level. What is an indicator? Height and weight Temperature 2
PELI Assesses the Critical Preschool Literacy Skills! PELI assesses each of the four critical preschool literacy skills.! Alphabet Knowledge! Vocabulary Oral Language! Comprehension! Phonological Awareness 3
PELI Benchmark Materials! Benchmark Assessment: 10 different books equally difficult! 5 books for 3 4 year olds children who are two years away from kindergarten entry! 3 Benchmark books! 2 Interim (PM) books! 5 books for 4 5 year olds children who will be going to kindergarten in the next school year! 3 Benchmark books! 2 Interim (PM) books! Score Forms corresponding to each book 4
How to Use PELI Benchmark Materials Use Benchmark books to assess all children three times per year:! Beginning of year! Middle of year! End of year Use Interim books to assess some children between Benchmark assessments 5
PELI Progress Monitoring Materials! Progress Monitoring: Quick Checks! Scoring booklets and corresponding student materials for:! Alphabet Knowledge! Vocabulary Oral Language! Phonological Awareness 6
How to Use PELI Materials Progress Monitoring Use Quick Checks to monitor progress of children who are receiving additional instructional support in one or more critical skills:! Alphabet knowledge! Vocabulary-oral language! Phonological awareness 7
PELI Books for PK 3/4 8
PELI Books for PK 4/5 9
PELI Score Forms 10
PELI Administration and Scoring Overview Storybook Format! The Assessor sits beside the child.! Assessor s directions are written in bold on the righthand side of the book.! The child is directed to pictures on the left-hand side of the book.! The assessment is untimed. 11
Features of PELI! Storybook format is familiar to preschool students Student Pictures Assessor Directions! Child sits to left of assessor 12
Features of PELI! Stories feature diverse characters 13
Scales and Subtests Early Literacy! Alphabet knowledge! Name upper- and lower- case le<ers! Phonological awareness! Iden?fy first syllable in two- syllable words! Iden?fy first sound in single- syllable words Language! Comprehension! Answer ques?ons about story (who, what, when, where, why, predic?on, inference)! Fill in details from story in retell (CLOZE task)! Vocabulary/oral language! Names pictures! Tells about pictures/ words 14
PELI Administration and Scoring Overview: Introduction 15
PELI Administration and Scoring Overview: Alphabet Knowledge Alphabet knowledge! Child is asked to name as many letters as he/ she knows from an array of letters embedded in theme-related picture.! Score is number of letters correctly named. 16
PELI Administration and Scoring Overview: Vocabulary-Oral Language Vocabulary/Oral Language! Child is shown a scene related to the theme of the book.! Child is asked to:! a) name 10 items! b) tell everything he/she can about 5 items.! Score is total of a) number of pictures correctly named and b) quality of response rating for Tell About. 8 5 4 6 2 10 1 3 7 9 17
PELI Administration and Scoring Overview: Comprehension Comprehension! Comprehension Questions: Assessor reads a story pausing to ask questions before, during and after.! Shared Retell: Child fills in missing words during a brief retelling of the story.! Score is total of: a) questions correctly answered and b) correct responses during Shared Retell. 18
PELI Administration and Scoring Overview: Phonological Awareness Phonological Awareness! Game format! The assessor shows and names a picture and asks the child to say the first part or the first sound in words.! Score is total of: first parts of words and first sounds in words that child says. 19
PELI Quick Checks! Use to progress monitor a single skill:! Alphabet Knowledge! Phonological Awareness! Vocabulary and Oral Language! 10 alternate forms in a booklet 20
Sample Quick Check Scoring Booklet: Vocabulary-Oral Language 21
Sample Quick Check Scoring Booklet: Vocabulary-Oral Language 22
Sample Quick Check Student Materials: Vocabulary-Oral Language 23
Sample Quick Check Student Materials: Vocabulary-Oral Language 24
Research on PELI Study 1: n = 90 130! Descriptive statistics! Concurrent validity Study 2 n = 32! Reliability! Inter-rater! Alternate form! Test-retest Study 3 n = 165! Descriptive statistics! Concurrent and predictive validity Study 4: n = 44! Comparison of versions Study 5 n = 136! Vocabulary study Study 6 n = 258! Preliminary benchmark goals Study 7 n = 2746! Benchmark Goal Study Study 8 n = 5150! Year 1 Early Release! Validate benchmark goals! Equating study Study 9 n = 6033! Year 2 Early Release! Validate benchmark goals 25
Reliability and Validity of the PELI Inter-rater reliability:.96 -.99 Alternate form reliability:.75.96 Criterion-related validity with PPVT, CELF ELI:.36 -.72 Criterion related validity with TOPEL, GRTR:. 28 -.92 Bravo Aguayo & Kaminski, 2012; Bravo Aguayo & Squires, submitted for publication; Kaminski, Abbott, Bravo Aguayo, Good, & Latimer, 2013 26
PELI Correlations with Criterion Measures (Kaminski et al., 2014) 27
PELI Benchmark Goals Analyses Conditional probability of meeting goal on external criterion measure(s)! CELF PreK Expressive Language Index (40 th %ile)! DIBELS Next Kindergarten BOY Composite Score Primary specification: Establish goals whereby odds are favorable (80-90%) of achieving outcome Secondary specification: Keep marginal percents consistent (e.g., 40%) 28
Benchmark Goals (Kaminski et al., 2014) 29 29
Sensitivity to Effects of Intervention (Kaminski et al., in preparation) 30
Questions? For information about the PELI Early Release for Research Partners go to:! https://dibels.org/ann_peli.html For other questions, send email to:! info@dibels.org 31