1 Page 1 of 16 Technical Report Teach for America Teachers Contribution to Student Achievement in Louisiana in Grades 4-9: to George H. Noell, Ph.D. Department of Psychology Louisiana State University & Kristin A. Gansle College of Education Louisiana State University October 27, 2009 Acknowledgements This report is based upon data provided by the Division of Planning, Analysis, and Information Resources of the Louisiana Department of Education. The authors would like to thank Allen Schulenberg, Sam Pernici, Michael Collier, and David Elder (Division Director), without whom this work would not have been possible. Additional data were provided by the Louisiana Board of Regents and Teach for America. Any errors, omissions, or misstatements contained herein are entirely the responsibility of the authors. Any conclusions proffered are the responsibility of the authors and do not reflect the views of the Louisiana Department of Education or the professionals from that organization who provided professional guidance and technical assistance. This work was supported in part by award CT-06/07-VAA-01 from the Louisiana Board of Regents and the Carnegie Corporation of New York.
2 Page 2 of 16 Table of Contents Abstract... 3 I. Introduction... 4 II. Data Merging Process and Base HLM Model Development... 5 Figure 1: Nesting Structure... 5 Attrition in TFA Teacher Data... 7 III. Assessment of the Contribution of TFA Teachers to Achievement... 7 Figure 2: English Language Arts Results... 9 Figure 3: Reading Results... 9 Figure 4: Mathematics Results Figure 5: Science Results Figure 6: Social Studies Results Table 1: Assessment Results across Content Areas and Comparison Groups IV. Persistence of TFA Teachers in Teaching Figure 7: Persistence in Teaching by Licensure Figure 8: Persistence in Teaching by Licensure Figure 9: Persistence in Teaching by Licensure V. Summary References... 16
3 Page 3 of 16 Abstract Teach for America Teachers Contribution to Student Achievement in Louisiana in Grades 4-9: to Analyses were conducted examining the degree to which students who were taught by Teach for America (TFA) corps members exceeded, met, or failed to meet the educational attainment that would be projected for them based on prior achievement and demographic factors. Work began with the augmentation of a large multivariate longitudinal database linking students, teachers, and outcome data that had been developed for a prior study (Noell, Porter, Patt, & Dahir, 2008). This was followed by a model fitting phase in which the hierarchical linear models (HLM) that were developed to predict student achievement based upon prior achievement, student demographic factors, and classroom level covariates in the previous study were adapted to examine TFA corps members contributions to educational attainment. The models nested students within teachers and teachers within schools. Separate models were developed for each content area. Comparisons were made against all teachers, new teachers, and experienced teachers. In all cases, coefficients for TFA were positive and in 4 of 5 content areas they were statistically significantly different when compared to new teachers. Additional analyses were also conducted to examine the persistence of TFA corps members in teaching beyond the first year. Across samples, new TFA teachers 5- year persistence in teaching ranged from 4% to 20%. In comparison, the 5-year persistence of new teachers with standard teaching certificates for these cohorts ranged from 62% to 65%.
4 Page 4 of 16 Technical Report: Teach for America Teachers Contribution to Student Achievement in Louisiana in Grades 4-9: to I. Introduction Two recent reports of the value added assessment initiative of teacher preparation in Louisiana have highlighted the success of programs such as the Masters of Arts in Teaching Program at the University of Louisiana at Monroe and The New Teacher Project (TNTP) across multiple content areas (Noell, Gansle, Patt, & Schafer, 2009; Noell, Porter, Patt, & Dahir, 2008). The success of these programs and the poorer results for some programs has raised a host of questions about candidate selection, content preparation, pedagogical preparation, and the transition into teaching for new teachers. Those questions are being examined as part of an ongoing research initiative by a research team lead by Dr. Jeanne Burns at the Louisiana Board of Regents. In addition to process questions, the results of the last two value added assessments have raised questions relevant to subgroups within overall preparation program estimates. One noteworthy question has been the role of Teach for America (TFA) corps members within The New Teacher Project (TNTP) program results. The TNTP estimates reflect a mixture of TFA corps members and TNTP teachers who are not affiliated with TFA. Although overall, TNTP may have a large proportion of TFA members enrolled in the program, many of them are not represented in the TNTP estimates because they have not yet received a permanent teaching certificate. They are teaching on a practitioner teacher license. As a result, only 23% to 35% of the teachers in the program estimates across content areas for TNTP in the 2008 report were TFA corps members. This result is a function of the interaction of the length of time it typically takes practitioner teachers to obtain their permanent teaching license and the typical length of service in teaching for TFA corps members. Prior to this issue surfacing, TFA expressed an interest in obtaining an analysis that would be specific to TFA corps members. They provided the research team at LSU a data set that would allow identification of the TFA corps members who were in the analysis completed for the 2008 report (school years , , and ). The analyses reported here in are based on the integration of the TFA corps members data set with the existing longitudinal data set that was developed to complete the value added analysis of teacher preparation reported by Noell and colleagues (2008). This technical report provides an analysis of TFA corps members only. Readers interested in the details surrounding how the broader data sets and models were built are referred to the earlier report. This report will provide some background information regarding the data set and the modifications that were necessary to complete the TFA specific analysis reported herein.
5 Page 5 of 16 II. Data Merging Process and Base HLM Model Development The intact longitudinal databases linking students, teachers, and courses for the , , and school years were used for these analyses. The data were based on students in grades 4 through 9 during those school years. Grades 4 through 9 were examined because those are the grade levels in which state administered standardized test data are available for each spring and for the preceding year. The availability of preceding year test scores provides the most important predictor of current year performance and is necessary for the analyses presented herein. Results were examined for English language arts, reading, mathematics, science, and social studies. The datasets included approximately 160,000 to 250,000 student observations per content area per year taught by approximately 6,000 to 7,000 teachers. The number of student observations was smaller in reading than in other subject areas because relatively few students have reading courses beyond grade 6. The details of the data set assembly are provided in Noell and colleagues (2008). This data set was augmented by adding a variable indicating whether a teacher was a TFA corps member. Data were analyzed using hierarchical linear models (HLM; McCulloch & Searle, 2001; Raudenbush & Bryk, 2002). The models used in these analyses began with the same base models that were developed in the previous report regarding teacher preparation assessment (Noell et al., 2008). The base models were the multiyear models that used prior achievement, demographic variables, attendance, and school enrollment to model current year achievement prior to consideration of TFA teacher effects. The modeling approach was somewhat parallel to Tekwe and colleagues (2004) in general strategy and has been followed over four years by the Value Added Assessment of Teacher Preparation Programs Project (VAA-TPP) at LSU. Figure 1 below illustrates the nesting structure that was employed. Figure 1: Nesting Structure of Students within Teachers and Teachers within Schools School 1 School 2 Teacher 1 Teacher 2 Teacher 3 Teacher 4 Student 1 Student 2 Student 3 Student 4 Student 5 Student 6 Student 7 Student 8
6 Page 6 of 16 At the student level, the model included achievement (5 variables), gender, ethnicity (4 variables), disability (7 variables), free or reduced lunch (2 variables), limited English proficiency, and absences. At the classroom and school building levels, models were tested for the contribution of aggregate variables and those that were significant at p <.01 were retained. Separate models were developed for each year. Classroom and school building level covariates were used to adjust intercepts for students and classrooms respectively. No covariates were used to predict lower level coefficients and all coefficients were treated as fixed. Error variance was modeled for intercepts with a mean of 0 and common variance at each level. A simplified presentation of the model is provided below. Only equations for intercepts are presented. All other equations (e.g., the level 2 and level 3 models for level one coefficients) were modeled as fixed and not varying. In the equations presented below, is used to indicate summing across the p, q, and s coefficients at the student, teacher, and school levels of the model respectively. Level 1: Students where Y ijk π 0jk π pjk a pijk e ijk Y ijk = π 0jk + (π pjk )a pijk + e ijk is the achievement of student i in class j at school k in the target subject is the adjusted mean achievement for classroom j at school k are the p coefficients that weight the contribution of the student level data in the prediction of Y for p = 1 to the total number of coefficients are the student level data (prior achievement, demographic variables, and attendance) that predict achievement for p = 1 to the total number of data points the student level random effect, the deviation of the predicted score of student i in classroom j in school k from the obtained score Level 2: Classrooms where π 0jk β 00k β q0k X q0jk r 0jk π 0jk = β 00k + ( β q0k )X q0jk + r 0jk is the adjusted mean achievement for classroom j at school k is the mean achievement for school k are the q coefficients that weight the weight the relationship between the classroom characteristics and π 0jk, q = 1 to the total number of coefficients are the classroom level data that are used to predict achievement; this is also the location in the model at which codes for recent TPP completers are entered (described below) the classroom level random effect, the deviation of classroom jk s measured classroom mean from its predicted mean
7 Page 7 of 16 Level 3: Schools β 00k = γ ( γ s00 )W s00k + u 00k where β 00k is the mean achievement for school k γ 000 is the grand mean achievement in the target subject γ s00 are the s coefficients that weight the weight the relationship between the school characteristics and β 00k for s = 1 to the total number of coefficients W s00k are the school level data that are used to predict achievement u 00k the school level random effect, the deviation of school k s measured classroom mean from its predicted mean Attrition in TFA Teacher Data It is important to note that there was a significant level of attrition between the number of corps members identified from TFA administrative records and those for whom data were available. From the data TFA provided, 350 teacher cases were identified for whom a valid certification record could be identified for that teacher during the relevant years. Of those teachers, 271 were identified as a teacher of record during the to school years. Of these 271 eligible teachers, 127 taught eligible grades and classes. If all teachers taught core subjects one would expect 135 teachers to be available for analysis as approximately half of all teachers teach outside the assessed grade span (e.g., kindergarten or twelfth grade). Some of the additional attrition may be the result of teachers teaching subjects that were not assessed (e.g., French). In order for a teacher to contribute to the analyses, that teacher and their students had to remain together for the bulk of the school year. III. Assessment of the Contribution of TFA Teachers to Achievement A series of HLM analyses were conducted across five content areas to examine the extent to which students taught by TFA corps members exceeded, met, or failed to meet the level of educational attainment that would be expected based upon prior achievement and demographic factors. Examining the efficacy of a group of teachers requires specifying a point of comparison. The selection of the comparison describes the plausible alternative teacher assignment that would have occurred if those students had not received a TFA teacher. This alternative has been described as the plausible counter factual (Rubin, 1974). The difficulty in specifying this comparison is that there are a number of plausible alternatives. For example, it is plausible that a student may receive a TFA corps member as a teacher in lieu of another new teacher, or in lieu of an uncertified teacher, or in lieu of an experienced teacher. In order to examine the implications of these points of comparison, different controls were entered into a series of models for each content area to illustrate the impact of different assumptions about the relevant comparison. In Model 1, an indicator variable was entered at level 2 to indicate whether a teacher was a TFA corps member. Model 1 was the comparison of TFA corps members to all teachers with no additional specification. In Model 2, indicator variables were added to control for years of experience. Indicators were added for 1, 2, 3-10, and more
8 Page 8 of 16 than 10 years of experience. Model 2 examined the effectiveness of TFA teachers controlling for years of experience. Model 3 compared TFA corps members directly to first and second year teachers (new teachers). The results of Models 2 and 3 are closely parallel as TFA teachers were overwhelmingly first and second year teachers (86%) and were nearly balanced between first and second year teachers. Model 4 was added to parallel the models used in the value added assessment of teacher preparation reports. In this model, indicators were entered for certification status and for being a first or second year teacher other than TFA members. As such, in this analysis the comparison is with experienced teachers teaching in their area of certification. A final issue in specifying the model was whether to use the data from just the districts that employed TFA teachers or from the entire State. Models were run for both the whole State and the select districts. In all cases, the obtained coefficients and probability values were quite close to one another. In order to leverage the available data to the maximum degree possible, the results presented here are those that use the entire State database. This also places these results in the same context as value added assessment of teacher preparation reports (Noell et al., 2009; Noell et al., 2008). The key findings are presented graphically in Figures 2 through 6 and numerically in Table 1 below. The coefficients indicate the degree to which students taught by TFA teachers exceeded projected achievement based on the HLM. The coefficients are derived from the scale of the Louisiana Educational Assessment of Progress (LEAP) which has a mean of approximately 300 and standard deviation of approximately 50 across content areas and years. To facilitate comparison across content and areas, scores were standardized so that the standard deviation would be exactly 50 across years and content areas. The results are strikingly consistent across subjects. In all content areas and in all comparisons, the coefficient obtained was positive. In all cases the results for the comparison to all teachers were positive, but were not statistically significant. In some of these cases it is quite plausible that with a larger sample of TFA teachers, coefficients of these magnitudes might become statistically significant (e.g., mathematics). Similarly, although they possessed a positive value, the coefficients for comparisons to experienced teachers were not statistically significantly different. It is important to note that TFA teachers are overwhelmingly first and second year teachers and that previous research in Louisiana has found statistically significant differences favoring experienced teachers over new teachers. If these results were placed in the context of the Value Added Assessment of Teacher Preparation model they would have fallen at Level 2 (see Noell et al., 2008, 2009). Level 2 results have been described as more similar to experienced teachers than typical new teacher performance. When TFA teachers coefficients for student achievement were compared to new teachers (first and second year teachers) as a group, they were positive and statistically significant for English language arts, reading, mathematics, and science. The social studies result was consistent with findings from other subjects, but was not statistically significant. This is likely the result of a smaller sample in social studies and the generally greater variance for data surrounding the social studies assessments.
9 Page 9 of 16 Figure 2: English Language Arts Results Figure note. The height of the colored bar represents the coefficient for the degree to which TFA teachers students exceeded expected achievement based on the HLM. The vertical black error I-bars illustrate the 95% confidence interval around the coefficient. In instances in which the error bar does not overlap with the x-axis, TFA teachers were significantly different from other teachers (p <.05). Figure 3: Reading Results Figure note. The height of the colored bar represents the coefficient for the degree to which TFA teachers students exceeded expected achievement based on the HLM. The vertical black error I-bars illustrate the 95% confidence interval around the coefficient. In instances in which the error bar does not overlap with the x-axis, TFA teachers were significantly different from other teachers (p <.05).
10 Page 10 of 16 Figure 4: Mathematics Results Figure note. The height of the colored bar represents the coefficient for the degree to which TFA teachers students exceeded expected achievement based on the HLM. The vertical black error I-bars illustrate the 95% confidence interval around the coefficient. In instances in which the error bar does not overlap with the x-axis, TFA teachers were significantly different from other teachers (p <.05). Figure 5: Science Results Figure note. The height of the colored bar represents the coefficient for the degree to which TFA teachers students exceeded expected achievement based on the HLM. The vertical black error I-bars illustrate the 95% confidence interval around the coefficient. In instances in which the error bar does not overlap with the x-axis, TFA teachers were significantly different from other teachers (p <.05).
11 Page 11 of 16 Figure 6: Social Studies Results Figure note. The height of the colored bar represents the coefficient for the degree to which TFA teachers students exceeded expected achievement based on the HLM. The vertical black error I-bars illustrate the 95% confidence interval around the coefficient. In instances in which the error bar does not overlap with the x-axis, TFA teachers were significantly different from other teachers (p <.05).
12 Page 12 of 16 Table 1: Assessment Results across Content Areas and Comparison Groups All Teachers Controlled for Experience New Teachers Experienced Certified Teachers English Language Arts 0.94 (-1.2, 3.1) p = 0.40 n = (0.6, 4.9) p = 0.01 n = (0.7, 5.05) p = 0.01 n = (-1.6, 2.7) p = 0.62 n = 70 Reading 1.33 (-1.8, 4.4) p = 0.41 n = (-0.6, 5.99) p = 0.10 n = (0.09, 6.37) p = n = (-2.2, 4.0) p = 0.56 n = 42 Mathematics 1.87 (-0.83, 4.57) p = 0.17 n = (1.7, 6.7) p < n = (1.79, 7.13) p = n = (-1.5, 3.9) p = 0.37 n = 89 Science 0.96 (-1.0, 3.0) p = 0.34 n = (0.3, 4.3) p = 0.03 n = (0.53, 4.55) p = n = (-1.4, 2.6) p = 0.53 n = 73 Social Studies 1.02 (-3.7, 5.7) p = 0.67 n = (-1.8, 7.2) p = 0.24 n = (-1.58, 7.72) p = n = (-4.0, 5.4) p = 0.78 n = 42 Table note. The top number in each cell is the coefficient based on the typical mean (300) and standard deviation (50) of Louisiana s assessment instruments. The values in parentheses are the 95% confidence interval. The p value is the probability value of the test of statistical significance for that coefficient. The n is the number of observations of teachers within years. IV. Persistence of TFA Teachers in Teaching An additional area of interest regarding TFA teachers is the extent to which they persist in teaching. One of the concerns expressed about TFA has been that corps members do not contribute to the enduring teacher workforce. An additional set of analyses was conducted examining the persistence in teaching of TFA corps members as
13 Page 13 of 16 compared to new teachers with standard licenses and teachers with practitioner licenses. The new teachers with standard licenses typically would be new program completers from undergraduate teacher preparation programs. The other teachers with practitioner licenses would be new teachers in practitioner training programs who were not enrolled through TFA. These include both university-based programs and private providers. The figures below present the percent of new teachers for each beginning year that persisted in teaching each subsequent year. This analysis was not dependent upon the HLM analyses above. Teachers could contribute to these analyses regardless of the grade level or content area in which they taught. For each year, all first time teachers were identified as TFA members, practitioner teachers, or new teachers with a standard license. The persistence in teaching of each of these groups was then followed. Records were located and followed for 132 first time TFA teachers for , 96 for , and 104 for Not surprisingly given the design of TFA, teacher persistence in teaching is similar to other paths into teaching for the second year, but then drops off dramatically following that year. For example, while 65% of new teachers with standard certificates were still teaching 5 years later for the entrants of only 4% of TFA teachers were still teaching in Louisiana. The subsequent years demonstrated somewhat higher persistence with 20% of the class of persisting 5 years and 18% of the class of persisting 4 years. Figure 7: Persistence in Teaching by Licensure
14 Page 14 of 16 Figure 8: Persistence in Teaching by Licensure Figure 9: Persistence in Teaching by Licensure V. Summary Results are strikingly consistent across content areas. In all areas except for social studies, TFA corps members were statistically significantly more effective than other new teachers. The magnitude and direction of the result in social studies is consistent with the
15 Page 15 of 16 other content areas, but due to greater variability within the social studies domain and a smaller number of observations, the result was not statistically significant. Although none of them achieved statistical significance, the coefficients for TFA corps members were positive when compared to experienced teachers teaching in their area of certification. However, given the magnitude of the difference, if it held in a larger sample, it would take a large sample of TFA members for an effect of this magnitude to achieve statistical significance. It is also worth noting that within the Louisiana studies, comparisons between experienced and new teachers have statistically significantly favored the experienced teachers. This is particularly salient as these TFA teachers are overwhelmingly first and second year teachers. If their results were consistent with previous overall findings in Louisiana, one would expect them to perform more poorly than experienced teachers. The persistence in teaching data clearly demonstrate that a small minority of Louisiana TFA corps members persist to the fourth year in teaching and beyond. Persistence across the three cohorts examined out to the fourth year ranged from 7% to 20% of each year cohort remaining in teaching in Louisiana. Overall, the data suggest that TFA corps members may be more comparable to experienced certified teachers than new teachers in their effectiveness, but that few of them persist in teaching in Louisiana beyond three years.
16 Page 16 of 16 References McCulloch, C. E., & Searle, S. R. (2001). Generalized, linear, and mixed models. New York: Wiley. Noell, G. H., Gansle, K. A., Patt, R. M., & Schafer, M. J. (August, 2009). Value Added Assessment of Teacher Preparation in Louisiana: to Baton Rouge, LA: Louisiana State University, Department of Psychology. Noell, G. H., Porter, B. A., Patt, R. M., & Dahir, A. (2008). Value added assessment of teacher preparation in Louisiana: to Added%20Report%20( ).pdf Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2 nd Ed.). London: Sage. Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66, Tekwe, C. D., Carter, R. L., Ma, C., Algina, J., Lucas, M. E., Roth, J., Ariet, M., Fisher, T., & Resnick, M. B. (2004). An empirical comparison of statistical models for value-added assessment of school performance. Journal of Educational and Behavioral Statistics, 29,
Evaluation of Delaware s Alternative Routes to Teacher Certification Prepared for the Delaware General Assembly January 2015 Research Team Steve Cartwright, Project Director Kimberly Howard Robinson, Ph.D.
Accountability Brief Public Schools of North Carolina State Board of Education North Carolina Department of Public Instruction Michael E. Ward, Superintendent March, 2003 Setting Annual Growth Standards:
Abstract Title Page. Title: Conditions for the Effectiveness of a Tablet-Based Algebra Program Authors and Affiliations: Andrew P. Jaciw Megan Toby Boya Ma Empirical Education Inc. SREE Fall 2012 Conference
Teacher preparation program student performance models: Six core design principles Just as the evaluation of teachers is evolving into a multifaceted assessment, so too is the evaluation of teacher preparation
CHARTER SCHOOL PERFORMANCE IN INDIANA credo.stanford.edu March 2011 TABLE OF CONTENTS INTRODUCTION... 3 CHARTER SCHOOL IMPACT BY STUDENTS YEARS OF ENROLLMENT AND AGE OF SCHOOL... 6 DISTRIBUTION OF CHARTER
HLM: A Gentle Introduction D. Betsy McCoach, Ph.D. Associate Professor, Educational Psychology Neag School of Education University of Connecticut Other names for HLMs Multilevel Linear Models incorporate
Arizona AYP Terms Annual Measurable Objectives (AMOs) In accordance with the No Child Left Behind Act of 2001, the Arizona Department of Education (ADE) has established the following intermediate goals:
CHARTER SCHOOL PERFORMANCE IN PENNSYLVANIA credo.stanford.edu April 2011 TABLE OF CONTENTS INTRODUCTION... 3 DISTRIBUTION OF CHARTER SCHOOL PERFORMANCE IN PENNSYLVANIA... 7 CHARTER SCHOOL IMPACT BY DELIVERY
Abstract Title Page Not included in page count. Title: The Impact of The Stock Market Game on Financial Literacy and Mathematics Achievement: Results from a National Randomized Controlled Trial. Author(s):
Introduction to Data Analysis in Hierarchical Linear Models April 20, 2007 Noah Shamosh & Frank Farach Social Sciences StatLab Yale University Scope & Prerequisites Strong applied emphasis Focus on HLM
Teacher Preparation and Performance in North Carolina Public Schools This policy brief examines the distribution, effectiveness, and persistence of individuals entering the teaching profession with different
Advanced Degrees and Student Achievement-1 Running Head: Advanced Degrees and Student Achievement A STUDY OF WHETHER HAVING A PROFESSIONAL STAFF WITH ADVANCED DEGREES INCREASES STUDENT ACHIEVEMENT By MEGAN
ACT Research & Policy Technical Brief 2016 Relating the ACT Indicator Understanding Complex Texts to College Course Grades Jeff Allen, PhD; Brad Bolender; Yu Fang, PhD; Dongmei Li, PhD; and Tony Thompson,
Louisiana Special Education Guidance This document outlines how special education policies impact students with disabilities and serves as a reference guide for LEA administrators and high school staff
Working Brief June 2011 The Middle Grades Student Transitions Study Navigating the Middle Grades and Preparing Students for High School Graduation Michael J. Kieffer Teachers College, Columbia University
Allen Elementary School April 4, 216 Dear Parents and Community Members: We are pleased to present you with the (AER), which provides key information on the 214-15 educational progress for the. The AER
Power Calculation Using the Online Variance Almanac (Web VA): A User s Guide Larry V. Hedges & E.C. Hedberg This research was supported by the National Science Foundation under Award Nos. 0129365 and 0815295.
Iowa School District Profiles Overview This profile describes enrollment trends, student performance, income levels, population, and other characteristics of the Central City public school district. The
Program Overview and Mission The College of Saint Elizabeth Report Narrative The College of Saint Elizabeth has been recognized as a leader in teacher education since its founding over 100 years ago. In
Highland Park High Twp HSD 3 Highland Park, ILLINOIS GRADES : 9 2 Highland Park High 2 8 ILLINOIS SCHOOL REPORT CARD and federal laws require public school districts to release report cards to the public
Stability of School Building Accountability Scores and Gains CSE Technical Report 561 Robert L. Linn CRESST/University of Colorado at Boulder Carolyn Haug University of Colorado at Boulder April 2002 Center
All children will learn, grow and develop to realize their full potential. The Parents as Teachers program: its impact on school readiness and later school achievement A Research Summary Based on a report
Teacher Qualifications and First Grade Achievement: A Multilevel Analysis An Occasional Paper by: Robert G. Croninger, Ph.D. University of Maryland, College Park Jennifer King Rice, Ph.D. University of
Transitioning English Language Learners in Massachusetts: An Exploratory Data Review March 2012 i This document was prepared by the Massachusetts Department of Elementary and Secondary Education Mitchell
Abstract Title: Identifying and measuring factors related to student learning: the promise and pitfalls of teacher instructional logs MSP Project Name: Assessing Teacher Learning About Science Teaching
Examining College Students Gains in General Education Dena A. Pastor and Pamela K. Kaliski James Madison University Brandi A.Weiss University of Maryland Abstract Do students change as a result of completing
Εισαγωγή στην πολυεπίπεδη μοντελοποίηση δεδομένων με το HLM Βασίλης Παυλόπουλος Τμήμα Ψυχολογίας, Πανεπιστήμιο Αθηνών Το υλικό αυτό προέρχεται από workshop που οργανώθηκε σε θερινό σχολείο της Ευρωπαϊκής
Educ Asse Eval Acc (2009) 21:209 234 DOI 10.1007/s11092-009-9074-2 Is experience the best teacher? A multilevel analysis of teacher characteristics and student achievement in low performing schools Francis
Introduction to Multilevel Modeling Using HLM 6 By ATS Statistical Consulting Group Multilevel data structure Students nested within schools Children nested within families Respondents nested within interviewers
High School Graduation Rates in Maryland Technical Appendix Data All data for the brief were obtained from the National Center for Education Statistics Common Core of Data (CCD). This data represents the
Introduction to Longitudinal Data Analysis Longitudinal Data Analysis Workshop Section 1 University of Georgia: Institute for Interdisciplinary Research in Education and Human Development Section 1: Introduction
MSP-Motivation Assessment Program (MSP-MAP) Tools for the Evaluation of Motivation-Related Outcomes of Math and Science Instruction Martin Maehr (email@example.com), Principal Investigator Stuart Karabenick
DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9 Analysis of covariance and multiple regression So far in this course,
19-22-2-26-5 Metea Valley High Prairie CUSD 2 Aurora, ILLINOIS GRADES : 9 1 11 12 2 1 2 Metea Valley High 1 ILLINOIS SCHOOL REPORT CARD and federal laws require public school districts to release report
Department of Psychology and Human Development Vanderbilt University GCM, 2010 1 Multilevel Modeling - A Brief Introduction 2 3 4 5 Introduction In this lecture, we introduce the multilevel model for change.
Illustration (and the use of HLM) Chapter 4 1 Measurement Incorporated HLM Workshop The Illustration Data Now we cover the example. In doing so we does the use of the software HLM. In addition, we will
TEACH FOR AMERICA TEACHERS IN DUVAL COUNTY PUBLIC SCHOOLS: AN ANALYSIS OF RETENTION AND PERFORMANCE Final Report August 29, 2014 Douglas D. Ready, Ph.D. Associate Professor of Education and Public Policy
Title: Research on the efficacy of master s degrees for teachers Date: April 2014 Question: >> Do teachers who have master s degrees support better outcomes for students than their counterparts without
SOUTH PEKIN SD 37 SOUTH PEKIN, ILLINOIS and federal laws require public school districts to release report cards to the public each year. 2 7 ILLINOIS DISTRICT REPORT CARD STUDENTS RACIAL/ETHNIC BACKGROUND
February 28, 2014 An Evaluation of Kansas City Reading Programs for Turn the Page Kansas City Leigh Anne Taylor Knight, Ed. D. Hajar Aghababa, Ph. D. Jiaxi Quan, Ph.D. Pat Oslund, M.A. Technical Assistance:
Student Loan Information Provision and Academic Choices By Maximilian Schmeiser, Christiana Stoddard, and Carly Urban As the cost of pursuing post-secondary education in the United States has continued
Research Brief: Master s Degrees and Teacher Effectiveness: New Evidence From State Assessments February 2012 CREDITS Arroyo Research Services is an education professional services firm that helps education
Gender Effects in the Alaska Juvenile Justice System Report to the Justice and Statistics Research Association by André Rosay Justice Center University of Alaska Anchorage JC 0306.05 October 2003 Gender
5-6--7- Wm Fremd High Township HSD Palatine, ILLINOIS GRADES : 9 Wm Fremd High ILLINOIS SCHOOL REPORT CARD and federal laws require public school districts to release report cards to the public each year.
www.ncolr.org/jiol Volume 7, Number 3, Winter 2008 ISSN: 15414914 Assessment of Online Learning Environments: Using the OCLES(20) with Graduate Level Online Classes Thomas A. DeVaney Nan B. Adams Cynthia
Using Hierarchical Linear Models to Measure Growth Measurement Incorporated Hierarchical Linear Models Workshop Chapter 6 Motivation Linear Growth Curves Quadratic Growth Curves Some other Growth Curves
Utah Comprehensive Counseling and Guidance Program Evaluation Report John Carey and Karen Harrington Center for School Counseling Outcome Research School of Education University of Massachusetts Amherst
The Effects of Read Naturally on Grade 3 Reading: A Study in the Minneapolis Public Schools David Heistad, Ph.D. Director of Research, Evaluation, and Assessment Minneapolis Public Schools Introduction
Using Value Added Models to Evaluate Teacher Preparation Programs White Paper Prepared by the Value-Added Task Force at the Request of University Dean Gerardo Gonzalez November 2011 Task Force Members:
The Long-Term Effects of After-School Programming on Educational Adjustment and Juvenile Crime: A Study of the LA s BEST After-School Program Pete Goldschmidt, Denise Huang, & Marjorie Chinen CRESST/University
Attitudes Toward Science of Students Enrolled in Introductory Level Science Courses at UW-La Crosse Dana E. Craker Faculty Sponsor: Abdulaziz Elfessi, Department of Mathematics ABSTRACT Nearly fifty percent
Chapter 5: Analysis of The National Education Longitudinal Study (NELS:88) Introduction The National Educational Longitudinal Survey (NELS:88) followed students from 8 th grade in 1988 to 10 th grade in
SOUTH DAKOTA BOARD OF REGENTS Full Board AGENDA ITEM: 29 DATE: April 1-2, 2015 ******************************************************************************* SUBJECT: Teacher Education Report 2014 This
College Readiness LINKING STUDY A Study of the Alignment of the RIT Scales of NWEA s MAP Assessments with the College Readiness Benchmarks of EXPLORE, PLAN, and ACT December 2011 (updated January 17, 2012)
Contingency Tables and the Chi Square Statistic Interpreting Computer Printouts and Constructing Tables Contingency Tables/Chi Square Statistics What are they? A contingency table is a table that shows
CRITICAL THINKING ASSESSMENT REPORT Prepared by Byron Javier Assistant Dean of Research and Planning 1 P a g e Critical Thinking Assessment at MXC As part of its assessment plan, the Assessment Committee
Business Course Text Bowerman, Bruce L., Richard T. O'Connell, J. B. Orris, and Dawn C. Porter. Essentials of Business, 2nd edition, McGraw-Hill/Irwin, 2008, ISBN: 978-0-07-331988-9. Required Computing
The Bridge: From Research to Practice Achievement of Children Identified with Special Needs in Two-way Spanish/English Immersion Programs Dr. Marjorie L. Myers, Principal, Key School - Escuela Key, Arlington,
ACADEMIC BACKGROUND Julie L. Bergeron, Ph.D. Louisiana State University in Shreveport Doctor of Philosophy Louisiana State University Major Field: Curriculum and Instruction Emphasis: Reading Dissertation
Ford, R., & Rice, K. (2015). Value-Added Results for Public Virtual Schools in California. Educational Technology & Society, 18 (4), 412 423. Value-Added Results for Public Virtual Schools in California
5-6-34-4-8 Westbrook Elementary Glenview CCSD 34 Glenview, ILLINOIS GRADES : PK K Westbrook Elementary ILLINOIS SCHOOL REPORT CARD and federal laws require public school districts to release report cards
Degree Attainment of Undergraduate Student Borrowers in Four-Year Institutions: A Multilevel Analysis By Dai Li Dai Li is a doctoral candidate in the Center for the Study of Higher Education at Pennsylvania
2015 Teacher Education Report 2015 This report provides a data-driven snapshot of the five teacher education programs in the public university system (i.e., BHSU, DSU, NSU, SDSU, and USD). Data are shown
Comparison of Progress Monitoring with Computer Adaptive Tests and Curriculum Based Measures A study conducted by Edward S. Shapiro, Ph.D. Denise P. Gibbs, Ed.D. Bethlehem, PA: Center for Promoting Research
Nutrition and Culinary Arts Example SLO A Student Learning Objective (SLO) is a detailed process used to organize evidence of student growth over a specified period of time. The SLO process is appropriate
LSU SCHOOL OF EDUCATION GRADUATE PROGRAMS IN GIFTED EDUCATION Thank you for your interest in LSU s graduate programs in Gifted Education. We are proud to offer mentorship and coursework that is based upon
Quality & Quantity 38: 381 389, 2004. 2004 Kluwer Academic Publishers. Printed in the Netherlands. 381 Longitudinal Meta-analysis CORA J. M. MAAS, JOOP J. HOX and GERTY J. L. M. LENSVELT-MULDERS Department
Qualitative vs Quantitative research & Multilevel methods How to include context in your research April 2005 Marjolein Deunk Content What is qualitative analysis and how does it differ from quantitative
Technical Appendix 2009 CREDO Center for Research on Education Outcomes (CREDO) Stanford University Stanford, CA http://credo.stanford.edu June 2009 CREDO gratefully acknowledges the support of the State
17-2-15-2-24 Lincoln Elem Clinton CUSD 15 Clinton, ILLINOIS GRADES : 2 3 2 1 3 Lincoln Elem 1 ILLINOIS SCHOOL REPORT CARD and federal laws require public school districts to release report cards to the
Findings from the Michigan School Readiness Program 6 to 8 Follow Up Study October, 2007 Elena Malofeeva, Marijata Daniel-Echols, and Zongping Xiang High/Scope Educational Research Foundation 600 North
Heron Lake-Okabena School District ISD 330 2012-2013 Annual Report on Curriculum, Instruction, and Student Achievement SSC High School HLO Elementary 124 N Minnesota 321 Stearns Ave PO Box 97 PO Box 378
Predicting Successful Completion of the Nursing Program: An Analysis of Prerequisites and Demographic Variables Introduction In the summer of 2002, a research study commissioned by the Center for Student
Illinois Preschool for All (PFA) Program Evaluation March 2012 Illinois State Board of Education Illinois Preschool for All (PFA) Program Evaluation Erika Gaylor, Ph.D. Center for Education and Human Services
NORTHERN ARIZONA UNIVERSITY Professional Education Unit ASSESSMENT SYSTEM HANDBOOK 2011/2012 PROFESSIONAL EDUCATION UNIT ASSESSMENT SYSTEM HANDBOOK Table of Contents The Unit Assessment System Overview...
Making Licensure Matter September 2012 Agenda History of This Study Guiding Belief, Goals & Key Recommendations Proposed Redesign of Licensure Transition Timeline 2 History of This Study S.B. 10-191 created
Introductory Guide to HLM With HLM 7 Software 3 G. David Garson HLM software has been one of the leading statistical packages for hierarchical linear modeling due to the pioneering work of Stephen Raudenbush
630701-04-0003 The New York State School Report Card for in Lake George Central School District An Overview of Academic Performance March 2002 The University of the State of New York The State Education
TECHNICAL REPORT #33: Exploring the Use of Early Numeracy Indicators for Progress Monitoring: 2008-2009 Jeannette Olson and Anne Foegen RIPM Year 6: 2008 2009 Dates of Study: September 2008 May 2009 September
Graduates of UTeach STEM Teacher Preparation Programs Nationwide OCTOBER MAY 2015 2014 Executive Summary Since 2008, 44 universities have followed The University of Texas at Austin and adopted the UTeach
The North Carolina Principal Fellows Program: A Comprehensive Evaluation In this policy brief, we report on our comprehensive evaluation of the North Carolina Principal Fellows program. We find that: (1)