Florida Education Data Systems PK-20 Education Data Warehouse and Florida Education & Training Placement Information Program (FETPIP) October 2014
Florida Student Population 2.7 million students Majority minority student population 59% Large population of English language learning students Majority of students are eligible for free and reduced priced lunch 58.6% 2
NAEP Average NAEP 4th Grade Reading Scores, Florida and National Average 1998-2013 230 225 224 226 225 227 220 215 217 218 219 220 220 220 221 215 216 217 210 207 214 205 200 1999 was the year Florida began comprehensive reforms to improve education 195 1998 2002 2003 2005 2007 2009 2011 2013 National Average Florida 3
NAEP National Average and Florida Students Scoring Basic or Better on 2013 NAEP Grade 4 Reading, by subgroup 90% 80% 70% 67% 75% 79% 85% 73% 66% In every category, Florida s students outperform their peers nationally. 60% 50% 40% 30% 50% 57% 52% 53% 41% 31% 31% 47% 20% 10% 0% All Students White Black Hispanic Low-Income English Language Learners Students with Disabilities Nation Florida 4
Average Score Changes 4 th Grade Public School Students, NAEP Reading Between selected assessment years 1992, 2003, and 2011 No other mega-state made more gains than Florida.
Results of Florida A+ Plan 90% Florida School Grades 1999 to 2013 80% 70% 72% 68% 67% 74% 69% 74% 78% 74% 76% 72% 60% 60% 59% 50% 40% 35% 41% Arrows indicate years when school grading standards were increased. 30% 28% 20% 10% 0% 21% 17% 16% 13% 10% 11% 11% 9% 9% 7% 5% 7% 7% 7% 6% 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 A/B D/F 6
A Command Focus on Reading Year Percent of 3rd graders who could not read Percent of 3rd graders not promoted 2000-01 29% 3.0% 2001-02 27% 3.3% 2002-03 23% 14.4% 2003-04 22% 11.1% 2004-05 20% 9.8% 2006-07 19% 8.1% 2007-08 16% 6.6% 2008-09 17% 6.4% 2009-10 16% 5.9% FCAT 2.0 Implemented (more rigorous test) 2010-11 16% 7.1% Increased Cut Score for Proficiency on FCAT 2.0 2011-12 18% 7.9% 2012-13 18% 7.1% 7 2013-14 19% Not yet available
Percent Retained in K-2, 2001-2013 9 8 7 2nd year of policy 7.5 7.9 6 5 1st year of policy 4.6 5 4.6 4 3.6 4 3 2.7 3 2 1 0 00-01 01-02 02-03 03-04 04-05 05-06 06-07 07-08 08-09 09-10 10-11 11-12 12-13 Kindergarten 1st Grade 2nd Grade
Short-Term Effect Manhattan Institute researcher Jay Greene did a study on Florida s fourth grade promotion policy, after two years of the policy, and found: Retained third graders made significant gains compared to socially promoted students. These gains actually grew substantially from the first to the second year after retention. Students who are socially promoted appear to fall farther behind over time, while retained third graders are able to catch up and succeed in later grades. Retention policies have had greatest impact on minority student learning. 9
Medium-Term Effect A follow-up study by Marcus Winters examined the performance of the retained and promoted students once they reached 7 th grade: Retained students were still outperforming promoted students in reading and math as late as 7 th grade Similar positive effect on 5 th grade science test Results similar on low-stakes standardized test 10
Percent Results of the Reading Guarantee in Middle School 70 60 50 40 48 49 Middle School FCAT Reading Grades 6, 7 and 8 51 51 51 57 58 61 62 64 Dotted line indicates first year the first class under the reading guarantee reached 6 th grade. 30 20 10 30 29 27 27 26 20 19 17 16 16 0 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 Level 3 and Above (On Grade Level and Above) Level 1 11
14 12 Percent Referred for Special Education Services: Good Instruction Matters 11 13 10 9 8 7 6 5 4 2 2 0 First Grade Second Grade Third Grade 2003-04 2009-10
Incentivize Rigor Since 1984, Florida provided school district bonus for AP passage: $700. This bonus more than pays for cost of offering AP and free AP tests. In 1999, realized few students in F schools taking PSAT. In 2000: Free PSAT or PLAN tests for all 10 th Graders Professional Development for teachers to teach AP Teacher Bonuses: $50 for every passing student score, up to $3,000 $500 for first passing score in D or F school, up to $3,000 13
350,000 300,000 AP Exams Taken by All of Florida's Students 2010 gains from 1 st year AP was added to high school grade 276,723 290,678 293,828 301,577 250,000 233,857 200,000 150,000 First year of the College Board Partnership 210,317 186,175 163,552 139,505 121,470 109,434 100,000 50,000 74,642 65,634 59,762 42,15445,306 47,672 51,40053,976 32,137 35,76938,030 89,447 0 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 Florida s College Board Partnership (Free PSAT Tests, professional development and Teacher Bonus)
50,000 AP Exam Takers Florida's Hispanic Students 45,000 40,000 1999-2013 606% increase 36,796 39,267 40,438 44,190 35,000 30,000 30,294 26,031 25,000 22,926 20,000 17,025 20,433 15,000 12,582 14,744 10,000 6,258 7,019 7,295 9,989 5,000 0 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
25,000 AP Exam Takers Florida's African American Students 20,000 1999-2013 740% increase 22,129 21,784 21,154 20,673 17,422 15,000 14,775 11,345 10,000 8,788 5,000 2,593 3,110 3,609 4,467 5,621 6,027 7,176 0 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
160,000 AP Passing Scores by All of Florida's Students 140,000 1999-2013 322% increase 124,362 138,611 133,523 120,000 114,064 100,000 80,000 60,000 40,000 20,000 39,671 36,573 32,831 22,897 27,19928,801 22,782 24,728 19,13619,700 16,402 48,155 54,436 66,174 61,100 73,970 88,277 83,344 100,356 0 1991 1992 1993 1994 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 Florida s College Board Partnership (Free PSAT Tests, professional development and Teacher Bonus)
40,000 AP Passing Scores Florida's Hispanic Students 35,000 34,857 31,187 30,000 28,368 25,859 25,000 22,132 20,000 17,697 18,882 15,830 15,000 12,691 13,864 10,818 10,000 5,681 6,434 8,001 9,151 5,000 0 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
9,000 AP Passing Scores Florida's African American Students 8,172 8,000 7,000 7,110 7,424 6,000 6,030 5,328 5,000 4,000 4,080 4,400 3,000 2,216 2,455 2,788 3,034 3,326 2,000 1,320 1,493 1,649 1,000 0 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
Industry Certifications As important as it is to have students graduating having earned college credit through AP is having students graduate with meaningful industry certifications such as: IT/network/database management/programmer ASE mechanic Welder Private pilot/aviation mechanic AutoCAD design and drafting
Percent of High School Students Enrolled in Industry Certification Courses in Industry Programs (aka CAPE Academies) There has been a 26.5 point increase in enrollment of students pursuing meaningful industry certifications since the start of the bonus program
Number of Students Earning Meaningful Industry Certification Courses in Industry Programs (aka CAPE Academies)
Principles of Florida Reforms Measurement Matters Funding Drives Behavior Competition Works 23
24
25
Purpose To provide accurate and comprehensive outcome information to Florida s education, workforce development and social service programs.
Types of Questions the EDW has data to support What types of jobs are recent college graduates getting? What degrees did these students earn? What are the wages of these graduates? Has enrollment in high school Geometry increased? Does enrollment in Geometry decrease the need to remediation in college? What is the average wage different of a student who met the minimum high school graduation requirement compared to a student scoring at the Advanced level of the state test? What are common course taking patterns for students who do not require remediation in college? What is the difference in per student funding at a school graded A versus a school graded F? Does class size have an impact on teacher value-added scores? On student outcomes? Do choice options improve student outcomes of students remaining in the public schools? Foundation for Excellence in Education Copyright.2014 27
Florida s Integrated, Longitudinal PK-20 Education Data Systems The System is comprised of: Public pre-kindergarten through graduate school with student level data for public schools, community colleges, career and technical education, adult education, and the state university system Staff, facilities, finance, and financial aid data systems Post school employment and non education system program data The System depends upon: State level laws requiring collaboration and provision of data State funding support for maintenance and operations System of common course numbers and directories Statewide articulation agreements and oversight committee A state level culture of data management and interagency sharing A means to follow the records of individual students across geographic areas, education sectors, and related programmatic areas 67 School Districts, 28 community colleges, 11 state universities Very open public records laws Foundation for Excellence in Education Copyright.2014 28
Florida s PK20 Education Data Warehouse PK-12 data Technical Center data Community College data State University data FETPIP EDW Central Repository (1995 forward) Pre-defined & Ad Hoc Reports/Requests Data Marts Research Extracts Foundation for Excellence in Education Copyright.2014 29
Types of Data in the PK-20 Education Data Warehouse Student Staff demographic, enrollment, educational programs, promotion, attendance, test scores, awards, other characteristics Administrators, teachers, academic background, professional development, salaries, courses taught Educational Institution types, location, facilities, design and uses Financial Aid state/local, loans/grants, disbursement Courses offerings, student and teacher participation, instruction type Educational Finance budget, expenditures Foundation for Excellence in Education Copyright.2014 30
Florida Education and Training Placement Information Program (FETPIP) Foundation for Excellence in Education Copyright.2014 31
Types of FETPIP Data Employment Data Quarterly Florida wage records (earnings, employer, industry type) US Office of Personnel Management US Postal Service US Department of Defense (active duty military) Wage Record Interchange System out-of-state employment Continuing Education Data District Postsecondary Florida Colleges Public Universities Independent Colleges and Universities of Florida Public Assistance Data Temporary Assistance to Needy Families (T.A.N.F.) participants Food Stamp Participants Unemployment Insurance Claimant Participants Corrections Data FL Department of Corrections incarcerations FL Department of Corrections supervised releases/community control data
Uses of Data Public Education Funding Performance-Based Budgeting Federal Performance Accountability Private School Licensure School District Accountability Reports Problem Solving High School Feedback Community College Performance Reports University System Program Reviews Legislative Performance Reviews/Budgeting Workforce Estimating Internal and External Policy Research Career Counseling, Consumer and Guidance Information Government, Public, Media Requests General Appropriation Act (GAA) Long Range Program Plan (LRPP) Florida College Performance Budgeting Federal Vocational Reporting University Program Reviews Economic Security Report OPPAGA reviews W.I.A. / Workforce Development Boards Career Counseling and Guidance Information Foundation for Excellence in Education Copyright.2014 33
Data Systems Lessons Learned in Florida Acquire and continuously cultivate leadership support Clearly outline the goals and purposes of a state-level integrated education information system both long and short term Clearly identify the benefits and risks for everyone involved. As possible, build on and use existing systems, expertise. Pursue opportunities to provide service and share information back to providing agencies. Publicize and update products, services, capabilities. Establish and maintain a culture of data and information integrity. Exceed all requirements dealing with confidentiality and restricted release; but, do not create unnecessary barriers. Secure on-going support Recognize that change is constant, keep ahead of it. Foundation for Excellence in Education Copyright.2014 34
Funding for Education Data Warehouse Initial Development 2000-2003 (State funds) Total $11,030,070 Contracted services $6.22M, Personnel $2.46M, Hosting $1.42M, Expenses $422K, Hardware $283K, Software $216K, Operating Capital Outlay $9,715 Statewide Longitudinal Data System Grants (Federal funds) $1,577,602 Florida Department of Education State Longitudinal Data System in 2006 $2,450,000 Florida Enhancement of Data Governance and Restricted Access to Data in 2009 $9,975,288, ARRA, Data in Data Out in 2009 Total $14,002,890 Ongoing Development and Operations 2004 Present (State funds) Approximately $1.65 Million annually (average) 2014-15 Fiscal Year - $3.16 Million appropriation Foundation for Excellence in Education Copyright.2014 35
Measurement Matters Data informs individuals of their status or progress Data informs individuals so they can make better decisions Data ensures resources and support get to the students, individuals, schools in need Data informs policymakers to make better, more effective decisions Data provides accountability to taxpayers for their funds Foundation for Excellence in Education Copyright.2014 36
Thank You! Foundation for Excellence in Education P.O. Box 10691 Tallahassee, FL 32302 (850) 391-4090 (786) 664-1794 info@excelined.org