2016 School Performance Tables

Transcription

1 2016 School Performance Tables Rebekah Edgar Head of School Performance Data Unit Department for Education NCER Conference, 13 May 2016

2 Contents of presentation Performance Tables and the Statement of Intent Reforms to Accountability and Performance Tables at: Primary Secondary Post 16 New Performance Tables Website and future Data modernisation

3 Performance Tables The performance tables sit at the heart of the accountability framework. They focus the debate on standards and provide a reliable and accessible source of comparative information on pupil attainment and progress. The performance tables present this information alongside wider contextual data including Ofsted judgements, absence, workforce and finance data, presenting users with a wider understanding of the setting in which schools are operating.

4 Statement of Intent and Publication dates The statement of intent will set out our full plans for the content of the 2016 school and college performance tables. There are a number of changes that will be made to the content this year, as a result of government reforms to the way schools and colleges are held to account for their performance. We plan to publish the final primary school performance tables by mid-december 2016, the secondary school tables in January 2017 and the performance by March We also plan to publish key provisional secondary performance measures in autumn 2016.

5 Primary assessment and accountability - what is different in 2016? No more levels Interim teacher assessment framework which includes pre-key stage categories Introduction of scaled scores to report test results New suite of performance measures

6 No more levels Levels were designed for the old national curriculum But had unintended consequences for pedagogy Teaching became guided by level descriptors rather than the curriculum Levels encouraged pace over consolidation They led to a disproportionate focus on pupils just below level boundaries The new framework does not use levels or anything that we should try to treat as equivalent to them To meet a particular teacher assessment standard, teachers will need evidence that a pupil demonstrates attainment of all of the statements within that standard and all the statements in the preceding standard(s)

7 Scaled scores Raw marks in the test will be converted to a scaled score Test results will be reported as scaled scores The expected standard will always be set at 100 Pupils with 100 or more will have met the expected standard The standard will be set by the profession expert panels are involved in the development of all tests created by Standards & Testing Agency Anchor items will link the tests from one year to the next to ensure expected standards are consistent

8 What measures will we have of primary school performance in 2016? Key stage 1 Teacher assessment will be reported for each of reading, writing and maths as: % working towards the expected standard % working at the expected standard % working at greater depth within the expected standard Additional pre key stage categories KS1 Teacher Assessment is not published in Performance Tables, its reported to DfE and included in RAISE for use by schools.

9 Key stage 2 headline measures KS2 headline measures in the 2016 performance tables will be percentage of pupils achieving the expected standard in English reading, English writing and mathematics at the end of key stage 2; average scaled score: in English reading at the end of key stage 2; in mathematics at the end of key stage 2; percentage of pupils who achieve at a high standard in English reading, English writing and mathematics; average progress: in English reading; in English writing; and in mathematics. Performance tables will also continue to include a range of additional measures covering attainment in individual subjects and for various pupil groups.

10 Progress measure how does it work? Stage 1: This is Chris All other pupils nationally with average score at KS1 of 18.0 Back to Chris Chris results are KS1 APS = 18.0 KS2 reading score = 117 He got 1 point more than the average for those with similar starting points = +1 All these pupils KS2 scores are added together and divided by the number of pupils in the group = average (national mean) reading score is 116

11 Progress measure how does it work? Stage 2: Chris now brings his +1 progress score with him We put Chris back with his Y6 peers in his school We add all the Y6 progress scores together and divide by the number of pupils to give mean score = schools progress score of, say, +2 So pupils in Chris school made slightly more progress than those with similar starting points in other schools Parents can now compare schools to see where pupils with similar starting points make more or less progress Govt will set the definition of sufficient progress once tests have been taken (e.g. a school should have a score of at least -3 below or above.

12 Useful links Rochford review re pupils below the standard of national curriculum tests. Interim report is out and introduced pre-key stage standards. Final report due this term:

13 Secondary Accountability Measures for 2016 what is different and why? 5A*- C including English & maths will no longer be the headline measure The current system is easy to understand, but contains three perverse incentives: Wolf Review identified that it encourages schools to enter pupils for poor quality easier to pass qualifications; It can encourage an excessive focus on pupils around the C/D grade boundary, to the detriment of others; and It causes a narrow concentration on just five subjects, rather than a broad curriculum.

14 What are we trying to achieve? New measures designed to hold schools to account for all their pupil s progress across a broader range of subjects, with a focus on an academic core. Progress 8 gives us: a measure of school effectiveness a measure that incentivise a broad and balanced curriculum with a strong emphasis on an academic core including English and Maths a measure which is sufficiently flexible to reflect pupils' needs

15 Secondary Accountability Measures for 2016 what are they? - Attainment 8 - showing pupils average achievement in from a suite of 8 qualifications - Progress 8 progress from primary to secondary school - % of pupils achieving a threshold measure (grade C or above in 2016) in English and mathematics - % of pupils achieving English Baccalaureate (Ebacc) as 2015.

16 Attainment 8 Calculated from a suite of 8 qualifications and the point scores awarded to each grade: English (double weighted) Maths (double weighted) 3 EBacc qualifications (history or geography, the sciences and a language) 3 other qualifications (can include further English, maths or EBacc subjects if not discounted)

17 Progress 8 The pupil Progress 8 score is defined as their Attainment 8 score, minus their estimated Attainment 8 score. The estimated Attainment 8 score is the average Attainment 8 score of all pupils nationally with the same prior attainment at key stage 2. Pupil scores are then used to calculate a mean score for the school, at school level, scores generally range from -2 to +2 but can be larger or smaller.

18 Pupil progress example pupil Pupil score measured against average Attainment 8 score for pupils nationally having same prior attainment Our example pupil scored 65 points for Attainment 8 this is equivalent to a grade B average across all subjects (divide score by 10 [8 subjects with E&M double weighted]) Pupil has fine-level scores of 4.6 in English and 5.1 in maths; an average of 4.8 Pupil s score of 65 is therefore compared to the average Attainment 8 score achieved by all pupils having average prior attainment of 4.8

19

20 School Attainment 8 / Progress 8 scores A school s Progress 8 score is the mean average of its pupils Progress 8 scores School has 120 pupils Pupil Att8 score P8 score Pupil Pupil Pupil Pupil Pupil Total (sum of scores) 6, Attainment 8 score is 6,518.5 / 120 = (5.4 per subject; average grade between a B and a C) Progress 8 score is 61.4 / 120 = Published score would be (published to two decimal places) Confidence intervals will show the range of scores within which underlying performance can be confidently said to lie

21 Useful links Progress 8 guidance: White Paper (chapter 7):

22 Changes to performance tables for 2016 There will be five headline measures in 2016 Tables: Progress the progress students make while at school/college Attainment how well students attain English and maths reporting on those who did not achieve a good pass at Key Stage 4 Retention the percentage of students who complete their core aim Destinations - what students do when they leave the provider There will also be a range of additional measures sitting below the headline measures and a wealth of subject/gender/grade information sitting below that. Results will be allocated to institutions on an annual basis, to bring the tables more in line with funding.

23 Post 16 Performance Tables in future years From 2017: Disadvantage measures based on pupil premium students in year 11 Expanding the tables to include outcomes below level 3 this will definitely include level 2 outcomes against each of the five headline measures but we are unsure what this will look like for level 1 and below From 2018: Looking to include apprenticeship and work based learning outcomes against the five headline measures in tables need standards based apprenticeships to be rolled out in significant numbers first In the interim will publish a link to apprenticeship success rates in performance tables from summer 2016.

24 Progress Measures Two progress measures: Value added measure for academic and Applied General qualifications based on L3VA Completion and Attainment measure for Tech Levels and Technical Certificates (at level 2) Both measures will show the progress of students compared to others taking the same subject nationally In addition: The value added measure will compare students with the same starting points The completion and attainment measure will treat non completion as a fail. These measures will form the basis for new progress based minimum standards

25 Attainment and Destination Measures Attainment measure Retaining average point score (APS) per entry measure Removing average point score per student measure Will show separate APS (expressed as a grade and points) for academic, Applied General, Tech Level and Technical Certificates (at L2). Destination measures Headline measure will be % of young people in sustained education, employment and/or training Plan to use HMRC/DWP data in this autumn s publication (2013/14 cohort into 2014/15 destinations) and update January s publication in April

26 English and maths measures We have recently undertaken detailed analysis of data from 2012/13, 2013/14 and 2014/15 (in two of these three years the continued study of English and maths was not a condition of funding). As a result of this modelling we are considering carefully what the best methodology is to reflect the progress of students continuing the study of maths and English post 16. We plan to provide shadow data to schools and colleges on all of the measures (except destination measures) later this month and we will communicate our decision ahead of that data exercise.

27 Retention Measure Student must be retained to end of core aim Measure is aligned to funding methodology Calculated at end of key stage 5 6 week qualifying period is allowed at the start Three supporting pieces of information: L3 students returning in year 13 Students who are retained but not assessed Students transferring onto lower level aims

28 More information You can find more detailed information on how each of the measures are calculated in the Accountability Headline Measures Technical Guide

29 New School Performance Tables website The site went live on 9 th March, and is replacing the old performance tables site that is being taken down this month, after which if you go to the old site you will be redirected. The site was built over 9 months, with extensive input and testing from over 250 key users along the way including head teachers, MAT and LA leads. It has received a lot of good feedback so far. The site is in public beta phase, which means that DfE want users to use it for real and provide feedback via the links on the site (and at events like today) about what was working well/what wasn t so that it can continue to be improved.

30 New data services (emerging thinking) A number of projects are in their infancy, some of which were alluded to in the recent white paper. They are: Looking at life after RAISE Providing a national website for teacher vacancies. Delivering a parent portal to help parents understand the education system and how they can best support their children through it. Proposal for schools to show performance data on their website home pages