Justice League? The problem with performance tables

For reasons that will become clear, I’ve been waiting for a while to write this, but here’s my view: School Performance Tables are misleading, iniquitous and damage the system, and we should move away from them as soon as possible.

This is not an argument against accountability. I’m not arguing against publication of results and I’m not advocating a lack of transparency. I’m specifically talking about the reduction of all the outcomes of students in a school to a single figure or a tiny handful of figures, and the use of that to publicly rank schools, allowing anyone, including parents or prospective employees, to ‘Find and Compare Schools’ as the DfE website banner proclaims.

I’m not even arguing against them on the grounds that I think they’re wrong and unethical (although I do). The case against league tables is that I think they are damaging and ineffective, for three main reasons. They don’t give an accurate picture, they act against the interests of students, and they actively work against school and system improvement.

Firstly, they are inaccurate.

The stated aim of league tables is to help parents know how well a school is doing. This can help them to make sure they choose the right one for their child, and to hold the school to account for performance. However, the reality is that schools are simply too complex and multifaceted for this to give useful information. Each parent will have their own criteria for defining the perfect school – for one it will be a level of academic excellence to facilitate a university place, for another it might be an ability to provide targeted support for a child with special needs, for someone else it may be the opportunities to take part in extra-curricular arts or sports. You might get a sense of this through an Ofsted report, you could probably explore it through a school visit, but there is no way a league table can capture this information. The fact that the key measure changes so often is an indication that there is no absolute measure that satisfies all beholders.

This is before we consider the inbuilt inaccuracy of using a norm-referenced system to make absolute judgements about quality. Every year, we will see the news stories that talk about whether pass rates have gone up or the proportion of top grades in a subject has fallen, with very little mention of the fact that this is entirely the result of decisions taken by Ofqual. Across the board, average attainment of students might have risen, it might have fallen, it seems unlikely that it mirrors exactly the profile of exam passes, but still for every school that rises in the league tables, there’s a school that falls.

Another built in reason for inaccuracy is the time lag between provision and outcomes. League tables are usually accompanied by lurid headlines about the ‘best’ and ‘worst’ schools, but unless GCSE outcomes are the product of cramming and gaming, they are telling you something about progress from KS2 – in other words, a five-year journey. So much could have changed during that period that any sensible statistical analysis would urge extreme caution.

Secondly, they act against the interests of students

How have we evolved a system where the interests of schools can be in direct opposition to the interests of their students? Unfortunately, that is often the case. We have all seen the farcical ‘gaming’ dance that takes place, where schools choose qualifications solely because of the impact they have on league tables. ECDL was a stain on the system, whose sole purpose (if we’re honest) was to hoover up a qualification that gave an advantage in Progress 8 for very little investment of time or teaching expertise. If anyone would argue that they did it because it had merits, I would ask why, as soon as it disappeared from league tables, did virtually every school in the country stop doing it?

It’s still going on. Reports of schools entering whole cohorts for English as a foreign language, regular ‘wink-wink’ emails from companies offering to come in to school for a few days and run a premium qualification that ‘counts in the performance tables’, SEND students forced through inappropriate curricula because it’s better for the school for them to score a 1 or a 2 in a GCSE than to succeed on a functional skills route.

Then there’s the student destined to drag the school down. No wonder permanent exclusions rise as GCSEs loom large. The evidence of off-rolling is stark, schools very often paying a premium for an Alternative Provision to place them on roll, students sitting exams as external students, parents choosing to home-educate at the most crucial time of their academic lives.

Long before we get to the business end of KS4, league tables are having an impact on curricula – extended Key Stage 4 courses, basket-filling, using GCSE assessment criteria from the start of Year 7. I welcome the renewed focus on curriculum that has been given momentum by Ofsted, but fear that unless it reaches deep into Key Stage 4, its impact will be limited. My question to schools would be: what curriculum decisions have you taken that are in the interests of students but may adversely affect your Progress 8 score? It seems inconceivable that the designer of Progress 8 has managed to get the perfect balance of subjects for every child in the country.

Thirdly, they have a damaging effect on school improvement across the system.

True collaboration drives improvement, particularly systemic improvement. It’s well-researched and widely accepted. Indeed, there are many policy initiatives that are explicitly designed to encourage collaboration and sharing of good practice.

To say that high-stakes performance tables militate against collaboration seems axiomatic. The performance tables website is designed to make it easy for parents to use a map tool to find local schools and create a ranking list. When so many schools are desperate for the funding that comes with the student, a low placing on that list can be disastrous. Many great schools, and principled Heads will do what’s right and I know collaboration happens within Trusts or formal partnerships, but how can it be a good thing when the failure of the school down the road, with all the impact on the lives of young people, is good news for me and my school.

At the same time that Ofsted have realized that great schools plan a long-term coherent curriculum journey, with aspirational goals for all students, we are still running a parallel system that priorities short-term solutions, narrows the focus of teaching and learning, and excludes many of our most vulnerable students. We are now evolving a system where the two main accountability mechanisms for schools – Ofsted and Performance Tables – are potentially acting in conflict.

A final point, but not an insignificant one is the impact of league table culture on the individuals at the sharp end, particularly school leaders. My doctoral study looked at the emotional impact of Ofsted ‘Inadequate’ judgements on Head Teachers (http://eprints.nottingham.ac.uk/50957/). These case studies of four remarkable colleagues who went through a public trauma that ate at the core of their professional identity, brought home how personally damaging public naming and shaming can be (for anyone who points out that it is the school, not the Head Teacher that is identified, I can only assume they haven’t been in that position).

I believe that as long as we keep this system, then politicians’ words about school leaders well-being ring hollow.

These are not new thoughts of mine, but I’ve not felt able to be quite so open about them before. You can probably guess why. One of the schools I work in has been at the wrong end of league tables in recent years, and despite the fact that the staff and school community have done a remarkable job in moving the school forward, providing an amazing quality of education and care, to the point where I believe this has been a high-performing school for a couple of years, it’s only now showing through in results. We’ve had a good week, and this year I’ll sleep easy the night before league tables are published, but we’ll do our best to remember what it’s like to be on the other side.

It’s perfectly possible to publish detailed information about a school, including performance data and the most recent Ofsted report, in fact most schools already do. We don’t need league tables, and the sooner we move away from them, the better.

Author: Dr Heery

I'm the Chief Executive Officer of the White Hills Park Trust, a current Ofsted Lead Inspector, former Head of both primary and secondary schools, and a former LA School Improvement Adviser, as well as being a practising teacher. I am interested in schools and school systems built on generous collaboration, collective responsibility and strong values. My blog is a place where I share my thoughts and ideas on the world of education and school leadership, with the aim of provoking debate and discussion. Click the logo above to read more.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: