There truly is no such thing as ‘expected progress’

22nd December 2017 at 00:00
We must stop using teacher assessment for anything other than formative purposes because it’s impossible without reinventing levels, says Tes’ resident data expert

The first rule of progress measures is: they can’t be predicted. The second rule of progress measures is: there is no such thing as expected progress.

Ofsted gets this. In March, it stated: “Ofsted does not expect any prediction by schools of a progress score, as they are aware that this information will not be possible to produce due to the way progress measures at both KS2 and KS4 are calculated…‘Expected progress’ was a DfE accountability measure until 2015. Inspectors must not use this term when referring to progress for 2016 or current pupils.”

This is hugely significant because it recognises that levels, along with their built-in progress pathways, are truly gone. Progress is no longer prescribed in advance; instead, each pupil’s attainment is compared against the average score of pupils in the same prior-attainment group nationally.

To calculate progress in advance, schools would need to be able to predict the following:

 

* Any changes to DfE methodology.

* Each pupil’s key stage 2 scaled scores.

* The national average scores for each of the prior-attainment groups.

 

'No one can define what it is they are asking for'

This, of course, is impossible, but questions such as “what percentage of pupils are on track to make expected progress?” are common, both in conversations between senior leaders and teachers, and in forms sent out by various external agencies. The data is expected, but no one can define what it is they are asking for.

It is not surprising that this desire to measure progress has resulted in the reinvention of levels in 101 different ways. Many, if not most, tracking systems offer a series of best-fit steps with associated numerical values and an expected rate of progress of anywhere between three and nine points per year. Progress in these systems is still focused on coverage and is still seen as linear. Such measures are contrary to the principles of a curriculum that prioritises depth and breadth of understanding, and can even be a threat to learning if they promote pace at the expense of depth.

Schools want to measure progress and I understand that, but we need to stop using teacher assessment for anything other than formative purposes.

To introduce elements of accountability into the process risks compromising the overall reliability of assessment and is counterproductive; we need to recognise that it is impossible to measure progress with teacher assessment without reinventing levels.

In short, if you really want to measure progress, use standardised tests.


James Pembroke founded Sig+, a school data consultancy, after 10 years working with the Learning and Skills Council and local authorities www.sigplus.co.uk

Subscribe to get access to the content on this page.

If you are already a Tes/ Tes Scotland subscriber please log in with your username or email address to get full access to our back issues, CPD library and membership plus page.

Not a subscriber? Find out more about our subscription offers.
Subscribe now
Existing subscriber?
Enter subscription number

The guide by your side – ensuring you are always up to date with the latest in education.

Get Tes magazine online and delivered to your door. Stay up to date with the latest research, teacher innovation and insight, plus classroom tips and techniques with a Tes magazine subscription.
With a Tes magazine subscription you get exclusive access to our CPD library. Including our New Teachers’ special for NQTS, Ed Tech, How to Get a Job, Trip Planner, Ed Biz Special and all Tes back issues.

Subscribe now