Curse of value-added 'superstition'

14th March 2008 at 00:00
Alun Pelleschi (TES, March 7) paints a depressing picture of the damage that can come from the thoughtless application of contextualised value-added (CVA) scores by Ofsted and others.

CVA is an attempt to isolate the progress from their prior level of attainment made by pupils in each school. In fact, around 80 per cent of the variation in school outcomes is explained by the prior attainment of their pupils. This leaves only around 20 per cent of the variation that could be attributable to schools in a value-added measure.

Since value-added scores are based on the difference between prior and subsequent attainment, at least half of that 20 per cent is still explained by prior attainment, leaving only 10 per cent for a possible school effect. Using the characteristics of pupils, such as poverty, first language, sex or ethnicity improves the predicted score for each pupil and school, and so reduces the 10 per cent variation attributable to schools even further.

Perhaps only 4 per cent of the variation in school outcomes could be due to the actions of the schools. But this 4 per cent also covers supra-school influences such as parnerships, local authorities, and regional finance. More importantly, this 4 per cent also includes the error component stemming from missing data, measurement and assessment errors, and mistakes in entering, copying and recording data.

There is simply not enough "loose change" left to explain systematic differences within schools caused by their curriculum, pedadogy or leadership. To judge, punish or to close schools on the basis of CVA is little better than superstition.

In general, most people who understand CVA do not use it, and many people who use it just believe it without comprehension.

Professor Stephen Gorard, School of Education, University of Birmingham.

Subscribe to get access to the content on this page.

If you are already a Tes/ Tes Scotland subscriber please log in with your username or email address to get full access to our back issues, CPD library and membership plus page.

Not a subscriber? Find out more about our subscription offers.
Subscribe now
Existing subscriber?
Enter subscription number

Comments

The guide by your side – ensuring you are always up to date with the latest in education.

Get Tes magazine online and delivered to your door. Stay up to date with the latest research, teacher innovation and insight, plus classroom tips and techniques with a Tes magazine subscription.
With a Tes magazine subscription you get exclusive access to our CPD library. Including our New Teachers’ special for NQTS, Ed Tech, How to Get a Job, Trip Planner, Ed Biz Special and all Tes back issues.

Subscribe now