More than a random effect

28th March 2008 at 00:00
In the 2nd century BC, the Roman playwright Terence wrote: "When two do the same, it isn't the same." So it should be no surprise to find that when five awarding bodies try to follow the same code of practice, the outcomes are different.

A striking example lies in the Qualifications and Curriculum Authority's annual reports on GCSE and A-level enquiries and appeals. About 1 per cent of all results are queried. At GCSE, some 22 per cent get an improved grade; at A-level, about 11 per cent. But these averages disguise big differences between boards. Last summer, 23 per cent of GCSE enquiries to AQA resulted in a grade change; only 17 per cent of appeals to OCR were successful. At A-level, AQA raised one in seven grades; OCR changed just one in 13. Clearly, the odds offered by the two boards are very different.

If this were a one-off discrepancy, we could put it down to abnormality or chance. But this pattern has been constant for at least five years so it cannot be random. There must be a systematic difference in the way the two boards re-mark. The data can't tell us what that difference is, but there are only two logical conclusions: either AQA's marking is much less reliable than OCR's, or OCR's examiners are more reluctant to change grades on appeal.

Last year, The TES carried an article entitled "OCR board deters A-level re-grades" about a leaked memo encouraging examiners not to change marks without "very strong grounds". Could this be the explanation we are looking for?

George Bethell, Director of Anglia Assessment.

Subscribe to get access to the content on this page.

If you are already a Tes/ Tes Scotland subscriber please log in with your username or email address to get full access to our back issues, CPD library and membership plus page.

Not a subscriber? Find out more about our subscription offers.
Subscribe now
Existing subscriber?
Enter subscription number

Comments

The guide by your side – ensuring you are always up to date with the latest in education.

Get Tes magazine online and delivered to your door. Stay up to date with the latest research, teacher innovation and insight, plus classroom tips and techniques with a Tes magazine subscription.
With a Tes magazine subscription you get exclusive access to our CPD library. Including our New Teachers’ special for NQTS, Ed Tech, How to Get a Job, Trip Planner, Ed Biz Special and all Tes back issues.

Subscribe now