Unreliable tests tell us nothing;Letter

17th December 1999 at 00:00
YOUR report (TES, December 3) claims that nearly one in 10 students who had achieved level 4 by the end of primary schooling in 1995 had made "no progress" by the end of key stage 3 in 1998.

This interpretation ignores two important facts. First the unreliability of the tests means at least a quarter of the children tested at key stage 2 get a "wrong" level. Therefore apparent lack of progress could be largely due to pupils being lucky at key stage 2 and unlucky at key stage 3.

More importantly, the tests at key stage 2 and 3 are not directly comparable, being based on completely different programmes of study. It is entirely possible for 11-year-olds to achieve Level 4, to make real progress in absolute terms, and then get to level 3 at 14, because they have not learnt enough of the new material in the Key Stage 3 curriculum.

The poor reliability and questionable validity of the tests simply do not allow us to draw meaningful conclusions about individuals. Even conclusions about cohorts need to be treated with caution. It may well be that pupil performance does dip in the first year of secondary school, but no amount of looking at national curriculum test data will establish this.

Dylan Wiliam

Professor of Education Assessment

Kings College London

Subscribe to get access to the content on this page.

If you are already a Tes/ Tes Scotland subscriber please log in with your username or email address to get full access to our back issues, CPD library and membership plus page.

Not a subscriber? Find out more about our subscription offers.
Subscribe now
Existing subscriber?
Enter subscription number


The guide by your side – ensuring you are always up to date with the latest in education.

Get Tes magazine online and delivered to your door. Stay up to date with the latest research, teacher innovation and insight, plus classroom tips and techniques with a Tes magazine subscription.
With a Tes magazine subscription you get exclusive access to our CPD library. Including our New Teachers’ special for NQTS, Ed Tech, How to Get a Job, Trip Planner, Ed Biz Special and all Tes back issues.

Subscribe now