International test ranking 'invalid'

1st December 2006 at 00:00
league tables showing England's primary pupils are among the best readers in the world have been condemned as of dubious validity.

Mary Hilton, of Cambridge University, says England's performance in the Progress in International Reading Literacy Study has been overstated because the design of the questions favoured English pupils. The tests, taken by 10-year-olds in 35 countries, were overseen by the National Foundation for Educational Research, which writes our national curriculum tests, to a similar format, she says. And a lower proportion of lower ability children took the tests here than in other countries, also limiting the study's usefulness, she says.

Her claims, in a paper for next month's British Educational Research Journal, are potentially devastating for ministers, who seized on England's good performance to argue that primary standards had been transformed and the national literacy strategy was working.

The Pirls tests were last taken in 2001 and the results released in 2003, when Charles Clarke was the education secretary. England finished third out of 35 countries, after Sweden and the Netherlands and ahead of the United States, Germany, Scotland and France.

Pupils were given a booklet with fiction and non-fiction texts and asked a mix of short answer and multiple choice questions. English pupils would have been prepared for these conventions, because "teaching to the test"

was rife in classrooms here and encouraged by the Government, Ms Hilton says.

"It is hardly necessary to point out that this put English children in a position of peculiar advantage when they came to do the international test," she says.

The paper also said more lower ability and non-native English speaking children were barred from taking the tests here than in all but three other countries: Israel, Greece and Russia.

A Department for Education spokeswoman said the study was carried out independently and had gone through detailed development to remove any possibility of bias towards any country.

Log-in as an existing print or digital subscriber

Forgotten your subscriber ID?


To access this content and the full TES archive, subscribe now.

View subscriber offers


Get TES online and delivered to your door – for less than the price of a coffee

Save 33% off the cover price with this great subscription offer. Every copy delivered to your door by first-class post, plus full access to TES online and the TES app for just £1.90 per week.
Subscribers also enjoy a range of fantastic offers and benefits worth over £270:

  • Discounts off TES Institute courses
  • Access over 200,000 articles in the TES online archive
  • Free Tastecard membership worth £79.99
  • Discounts with Zipcar,, Virgin Wines and other partners
Order your low-cost subscription today