Results drive leaves lowest achievers behind

26th May 2000 at 01:00
INTERNATIONAL pupil achievement surveys that rank countries as if they are football teams make fascinating reading. Which nation is the Manchester United of maths? And which has slumped into the relegation zone?

But a new study by an Irish researcher reminds us that such league tables should be taken with several pinches of salt.

Michael O'Leary, of St Patrick's College, Dublin, began his investigation after noticing discrepancies in two international surveys of 13-year-olds' science achievement. The 20-country Second International Assessment of Educational Progress (IAEP2), conducted in 1991, indicated that Ireland was near the bottom of the league. But the 40-country Third International Maths and Science Study (TIMSS), just four years later, gave the Irish a mid-table rating.

In 1991, only the bottom 10 per cent of Swiss children had performed as poorly as the average Irish 13-year-old. By 1995, Ireland's science scores were at least as good as Switzerland's. How could this be?

O'Leary found that most of the Irish pupils involved in the IAEP2 test were in grade 7 whereas almost three-quarters of the Swiss children were in grade 8 and had therefore had an extra year of secondary schooling.

He also points to another complicatig factor highlighted by Professor Margaret Brown, of King's College, London; the number of children who repeat grades in some countries (Research Focus, February 4).

"In Spain, up to 25 per cent of secondary students are repeaters," he points out. "An even higher percentage of repeaters are found in Portugal."

O'Leary acknowledges, however, that age and grade factors do not explain all the inconsistencies. The format of questions can also have a bearing. Some test surveys use only multiple-choice questions while others include short-answer and extended-response items. The degree of overlap between test topics and the national curriculum, and the quality of data-collection, can also affect countries' rankings.

"The motivation of students participating in international tests to do well may also be relevant," he adds. As there have been reports of Taiwanese pupils chanting nationalistic slogans as they marched into their TIMSS tests, that may be one of the most important factors of all.

"The effects of age-based and grade-based sampling on the relative standing of countries in international

comparative studies of student achievement", by Michael O'Leary,

St Patrick's College, Dublin. Contact: MICHAEL.OLEARY@SPD.IE

Subscribe to get access to the content on this page.

If you are already a Tes/ Tes Scotland subscriber please log in with your username or email address to get full access to our back issues, CPD library and membership plus page.

Not a subscriber? Find out more about our subscription offers.
Subscribe now
Existing subscriber?
Enter subscription number


The guide by your side – ensuring you are always up to date with the latest in education.

Get Tes magazine online and delivered to your door. Stay up to date with the latest research, teacher innovation and insight, plus classroom tips and techniques with a Tes magazine subscription.
With a Tes magazine subscription you get exclusive access to our CPD library. Including our New Teachers’ special for NQTS, Ed Tech, How to Get a Job, Trip Planner, Ed Biz Special and all Tes back issues.

Subscribe now