pound;30m bill for the real thing

16th July 1999 at 01:00
Inquiry discounts rigged tests allegations

NATIONAL testing is an expensive business, costing more than pound;30 million every year.

The tests are taken by 1.8 million seven, 11 and 14-year-olds in around 24,000 schools each summer and ensuring that standards are maintained is a time-consuming and complex task.

The Government's curriculum quango, the Qualifications and Curriculum Authority, is responsible for administering the tests, but contracts out key stage 2 English test development to Britain's largest educational research centre, the National Foundation for Educational Research.

Each test takes around two years to develop and involves more than 100 teachers, literacy consultants and academics as well as QCA and NFER officers.

Each test is pre-tested at least twice to give a measure of how children respond to the questions in a "real" exam situation.

Two alternative tests are developed to provide a "spare" if the first is compromised by a security leak.

When around 2,000 children sat the first pre-test in November 1997, each test had two alternative question booklets, with 500 pupils sitting each test.

A statistical analysis of how many children successfully answered each question was used to assemble one question booklet for each test, constructed so that the average child would score approximately 50 per cent.

The second pre-test was taken in April 1998 by 2,000 11-year-olds who took the proposed 1999 test three weeks before their actual 1998 test. Statisticians then analysed their results to compare performance in the 1998 and proposed 1999 tests.

Meanwhile, panels of experienced teachers set thresholds for each performance level by judging how difficult a borderline pupil would find each question.

An initial level-setting meeting in February this year considered their recommended thresholds and other statistical evidence to produce a pass mark. It was this meeting that recommended the controversial cut in the pass mark from 51 to 47 per cent this year which prompted the inquiry.

However, after the real test was taken on May 12 a final script analysis in June raised the pass mark to 48. A script scrutiny by chief markers had judged that children found the test easier than expected, and a check of 30,000 test papers confirmed this.

Log-in as an existing print or digital subscriber

Forgotten your subscriber ID?


To access this content and the full TES archive, subscribe now.

View subscriber offers


Get TES online and delivered to your door – for less than the price of a coffee

Save 33% off the cover price with this great subscription offer. Every copy delivered to your door by first-class post, plus full access to TES online and the TES app for just £1.90 per week.
Subscribers also enjoy a range of fantastic offers and benefits worth over £270:

  • Discounts off TES Institute courses
  • Access over 200,000 articles in the TES online archive
  • Free Tastecard membership worth £79.99
  • Discounts with Zipcar, Buyagift.com, Virgin Wines and other partners
Order your low-cost subscription today