pound;30m bill for the real thing

16th July 1999 at 01:00
Inquiry discounts rigged tests allegations

NATIONAL testing is an expensive business, costing more than pound;30 million every year.

The tests are taken by 1.8 million seven, 11 and 14-year-olds in around 24,000 schools each summer and ensuring that standards are maintained is a time-consuming and complex task.

The Government's curriculum quango, the Qualifications and Curriculum Authority, is responsible for administering the tests, but contracts out key stage 2 English test development to Britain's largest educational research centre, the National Foundation for Educational Research.

Each test takes around two years to develop and involves more than 100 teachers, literacy consultants and academics as well as QCA and NFER officers.

Each test is pre-tested at least twice to give a measure of how children respond to the questions in a "real" exam situation.

Two alternative tests are developed to provide a "spare" if the first is compromised by a security leak.

When around 2,000 children sat the first pre-test in November 1997, each test had two alternative question booklets, with 500 pupils sitting each test.

A statistical analysis of how many children successfully answered each question was used to assemble one question booklet for each test, constructed so that the average child would score approximately 50 per cent.

The second pre-test was taken in April 1998 by 2,000 11-year-olds who took the proposed 1999 test three weeks before their actual 1998 test. Statisticians then analysed their results to compare performance in the 1998 and proposed 1999 tests.

Meanwhile, panels of experienced teachers set thresholds for each performance level by judging how difficult a borderline pupil would find each question.

An initial level-setting meeting in February this year considered their recommended thresholds and other statistical evidence to produce a pass mark. It was this meeting that recommended the controversial cut in the pass mark from 51 to 47 per cent this year which prompted the inquiry.

However, after the real test was taken on May 12 a final script analysis in June raised the pass mark to 48. A script scrutiny by chief markers had judged that children found the test easier than expected, and a check of 30,000 test papers confirmed this.

Subscribe to get access to the content on this page.

If you are already a Tes/ Tes Scotland subscriber please log in with your username or email address to get full access to our back issues, CPD library and membership plus page.

Not a subscriber? Find out more about our subscription offers.
Subscribe now
Existing subscriber?
Enter subscription number

Comments

The guide by your side – ensuring you are always up to date with the latest in education.

Get Tes magazine online and delivered to your door. Stay up to date with the latest research, teacher innovation and insight, plus classroom tips and techniques with a Tes magazine subscription.
With a Tes magazine subscription you get exclusive access to our CPD library. Including our New Teachers’ special for NQTS, Ed Tech, How to Get a Job, Trip Planner, Ed Biz Special and all Tes back issues.

Subscribe now