Machine marking 'lunacy'

8th December 2006 at 00:00
Authors condemn first move towards computers, not people, assessing examination essays

THE UK's second largest exam board is to start trials of a computerised system which marks essays without a human examiner.

Developers preparing the system for a dummy trial by Edexcel on GCSE-style scripts next year believe it is accurate and economical. But authors, academics and teachers have attacked the idea, fearing it will be unable to appreciate sophisticated essays.

The Pearson Knowledge Technologies system rates essays for content, syntax, style and spelling, without human help. It is already used in several parts of the United States, where it has attracted a lot of controversy.

Critics say it deals poorly with metaphors and reads for vocabulary rather than meaning. The sentence "the cat ate the pin cushion," for example, could score the same as, "the pin cushion ate the cat".

John Mortimer, the playwright and Rumpole author called the concept "lunacy". He said:"How can a computer listen to the sound of words? How can it decide whether ideas are original or not?"

But Jerry Jarvis, managing director of Edexcel, said he had been astounded by the software's accuracy. "You start off sceptical, but after a while you realise there's something in it," he said. "The makers believe it is more accurate than human beings."

While he conceded that Britain was not yet ready for e-marking of GCSE and A-level essays, he plans to hold the first UK trials of the software next year. Edexcel's human examiners already do more than 70 per cent of their marking on computer screens.

Mr Jarvis said: "There is a lot of potential scepticism. But I believe I'm doing the best for students. Others will disagree."

Geoff Barton, a fellow of the English Association and head of King Edward VI school, Bury St Edmunds, Suffolk, said the system might liberate human markers to focus on finer qualities of writing while the computers dealt with common spelling and grammar.

But Michael Morpurgo, the award-winning children's author, said the software was a symptom of how "depersonalised" education had become. "If teachers feel their expertise can be summed up by a machine, what does that say about them? It's productivity-driven and it demeans the subject," he said.

John Bangs, head of education at the National Union of Teachers, feared the move represented a money-saving exercise fuelled by a shortage of examiners.

Most large boards mark multiple-choice papers by computer. But, until recently, it was thought impossible to computer-mark essays. Examiners complain it could encourage simple questions. Multiple choice has been introduced by stealth because it is easier and cheaper, critics allege.

Full reports, page 10

Tick box testing, page 18

Leader, page 26

Log-in as an existing print or digital subscriber

Forgotten your subscriber ID?


To access this content and the full TES archive, subscribe now.

View subscriber offers


Get TES online and delivered to your door – for less than the price of a coffee

Save 33% off the cover price with this great subscription offer. Every copy delivered to your door by first-class post, plus full access to TES online and the TES app for just £1.90 per week.
Subscribers also enjoy a range of fantastic offers and benefits worth over £270:

  • Discounts off TES Institute courses
  • Access over 200,000 articles in the TES online archive
  • Free Tastecard membership worth £79.99
  • Discounts with Zipcar,, Virgin Wines and other partners
Order your low-cost subscription today