Clever computer marks creative work reliably

2nd January 2004 at 00:00
Computers can mark creative stories by children as accurately as factual essays, according to new research.

Academics from the University of Colorado and New Mexico State University have been testing a system they have developed called the Intelligent Essay Assessor (IEA).

The system, like other computerised essay-marking systems currently in development, uses a range of measures to analyse content and style, register concepts and spot plagiarism and mistakes.

The researchers tried out the system on thousands of essays from school to university level and found the difference between two human markers was usually greater than the difference between a marker and the computer.

They tested the computer on nearly 800 fictional stories written by middle school pupils.

The team concluded that such systems should now be used to give a second or third opinion on essays.

They said results suggested that "human graders are so unreliable that they can be matched by measuring almost anything that distinguishes good from bad essays".

Automatic Essay Assessment by Thomas K Landauer et al appears in Assessment in Education: principles, policy amp; practice Volume 10 Number 3

Log-in as an existing print or digital subscriber

Forgotten your subscriber ID?


To access this content and the full TES archive, subscribe now.

View subscriber offers


Get TES online and delivered to your door – for less than the price of a coffee

Save 33% off the cover price with this great subscription offer. Every copy delivered to your door by first-class post, plus full access to TES online and the TES app for just £1.90 per week.
Subscribers also enjoy a range of fantastic offers and benefits worth over £270:

  • Discounts off TES Institute courses
  • Access over 200,000 articles in the TES online archive
  • Free Tastecard membership worth £79.99
  • Discounts with Zipcar,, Virgin Wines and other partners
Order your low-cost subscription today