Clever computer marks creative work reliably

2nd January 2004 at 00:00
Computers can mark creative stories by children as accurately as factual essays, according to new research.

Academics from the University of Colorado and New Mexico State University have been testing a system they have developed called the Intelligent Essay Assessor (IEA).

The system, like other computerised essay-marking systems currently in development, uses a range of measures to analyse content and style, register concepts and spot plagiarism and mistakes.

The researchers tried out the system on thousands of essays from school to university level and found the difference between two human markers was usually greater than the difference between a marker and the computer.

They tested the computer on nearly 800 fictional stories written by middle school pupils.

The team concluded that such systems should now be used to give a second or third opinion on essays.

They said results suggested that "human graders are so unreliable that they can be matched by measuring almost anything that distinguishes good from bad essays".

Automatic Essay Assessment by Thomas K Landauer et al appears in Assessment in Education: principles, policy amp; practice Volume 10 Number 3

Subscribe to get access to the content on this page.

If you are already a Tes/ Tes Scotland subscriber please log in with your username or email address to get full access to our back issues, CPD library and membership plus page.

Not a subscriber? Find out more about our subscription offers.
Subscribe now
Existing subscriber?
Enter subscription number


The guide by your side – ensuring you are always up to date with the latest in education.

Get Tes magazine online and delivered to your door. Stay up to date with the latest research, teacher innovation and insight, plus classroom tips and techniques with a Tes magazine subscription.
With a Tes magazine subscription you get exclusive access to our CPD library. Including our New Teachers’ special for NQTS, Ed Tech, How to Get a Job, Trip Planner, Ed Biz Special and all Tes back issues.

Subscribe now