Cold comfort for 'warm' markers

23rd October 1998 at 01:00
Four years ago, an American student fooled a computerised essay-marking system into commending him - for a nonsensical essay which claimed that rabid aardvarks posed a threat to children's outdoor activity centres.

We revel in such coups, because they prove that "warm bodies" - the fetching term that designers of artificial-intelligence systems use to describe human beings - can still outperform machines in tasks that require real intelligence and insight rather than flashy computational skills.

But can we really? This week's report explaining how variable human exam-markers can be (page 5) is a reminder of our fallibility. But the Intelligent Essay Assessor (page 7) never gets bored, sleepy or forgetful. It might have failed Ernest Hemingway for writing sentences without subjects, but we should not underestimate its "intelligence". The assessor studies the combination of words in a student's written answer and computes its similarity to model essays which it has stashed away in its electronic brain. It's as simple - and complex - as that.

Before long, teachers may accept that such a system is as important a labour-saving device as the dishwasher; but if that day comes we'll feel a little sad and deflated all the same.

Subscribe to get access to the content on this page.

If you are already a Tes/ Tes Scotland subscriber please log in with your username or email address to get full access to our back issues, CPD library and membership plus page.

Not a subscriber? Find out more about our subscription offers.
Subscribe now
Existing subscriber?
Enter subscription number


The guide by your side – ensuring you are always up to date with the latest in education.

Get Tes magazine online and delivered to your door. Stay up to date with the latest research, teacher innovation and insight, plus classroom tips and techniques with a Tes magazine subscription.
With a Tes magazine subscription you get exclusive access to our CPD library. Including our New Teachers’ special for NQTS, Ed Tech, How to Get a Job, Trip Planner, Ed Biz Special and all Tes back issues.

Subscribe now