Boards explore cheaper option of online multiple-choice tests

10th October 2008 at 01:00
Hybrid exams with some long questions could address fears of dumbing- down, says software expert

Exam boards' moves to get pupils to answer multiple-choice papers on computer screens are partly financially motivated, according to a leading advocate of online testing.

David Haggie, assessment services director at education software firm RM, said most UK awarding bodies were "exploring the potential" of the tests, as evidence was emerging that they are significantly cheaper to mark than short written answers and conventional essays.

However, he said it would be a mistake to see the technology purely as a vehicle for cheaper tests.

Mr Haggie told an assessment conference in Amsterdam that there was some public scepticism in Britain about multiple-choice tests, also referred to as objective tests, owing to fears of dumbing-down.

But there were benefits. "Objective items are cheaper: no printing, no logistics, no marking issues," he said. Mr Haggie cited a study of tests in the US state of Maryland from 2001. This had found that short-answer tests cost $30 (pound;17) per student per annum, compared to $6 for a multiple- choice test.

Mr Haggie added that because schools and colleges were "increasingly IT ready", they incurred few additional costs if they ran online exams. Other potential benefits included "speedy return of marks" and tests taking place whenever pupils wanted.

He noted that there was "lower take-up" of multiple-choice tests in exams such as GCSEs and A-levels.

"Getting the cost-saving is proving hard. Item banks (collections of questions) are very expensive to create and maintain," he said. Other problems included boards' inexperience at handling new tests and public mistrust of multiple-choice.

Mr Haggie urged test developers to work on a "hybrid model" of online exams, containing multiple-choice and longer questions, in order to retain public confidence.

In 2006, The TES revealed that England's two largest exam boards were introducing new science GCSEs in which pupils would be able to score up to 75 per cent through multiple-choice papers.

Derek Bell, chief executive of the Association for Science Education, warned that it seemed "an over-simplistic way of assessing what is a very complex learning process".

Multiple-choice tests dominate assessment in the United States. Advocates say they can be used in very tough exams, such as entrance tests for those hoping to go to UK medical schools. Last week, The TES revealed that trials here of such a US-style university entrance exam saw boys do better than girls.

RM, one of the biggest suppliers to UK schools, has just won a contract to run the marking of the Government's new single-level test trial on-screen from December.

Mr Haggie said exam boards were not investigating online multiple-choice tests only in order to save money. It was also "about improving the service that they are trying to offer", he said.

Subscribe to get access to the content on this page.

If you are already a Tes/ Tes Scotland subscriber please log in with your username or email address to get full access to our back issues, CPD library and membership plus page.

Not a subscriber? Find out more about our subscription offers.
Subscribe now
Existing subscriber?
Enter subscription number

Comments

The guide by your side – ensuring you are always up to date with the latest in education.

Get Tes magazine online and delivered to your door. Stay up to date with the latest research, teacher innovation and insight, plus classroom tips and techniques with a Tes magazine subscription.
With a Tes magazine subscription you get exclusive access to our CPD library. Including our New Teachers’ special for NQTS, Ed Tech, How to Get a Job, Trip Planner, Ed Biz Special and all Tes back issues.

Subscribe now