The schools minister declined to answer a grammar question after being quizzed in the House of Commons.
Nick Gibb told fellow MPs that he had "learned through bitter experience not to respond to that kind of provocation" after being questioned by Labour MP Helen Goodman.
Mr Gibb became the subject of a media storm last week after he apparently failed to differentiate between a preposition and a subordinating conjunction, when given a question for 11-year-olds, while appearing on BBC Radio 4's World at One.
Asking a question following Mr Gibb's statement on leaks of key stage 2 Sats tests today, Ms Goodman, MP for Bishop Auckland, said: "I want to give the minister a second chance. In the sentence, 'My baby was born in hospital, in the hospital where my father works,' are the words 'where my father works' a preposition phrase, a relative clause, a main clause or a noun phrase?"
To laughter on the Labour benches, Mr Gibb responded: "Well it's a very clever, clever question she asks, but I have learned through bitter experience not to respond to that kind of provocation."