
One particular public school educated parliamentary sketchwriter, for instance, has been running a vendetta against Martin for years that is based on pure class warfare.
I also have to say that my wife and I were very struck by his hospitality in inviting not only all the Lobby journalists but also their partners to a reception at Speaker's House shortly after his election, and for his courteousness and friendliness to all on that and subsequent similar occasions.
But against that, it has to be said that behind the smiling face and hearty handshakes lies a man whose pettiness apparently knows no bounds.
It was Martin who, as chairman of the House of Commons Administration Committee during the mid-90s, was behind the infamous ban on journalists using the Terrace. On another occasion, when chairing a Commons Committee, he insisted on a public apology from a journalist who had inadvertently strayed the wrong side of the line separating MPs from the press bench.
More importantly, in his conduct of the office of Speaker itself, there have simply been too many questions about his partiality towards the Labour Party for comfort.
Then again, such partality is scarcely surprising given the original circumstances of his election courtesy of a "Peasants Revolt" by backbench Labour MPs hacked off by Mr Tony's attempts to tee-up the Speakership for Sir Menzies Campbell as part of his ongoing flirtation with the Liberal Democrats.
I have been accused on Guido's blog of making this up - by an anonymong, natch - but analysis of the voting figures in the Speakership Election show that, by and large, Martin's support came from Labour backbenchers and assorted ministerial Brownites who jumped on the bandwagon in a bid to give Blair a bloody nose.
What is certainly the case is that Martin has never managed to become a non-partisan figure in the way Betty Boothroyd and George Thomas did. Today's blogospheric postings on the subject divide on broadly party lines, with Labour bloggers Mike Ion and Paul Burgin backing his handling of yesterday's PMQs row, and the Tories' Iain Dale arguing it's time for him to go.
As left-of-centre blogger, I am not about to buck that trend. Contrary to what Nick Robinson says, I think Martin was right to stop David Cameron asking questions about the Labour succession, not necessarily because it doesn't relate to the conduct of Government business, but because it's simply a waste of his time and ours.
If and when Blair is ready to give that crucial endorsement - and I suspect that won't be until the contest is actually up and running - he'll announce it in his own time and in his own way, and he won't be giving Mr Cameron the exclusive.
Until then , the best thing the Tory leader can do is accept the Speaker's ruling, stop banging on about it, and go and find himself some policies instead.