Last week’s Daily Telegraph article attacking YouGov’s polling raises some disturbing issues about the quality of political debate as we fast approach the general election.
Firstly, the article’s authors seem to have no understanding about how polls should be conducted. They complain that the raw data in one large aggregated survey “were…‘weighted’ using an undisclosed YouGov formula which reduced the lead to sex per cent [from 12 percentage points in the raw data].” But all reputable pollsters know that their sample will not usually be representative of the population, for example by having too few women or too many Guardian readers, and so adjust the weight given to each person’s responses so that the sample matches the population. And as for the formula being “undisclosed”, it is laid out openly at the end of each YouGov poll (on page 3 of this pdf, for example). If the political staff of a leading newspaper to have no understanding of the polls they used to commission (YouGov worked for the Telegraph until a few weeks ago) it makes you wonder whether they are up to the job.
Secondly, from the e-mails between Peter Kellner and Robert Winnett, one of the article’s authors, it is clear that the newspaper was fed questions, perhaps by the anonymous source posing as a polling expert in the article. Unfortunately, this person either knows as little about polling as Mr Winnett or has an agenda. The source implies that just because the sample is large it doesn’t need to be weighted. Anthony Wells, who works at YouGov, rightly points out that a large unrepresentative sample is a lot worse than a small but representative sample in an excellent post that demolishes the insinuations in the article.
Unless Mr Winnett is a complete nitwit there is only one conclusion to draw: someone high up in the Conservative party (perhaps the anonymous shadow cabinet member quoted in the article?) is orchestrating a campaign to discredit one of Britain’s most accurate pollsters through the newspaper that used to commission those polls, simply because they don’t like the results of the polls. (Though this has not stopped the Tories from employing YouGov for private polling.)
For far too long British newspapers have tolerated anonymous politicians using their pages to wage vicious campaigns to discredit the opponents, and sometimes even their colleagues – remember the “forces of Hell” unleashed on Alastair Darling. Unless more journalists are as gullible as Mr Winnett this particular storm will probably blow over. But, on principle, I feel that politicians who want to make such attacks should at least have the decency to name themselves when doing it. The way the media can encourage a more responsible political debate is by refusing to report hatchet-jobs unless the people giving the briefings are willing to stand up and be counted. Until then, the kinds of smears so devastatingly documented by Nick Cohen in an article last year will continue to sully our newspapers and drive decent people out of politics.
Niklas Smith is Junior Treasurer of Cambridge Student Liberal Democrats. The Voice has also covered the Telegraph story in this post.
4 Comments
the reason the telegraph went for yougov is because they walked away from the newspaper and went to the sun. which offered them a more lucrative daily polling deal for the election. it’s what passes for journalism at the telegraph these days – giving over pages to personal and corporate vendettas…
Ah, so, YouGov walked off to those waving the bigger cheque book, well whatever next.
The Telegraph has been losing money. Lots of good staff have been given the shove. They probably expected, having helped to build up YouGov’s standing, that they would be with them for the election.
Their item did actually say ALL polls are weighted – so, presumably, if ALL polls do this then even the Telegraph’s has been weighted to make them more exciting to read, trim the Tory lead, dent the Lib Dem vote, close the gap on Labour, whatever.
Does anyone know whatever happened to the Telegraph’s Gallup polling organisation – they were part and parcel of the Telegraph every month for years and years….used to be considered the bible. With 39 polls in March alone, isnt this saturation so over the top nobody is taking any notice any more? That might be a good thing.
Only NOP got it totally bang on last time in terms of party’s percentage shares.
@Philip Young: Only NOP got it totally bang on last time in terms of party’s percentage shares
…and were promptly dropped by their commissioning paper, the Independent! So now they don’t do any political polling in the UK. I’ve never understood why the Indy did that.
Well, you obviously need to learn how to read and comprehend Mr. Smith.
The Telegraph is fully aware about weighting. If you think a formula consists of 1+1 = 11 as per the ‘disclosure’ at the end of the You Gov poll you cite then you might try going back to school. The point is how they decide their weighting, not what the weighting is you fool.
One with an analytical mind might ask, for example, how they determine social class for their polling?
Seriously, if your analytical skills are the best the LibDems can come up with Niklas then thank god we do not have proportional representation.