Was YouGov’s leadership poll “technically flawed”? (UPDATED)

That’s the suggestion that was made last night in a comment on Lib Dem Voice by Martin Tod, the party’s prospective Parliamentary candidate for Winchester, who noted:

Just had a quick look and there’s an important technical flaw with the poll… The poll sample’s age split isn’t even close to the party membership’s actual age split. It (unfortunately) hugely overstates young voters and understates those over 60.

If my reading of the data is right, YouGov’s weighted sample of 678 Lib Dem members comprised:

* 237 (35%) 18-39 year-olds
* 217 (32%) 40-59 year-olds
* 224 (33%) 60+ year-olds

I don’t know how this corresponds to the overall party membership; but my guess, if only from observation, is that Martin is right, and that the weighted YouGov sample is indeed hugely overstating the proportion of members under the age of 40. Which candidate this might have most benefited – or disbenefited – is simply conjecture. But perhaps the results of the poll should be treated with great caution until this point can be clarified.


Peter Kellner has kindly provided this response:

We derived our age profile by comparing the profile of Lib Dem members in our panel with the demographic profile of our overall panel. This gave us a median age of 51. Given that there may have been changes since the Seyd/Whiteley survey which was, I believe, some years ago [and gave an average age of 59 for Lib Dem members], we were comfortable with this.

However, my calculation is that were we to have weighted the data using a median age of 59, this would give us Clegg 55-Huhne 45, instead of 56-44.

Given the margin of error that is always liable to occur in a sample of 678, this difference seems too slight to cause huge concern. The main point remains the one that we made to Sky News when delivering the results: given the large number of don’t knows among those who had not yet voted, the result could be anywhere between a comfortable Clegg victory and a very tight finish with the contest going either way.

Read more by .
This entry was posted in Leadership Election, News and Polls.


  • Peter Bancroft 4th Dec '07 - 9:52am

    It’s presumably not entirely conjecture as to what the result would be – we can rebalance the scores according to the right age ratios and see what the impact is.

    I think that Clegg won over the under 35s (which corresponds from anecdotal feedback on the LDYS website) which means that, if the YouGov poll is otherwise correct, the contest is going to be a lot closer.

    I was actually wondering a about the ABC1 v C2DE split – that’s ratio has to be right as well, but I doubt that YouGov have access to that kind of information (the latest public work I’ve seen was the “Neither Left nor Right” book from a few years ago.

  • Cheltenham Robin 4th Dec '07 - 10:06am

    OR – we could wait until December 17th

  • Last time YouGov overstated Hughes and understated Campbell. They weren’t far off on Huhne’s percentage but wrongly had him ahead because of understating Campbell.

    At the time I didn’t believe their poll because I thought those in the YouGov panel were unlikely to be representative, and were likely to be inclined towards the people who were swining Huhne’s way.

    It is very possible that the same factors could skew the poll Clegg’s way this time.

  • Dan Falchikov 4th Dec '07 - 12:53pm

    I’ll treat this YouGov poll as I do all of them – with contempt. They’re voodoo polls – not based on any statistically valid methodologies and when Kellner talks guff about MoE – he knows its spin as MoE can only apply to randomly sampled polls. YouGov’s panel poll is self selected, not randomly sampled and the subset of confirmed Lib Dem members likely to be very small in total.

    I’d guess the reason for the sample size of 648 is that it represents pretty much everyone on their database who ticked the ‘I’m a Lib Dem member box’.

  • “Women twice as indecisive as men.”

    Chris Squire – this “former senior pollster, now retired and teaching Politics” – it isn’t the “Pub Landlord” is it?

  • Peter seems to have cleared up Martin’s point: the age profile could have mattered but doesn’t. Obviously it is possible that the whole You Gov panel is warped by non-age related issues (self-selection) but we don’t have any evidence to that effect. In addition, neither camp is claiming that it is wildly wrong, so I think it is our best guess of where things are at the moment.

  • Dan Falchikov 5th Dec '07 - 1:55am

    13 – or not.

    YouGov has an appalling record of predicting Lib Dem internal elections and the party’s public share. Almost as bad as the Parliamentary Party…

    I suspect Clegg is in the lead – but there are loads of people who voted for Ming who are now backing Huhne – mainly due to Clegg’s appalling campaign.

Post a Comment

Lib Dem Voice welcomes comments from everyone but we ask you to be polite, to be on topic and to be who you say you are. You can read our comments policy in full here. Please respect it and all readers of the site.

To have your photo next to your comment please signup your email address with Gravatar.

Your email is never published. Required fields are marked *

Please complete the name of this site, Liberal Democrat ...?


Recent Comments

  • Alex Macfie
    Tactical voting does happen; why else would the Labour vote in Richmond Park be 5.2%? Obviously it takes a lot of hard work locally to keep the Labour vote that...
  • Nick Collins
    @ Tom Arms & Mary Fulton II think another quote, again from Edmund Burke I believe, is also apposite "No-one made a bigger mistake than the man (toda...
  • Martin Gray
    @Martin... 'Liberal Democracies' have embraced globalisation & neoliberal economics . No fundamental change for those at the bottom just perpetual struggle....
  • Slamdac
    The checks and balances are there to ensure that there are no rash decisions just because one party or group have a majority. If a settled majority want som...
  • Peter Davies
    Though none of the articles actually confirms the headlines, they do suggest that these rags are still trying to defend Brexit and with increasing desperation....