Was YouGov’s leadership poll “technically flawed”? (UPDATED)

That’s the suggestion that was made last night in a comment on Lib Dem Voice by Martin Tod, the party’s prospective Parliamentary candidate for Winchester, who noted:

Just had a quick look and there’s an important technical flaw with the poll… The poll sample’s age split isn’t even close to the party membership’s actual age split. It (unfortunately) hugely overstates young voters and understates those over 60.

If my reading of the data is right, YouGov’s weighted sample of 678 Lib Dem members comprised:

* 237 (35%) 18-39 year-olds
* 217 (32%) 40-59 year-olds
* 224 (33%) 60+ year-olds

I don’t know how this corresponds to the overall party membership; but my guess, if only from observation, is that Martin is right, and that the weighted YouGov sample is indeed hugely overstating the proportion of members under the age of 40. Which candidate this might have most benefited – or disbenefited – is simply conjecture. But perhaps the results of the poll should be treated with great caution until this point can be clarified.

UPDATE:

Peter Kellner has kindly provided this response:

We derived our age profile by comparing the profile of Lib Dem members in our panel with the demographic profile of our overall panel. This gave us a median age of 51. Given that there may have been changes since the Seyd/Whiteley survey which was, I believe, some years ago [and gave an average age of 59 for Lib Dem members], we were comfortable with this.

However, my calculation is that were we to have weighted the data using a median age of 59, this would give us Clegg 55-Huhne 45, instead of 56-44.

Given the margin of error that is always liable to occur in a sample of 678, this difference seems too slight to cause huge concern. The main point remains the one that we made to Sky News when delivering the results: given the large number of don’t knows among those who had not yet voted, the result could be anywhere between a comfortable Clegg victory and a very tight finish with the contest going either way.

Read more by .
This entry was posted in Leadership Election, News and Polls.
Advert

14 Comments

  • Peter Bancroft 4th Dec '07 - 9:52am

    It’s presumably not entirely conjecture as to what the result would be – we can rebalance the scores according to the right age ratios and see what the impact is.

    I think that Clegg won over the under 35s (which corresponds from anecdotal feedback on the LDYS website) which means that, if the YouGov poll is otherwise correct, the contest is going to be a lot closer.

    I was actually wondering a about the ABC1 v C2DE split – that’s ratio has to be right as well, but I doubt that YouGov have access to that kind of information (the latest public work I’ve seen was the “Neither Left nor Right” book from a few years ago.

  • Cheltenham Robin 4th Dec '07 - 10:06am

    OR – we could wait until December 17th

  • Last time YouGov overstated Hughes and understated Campbell. They weren’t far off on Huhne’s percentage but wrongly had him ahead because of understating Campbell.

    At the time I didn’t believe their poll because I thought those in the YouGov panel were unlikely to be representative, and were likely to be inclined towards the people who were swining Huhne’s way.

    It is very possible that the same factors could skew the poll Clegg’s way this time.

  • Dan Falchikov 4th Dec '07 - 12:53pm

    I’ll treat this YouGov poll as I do all of them – with contempt. They’re voodoo polls – not based on any statistically valid methodologies and when Kellner talks guff about MoE – he knows its spin as MoE can only apply to randomly sampled polls. YouGov’s panel poll is self selected, not randomly sampled and the subset of confirmed Lib Dem members likely to be very small in total.

    I’d guess the reason for the sample size of 648 is that it represents pretty much everyone on their database who ticked the ‘I’m a Lib Dem member box’.

  • “Women twice as indecisive as men.”

    Chris Squire – this “former senior pollster, now retired and teaching Politics” – it isn’t the “Pub Landlord” is it?

  • Peter seems to have cleared up Martin’s point: the age profile could have mattered but doesn’t. Obviously it is possible that the whole You Gov panel is warped by non-age related issues (self-selection) but we don’t have any evidence to that effect. In addition, neither camp is claiming that it is wildly wrong, so I think it is our best guess of where things are at the moment.

  • Dan Falchikov 5th Dec '07 - 1:55am

    13 – or not.

    YouGov has an appalling record of predicting Lib Dem internal elections and the party’s public share. Almost as bad as the Parliamentary Party…

    I suspect Clegg is in the lead – but there are loads of people who voted for Ming who are now backing Huhne – mainly due to Clegg’s appalling campaign.

Post a Comment

Lib Dem Voice welcomes comments from everyone but we ask you to be polite, to be on topic and to be who you say you are. You can read our comments policy in full here. Please respect it and all readers of the site.

If you are a member of the party, you can have the Lib Dem Logo appear next to your comments to show this. You must be registered for our forum and can then login on this public site with the same username and password.

To have your photo next to your comment please signup your email address with Gravatar.

Your email is never published. Required fields are marked *

*
*
Please complete the name of this site, Liberal Democrat ...?

Advert



Recent Comments

  • User AvatarTonyH 15th Oct - 10:17pm
    David Evans - "Ryan didn’t have any experience of UK politics." I was actually thinking about one E. Pamplin, but maybe that's ancient history now....
  • User AvatarPaul Barker 15th Oct - 8:14pm
    While I understand some of the concerns expressed in this thread I disagree about the threats facing us. Right now, it seems to be that...
  • User AvatarPeter Martin 15th Oct - 8:09pm
    @ Katharine, I did think twice about including Guy Verhofstadt. I haven't done an extensive background check on his views, but I did turn up...
  • User Avatarfrankie 15th Oct - 8:05pm
    It also increases Iran's influence. Right next door to Israel sits an ally of theirs. Syria has a battlehardend population and army, with no fear...
  • User AvatarDavid Evans 15th Oct - 7:36pm
    TonyH - It's not tribal to expect senior appointments to be long standing Lib Dems with real knowledge of how the UK political system grinds...
  • User Avatarfrankie 15th Oct - 6:57pm
    They may indeed hang tough for awhile, but as a country we are unused to pain, especially the boomer generation. When bad things happen expect...