Reasons the British public are so often wrong (and suggestions for what to do about it)

Earlier this week, I set readers a quiz — The British public, eh? What do they know? — based on research undertaken by Ipsos MORI for the Royal Statistical Society and King’s College London showing the British public is often wrong about what we think we know on a range of current social issues. For instance, we (collectively) massively over-estimate the proportion of people in this country who are black or Asian, or who are Muslim, or who are over 65. We also think, again wrongly, that crime is rising, and that more is spent on overseas aid than on pensions.

Over at The Conversation, Bobby Duffy, a senior research fellow at King’s, has outlined four explanations he thinks do most to account for how unreliable is the public’s knowledge of facts and figures:

First, there are simple measurement and definitional problems. It’s difficult to get across what can be quite complex and precise issues in simple survey questions.

But probably more importantly, the public are not always thinking about the things we think they are. For example, when we ask people what they were thinking of as benefit fraud when they guessed at its scale, they select items that can’t be counted as actual fraud. In people’s minds, it includes claimants not having paid tax in the past and people having children so they can claim more benefits.

Second, there are a whole range of cognitive errors, simple mistakes we make when answering these types of questions. This includes problems of statistical literacy – for example, we just struggle with very big or very small numbers, and find it hard to distinguish between rates and levels.

But there are also explanations from social psychology on the biases and shortcuts in how we think: for example, we know we’re more likely to focus on and remember negative information.

Third, there is certainly an impact from the media and political discourse. The links are complex and difficult to prove categorically, but the association between attitudes and media coverage is often strong. Of course, the media also reflects our concerns and tastes for types of information: to a large extent we get the media we want. The focus on vivid stories rather than straight facts is because we pay more attention to those vivid stories ourselves (we admit we rely on personal experience and information from those around us more than representative data).

Which leads onto the fourth key explanation – that these misperceptions may be an effect of our concerns rather than a cause. That is, we overestimate partly because we are worried about these things, rather than being worried because we believe we know their full extent. Academics call this “emotional innumeracy”: we’re making a point about what’s worrying us, whether we know it or not.

There is no easy solution to any of this.

Efforts to encourage/shame the media and politicians into using accurate statistics will help. So, too, can ‘citizens’ juries’: “deliberative workshops on tricky policy issues where information is provided, experts give evidence and people have time to reflect on things they don’t normally get the chance to”. Interestingly, this process was used by the Independent Parliamentary Standards Authority (Ipsa) to consult the public on the appropriate level of MPs’ pay. Here’s what they found:

mps pay

Our work with ComRes in 2012 showed that most members of the public, when initially considering MPs’ pay, did not think it should be increased. In fact, when asked how much MPs should be paid, a plurality pitched it in the £30,000-50,000 range, with the average figure being £49,710. In a citizens’ jury exercise, the participants discuss the issues for several hours and receive more supporting information than in a focus group. This allowed us to see whether attitudes changed with greater understanding of the subject. What we found is that some people did become more inclined towards somewhat higher pay for MPs. The decisive information was seeing what others, whose roles carried significant responsibilities, received.

The problem with ‘citizens’ juries’, of course, is that they’re not scaleable. But here Bobby Duffy has an intriguing suggestion:

… it’s obviously not very practical to get the whole population in a workshop for a day or so. However, new communication technology does provide easier ways to do this. It won’t be as cathartic and will only reach a subset, but online mass deliberations by independent organisations (say, the BBC) could play its part in improving our currently badly informed debates.

There’s something in that. Remarkably, the last time this country had a national referendum – on the ‘alternative vote’ – the BBC failed to broadcast a single peak-time debate on the issue, despite the fact that almost 20 million citizens turned out to vote. In the lead-up to the 2015 general election, there is a definite role for broadcasters to use their skills and experience to ensure that, amidst all the heated partisan noise and the temptation to fire-up ratings by dumbing down, the public gets the chance to hear the reasoned views of all sides before we make up our minds.

* Stephen was Editor (and Co-Editor) of Liberal Democrat Voice from 2007 to 2015, and writes at The Collected Stephen Tall.

Read more by or more about , , , or .
This entry was posted in News.


  • Reasons the Public get some of the Above well most is simply the propaganda of past and present Government and MP’s and opposition parties put out. I.e. the current Government is labelling unemployed and those on sick as scroungers layabouts etc the public view on drugs so muddled not based on facts Immigration by exaggerations by some MP’s and parties along with the press A Lot can be laid at your own door Start there to put things right. Your Faults.

  • It would be interesting to see what information was presented to the “Citizen’s Juries” and who chose it. I would suggest that if it included a session on political slogans such as

    “An end to boom and bust”,
    “No more broken promises”,
    and the 2009 classic “The best way to get that (EU) referendum is to vote Conservative on Thursday”,

    the result would be a lowering of the salary level deemed appropriate.

  • And, of course:
    “Oppose higher tuition fees”

  • Unusually I agree with you, Joe. But it is more of a balance – parties must also engage with political education, to move voters away from prejudices. Difficult, long-term and sometimes vote-losing, but when you are a proper political party, with certain values, these must drive some of your actions.

  • @ Terry

    ” I.e. the current Government is labelling unemployed and those on sick as scroungers layabouts etc”

    I think you are unwittingly (?) illustrating the problem.

    When can you point to anyone in government saying the things you accuse them of?

    Surely that is just your impression of what they have said.

  • Helen Dudden 14th Jul '13 - 7:11pm

    Another one I found, was social housing tenants have children who smash green house windows.

    In society, there will always be someone who needs the help to stay afloat, when things for wrong.

  • “new communication technology does provide easier ways to do this”

    Totally, agree, if we can have on-line voting for Dancing on Ice – using the ‘app’, I’m sure we can use the same system for more practical applications. I’m a little surprised that they haven’t tried it yet for current affairs programmes…

  • Keith Browning 15th Jul '13 - 11:00am

    Tony Blair was disingenuous with his famous three part quote.

    Should have been: propaganda: propaganda: propaganda.

    No wonder that the population at large has no idea of the reality of anything. Finding out the truth about any event is nye on impossible. The greatest and most obvious truths are often the biggest lies – and continue to be so.

  • It’s amazing how the media sometimes gives the wrong impression. For example, even the Independent used words like ‘suffer’ and ‘worse off’ and ‘reduce’ when describing budget changes like the welfare cut to 1%; this is taken by the public to mean that people’s income will actually reduce, when what was actually meant was that their income will not increase by as much as if the changes had not taken place. One had to listen carefully to longer-term analyses from the IFS that came a day or two later, to get the proper picture of what was going on and how many of the public would have heard or read all that ?
    I suppose it is up to us activists to put out the right information, but then our own party does not help because the information they supply is often accompanied by spin.

Post a Comment

Lib Dem Voice welcomes comments from everyone but we ask you to be polite, to be on topic and to be who you say you are. You can read our comments policy in full here. Please respect it and all readers of the site.

To have your photo next to your comment please signup your email address with Gravatar.

Your email is never published. Required fields are marked *

Please complete the name of this site, Liberal Democrat ...?


Recent Comments

  • Katharine Pindar
    My good friend David Raw's comments on this, yesterday and today, are apposite as ever. I was pleased that you gave the JRF quote, David, because they are indee...
  • Charley HastedCharley Hasted
    @Elizabeth We aren't tory-lite or labour-lite though. We're Liberals and it's past time we remembered that the way we're going to win seats AND keep them is ...
  • David Raw
    "Naturally eugenics takes things a little further and screens the prospective parents and permits only those with ‘desireable’ tracts to inter-breed". Wh...
  • Tristan Ward
  • Barry Lofty
    Sorry " most certainly "!...