How does The Spirit Level withstand a critic?

The success of Richard Wilkinson and Kate Pickett’s The Spirit Level (reviewed here in August) in setting the terms for much political discussion unsurprisingly triggered a burst of publications taking a sceptical look at their case. Prime amongst these is Policy Exchange’s publication Beware False Prophets, by Peter Saunders, whose title gives you a fair clue as to its line.

As the book says on its back cover:

In The Spirit Level, Richard Wilkinson and Kate Pickett claimed that egalitarian societies benefit rich and poor alike. Crime rates are lower, infant mortality is reduced, obesity is less prevalent, education standards are higher, average life expectancy is longer, social mobility is more extensive, and so on. They concluded that we would all benefit from a more egalitarian distribution of income…

[However] their evidence is weak, their analysis is superficial and most of the correlations in their book do not stand up.

So how does the Policy Exchange publication come to this conclusion and is its argument well founded? The critique is based on three core points: how strong the data is for the 23 countries that Wilkinson and Pickett looked at, what happens if you look at more countries and what the evidence is when comparing individual US states with each other.

Beware False Prophets book coverOn the 23 countries some individual criticisms are made of specific graphs that carry weight. However, the criticisms are not consistent with each other across the different graphs – sometimes Saunders suggests the data is overly dependent on one country, sometimes on others. Picking and choosing which countries to exclude from graph to graph does not make for a coherent case that there is no underlying pattern. Moreover, the basic point Wilkinson and Pickett are arguing is buttressed by numerous other studies beyond their own (see a partial round-up here) and so picking apart some of their individual data is a bit like picking apart the methodology of one individual pollster in some polls; it is a long way short of undermining the polling industry overall.

A more general point made is that there is a consistent difference between Scandinavia countries and Anglo countries. The Scandinavian countries are generally more equal and perform better on education standards, life expectancy and so on, whilst the Anglo countries are less equal and perform less well. That raises the question as to what extent it is the greater level of equality that makes Scandinavia different compared with other factors.

Peter Saunders also looks at what happens to the Wilkinson / Pickett data if you add in more countries, finding that in many cases the relationship between inequality and outcomes goes. However, he does this in part by adding in many small countries – those with populations of 1-3 million. So his critique really amounts to saying that the relationships may be different in small countries from large countries. The existence of such a difference is neither inherently implausible nor does it alter the political implications for the UK (population: a lot more than 3 million).

Saunders also adds in some large countries to the data set, though as he acknowledges these are generally poorer than the Wilkinson / Pickett set. As their theory is deliberately and explicitly one for affluent countries only, saying that something different happens in less affluent countries compared to more affluent ones does not undermine thesis. Their own response to Saunders’s work does not, though, directly address the question of how sensitive their results are to quite where you draw the cut off amongst countries nor why some of the affluent countries Saunders looks at were excluded from their study.

This mixed picture is common across all of Saunders’s areas of criticism – a few points that stick, some that simply sharpen the definition of the Spirit Level‘s thesis as applying to medium to large rich countries, a few that Wilkinson and Pickett rebut and some where, even if you read their different accounts side by side (or look at what they said when appearing together, such as at an RSA meeting), they do not directly address each other’s points.

The ‘trump card’ that Wilkinson and Pickett have to play is the amount of other research that points in the same direction as their research. The two main weaknesses left are the question of whether there is really something else going on in Scandinavia and also (though not mentioned by Saunders) the point I made when reviewing the Spirit Level:

Not only does it rely overwhelmingly on comparisons across countries at the same point in time, rather than in tracking ailments varying over the years, the limited amount of such evidence deployed is almost all of the ‘inequality increased and then things got worse’ form. There is no automatic reason why, even if increasing inequality makes things worse, then decreasing it will make things better. The world is not always symmetrical. Moreover, even if the effect works strongly ‘in reverse’, is it the most cost-effective route to take? If inequality causes stress which causes social ills, is targeting stress going to be more successful?

My verdict then? Where the Spirit Level to have been original in the data patterns it found, these criticisms would add up to reasons to be cautious about its findings. However, because of the extensive other supporting data available, the findings still look solid even though – as I said in my review of it – the political policy implications are far more nuanced.

Amazon sell both The Spirit Level and Beware False Prophets and Policy Exchange both sell their pamphlet and provide it as a free pdf.

Read more by or more about , , , or .
This entry was posted in Books and Op-eds.
Advert

10 Comments

  • Do you mean a critique?

  • To repeat my main objection to this literature, we could all get Japanese/Norwegian levels of income inequality and Japanese/Norwegian levels of social solidarity among citizens if we adopt Japanese/Norwegian levels of ethnic homogeneity.

    The case is tantamount to saying that the United States of America should not accept non-white immigration, and thus inflate its own numbers on almost all levels of social loveliness, regardless of what it means for those who would have otherwise immigrated.

  • Any book that questions the status quo and challenges vested interests is bound to be attacked, crticised and smeared. This book is no different.

    It’s a great read and is certainly thought-provoking. Read it yourself and draw your own conclusions.

  • Jane Leaper – you suggest that the USA is exceptional because of its lack of gun control, and that this makes conclusions about murder rates/unequal socities unreliable. However: the authors of The Spirit Level did not only analyse international data – they applied the same analysis to the 50 states of the USA, and found the same result.

  • Jane Leaper – one other point: ‘Excluding outliers is something I was taught to do when I did my social science degree.’ Is that not another term for cherry-picking?

Post a Comment

Lib Dem Voice welcomes comments from everyone but we ask you to be polite, to be on topic and to be who you say you are. You can read our comments policy in full here. Please respect it and all readers of the site.

To have your photo next to your comment please signup your email address with Gravatar.

Your email is never published. Required fields are marked *

*
*
Please complete the name of this site, Liberal Democrat ...?

Advert



Recent Comments

  • John Roffey
    I am inclined to believe that it is the Party’s lack of commitment to the climate crisis that deters many voters (and explains Labour’s popularity). This...
  • Ernest
    @Gwyn Williams The Independent for Wales movement YesCymru has always believed that it is about having a free Wales that is able to see its way in the world. W...
  • Jenny Barnes
    no worries, here it is https://petition.parliament.uk/petitions/619781...
  • Jenny Barnes
    Could we also promote the new Petition calling for an immediate Election ? link please...
  • Joe Bourke
    The ONS does actually attempt to measure wellbeing ...