Britain is failing its children – again

There’s a time-honoured tradition of getting headlines by putting countries in a league table.  This week it was the turn of UNICEF’s report on inequality in child well-being, which showed the UK struggling in lower mid-table obscurity – and with the US, Greece and Italy at the bottom.  This follows a well-publicised paper last year that put the UK at 24th out of 29 EU countries for its overall level of child wellbeing.  But while the headlines rarely go beyond the overall ranking, to actually understand these we need to dig deeper to understand what they’re actually showing – and to ask whether these league tables can be any use at all.

(A confession: I’m as guilty of creating these league table as anyone, back in the days when I was a full-time alcohol researcher… So I understand how tempting this is!).

How UNICEF created their league table

The ‘overall record’ league table is shown to the right of the page, based on a simple 1-3 score of whether a country is below, at, or above average for inequalities in each of material wellbeing, education and health. The danger, though, is that it’s almost impossible to understand this without knowing how this is calculated – which to be fair to UNICEF, they explain very well if you’re prepared to dig into the report.

Let’s start with inequality in material well-being. This is based on an equally-weighted average of three standardised scores: post-tax income, educational resources (e.g. internet connection, a quiet place to study), and number of rooms per person in families with children.

This is transparent  – but I’m not convinced this is a sensible scale.  ‘Number of rooms’ and ‘educational resources’ simply don’t seem as important as income here. Otherwise Sweden – which does brilliantly on income equality – is ‘close to the average’, simply because it has fewer rooms per person than other countries. (If any Swedes can explain whether Swedish rooms are unusually large, btw, that would be helpful…).  Spain, conversely, does terribly on income inequality but pretty well on rooms-per-person.  What this means – and why you would put these measures together – isn’t obviously clear to me.

Reassuringly, the measure of educational inequality makes perfect sense: it sensibly combines reading, maths and science literacy.

But the scale for health wellbeing is muddled too. It combines inequalities in (i) number of self-reported ill-health symptoms, (ii) eating fruit & vegetables, and (iii) physical activity outside school.  These are just not the same sorts of thing: ill-health symptoms are a health outcome; while healthy eating and physical activity are health risk factors.

There are also other, more technical issues here – for example, about their measures of inequality for the categorical outcomes.  (For everything except income and education, they compare the median score with the average score of those below the median – which is defensible, but not that easy to interpret). Moreover, it would be a brave researcher who would argue that 11-15 year olds answer questions on ‘feeling irritable’ in the same way across all these different countries.

But even if we could create a perfect league table, the question remains: what do league tables tell us?

Going beyond league tables

Politicians and newspapers are suckers for league tables.  Newspapers love them because anything that is the best/worst is automatically a good headline – and in the UK, they also feed our masochistic urge to say how terrible our country is. More helpfully, politicians love league tables because they seem to show that we’re failing in some way, and that a better world is possible.  For those on the right, this often means envious glances over the Atlantic to the US; for those on the left, it’s dreaming of Sweden (which, as ever, is near the top on the UNICEF table).

The trouble is that it’s by no means clear what we should actually do in response to league tables. UNICEF follow-up their table by talking about a range of policies, but nothing here is as hard-hitting as the original ranking – and it certainly isn’t based on naively imitating top-ranked Denmark or Switzerland.  Often there are a range of reasons behind a country’s superior performance, some of which are cultural factors that are simply not possible to replicate. Americans will never become Swedes; the Danish flexicurity model may simply require too much goodwill for a Britain that is riven with stereotypes and distrust around benefits. And for the top-ranked countries, league tables argue for a policy of smug complacency, rather than the possibility for every country to do more.

None of which is to say that league tables should be scrapped. They have their place. But it would be much more useful to focus our knowledge on what we could actually do to reduce inequalities, and how this compares internationally. We desperately need more results that estimate the effect of a whole range of policies across different countries, showing in which countries the greatest gains could be made – and by extension, where the political class is showing the greatest failures. Colleagues of mine in the alcohol field are working on just such models. Over the coming fortnight, I’ll try and explain these in more detail – and why even creative experiments need this kind of work alongside them.

About Ben Baumberg

I am currently a Lecturer in Sociology and Social Policy at the School of Social Policy, Sociology and Social Research (SSPSSR) at the University of Kent. I also helped set up the collaborative research blog Inequalities, where I regularly write articles and short blog posts. I have a wide range of (too many...) research interests, at the moment focusing on disability, the workplace, inequality, deservingness and the future of the benefits system, and the relationship between evidence and policy. You can find out more about me at http://www.benbaumberg.com
This entry was posted in Blog posts and tagged , . Bookmark the permalink.

8 Responses to Britain is failing its children – again

  1. The problem with the “cultural” argument (“Americans will never become Swedes”) is that it can’t explain how the Swedes got to be the way they are. In the 19th century, Sweden was an agricultural society with huge inequalities and widespread poverty. The real question is, how did the Swedes manage to “become Swedes”? And if they could do it, why couldn’t the Americans do it, too?

  2. Ben Baumberg says:

    It’s a great question, which I was partly going to address in the next post – how do we evaluate possible macro-level social changes? It’s difficult.

    The ‘welfare regimes’ literature (e.g. Esping-Andersen’s ‘Three Worlds’ book) tries to justify each welfare regime as part of a historical path that is heavily dependent on particular institutions and configurations. But I’ve seen relatively little discussion about how much it’s possible for countries to deliberately, reflexively change regime type (this might just be because I’m not immersed in this literature…).

    So Ben, any help you could give here would be really useful!

  3. It’s a mystery to me. This has always been one of those things I’ve planned to look into after I finish my PhD.🙂

  4. I think the type of welfare state influences the attitude of the people, as well as influencing inequality outcomes. With a higher proportion of means-tested benefits, as the more unequal countries tend to have, there is more stigma attached to claiming, rather than there being solidarity and the idea that citizenship entitles you to benefits. There is also the paradox that more targeted welfare states are associated with more inequality, and universalism with less inequality.

    This approach doesn’t explain how welfare states came to differ in the first place (historical accident?), but does suggest that changing them would change national attitudes. The problem is, as you imply, the catch 22 that attitudes will be averse to the welfare reform that would change the attitudes.

  5. Tom Rees says:

    This seems like rather a blanket condemnation of league tables. Surely some are better than others? If only we could put together some kind of organised list, ranking them according to utility, we could ascertain the common features of the most effective and… oh, wait, hang on…

    • Ben Baumberg says:

      🙂

      And seriously, you’re right that that league tables might have some use. I’ll give them a fairer treatment in my next couple of posts, in the process of arguing why randomised controlled trials have their problems…

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s