‘The State of Welfare’ on the BBC: a missed opportunity

In a guest post from Declan Gaffney – re-posted from his personal blog L’Art Social – he picks apart a repeated false claim about what we know about benefit fraud, in the midst of an otherwise welcome BBC report.  This is perhaps our last post directly on benefit deservingness and perceptions for a little while, after a series of posts connected with the report that Declan, Kate Bell and I wrote – but we will return to these issues in early 2013!

In many ways Radio 4’s report ‘The State of Welfare’, broadcast on 27 November to mark the 70th anniversary of the Beveridge report, showed the BBC at its best. There was something symbolically appropriate about Radio 4 disrupting its morning schedule, a revered national institution in its own right, to devote three whole hours to the social security system that Beveridge founded. The programme was genuinely informative and balanced, drawing on a wide range of views from experts, historians, commentators, politicians and members of the public, including people who rely on benefits.

It may therefore seem churlish to single out one detail of the programme for criticism, but that’s what I’m going to do.

Evidence-based Churlishness

At a couple of points in the programme, participants cast doubt on the estimates of benefit fraud produced by the Department for Work and Pensions. The journalist James Batholomew asserted that the figures only captured /detected/ fraud, suggesting that the real level of fraud is unknown; Frank Field also seemed to query these statistics. The BBC is not responsible for views expressed by guests, but at one stage the presenter Julian Worricker also stated that our knowledge of the level of benefit fraud was based on ‘anecdote’.

This is simply incorrect. The figures produced by DWP are among the most statistically robust estimates of fraud produced by any government department. You don’t need to take my word for this: the following quotation comes from a report by the Centre for Counter Fraud Studies at the University of Portsmouth which is highly critical of the approach to fraud estimation taken by most other government departments: ‘DWP provided estimates of losses to fraud involving the benefits which they administer. They estimate for 2008-2009 that £1.1 billion (or 0.8% of total expenditure) was lost to fraud. This is a low figure, but one which, for the most part, is based on statistically valid and accurate loss measurement exercises – something which the DWP should be congratulated for undertaking. The low figure may reflect the length of time that DWP have been tackling this problem.’ (from this report)

Given Mr Bartholomew’s assertion that the DWP figures only show cases of detected fraud it is worth noting the kind of practice with which the Centre for Counter Fraud studies is /contrasting/ DWP’s approach: ‘In some cases organisations simply added up the value of the losses found in cases of detected fraud and assumed that this figure represented the total losses incurred. This conveniently ignored the reality that for the figure to be accurate there would need to be a 100% successful detection rate….’ Far from doing this, DWP selects a large random sample of benefit claims every year, carries out benefit review interviews with claimants and uses standard statistical techniques to gross the sample data up to overall estimates, controlling for sample bias and missing information (as described here). The sample for the 2011/12 estimates was some 36,300. Anecdote?

The impact of misrepresentations

Why is this important? The Radio 4 programme returned to the issue of benefit fraud several times- quite rightly given its salience in public attitudes and debate. But in going along with the claim that fraud represents an unknown quantity, the BBC was not only mistaken, it was missing an opportunity to challenge a widespread public misunderstanding which distorts debate on social security.

For our recent report on benefit stigma for the charity Turn2Us Ben Baumberg, Kate Bell and I commissioned a survey from Mori in which we asked people to estimate the level of benefit fraud. Previous surveys, and the survey commissioned by Radio 4 for its programme, have asked similar questions, but we tried to formulate our survey questions to be as unambiguous as possible so that answers would reflect beliefs about fraud rather than less specific negative attitudes towards claimants.

  • Thus while the British Social Attitudes Survey in 2007 asked ‘Out of every 100 people receiving [sickness or disability/unemployment] benefits, how many do you think are falsely claiming the benefits?’…
  • …our survey question was: ‘The government releases figures on the amount of “benefit fraud” – where some people deliberately deceive the government, as they would not be entitled to benefits if they told the truth. Out of every 100 people claiming out-of-work benefits how many, if any, would you say, commit fraud in this way?’

Unsurprisingly, the average estimate of fraud in our survey is somewhat lower than that for people ‘falsely claiming’ in British Social Attitudes: 25% for all out of work benefits compared to BSAS results of 30% for disability benefits and 35% for unemployment benefits. But even 25% is an extraordinary value: DWP estimate that the percentage of claims which are overpaid due to fraud ranges from 2.3% (working age housing benefit) to 4.2% (lone parents on income support). For all income support and Jobseeker’s Allowance claims taken together, the estimate is 3.4%. (See table 5 on page 28 of the report here for our and the BSAS results but note that the official estimates of fraud we cite there are based on expenditure rather than caseload, which gives slightly lower figures- caseload figures weren’t available at time of drafting).

We also looked at newspaper reporting of social security: some 30% of all articles on working age benefits published in national titles between 1995 and 2011 made reference to benefit fraud. We found a striking relationship between people’s estimates of fraud and the amount of coverage of fraud in the newspaper they read. This relationship remains statistically significant after controlling for other factors associated with beliefs about fraud. Our interpretation is that members of the public, including claimants, supplement the limited information on benefit fraud accessible through direct experience with information from the media- and that information is strongly skewed towards fraud.

That the UK public overestimates benefit fraud by an order of magnitude is surely an important aspect of current debate on social security. This finding turns on having something robust to compare public opinion with, and fortunately that is precisely what we have. We don’t have to believe that DWP has identified /all/ the fraud in the system: no estimate is perfect and the fraud detection rate for the sample is unlikely to be anything like 100%. But DWP’s estimates would have to be out by a factor of seven to match the public’s estimate, and that is utterly implausible. We can be very confident that benefit fraud, which exerts such a strong hold over public opinion on social security, is /much/ lower than people generally think. It’s unfortunate that the BBC didn’t set this straight in a programme which was otherwise well-researched and balanced.

This entry was posted in Blog posts and tagged . Bookmark the permalink.

4 Responses to ‘The State of Welfare’ on the BBC: a missed opportunity

  1. Ben – I was a contributor to the programme on the day – and you are quite right. But I did try to correct this perception during the programme – in response to a direct question – I pointed out that the DWP figure is based on a sample survey and was a properly researched figure.

    Even more worrying, I thought, was the claim by James Bartholomew about the relevance of a survey conducted in the US with 379 lone parents which he claimed showed they admitted lying about their status to claim benefit fruadulently. Even if this were good evidence – we simply cannot compare what happens here with the US for many reasons – chief among these is the fact that in many states, it is only lone parents who can claim social assistance at all through Temporary Aid to Needy Families (TANF) – if in a couple you cannot claim – so the incentives there are entirely different. This is not the case in the UK – despite the mythical ‘couple penalty’.

    Well done you though for focusing again on the issue – it clearly has an impact on public opinion.

    • Ben Baumberg says:

      Thanks Alison – there’s an excellent book on the US called ‘Cheating Welfare’ that seems to find some similar things to Bartholomew. But I think there’s a difference between ‘fraud’ in the public mind (huge sums of money, outrageous lies), and the reality of fraud in the benefits system (people not reporting temporary cash-in-hand work or partners moving in and out, both of which can be so unstable as to disintegrate if the pressure of moving off benefits was added).

      (I thought today’s event was excellent btw, and that Kate Green’s talk in particular was fantastic. And sorry for missing your comment for a few days – this was a post by Declan as a ‘guest’ on Inequalities, so it doesn’t automatically tell me when there are comments).

  2. Ben Baumberg says:

    If you liked this post by Declan, then he’s written a fantastic post about why unemployment in this particular downturn doesn’t lead to changing public attitudes – you can read this on the New Statesman blog here. (This is as much for my reference as anyone else’s…)

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.