The only way that David Cameron can make the case for his policy is by abusing statistics
The Tories’ decision to make free schools a flagship election policy is a little surprising. Free schools have rarely been in the news for good reasons with catastrophic failures such as those in the Al-Madinah and Discovery free schools receiving significant media coverage, along with the spiralling cost of the programme.
There is also no evidence base to support the planned extension of the programme. The only way that Cameron can make the case for his policy is by abusing statistics, as he did in his speech last week:
“What [free schools] have achieved is, frankly, remarkable. They’re more likely to be good or outstanding. In fact, free schools are twice as likely to be judged ‘outstanding’ as other schools inspected at the same time.”
It is just not true that free schools are twice as likely to be judged outstanding as other schools.
When comparing Ofsted inspection results we need to be mindful that inspection frameworks have changed several times in recent years, most recently in September 2012. However, the best way to make the comparison is still to look at the most recent inspection outcomes of all schools compared with those for free schools.
In December 2014, Ofsted published a report providing a picture of ‘the ‘state of the nation’s schools’ as indicated by inspection outcomes.’ As at 31 August 2014, the most recent inspection results for all schools gave the following results: 20 per cent were judged to be outstanding, 61 per cent good, 17 per cent were deemed to require improvement and three per cent were judged inadequate.
The Ofsted report includes free school inspection results also at 31 August 2014 when 76 free schools had been inspected: 18 of these were judged to be outstanding (24 per cent), 35 were good (46 per cent), 19 were judged to require improvement (25 per cent) and four were deemed inadequate (5 per cent).
The most up-to-date statistics for free schools are slightly different to those in the report: counting the two schools that have been closed down as inadequate, 23 per cent of free schools have been judged to be outstanding, 48 per cent good, 22 per cent required improvement and eight per cent were inadequate.
So where is Cameron getting his figures from? The clue, I think, is in the line ‘free schools are twice as likely to be judged ‘outstanding’ as other schools inspected at the same time.’ The major problem with comparing any one school’s, or group of schools’, inspection results with other schools inspected that year – or in any similar time-frame – is that weaker schools are inspected more frequently than highly performing schools. The inspection results of weaker schools are therefore overrepresented and the results are not indicative of the national picture. As the Ofsted report states:
“The impact of risk assessment is that a smaller proportion of previously good schools are inspected than the proportion of good schools nationally. Certain types of school previously judged to be outstanding are exempt from inspection under regulations and will not be inspected unless Ofsted has concerns about them…Therefore, school inspections in the year are not representative of schools as a whole.”
Let’s take, for example, the Ofsted reports for schools inspected in 2013/14 when nine per cent were judged to be outstanding, 54 per cent good, 30 per cent were held to require improvement and seven per cent were inadequate. The results in 2012/13 are very similar (see page 5 of the Ofsted report).
Is this perhaps what Cameron was using as a comparison for free school inspection results? It would seem so, because it is hard to guess on what else he could base his statement that free schools are twice as likely to be judged outstanding as other schools.
What’s more, this is not the first time that the government has made this false and deceptive comparison.
Using the best – albeit imperfect – data available, free schools have a slightly higher proportion of outstanding inspection results (23 per cent as against 20 per cent) but a significantly higher proportion of free schools either require improvement or are judged inadequate (30 per cent compared with 20 per cent of all schools).
The sample size of free schools is clearly small. However, it’s the only data we have and it is the data the government is using to justify its pledge to extend the free school programme (it has to rely solely on inspection results because free schools have not been around long enough to produce GCSE or Key Stage 2 results).
If we are to detect any trends in the data, it’s that free schools are more likely to be below the standard that we expect. This is perhaps not surprising given that they are frequently set up by groups that have little experience of running a school and are not subject to the same level of oversight as schools that fall within the remit of local authorities.
Supporters of free schools like to argue that they raise the standard of surrounding schools and that spending on free schools in areas with surplus places is therefore justified. David Cameron said on 9 March:
“As Policy Exchange said this week, free schools don’t just raise the performance of their own pupils – they raise standards in surrounding schools in the area too.”
The problem for David Cameron and others is that there is no evidence for this. Even Policy Exchange’s own report does not support this conclusion, although that is how the authors of the report have spun (it’s worth noting that one of the authors has set up his own free school).
For a masterful takedown of Policy Exchange’s conclusions based on the think tank’s own data, see Henry Stewart’s piece for the Local Schools Network. Stewart points out that while Policy Exchange finds that in the lowest performing 25 per cent of primary schools those closest to a free school improve at a faster rate than similar schools nationally, primary schools in the other three quartiles closest to free schools do less well than similar schools nationally.
As Stewart writes:
“If this data is used to argue that the presence of primary [free] schools improves the performance of the least well performing schools, it must also be argued that they reduce the performance of the other 75 per cent.”
Let’s hope that if this policy comes up in the televised leadership debates that Cameron’s attempts to mislead the public about their children’s education are exposed.
Annie Powell is a contributing editor at Left Foot Forward. Follow her on Twitter
6 Responses to “Lies, damn lies and David Cameron on free schools”
Bernie Evans
Most of this was on the Guardian website last week:
Increasingly, it becomes more difficult to react to news about education policies with anything but despair. It would be expecting too much of the Tories for them to base their policies on empirical evidence, given Gove`s examination reforms, but even the report by Tory think-tank, Policy Exchange, on which their “500 more free schools” announcement is founded, admits its limitations. (Cameron to pledge 500 more free schools despite statstical doubts,09/03/15) The fact that the report confesses its own “data cannot demonstrate conclusively” that any improvements in state schools have anything to do with being near a free school, beggars belief; they should have added, “despite what the prime minister will say”!
Sadly, news from Labour on the education front fares little better, despite their intention to “scrap” the free school scheme Only last week we saw Tristram Hunt showing enthusiasm for another policy testifying, in Rafael Behr`s words, “to the power of nostalgia above evidence”. (Policy by nostalgia just ain`t what it used to be,04/03/15) Of course, the country needs to “make the most of the talents of all our young people” but how can that be achieved by identifying only a small proportion, the so-called “gifted and talented”, and giving them special treatment?
All children have talents and deserve an educational system which will stretch them to the limit, but designating some as worthy of a more expensive education, is clearly unfair, and certainly should not be featuring in an education policy of any political party. Whatever happened to the idea of equality of opportunity?
Whilst not usually finding anything significant with which to disagree in a Fiona Millar column, her article on “character education” appeared to be based on the mistaken premise that pupils in state schools today lack sufficient “character and resilience”. (You can`t measure good character,10/03/15) Tristram Hunt frequently has remarked on this alleged difference in this respect between the state and privately educated, but is this not an example of merely carrying on where Gove left off, making huge generalisations about education without the empirical evidence to substantiate them? Rafael Behr would, no doubt, refer to it as “the power of nostalgia above evidence”. (Policy by nostalgia just ain`t what it used to be,04/03/15)
Millar states that the DfE`s definition of character includes everything from “perseverance, drive, and grit” to “honesty and dignity”, but, in my experience, all of these characteristics, and more, abounded in state schools. As for resilence, state pupils constantly display the ability to recover from setbacks. How often have they had to bounce back in the face of assessment “goalposts” being frequently moved, and their excellent examination results being crticised and challenged by politicians from all parties, not to mention the personal economic and social problems many face? Then there`s the Education Maintenance Allowance being removed, 6th form courses being dropped because of lack of government funding, university fees being hiked, and the ever-present preference shown by the so-called top universities for students from the private sector, despite recent research showing how state-educated undergraduates do better at university than students educated at the so-called “schools of character”, with similar A-level grades.
Of course, the “enrichment activities that help cultivate well-rounded young people” are under threat in state schools, and perhaps it is here where the DfE`s attention needs to be focussed, rather than on England becoming a “global leader of teaching character”, with its inevitable criticism of teachers, albeit implicit this time.
Posted by Bernie Evans at 03:29
Email ThisBlogThis!Share to TwitterShare to FacebookShare to Pinterest
AlanGiles
For far too long, education, like health, has been a political football, far too much meddling from politicians who know little or nothing about what they are talking about – it always seems otiose in the extreme that this week you can be Education secretary and next week Defence secretary and pretend to be knowledgable in both fields overnight. This might have worked in the days when politicians of all parties had knowledge of working in the real world, but these fdays they are all artsy-fartsy Oxbridge career politicians who only know about life through books and what their respective aprties force feed them.
sarntcrip
free schools are little more than middleclass hobby schools impossible to compare with local authority schhols of similar size as the absurd position has developed where 1.freeschools do not have to teach national curriculum,laughably they do not even have to employ trained teachers,a pathetic wasteful policy
Leon Wolfeson
Quite. Successive government’s haven’t let educators near education.
(This isn’t a Tory failing along, Labour are 99.9% as bad. Gove manages another 0.01% for the shear scale of the damage)
Castilian
“trained teachers”? Do you really mean Marx indoctrinated teachers?