I’ve mentioned before that we are frequently told that exclusions from schools are common, rising and racist. I find that evidence is often ignored, or carefully selected to fit, by those who make such claims.
The most recent exclusion figures we have are for the academic year 2019-2020 released in July 2021. These statistics are notable for several reasons.
Firstly, there is a change in terminology. “Fixed Term Exclusions” where a student is removed from school temporarily (usually for a day or two) are now called “Suspensions”. One of the most common tricks used to make permanent exclusions seem common is to cite figures for fixed term exclusions and refer to them only as “exclusions” in articles that are mainly about permanent exclusions. There would have been even greater clarity if “permanent exclusions” had been renamed “expulsions” (this was proposed, but the DfE gave in to the anti-exclusions lobby). Nevertheless, the change ensures that anyone referring to suspensions as just “exclusions”, when looking at the figures, is likely to be out of date (or perhaps even dishonest).
Secondly, this was the first school year affected by Covid. The lockdown that year reduced permanent exclusions and suspensions dramatically from previous years. Permanent exclusions fell from 7894 to 5057. Although the DfE did its best to support the anti-exclusion lobby by releasing termly figures for that year and the previous year (and suspiciously for no other years) you can’t get round the fact that this is not an increase. When permanent exclusions fell slightly in the 2018/19 academic year it was easily hidden by talking about Fixed Term Exclusions instead, or comparing with two or more years earlier rather than just the previous year. In 2019/20 however, it doesn’t matter how you slice it, permanent exclusions and suspensions are lower than they’ve been in years. It also means that permanent exclusions and suspensions fell dramatically for almost every subgroup in the data. So another classic trick of slicing up the data (by gender, race, sector i.e. primary or secondary, age, region or SEND) and only reporting on statistics showing a rise, is not readily available.
Thirdly, this is the first year where black pupils had a lower rate of permanent exclusions than white British pupils. It’s only a marginal difference (the DfE website gives them both as 0.07%, i.e. 7 pupils in every 10 000) but if you calculate it to another decimal place you find black pupils are less likely to be excluded than white British pupils. Black pupils had been less likely to be suspended than white British pupils for a few years now. For a very long time, ethnic minority pupils in general have been less likely to be excluded or suspended than white British pupils. But those two facts had been ignored by commentary that focused only on the rate of permanent exclusions for black pupils while ignoring other data. Now, that trick is not available.
Combined together these three developments should make it impossible now for anyone to claim that “exclusions” are rising; that permanent exclusions are common, or that black pupils are disproportionately excluded. The exception to this is, of course, if one lies or shares information from somebody who is lying.
It is worth noting that, since those figures came out you may have seen some of the following claims:
(David Collins is a Sunday Times journalist.)
(Agenda is a charity, and after a FOI request I checked that the claim is no more true for black girls than for black pupils in general)
From The Guardian
From the BBC.
From activist Lee Jasper.
From The Guardian website although it may be a story from The Observer.
(I doubt this is accurate about Katharine Birbalsingh.)
From Professor Kalwant Bhopal in the Mirror.
(City Of London is a NGO).
(Beyond Autism is a charity)
From The Telegraph.
From The Express. (There are over 20000 schools in England, so the average number of permanent exclusions a year in most schools is actually less than a tenth of what is claimed in the first sentence.)
(Bright Futures is a charity.)
(The Council for Disabled Children (CDC) is “the umbrella body for the disabled children’s sector in England”)
I could keep going with this. The BBC and Guardian claims were particularly widely shared, often by people and organisations with power in education. My conclusion is that where there is an absence of data that can be cherrypicked to mislead, we can expect to be bombarded with outright falsehoods instead.
Book Review: Measuring Up by Daniel Koretz
January 16, 2022Measuring Up by Daniel Koretz. Published by Harvard University Press. 2008
One of my new year’s resolutions for 2021 was to read more books and I intend to continue that into 2022. I will be reviewing those books that are relevant to education. Two warnings though. 1) Any links to Amazon will be “associate” links potentially earning me a few pennies. 2) A lot of these books have been sent to me by people I know, so I’m completely biased.
Daniel Koretz is the rarest of treasures: a Professor of Education who is an expert on a genuine body of knowledge. His speciality is testing, and he taught classes at Harvard on assessment. This is an area where it is possible to make and research empirical claims, and this is a balanced and well informed book exploring the utility and the limits of testing in education.
This is a good introduction to the key concepts and the technical language of testing. It is an important read at this time. These days schools seem particularly keen to design their own tests. Additionally, following the cancellation of exams in the last two years, much is claimed about both the value of tests and the capacity of schools to accurately and objectively assess their pupils. Test design and the interpretation of test results is not a trivial matter, and anyone claiming to be able to do them well just from their knowledge of teaching should be treated sceptically.
If you are expecting this book to give simple answers, it won’t. It will tell you that tests have an important role in assessment and cannot easily be replaced by other means of assessment. However, it will also tell you tests have important limitations, and that it is easy to make incorrect inferences from them. There is a body of knowledge out there that enables us to discuss the benefits and disadvantages of testing in a rational manner, and this book is a great introduction to that.
Terms such as “error”, “validity”, “reliability” and “bias” are thrown around in education debate about tests, often by people who have little understanding of what they mean in the context of testing. Rather than resolving all arguments, this book is a tool for having better arguments.
Its final chapter does, however spell out where tests are likely to be most useful, and in how the limitations of testing can be addressed. This is definitely worth a read before designing another assessment, or weighing into any more debates about the value of exams.
Share this:
Like this:
Posted in Commentary | Leave a Comment »