The delusional voodoo of grading lessons has got to stop.

Screen Shot 2015-11-28 at 17.51.10

Last week I tweeted this message, along with a link to my Lesson Observations Unchained post from last year.

Screen Shot 2015-11-28 at 17.54.10

I received several replies from people in schools across the country where grading lessons is still very much alive and kicking. One person suggested that their lessons are given sub-grades: 2.1, 2.2, 2.3 etc.  Think about the very special powers you would need to sustain that with any level of reliability!  It’s either delusional madness or a weird power game of some kind.

The de-bunking of lesson grading has been running for some time now. Most people (especially those who run schools) should have read or heard Professor Rob Coe and his report on the MET project study.  If not, here’s a link to a superb round-up by Prof Coe  Classroom observation: it’s harder than you think.  And here are the slides:

Screen Shot 2015-11-26 at 23.24.18
Key slides form Prof. Rob Coe’s excellent presentation. Click to download from the CEM website

The conclusion is clear:  even well-trained observers can only agree 61% of the time and observations only agree with data 49% of the time.  More likely, with less well-trained observers, they can disagree 90% of the time with inadequate judgements.  Of course this is just one study but it highlights the fact that observation is complex and unreliable. To me, it is obvious that individuals and certainly groups of people are not capable of applying a consistent set of criteria to something as complex as a lesson, where the key outcome (learning) is invisible.  To think you can, is to kid yourself; it is a delusion.

To think you could reliably judge a French lesson (where 25 complicated people are all interacting with the teacher in a complex manner) to be Requires Improvement but not quite Good on one day and, several weeks later, judge a Maths lesson (where 25 complicated people are all interacting with the teacher in a complex manner) to be Good and not RI – is to believe you have special powers.

Ofsted has acknowledged this fully.  Ofsted inspectors do not grade lessons or expect or encourage schools to do so.

Screen Shot 2015-11-26 at 23.33.51
From OfSTED’s mythbusting document.

Despite the changes to Ofsted and the strong research evidence that grading is dubious, it persists.  I would like to encourage all teachers in schools where grading remains to ask their Heads or Principals directly why this is the case.  It’s a legitimate question and the subsequent discussion would be fruitful.  Here are some reasons that might explain their position; some might be hard for them to accept!

They haven’t read the evidence:  Easily fixed; send a copy.

They haven’t caught up with the change to Ofsted framework.  This would be worrying on many levels so definitely worth making sure they have the latest guidance. 

They know about the two points above but ‘don’t trust Ofsted’ and, for that reason, will keep grading to show that they’re good at leadership and management.   Perhaps point out that, now, even Ofsted is likely to look unfavourably on Heads who grade lessons despite the evidence.  It suggests you can’t evaluate quality effectively in an intelligent triangulated manner. 

They struggle to imagine how they could reach an overall judgement of the quality of teaching for Ofsted purposes without counting up the grades. Suggest that this practice has always been dubious. The Ofsted criteria relate to an overview of all lessons and their link to outcomes. It’s not a hard science; it’s a rough picture best-fit process, nothing more. 

They are genuinely deluded about their special powers and say things like ‘any Head worth their salt can just tell’ or ‘I’m sorry, but some lessons just are better than others’ – as if that somehow backs up their ability to grade reliably. This is a tough nut to crack because you’re not dealing with a rational analysis.  Perhaps chip away by emailing the Rob Coe article to all staff and governors and by requesting a show-down debate so it can be thrashed out. 

They may suffer from Stockholm syndrome. They know they should stop grading but are scared of the change; worried about stepping into the unknown.  Send them blogs by all the various Heads who don’t grade lessons. It’s fine! It’s better! It works! 

They are control-freaks.  They know grading is edu-voodoo but want a neat way to hold teachers to account even if it’s all nonsense. Chasing ‘Outstanding’ keeps people on their toes – that kind of thing.  Again, a tough one because of the cynicism. Perhaps it’s worth appealing to their ego – do we want to be a school that is this far behind the times? This out of touch? 

Perhaps they are deeply conservative and perceive ending grading as a radical, maverick move despite the evidence. They may be scared, risk-averse and lack professional courage.  Maybe they have been defending grading for so long that they feel they can’t back down.  I would write a formal proposal, citing the evidence from multiple sources, and request that this is debated at a full staff meeting and governors’ meeting. Perhaps, through collective courage, the Head could find their way to take the right path. 

None of the reasons for retaining grades are built on sound educational principles. None. There are no good reasons. If you are a grading Head, you are either deluded (which sounds rude but is meant in a literal sense), cynical, out of touch, autocratic, unjustifiably scared or dogmatic to an extreme.  Take your pick. It pains me to think of all the teachers whose annual review process hangs on getting ‘at least Good in two or more observations’ and other such nonsense. Never mind all of their other lessons – or the absence of meaningful assessment of long-term learning within an observation.

Come on people, let’s end this nonsense.  It demeans the whole profession that we allow a practice that has been so soundly debunked to persist.  Wake up! Wise up! Release your staff from the edu-voodoo.

32 comments

    • Thanks. I think links to grading student work are misplaced. Student work can be seen and lined up against some criteria; standards can be moderated quite tightly. That doesn’t apply to lesson grading at all. Really, it’s entirely different.

      Liked by 1 person

  1. I make no excuses for the pursuit of consistently Good teaching as the goal for all teachers and the right for all students . We do not grade teaching and learning ‘for Ofsted ‘nor is it an SLT pursuit’, our staff at all levels are involved in the continuous dialogue about what Good learning looks like ,how it is evidenced and the impact of learning ( of which lesson observations /learning walks /work scrutiny /student and parent feedback as well as the progress data for the students) all form a part .
    Our expectations for Good teaching and Learning are ‘in house defined ‘by a range of staff and I see no harm in regularly celebrating both individuals and teams who meet expectations . Paired observations and learning walks are part of everyday life and feedback is a two way process which is appreciated by staff. Mentoring and support is also collegiate and focussed . We have an open door policy and Good teaching and learning a shared goal . I look forward to reading your ideas each week-which are usually so positive and inspirational, so found this unusually defensive and patronising . I think the issue is how grading is done not whether you do it .

    Like

    • The problem is that you think you can evaluate Good teaching consistently. You’ll think your staff are being consistent when saying lesson A is slightly better than lesson B but, in truth, they’ll be wrong quite a lot of the time. You are perpetuating a practice that is like homeopathy; lots of people use it, it might seem to be ‘doing the trick’ but it has no basis in science. Honestly, your school would be just as good, and probably better, if you give the feedback without the grades. Why not give it a go? I’m not being defensive; I’m on the offensive with this. Grading lessons needs to stop.

      Liked by 1 person

      • I’m agreeing that ‘a lesson ‘alone is not what were grading but disagreeing that what Good learning looks like shouldn’t be discussed and observed. Does it matter where it looks different in different year groups /different subjects -it’s the discussion about the common denominators that is interesting and developmental . Are there no teachers that find that feedback and discussion useful ?

        Like

      • We can all discuss effective teaching. Of course. I’m now confused: do you grade lessons? Do you have a theshold for saying any particular lesson is Good/RI? If not, no problem. We all discuss effective teaching – all the more in the absence of grades.

        Like

  2. My school is continuing with grading on the basis of a possible Ofsted inspection. I have tried to counter the arguments with the fact that teaching staff only become concerned with a number and not the areas to improve practice. This seems madness to me, as we are trying to enable teachers to reflect on what tweaks they need to make to improve.

    Like

  3. Have seen many outstanding teachers who perform outstanding lessons (everything we want to see), yet perform poorly in terms of examination results.

    Liked by 1 person

  4. I have been pushing this idea at my school for some time now, and people are keen to explore it further. To me, it makes a lot sense, and we have made some tentative steps. However, the stumbling block we come up against is the evidence that is required to ‘pass’ appraisal. If I can counter this argument I think we will be in business. I have argued that it should be a triangulation of data, lesson observation and student feedback to provide an overall picture as this can be collated over time, rather than as a snapshot of two or three standalone lessons. I wonder what other leaders have used to explain this element of the process and discussion?

    Like

  5. I was thrilled when grading was removed!! I really used to hate how judgements were made about the quality of my teaching based on a 30-60min snapshot that was supposed to tick a huge variety of boxes! But I have a question… Don’t Ofsted still make a judgment about the quality of teaching and learning and decide whether it is ‘outstanding’, ‘good’ etc… And as part of that decision they observe lessons… So surely that means they are judging lessons even if they don’t put a number to their judgment…??

    Like

    • The criteria refer to an overview of all the teaching they see and to the link to outcomes. I’m dubious about this too but it’s not an average of secret lesson grades or anything like that.

      Like

  6. My furst decision – when taking on the role of leading T&L in the school was to speak to our new Head and argue the case against grading lessons. That was 2 years ago and it has been a joy to share and hear the conversations people now have after observed lessons compared to previously.

    One area I disagree with you though, Tom, is using OFSTEDs decision to stop grading as (at least part) of a a reason for an individual school to stop grading. A very wise man once said “imagine what you’d do if OFSTED didn’t exist. Well do that anyway!” – we shouldn’t stop grading lessons because Ofsted stop – we should consider the arguments irrespective of Ofsted and make our decision based on those alone!

    Like

  7. […] It is hard to believe that there are schools in which the practice of lesson grading is still deployed; worse, it is linked to performance management. I made the decision to abandon lesson grading two years ago when the arguments were being forcefully presented through social media. The reasons why I did are eloquently and succinctly explained in Tom Sherrington’s post in which he exclaims that “The delusional voodoo of grading lessons has got to stop.” […]

    Like

  8. […] If you are grading lessons, you don’t know what you’re doing. We only come to this towards the end; it seemed to provoke some quite defensive responses from people who are now grading. It seems that some people working in academy chains are required to report on the quality of teaching to their overlords using lesson grades; that’s their excuse.  It’s a control device; nothing more.  In my view, grading lessons demeans our profession – because it is based on such a misguided idea of what can be observed in a one-off lesson with any accuracy. Graders are deluded.  It’s a battle that needs to be won if we are going to move forward as a profession. (See Delusional Voodoo.) […]

    Like

  9. In my school, SLT and DoTL do the learning walks. Not numbers are used to grade lessons but colours (red, orange and green) and these ‘quite often’ learning walks are based on the new Ofsted criteria. 😦

    Liked by 1 person

Leave a comment