Revolution School

Revolution School was a 4 part TV series on the Australian public school Kambrya College using Prof John Hattie as the 'teaching' expert.

Looking at the historical academic data (see below), the school improved around 2008-2013 then plateaued and then decreased a little in 2015 (the year Hattie was there).

The show displayed the passion, enthusiasm, care and patience of the teachers at Kambrya. Also, the hard work that was needed to cater for the many difficult and disruptive students was apparent. The staff also displayed a desire to improve their teaching, a key mindset, according to a different expert, Prof Dylan William.

Ironically, the qualities like passion are the invisible influences that Hattie argues AGAINST in his book Visible Learning. But, in the 2012 update to VL he states,

"Throughout Visible Learning, I constantly came across the importance of ‘passion’; as a measurement person, it bothered me that it was a difficult notion to measure – particularly when it was often so obvious" (preface).

I am concerned that Hattie seems to be given the credit for the improvement, yet the year he was there, 2015, the Year 12 and NAPLAN results decreased!

However, I am more concerned over Hattie's financial conflict of interest in promoting his own software as a solution to the 'so-called' problems he identifies with public education. Professor John O'Neill wrote a timely warning in 2012, about Hattie's strategy,

The "discourse seeks to portray the public sector as ‘ineffective, unresponsive, sloppy, risk-averse and innovation-resistant’ yet at the same time it promotes celebration of public sector 'heroes' of reform and new kinds of public sector 'excellence'. Relatedly, Mintrom (2000) has written persuasively in the American context, of the way in which ‘policy entrepreneurs’ position themselves politically to champion, shape and benefit from school reform discourses" (p2).

This particularly applies to Revolution School - click here for a short clip of Hattie.

Professor Ewald Terhardt (2011) also mentions Hattie's conflict of interest,

"A part of the criticism on Hattie condemns his close links to the New Zealand Government and is suspicious of his own economic interests in the spread of his assessment and training programme (asTTle)" (434).

Was there a revolution?


The Maths curriculum for all Victorian schools including Kambrya has detailed the following criteria for ALL students to achieve by the end of Year 10:

"Evaluate statistical reports in the media and other places by linking claims to displays, statistics and representative data." Mathematics Statistics and Probability Levels 7-10A.

We expect our students to evaluate claims but we rarely do this ourselves, particularly with regard to educational statistics and in particular to Hattie's claims.

The program displays this graphic indicating phenomenal improvement in Year 12 achievement, click here for short video clip from TV show.




Yet, when I checked the actual scores, I got these results below.



These results show a reasonable improvement from 2008 to 2010, but they don't indicate the phenomenal improvement implied by the graph on TV. Also, it appeared that when Hattie consulted to the school in 2015, the results slightly decreased!

Perhaps the graph is showing the change in ranking and the School got into the top 25% of Schools. But, this is not correct either as the school ranking in 2015 was 273rd out of 528 schools. Berwick College (nearby) was ranked higher at 260th - check rankings here.

Similar spectacular English results were displayed:


But these cannot be Y12 results so they must be the Y7 and Y9 NAPLAN results. When I checked the NAPLAN results (see- https://www.myschool.edu.au) I found these (Y9 are the higher line):



These NAPLAN results do not show phenomenal improvement.

Comparison with other local schools:

A comparison with other schools nearby shows, when comparing Y12 results, other Schools are doing just as well if not better. Nossal High is nearby, but it is a select entry school - you can see the difference in scores! Box Hill is in a middle-class suburb and results are comparable to private schools.


2015
2014
2013
2012
% of 40+
Median
students
% of 40+
Median
students
% of 40+
Median
students
% of 40+
Median
students
suburb
Berwick Sec College
3.50%
29
370
5.40%
30
337
4.40%
30
330
5.20%
30
323
BERWICK
Kambrya College
2.30%
29
227
2.60%
30
200
2.10%
30
214
3.80%
29
165
BERWICK
Nossal High School
27.10%
36
428
24.70%
35
407
22.60%
35
411
29.90%
37
203
BERWICK
Box Hill High School
16.30%
33
343
15%
33
334
12.30%
33
318
12.20%
32
312
BOX HILL


NEWS: the 2016 results have just been released Kambrya - Median = 29 and '% of 40+' = 2.20%

Berwick SC - Median = 29 and '% of 40+' = 3.8%

The other spectacular results are the parent, student and staff surveyed perceptions of the school. I have not got access to all that data. Small segments of the surveys are available in the School's annual reports. These brief snapshots of the surveys do show improvement in the student, parent and staff attitudes. Whilst these are not the phenomenal improvements implied by the graphs, they are still worthwhile.

So what caused these improvements? Was it the leadership? Was it the passion and other qualities fostered and demonstrated by the teachers? Was it the strategies they employed? Was it due to Hattie's involvement? Or was it something else?

Hattie was very prominent on the show. He expressed some controversial views like 'public schools perform as well as private schools' and 'your postcode does not determine your VCE score'. But, the only strategy I could identify that he was directly involved with was the recording of teacher directed instruction and determining the % of the time the teacher spoke versus students. It seemed Hattie was coaching staff to get down to 50%.

Given Hattie's position of pushing for influences with high effect sizes (d), values of d > 0.40 and his associated mantra of 'know thy impact', it seemed contradictory to me that the other strategies used by the school were strategies which Hattie ranks very lowly. Hattie has regularly described influences where d < 0.40 as 'going backwards', 'distractions' or 'disasters'!

Strategies Kambrya used and their effect size (d):

Principals / school leaders: d = 0.36

Maths teacher told to make videos: audio/video, d = 0.22

Daraby (difficult) boys class reduced to 18 kids: class-size, d = 0.21 Hattie has called a focus on a class-size a disaster!

Daraby boys taken on outdoor-ed camp: co/team teaching d = 0.19, out of school d = 0.09, extra-curricula d = 0.17

Gender seperation: Daraby boys and girls: gender d = 0.12

Psychologist brought in to teach well-being, respect: Values/moral d = 0.24 (Prof. Lea Waters)

Full-time welfare worker: Welfare d = -0.12 (NEGATIVE!!!!)

Use of restorative practice: Decreasing disruptive behaviour d = 0.34

Classroom management (Dr Rogers): Decreasing disruptive behaviour d = 0.34, but, Classroom behavioral d = 0.80

Reading programs: d = 0.36 (literacy consultant Di Snowball)

Debutante ball: out of school d= 0.09, extra-curricula d = 0.17

Home visitation: d = 0.29

Mentoring: d = 0.15


From Hattie's 2008 Nuthall lecture:


The School's choice to use these strategies (classified as poor by Hattie) questions Hattie's interpretation of the research. Also, Dan Haesler in his excellent commentary about the program mentions Hattie's input would cost the school about $60,000.

In Hattie's recent collaboration with 16+ experts; the head scholar, Professor Peter Blatchford, concludes by asking for a new direction of research - the aim is move beyond the rather tired debates about whether these individual influences affects pupil performance and instead move things on by developing an understanding of the complex nature of classrooms and teaching with important practical benefits for education worldwide (p102).

Whilst it may be simpler and easier to see teaching as a set of discreet influences, the evidence shows that these influences interact in ways in which no-one, as yet, can quantify. It is the combining of influences in a complex way that defines the 'art' of teaching. 

Math's Teaching Revolution:

I have been following Professor Jo Boaler who is developing many strategies and resources to help improve math's teaching. Most of her strategies, e.g. problem-based learning, Computer-assisted instruction, Creativity, Simulations, Inductive teaching, Inquiry-based teaching,Visual/audio-visual methods, Web-based learning, Within-class grouping, Student control over learning, kinesthetic awareness and Teacher subject matter knowledge, are strategies which fall below Hattie's "worthwhile" point of d = 0.40. Click here for an example of her use of visualisation and kinesthetic awareness in Math's teaching.

Other, initiatives similar to Professor Boaler, which contradict Hattie's interpretations are the Maths 300 projectThe Maths Task Centre, and Prof James Tanton.

Also, helpful are Prof Dylan William's work on formative assessment and the U.S. National Center for Education Research's Teacher Practice Guide which is based on higher quality studies than Hattie's work. Both are free and easy to apply - see Other Researchers.

We also need to spend more time promoting and congratulating good teaching, like Maths Guru, Prof Steven Strogatz tweet about an Australian maths teacher.

Private versus Public Schools


Throughout the program Hattie constantly proclaimed that there is no difference between private and public schools here in Victoria. The actual Year 12 results of schools show a completely different picture. Only five public schools make the top 50, but four of those are select entry via standardised tests, which demonstrates how powerful prior knowledge, home environment, socio-economic status, and even ability grouping at a school level are.

Also, Hattie contradicts his colleague at Melbourne University, Professor Richard Teese, who in his book 'Undemocratic Schooling' presents compelling data showing private schools outperform public schools consistently in Year 12 scores. Teese also identified that schools need to offer students a broader range of pathways (e.g., vocational and apprenticeship) rather than just an academic pathway.

This snippet, from the Kambrya website, shows the improvement of the school from 2007. But, it also shows the difference compared to the top schools, which are all private apart from Mac.Robertson which is a select entry school.

The difference in achievement is significant. Perhaps Hattie means there is no difference in teacher quality? If that is the case then, what is causing the difference between the schools? It appears to be other factors besides the teacher, perhaps, home background, socio-economic status, parent involvement, culture of the school, selective entry, homework, ability grouping, ???

Whatever it is, this totally contradicts the main contention of Hattie's book, that it is the teacher that most influences student learning.


Victorian School Rankings


Scores are out of 50, so the "Scores of 40+ (%)" indicate the percentage of students in that school, who get 40 or above out of 50. In other words the A+ students. This to me indicates the academic culture of the school. 

These rankings indicate that the kinds of schools that are revolutionary (if focusing on academic success) are the government high schools such as Box Hill High School who get comparable scores with private schools but are able to do it with $7,000 - $30,000 less funding per student/year compared to private schools.

However, as Hattie points out schools are not just about academic results. "Of course, there  are many outcomes of schooling, such as attitudes, physical outcomes, belongingness, respect, citizenship, and the love of learning. This book focuses on student achievement, and that is a limitation of this review" (p6).

Ken Robinson, in the most viewed TED talk, 'Do Schools kill creativity?' answers YES. He asks for another type of revolution, one that values and fosters the individual talents of the student, whether they be academic, athletic, creative or otherwise.

Many schools are trying to provide for a broad range of student outcomes. I am proud to belong to one such school who provides pathways for academic, artistic, vocational, apprenticeship and sport. At the time of writing (June 2016) one of our students, Ben Simmonds has been picked Number 1 in the NBA draft. That was his intended outcome all along, yet his success and others like it are lost in the myopic scrutiny of academic results which people like Hattie tell us to focus on.

Kambrya has these sorts of broad programs too, but that was lost in the documentary.

Other news about Kambrya.