This month Collaboration for Impact hosted Mark Cabaj – international thought and practice leader on evaluating change in complex settings, social innovation and systems change. Mark is the President of From Here to There Consulting and previous Vice President of Tamarack Institute.
Together, Collaboration for Impact and Mark delivered 3 Master Classes around the country – Sydney, Adelaide and Melbourne. This post shares the slides and resources from the Master Classes.
Part 1 – getting grounded
The Mater Classes kicked off with some framing on complexity, the six conversations of the Master Class and getting to know each other. The slides for Part 1 are:
Part 2 – complex issues and adaptive responses
The second part reviewed the different types of social challenges we face – simple, complicated, complex and chaotic. The leadership needed to make progress in complex challenges is known as adaptive leadership. The leadership approach was overviewed at a high level and married with the type of practice or design needed (participatory, experimental and systems thinking). The tensions inherent in adaptive responses to complex problems were explored as well as the high stakes of getting it right. The slides and resources for Part 2 are:
- 2. Sydney Master Class_Evaluating Community Change_Conversation 2_Complex Issues & Adaptive Responses
- 2A. http://www.ted.com/talks/eric_berlow_how_complexity_leads_to_simplicity
- 2B. AgreementCertaintyMatrix
Part 3 – Going deeper on evaluation issues
This third and final part of the Master Class looked at the evaluation through the lens of social innovation. The evaluation approach required for the early phases of social innovation is developmental evaluation. Time was spent unpacking and understanding the difference between traditional evaluation and developmental evaluation.
Five challenges facing evaluation of complex community change were shared and explored. They were:
- Conceptualising the intervention
- Measuring systems change
- Unanticipated outcomes
- Attribution of outcomes to interventions
- The role evaluator.
The slides, resources and tools for this Part are:
- 3. Sydney Master Class_Evaluating Community Change_Conversation 3_Going Deeper on Evaluation Issues
- 3. Melbourne Master Class _Evaluation Master Class
- 3A. Patton 2006 Evaluation for the Way We Work (2)
- 3B. DE 201 EN
- 3C. developmental_evaluation_primer
- DE Readiness: http://aea365.org/blog/developmental-eval-week-kate-mckegg-on-readiness-for-developmental-evaluation/
Measuring systems change
- 3D. What We Know So Far_Evaluating Systems Change_Version 1.0_August 30 2016
- 3E. Contribution Analysis
- 3F. ExpandingtheEvidenceUniverseDec2011
- 3G. Innovativereformsaug2009
- Checklist: http://weblog.tetradian.com/2012/07/23/checklists-and-complexity/
- Adversary Evaluation (aka Jury Evaluation) http://www.ascd.org/ASCD/pdf/journals/ed_lead/el_198004_worthen.pdf
Conceptualizing the intervention
The role of the evaluator
- 3G. Designing Evaluations That Are Used_Five Aides for Action_Version 1.0_August 30, 2016
- 3H. Aide Action_Handout_V2_20160830
Collaboration consultation process
Participant contact details (NB: shared with consent)
We very much hope the Master Class met your learning needs. Certainly the evaluations we have received so far rate the learning experience on average between 8.75 – 9.75 out of 10. The suggested improvements relate to:
- having more time
- having resources available during the Class.
The evaluation feedback also indicated that there is demand for learning about Adaptive Leadership for Collective Impact and complex community change.
Collaboration for Impact are about to offer a day-long Workshop on this. If you have an interest in pre-registering or booking an workshop in your area, please reach out to Kyrstie Dunn on firstname.lastname@example.org.