Community of Practice Events

Virtual Meeting 

Evaluating Coalitions and Networks

Speaker:

Jared Raynor, TCC Group

March 25, 2011

Presented in collaboration with the InterAction Evaluation and Program Effectiveness Working Group

Collaboration is often key to advocacy success, and coalitions are one of the most common forms of collaboration. Understand coalitions and networks from an evaluative perspective, and learn about how to assess coalition member capacity, coalition capacity, and coalition achievements.

Resources

Jared Raynor's PowerPoint presentation on Evaluating Coalitions and Networks.

What Makes an Effective Coalition? by Jared Raynor, Senior Consultant of TCC Group. 

Assessing Strategic Partnership: The Partnership Assessment Tool (2003) from the UK-based Strategic Partnership Taskforce in the Office of the Deputy Prime Minister in coordination with Nuffield Institute at the University of Leeds. 

Levels of Collaboration Scale from Frey, B.B., Lohmeier, J.H., Lee, S.W, & Tollefson, N. (2006). Measuring collaboration among grant partners. American Journal of Evaluation, 27(3), 383-392.) 

Church M. et. al. (2002). Participation, relationships and dynamic change: New thinking on evaluating the work of international networks. Development Planning Unit, University College London.
 

 


 

Changing the World through Local to Global Advocacy: Scaling and Assessing Impact from the Campaign to End Pediatric Aids 

The Aspen Institute, One Dupont Circle, Suite 700, Washington, DC

Speakers:

Paul ZeitzGlobal Aids Alliance

Sanjeev KhagramUniversity of Washington and iScale

January 14, 2011

The Campaign to End Pediatric HIV/AIDS (CEPA) is a CIFF-funded initiative managed by the Global AIDS Alliance (GAA). Launched in May 2009, CEPA seeks to achieve 80% coverage for comprehensive prevention of mother-to-child transmission and pediatric treatment services, with an initial focus on six sub-Saharan African countries: Kenya, Mozambique, Nigeria, Tanzania, Uganda, and Zambia.  Specifically, the campaign is working to overcome key policy and implementation bottlenecks, and to hold government and multilateral stakeholders accountable for their commitments. 

GAA coordinates local-to-global advocacy campaigns. CEPA also works on maternal and children health, sexual and reproductive health and rights, and universal basic education.

In collaboration with GAA, CIFF, and other partners, iScale has developed an innovative monitoring and evaluation system for CEPA. 

Resources

Download the presentation and handout.

Read a Q&A with Paul Zeitz about the CEPA evaluation in an article by the Center for Evaluation Innovation.

Also read a blog post about iScale's evaluation approach from the Harvard University’s Hauser Center for Nonprofit Organizations.


ADVOCACY EVALUATION BREAKFAST

How Does Evidence Influence Policy Change? Two Complementary Approaches

The Aspen Institute, One Dupont Circle, Suite 700, Washington, DC

Speakers:

Carlisle Levine, CARE

Veena Pankaj, Innovation Network

Lisa Molinaro, Continuous Progress Strategic Services

December 10, 2010

If alleviating global poverty depends on successful pro-poor policies, then CARE, like other international humanitarian organizations, can promote these policies by presenting evidence based on decades of working in more than 60 countries. With Gates Foundation support, CARE is testing this hypothesis via two initiatives. CARE's LIFT UP grant aims to build organizational capacity to more systematically use country-level evidence to influence U.S. policymakers. CARE’s Learning Tours grant provides Members of Congress and influential media and “grasstops” leaders with firsthand experiences aimed at increasing their support for improving maternal health and child nutrition globally.

Working with external evaluators Innovation Network and Continuous Progress Strategic Services (CPSS), CARE is assessing the effectiveness of these approaches. Speakers will discuss how to measure the effect of country-based evidence on policy change and highlight how CARE’s overlapping evaluations, inform each other’s work, and increase CARE's ability to influence policy change.

Resource

Get the brief Champions and "Champion-ness": Measuring Efforts to Create Champions for Policy Change by David Devlin-Foltz and Lisa Molinaro on their tool for tracking progress in engaging champions.


Virtual Meeting 

Advocacy Evaluation Case Study: Evaluating Oxfam’s Climate Change Campaign

Speakers:

Simon Starling & Claire Hutchings, Oxfam Great Britain

Dr. Brian Cugelman & Eva Otero, External Evaluators for Oxfam GB

Gabrielle Watson, Oxfam America

September 24, 2010

Presented in collaboration with the InterAction Evaluation and Program Effectiveness Working Group

Oxfam Great Britain, one of 14 organizations in the Oxfam International confederation, works together with partners and allies around the world to find lasting solutions to poverty and injustice through development, humanitarian and campaign programmes in more than 63 countries. Over the past few years, Oxfam GB has been working to improve how it monitors, evaluates and learns from its programmes, including its campaign and advocacy work.  As part of this process, they piloted a number of different approaches to M&E in the Climate Change Campaign - a large, high profile, complex campaign, working with national, regional and international partners to influence policy and public opinion in the UK, and more than 10 priority countries in the global south, in support of a fair, safe and binding global climate change deal. 
  
Drawing on the literature and lessons around developmental evaluation as well as their own experience, Oxfam GB focused on developing light monitoring systems able to support real time, strategic learning and inform decision-making processes during the campaign.

At the same time, this capacity was complemented by an independent evaluation, commissioned to provide a rigorous and credible assessment of their climate change campaign. The evaluation was carried out by evaluators with Leitmotiv and AlterSpark, who worked with Oxfam GB to design an evaluation project capable of overcoming a number of practical challenges, and to consolidate evidence across numerous sources, including interviews, publications, surveys, web data, independent studies, and the researchers' own investigations. 

Resources

Get Dr. Brian Cugelman and Eva Otero's External Evaluation Executive Summary and Full Report.

Get Simon Starling and Deborah Eade's article Monitoring and Evaluating Advocacy: Lessons from Oxfam GB's Climate Change Campaign that appeared in the journal Development in Practice.

Join the Basic Efficiency Resource (BER) Analysis Facebook group to learn more about this method that was developed by Dr. Brian Cugelman and Eva Otero for Oxfam GB's global climate change campaign evaluation.