Monitoring and Evaluation

“HIFA2015 achieves an extraordinary level of activity on minimal resources from which many people around the world benefit… its ultimate success will depend on external funders providing additional funding…
HIFA2015 External Evaluation Report, October 2011, funded by Rockefeller Foundation

From January 2011 until August 2011, HIFA2015 was evaluated by a team of two professional evaluators, Teresa Hanley and Jackie Davies, with funding from the Rockefeller Foundation.

Methodology

The evaluation used a Visual Outcomes mapping approach developed by Paul Duignan (New Zealand) and summarised here.

The detailed Evaluation Plan is available here.

The evaluation was conducted as a portfolio of evaluation projects, which include:
• Monitoring information from the HIFA forums and knowledge base
• Surveys of HIFA 2015 members
• Study of supporting organisations
• Stakeholder key informant interviews
• Monitoring of trends in the healthcare literature
• Identification of success stories
• Identification of lessons learned
• Identification of barriers and opportunities

Purpose

The evaluation is expected to serve a number of functions:
1. Help directly to inform the future development of HIFA2015
2. Help directly and/or indirectly to inform the future development of the growing number of HIFA2015 sister forums such as CHILD2015, HIFA-Portuguese, and HIFA-EVIPNet-French (see HIFA Global Networks)
3. Provide evidence of what is working well, which may in turn:
(a) help to secure much-needed sustainable operational financial support for HIFA2015 and other HIFA Global Networks;
(b) help to inform the wider Communications for Development on ways to mobilise interdisciplinary communication, understanding and advocacy to address other global health and development challenges.

Support

The work was assisted by a voluntary M&E Advisory Committee including Dr Peter Tugwell (University of Ottowa), Dr Jordi Pardo (University of Ottowa), Dr Veronique Thouvenot (Millennia2015) and Dr Paul Duignan (Independent).

We are especially grateful to the Rockefeller Foundation for their financial and technical support.

A project such as HIFA2015 requires continual monitoring and evaluation throughout. We are currently seeking support to continue the M&E of HIFA2015 through to 2015.

For further information, please contact the HIFA2015 Coordinator.

Report

The HIFA2015 External Evaluation Report was published in October 2011.

HIFA2015 Evaluation Report (PDF, 50 pages, 1.3Mb)

HIFA2015 Evaluation Report – Executive Summary (PDF, 5 pages, 580kb)

HIFA2015 Evaluation Annex – Case Studies, Methodology, Glossary of Terms (PDF, 58 pages, 640kb)

HIFA2015 Evaluation Report – Response from Global Healthcare Information Network and HIFA2015 Steering Group (PDF, 3 pages, 70kb)

Future

HIFA2015 is now implementing the recommendations of the Evaluation, but continues to be constrained by lack of human resources (HIFA2015 has less than one full-time staff person) associated with lack of funding. This constrains our ability to implement some of the recommendations, it constrains our ability to continue to roll out the HIFA2015 strategy, and it constrains our capacity for continuing monitoring and evaluation.

‘Interorganizational networks have emerged at the global level, as well as at national and subnational levels, as important strategies for organizing human effort in a systems-thinking mode of operation… Yet, funding for network activities such as HIFA remains elusive… Critical challenges exist in developing measurement tools and feedback mechanisms that not only provide opportunities for learning, but that also build accountability into the system.’
Willis CD et al. Strengthening health systems through networks: the need for measurement and feedback. Health Policy and Planning 2012;27:62-66