Our team was engaged to develop the Impact Framework and advise on the Impact Measurement Plan for the Field Epidemiology in Action (FEiA) program, delivered in Papua New Guinea (PNG) under the auspice of University of Newcastle.                             

The Challenge:  

This project was deemed important to uphold the program’s commitment to continuous evidence-based quality improvement and ensure alignment between the program’s activities and the longer-term impact of rapid and effective response to health threats.  

The challenge was threefold.  

  • There was a lack of clarity about the program’s outputs, outcomes and long-term impacts and how they were experienced by a number of stakeholder groups including: PNG communities, PNG health system, program staff and participants.  
     
  • The Field Epidemiology in Action Global Program did not have an outcome measurement framework to establish a benchmark approach for the national programs.  
     
  • The program had an inadequate survey instrument for collecting meaningful data at program’s key milestones to observe change over time. The lengthy survey they were using resulted in low engagement and inability to collect feedbacks at different points in time.  

 To address these concerns and deliver a sustainable solution, ImpactInstitute sought to establish what outcomes and impact are experienced by who and what needs to be measured, at what point in time.  

The Solution:  

ImpactInstitute consulted with key stakeholders from the FEiA program to design and develop an evidenced-backed and sustainable impact measurement solution.  

  • We developed an Impact Framework fully referenced to the academic literature that has been validated by the Epidemiology Scientific Community. 

  • We advised on a fit-for-purpose Impact Measurement Plan to allow meaningful data collection. 

  • We presented our work to the 11th TEPHINET Global Scientific Conference (Training Programs in Epidemiology and Public Health Interventions Network) and it was widely accepted among conference delegates. 

  • We are co-authoring a peer-reviewed article with University of Newcastle intending that it be published in an academic journal. 

 

 

The Impact Index

Outcome:  

The work ImpactInstitute completed with the University of Newcastle has led to several positive outcomes, both for the FEiA program and the university more broadly.   

  • The revised Impact Measurement Plan will also enable collection of data about the program’s long-term impact on participants through surveying and observing young epidemiologists in PNG, tracking their progress from student to graduate, fellows, teachers and then leaders.  

  • The Impact Measurement Plan is linked to existing public health data that can inform how the program is contributing to the health of communities in PNG. 

  • The University of Newcastle is collaborating with other national FEiA programs to make the Impact Framework available for their use and establish a global approach to impact measurement for the FEiA program. 

  • The University of Newcastle is now reviewing their survey instruments to align them with the indicators identified during the development of the Impact Framework and Impact Measurement Plan.  

  • Overall, there is greater clarity on what is the right data to gather and when and utilise it as validation of the program based on the existing evidence. 

Services

  • Impact Advisory (Impact Framework, Research & Stakeholder Engagement)