Evaluation Methodology and Tool Development Consultancy (Part-time)

The Prevent Epidemics (PE) team at RTSL partners with governments to strengthen key aspects of their health security systems with the aim to make the world safer from epidemics.

Location: Global - Remote

Job Structure: Independent Contractor 

 

1. Background

Resolve to Save Lives (RTSL) has been implementing the Collaborative Surveillance program through the Epidemic Intelligence Team in Zambia, Ethiopia, Mozambique, and Nigeria since late 2023. This program works in partnership with national governments to strengthen how surveillance data is generated, shared, and used to support timely public health action. This includes supporting improvements in systems, workforce, governance, and coordination, with the goal of enabling public health actors to better detect risks, assess events, and respond effectively.  

As implementation has progressed, there is a need to understand how these efforts are contributing to stronger surveillance and epidemic intelligence functions. This includes assessing whether improvements in systems, processes, and collaboration are helping actors access and use information more effectively, and identifying areas where additional strengthening may be needed.   

RTSL is piloting an impact evaluation to develop and test a structured methodology for assessing program contributions across select pilot countries. This evaluation will use mixed methods to collect data from key stakeholders and program participants and will generate insights to inform ongoing implementation, strengthen accountability, and support broader learning. The purpose of this consultancy is to refine and operationalize the evaluation methodology and develop standardized data collection tools, protocols, and implementation guidance to support consistent and high-quality data collection across countries. 

2. Purpose

To support the impact evaluation pilot by refining the data collection methodology and developing evaluation tools, protocols, and implementation guidance required to conduct high-quality, mixed-methods data collection across multiple country contexts. 

The consultant will work closely with RTSL technical staff to: 

• Refine and operationalize the evaluation methodology and measurement approach 

• Develop quantitative and qualitative data collection instruments 

• Develop protocols and guidance to ensure consistent and high-quality data collection 

• Prepare training and implementation materials to support in-country data collectors.  

This consultancy will focus on methodology and tool development, enabling in-country consultants and teams to conduct standardized data collection.  

3. Scope of work

The consultant will refine and operationalize the evaluation methodology and develop the tools and protocols required for implementation. This includes the following components: 

3.1 Refine evaluation methodology and measurement approach 

The consultant will review existing program documentation, impact framework, and draft indicators, and work with RTSL to refine a clear, practical, and implementable evaluation methodology. This will include: 

• Refining the overall evaluation design and methodological approach 

• Operationalizing the measurement framework and draft indicators into measurable constructs and indicators 

• Ensuring methodological rigor and alignment with best practices in mixed-methods evaluation. 

• Ensuring feasibility of implementation across diverse country contexts 

3.2 Develop quantitative and qualitative evaluation tools 

The consultant will operationalize the measurement framework by developing survey instruments and qualitative interview guides. This includes: 

• Developing and refining a survey instrument against evaluation objectives and indicators 

• Developing and refining semi-structured interview guides for key informants, considering multiple categories of informants (i.e., national, sub-national, validators) 

• Ensuring evaluation instruments are theoretically grounded and validated to ensure data reliability. 

• Ensuring alignment between evaluation questions, indicators, and data collection tools.  

• Ensuring tools are clear, culturally adaptable, and feasible for use across country contexts. 

3.3 Develop data collection protocols and data quality assurance guidance 

The consultant will develop guidance to support consistent and high-quality implementation of data collection and analysis. This will include: 

• Developing clear data collection protocols for both quantitative (survey) and qualitative (interview) data collection 

• Developing data quality assurance procedures, including guidance on completeness, consistency, and documentation 

• Developing guidance for managing and organizing qualitative data 

• Developing a first draft codebook for qualitative data analysis, based on the impact framework and refined evaluation methodology 

3.4 Develop training materials  

The consultant will develop practical materials to support training and implementation by in-country data collectors. This includes: 

• Training materials for data collectors, including slide decks and facilitator notes 

• An implementation guidance note outlining step-by-step procedures for conducting data collection 

Materials should be designed for use by consultants and program teams with varying levels of prior evaluation experience.  

Contract Deliverables 

The consultant will produce the following deliverables: 

• Deliverable 1: Refined evaluation methodology and measurement approach  

• Deliverable 2: Data collection tools, fully developed and ready for deployment 

          (a) Survey instrument

          (b) Semi-structured interview guide 

• Deliverable 3: Data collection and quality assurance guidance, including data collection protocols, data quality assurance guidance, and qualitative codebook 

• Deliverable 4: Training materials and implementation guidance 

Duration and level of effort 

Estimated level of effort: Approximately 5 weeks part time (Mar-Apr) with an effort equivalent to 15 full working days. 

Anticipated distribution of effort: 

• Week 1-2: Deliverable 1 

• Week 3: Deliverable 2 

• Week 4: Deliverable 3 

• Week 5: Deliverable 4 

Timeline may be adjusted in coordination with RTSL based on consultant availability and project needs.  

Payment schedule 

Payments will be made upon completion and sign-off of deliverables as follows:  

• 40% upon completion of finalized evaluation methodology and data collection tools (Deliverables 1 and 2) 

• 30% upon completion of data collection and quality assurance guidance, and qualitative codebook (Deliverable 3) 

• 30% upon completion of data collector training materials and implementation guidance note. (Deliverable 4) 

Required expertise 

• Strong background in social science research and mixed methods evaluation   

• Demonstrated experience developing evaluation methodologies and measurement frameworks 

• Demonstrated experience designing surveys and qualitative data collection tools  

• Experience conducting qualitative analysis (NVivo preferred) 

• Demonstrated experience producing high quality evaluation reports 

• Ability to translate technical findings into practical program recommendations 

• Experience working in international development or public health preferred 

• Experience working across multiple country contexts preferred 

 

Application Process 

Interested candidates should submit their CV and a cover letter detailing their suitability for the role.