Endline Evaluation of ECHO Funded Project Consultant at the International Rescue Committee (IRC)
The International Rescue Committee (IRC) responds to the world’s worst humanitarian crises and helps people to survive and rebuild their lives. Founded in 1933 at the request of Albert Einstein, the IRC offers lifesaving care and life-changing assistance to people affected by war or disaster. At work today in over 40 countries and 22 U.S. cities, we restore safety, dignity and hope to millions who are uprooted and struggling to endure. The IRC leads the way from harm to home.
We are recruiting to fill the vacant position below:
Job Title: Endline Evaluation of ECHO Funded Project Consultant
Project specific objective
- To mitigate the harmful effects of violence and displacement on IDPs, host community members and returnees by responding to the urgent nutritional and WASH and shelter/NFI needs and ensuring a protective environment for adults and children.
Expected results and indicators
Result 1: Improved access to and quality of humanitarian protection services for targeted IDPs and host communities through strengthening of community based protection structures and the promotion of protection mainstreaming principles and tools:
- % of persons /target population in a given context reporting an improved feeling of safety and dignity by the end of the intervention compared to at the beginning
Result 2: Conflict-affected children (boys and girls), including UASCs are identified, safe, cared for, and have access to appropriate existing services and support:
- % of interviewed girls and boys who perceive SHLS as safe and supportive
- % of caregivers participating in parenting programs that report utilization of positive parenting skills to control violent behavior
Result 3: IDPs and returnees are protected from waterborne and hygiene-related diseases through the provision of potable water, sanitation facilities, increased hygiene awareness and waste management facilities in Borno and Adamawa states:
- % of the population considering that their basic WASH needs are met
- % of population with adequate hygiene practices ( according to SPHERE Standard on appropriate use and regular maintenance of facilities and on hand washing)
Result 5: The nutrition well-being of pregnant women, lactating mothers and children under five in IDP camps, host communities and areas of return in Adamawa and Borno states is improved with reduction of the morbidity and mortality associated with malnutrition:
- % of health facilities and mobile clinics without shortage of RUTF and systematic treatment (>24H)
- % of health facility and mobile clinics who meet the three Sphere standards indicators (cured rate, death rate and defaulter rate)
- % of MtMSG members who are able to correctly explain at least three optimal infant and young child feeding practices
Result 6: IDP households’ access to food and basic necessities is improved through increased purchasing power.
- % of the target population achieves borderline Food Consumption Score (FCS)
- The mean Household Dietary Diversity Score (HDDS) of target population has increased by the Target % over the project period
- The proportion of households in the highest Coping Strategy Index score category has been reduced by the target % (Reduced CSI)
Note: successful consultant (s) will be provided with full details of project background and indicators.
The Purpose of Endline Evaluation
- The purpose of this evaluation is to assess the IRC’s performance and delivery of the integrated ECHO funded project results. The endline evaluation report will help the IRC to improve its future projects through lessons learned and best practices generated from this project.
The Scope of the Evaluation
- The endline evaluation process will be structured around OECD DAC criteria, with suggested evaluation questions as below. However, the consultants shall be encouraged to review the project documents and modify evaluation questions to provide detailed synthesis of the project performance.
- Relevance: Does the project align with humanitarian priority concerns? Did the project interventions effectively reach the most vulnerable individuals? Did the project address priority needs of the affected population? Were targets in line with international standards?
- Effectiveness: Were monitoring mechanisms effective in providing timely data to inform programming decisions? To what extent did the project meet its targets and deliver outputs?
- Impact: To what extent did this project achieve the intended outcomes? What was the performance against stated indicators? Are there any unplanned outcomes as a result of this project?
- Efficiency: What evidence is available on cost effectiveness of the interventions? How do intervention costs compare with other modalities in similar context? What evidence is available that efficiencies were sought in programme design? Were adequate human and financial resources applied to delivering project outcomes? Were outputs delivered in a timely fashion? Was technology deployed to improve efficiency?
- Sustainability: To what extent did the project utilise established institutions/mechanisms to ensure sustainability at the end of the project? To what extent were relevant partnerships/capacity developed to ensure sustainability? Are there elements of exit strategy to ensure sustainability?
Main Evaluation Team Tasks
- Refine evaluation primary questions in consultation with the IRC’s M&E Country and regional advisor.
- Conduct secondary data collection and review including using the IRC’s existing project monitoring data, to identify gaps in data coverage and knowledge.
- Conduct primary data collection to establish and quantify the IRC’s performance against project indicators and criteria outlined.
- Provide a draft report to country management that will be incorporated into ongoing program planning and evaluation, as well as recommendations for maximizing social impact.
- While in country, facilitate a workshop to validate findings of the evaluation with IRC and partner staff and stakeholders.
- Incorporate IRC feedback into a draft report and prepare a final report. The final report should both describe the results of the evaluation, and provide actionable recommendations for improving the IRC’s program work in North East Nigeria.
- The IRC recommends the use of the mixed methods approach that can quantify results and achievements against targets and indicators. However the final methodology and tools will be agreed by the evaluation team working closely with the IRC country M&E team, and will be contingent on the above tasks.
Data collection and management:
- The IRC expects a balanced use of both quantitative and qualitative methods to better understand the program performance in addressing community needs. All quantitative data should be rigorously analysed and representative of the project areas within reasonable limits.
- Qualitative data should also be rigorously analysed and should focus on developing a deeper understanding about the relevance of the programme results and providing recommendations for improving and /or strengthening effectiveness, efficiency, and sustainability of the results. Both direct and indirect beneficiary perspectives should be considered, examining any positive or negative spill over effects.
- All documents related to this consultant shall remain the property of the IRC. The IRC would request the consultant to share all documentation, including datasets for this consultancy.
Presentation and Documentation:
This consultancy takes place at the end of the grant, starting no later than 5th January 2018 with the final approved report expected to be submitted within 40 days from the start of the assignment. The final evaluation report must be shared with IRC in the following formats:
- Workshop with IRC staff to present and validate findings:
- Agreed lessons learned and best practices that can be incorporated into relevant sector programming.
- Agreed recommendations that will inform and/or improve IRC Nigeria program strategy, with clear action points required.
- Draft Evaluation Report submitted to Deputy Director – Programs, and Country Director for feedback and comments, within two weeks after conclusion of field data collection.
Final Evaluation Report- The report must be clear and concise (max. 60 pages). and the following sections must be included as a minimum:
- Background information
- Executive Summary,
- Interpretation of findings and conclusions,
- Recommendations and actions points,
- Annexes: ToRs, a timeline of response, a list of individuals interviewed, statistical outputs, templates of data collection tools used, a description of the methods employed, a summary of survey results (if appropriate) and any other relevant materials.
- North East Nigeria still remains an emergency zone, and not all program locations may be accessible for field data collection. The consultant will be required to develop flexible workplans in consideration of the context changes on ground.
- At the time of development of this ToR, input from the donors was partially obtained, should there be additional requirements for modification of some sections of the ToR, the consultant shall be required to be considerate and accommodate discussions on minor or major changes to the ToR.
- The consultants are encouraged to include other limitations based on their interpretation of the assignment ToR for discussion with IRC management.
- PowerPoint presentation of preliminary findings & recommendations to the IRC senior management team.
- Draft report shared with IRC within two weeks after completion of field work.
- Detailed Final Evaluation Report to IRC management.
- Evaluation datasets shared with IRC management.
Profile of consultant(s)
This is an integrated project covering; health, WASH, nutrition, economic wellbeing and protection. To the greatest extent possible, the evaluation team should consist of diverse backgrounds and experience in multi-sectoral programs.
The IRC welcomes expressions of interest from seasoned consultants, individuals or firms in academia, social research, or humanitarian evaluation with a background in humanitarian aid, research methods, WASH, development economics, agricultural economics, development studies, or other related fields. The lead consultants should possess:
- Master’s Degree or higher in Development, International Relations or Humanitarian work.
- Extensive experience in conducting evaluations along OECD evaluation criteria, ideally leading an evaluation team and experience of designing evaluation methodology / tools and data analysis.
- A minimum of 10 years of progressively responsible work experience in research on nutrition, Environmental health, Economic Recovery Development and protection programs.
- Experience of working in humanitarian contexts and good understanding of humanitarian response work – both in programs and operations
- In-depth knowledge of quantitative and qualitative research methods
- Excellent analytical, presentation and writing skills in English
- The consultant will be based in Maiduguri State of Borno with trips to Adamawa and will spend most of the duration in the field.
- The consultant will be required to abide by the IRC security protocols and rules in place for IRC staff.
- While in the field, the consultant will be provided with security briefings from the field security focal person.
- The consultant will conduct his/her work using his/her own computer equipment. Terms of payment will be negotiated upon acceptance of the consultancy.
- On the basis of the above proposed activities, the total budget for the consultancy will include VAT as and if required.
- Final payment to the consultant will be dependent on the completion of all deliverables.
Proposal Details and Submission time frame:
- This consultancy is anticipated to start early January 2018. The entire exercise will last between 30-40 days including final report submission. The deadline for submission of the technical and financial proposals and accompanying documents is December 15th2017.
Applications should include:
- Technical proposal with clear understanding and interpretation of the ToR, including detailed tasks, recommended methodology summary and proposed schedule, your relevant experience, how you meet the profile required and details of time required (maximum 4 pages)
- Detailed, itemized financial cost, including daily professional fee and any other associated costs. All costs should be indicated in the submission bids. IRC will only cover field related costs to program areas during field work. All other costs need to be clearly stated in the bid submission.
- CVs of key personnel that will be involved in executing the evaluation process.
- Samples of past consultancies and /or reference persons on related consultancies.
- Modest accommodation will be provided at field locations where necessary, consultants will be required to express need for this or budget for it altogether.
- The estimated consultancy proposal should not exceed €30,000
- All applications should be marked: “Expression of interest for ECHO funded project endline evaluation – North East Nigeria”
Application Closing Date
15th December, 2017.