Somalia: Consultancy: End of Project Evaluation Odweyne Area Rehabilitation Programme Togdheer Region, Somaliland

WV Somalia
Checklist for Evaluation Terms of Reference (ToR)

1. Evaluation Summary
   Project Name Odweyne Area Rehabilitation Programme Togdheer Region, Somaliland
   Evaluation Type End of Project Evaluation
   Evaluation Purpose The purpose of the evaluation is to assess the progress made towards achievement of the objectives of the project, its outcome and impact on the lives of Odweyne community that include the families, communities and governments involved in the implementation of the interventions.
   It will also measure the level of community and other stakeholder participation and ownership of the implementation process. Also identify the intended and unintended outcomes, best practices, lessons learned as well as challenges arising from project execution. In addition, the evaluation will come up with conclusions and recommendations for learning and future intervention.
   Proposed Methodologies Household survey
   FGD,KII,
   Document Reviews
   Most Significant Change( Case study)
   Proposed dates of Evaluation 22 February-8 March 2016
   Anticipated Date of Draft Evaluation Report Submission 12 March 2016
   Anticipated Date of Final Report Submission 17 March 2016
2. Description of Programme or Project Being Evaluated
   Project Goal To Improve the wellbeing of children in community through participatory community empowerment, livelihood resilience enhancement and better water accessibility in 8 priority villages within Odweyne District, Daadmadheedh Region.
   Project Objectives/ Outcomes 1. Improved and diversified livelihood alternatives among the Odweyne agro pastoralists.
3. Improved and sustained community Rangeland Environmental Management.
4. Enhanced community resilience and mitigation of disaster.
5. Improved access to water.
6. Community-led programme design developed to attract additional funding for sustainable development through the Area Rehabilitation Programme model.
   Project location (Districts and # of villages/ sub-locations) 8 villages (Odweyne, Galooley, Gatiitalay, Qaloocato, Baarcad,
   Laan-Mulaaho, Abdi Dheere, and Jamaacaadka Aynaanshe).
   Number of target beneficiaries 22, 500
   Sectors FSL and WASH
   Key Project Activities • Support 24 MT of assorted Drought tolerant seeds to 400 farmers (200 farmers first year)
   • Provide 400 farmers with 400 tractor hours per year for two years and 200 tractor hours for one year(last year)
   • Procure and distribute farm tools for 400 farmers
   • Procure for distribution 0.6 MT of pasture grass seeds
   • Support 5 communities to Establish 5 check dams through cash for work
   • Construction of 3 earth dams
   • Construction and equipping of 3 shallow wells
   Donor Fu Tak Iam Foundation Limited (WV Hong Kong)
   Length of Program 3 years
   Available Project Documentation (baseline, mid-term, key monitoring data etc.) • Baseline
   • ARP Design document
   • Midterm evaluation
   • Quarterly report
   • Annual reports
7. Evaluation Purpose and Objectives
   Provide project staff, community members and other stakeholders with an analysis to understand overall project relevance, operational efficiency, effectiveness, Programme impact and sustainability.
   3.1 Relevance
   The evaluator will assess to what extent the programme activity were suited to the priorities of Odweyne community. The evaluator should ascertain;
    To what extent are the objectives of ARP valid?
    Are the activities and output of the programme consistent with the intended programme goal to improve the wellbeing of children in community through participatory community empowerment, livelihood resilience enhancement and better water accessibility?
   3.2. Effectiveness
   The evaluator will assess the effectiveness of capacity building interventions within the community structures. Also the evaluator will ascertain the extent to which the objectives of the ARP has been achieved and what major factors influencing their achievement and non-achievement of the objectives.
   3.3. Efficiency
   The evaluator will assess whether activities of the programme were cost-efficient, were achieved on time and whether they were implemented in the most efficient way compared to alternatives.
   3.4. Impact
   The evaluator will assess the positive and negative changes produced by ARP interventions, directly or indirectly, intended or unintended. The evaluator will ascertain whether;
    There is improvement in household income as result of improvement in crop productivity.
    There is improvement of social ties with other communities through farmers exchange programmes.
    Community empowerment has helped to create better coordination between residents and local government.
    There is real difference made to the beneficiaries through ARP activities and how many people have been affected.
   3.5 Sustainability
   The evaluator will assess the sustainability of the project in terms of continuation, maintenance and replication of the project outcomes by communities, local authorities and central government. Sustainability will be measured by the possibility of communities, local authorities, and central government to manage projects (-cohesion, building capacity of partners and national staffs, technical replication of technology and financial viability).The Evaluator will also ascertain the possibility of scaling up of the project beyond the project areas to other communities and districts. For more details, please refer the project sustainability part in the design document.
   Also the evaluator will;
    Verify project activities as described in project documents (embed log frame)
    Measure high-level project indicators (objective/ outcome and goal/ impact level)
    Measure the child wellbeing indicators( embed below)
    The evaluator should ascertain changes being brought in the lives of Odwyane community due to the result of project activity implementation. The Evaluator will assess whether there are any changes in the living standards of poor rural agro-pastoralist community:
8. Whether environmental health restored
9. Whether food is available in homes from alternative source,
10. Where community access water for home, livestock and irrigation purpose
11. Where community are well aware of personal hygiene and environmental sanitation
12. If the targeted community feel empowered by the project and,
13. If the general community livelihoods have been improved.
14. Outline the intended and unintended outcomes
     Assess integration of humanitarian accountability standards in project implementation
     Assess the influence of other projects in Odwyane ARP (WV to provide list of project and log frame document and other relevant project documents.
     Assess world vision influence in the last three years.
     Assess the integration of gender, disability, resilience, child protection and engagement with faith/religious leaders
     Provide lesson learnt, conclusion and recommendations for future interventions
     The evaluator shall on the basis of the data gathered:
15. Capture best practices and lessons learned from this project. World Vision Somaliland will share this information with the donor and key stakeholders including government bodies, other NGOs, and other stakeholders for further programing
16. Draw conclusions and make recommendations
17. Logistics
     Travel logistics (embed flight schedule)
    o
     Access to Operational Areas (security/ physical access)
18. Consultant Responsibilities during evaluation
     The consultant will use the baseline methodology and WVSom will provide HH Survey tools
     Train enumerators
     Work with field staff to coordinate evaluation schedule
     Supervise enumerators during data collection in the field
     Data verification during data collection
     Data entry and analysis
     Reporting
     Retain original data collection tools for 3 months after final submission of evaluation report
19. WV Responsibilities during evaluation
     Arrange and fund all international flights and Somalia travel/ logistics, including visas
     Arrange accommodation and meals
     Source, hire and pay for enumerators (depending on the project)
     Provide Security Briefing to consultants
     Arrange key information interviews and focus-group discussions as per the evaluation plan
     Review all plans/ tools before use
     Review all reports and provide feedback
     Liaise with local implementing partners on behalf of the consultant to plan data collection
     Products
     Evaluation Report
20. No more than 30 pages (without annexes)
21. Includes photos and quotes highlighting significant change
22. Including, but not limited to, sections on context, sampling, methodology, findings (including table showing achievements per indicator/ activity), analysis and recommendations
23. Annexes with the following information:
    i. List of enumerators
    ii. All data collection tools
    iii. Findings on the integration of humanitarian accountability standards in project implementation
    iv. Findings on the integration of gender, disability, resilience, child protection and engagement with faith/religious leaders
    v. Key lessons learned by project staff during project design and implementation
24. 1- page “fast facts” evaluation summary
25. 15 minutes evaluation preliminary findings presentation to be delivered to the field team
26. 15 minutes evaluation summary/ review PowerPoint presentation to be delivered at Nairobi national office level
27. Soft copy of raw data set for any quantitative data
28. Soft copy of cleaned data set for any quantitative data
29. Soft copies of data collected during qualitative data collection exercises (i.e. interview notes)
30. Proposal Contents
    Proposals from Consultants should include the following information (at a minimum)
     Proposed timeline (see travel schedule below)
     Proposed methodology, including types of data collection tools and data collection activities
     Proposed budget
     CVs of key consultants for this evaluation

• Applications from qualified firms/individuals should be submitted by 11th February 2016 to somo_supplychain@wvi.org. If you don’t hear back from us by 30th March 2016, kindly be informed that your bid was not successful.