Consultancy Evaluation of Support to Refugees and Host Communities (SR&HC) in Kakuma Refugee Camp, Kalobeyei Settlement, and Surrounding Areas, 2021- DanChurchAid

1. Background to the Project and Rationale for conducting an End of Project Evaluation

DanChurchAid (DCA) has implemented humanitarian projects for refugee and host communities in Turkana County through its partners since 1995, 3 years after the establishment of Kakuma refugee camp in 1992. For many years, DCA funded international and local partners in implementing projects in Education, WASH and Livelihoods. In January 2017 DCA Kenya started direct implementation work in Kakuma refugee Camp focusing on Livelihoods and Financial inclusion interventions. The aim of this strategic shift in approach was to enhance its overall added value to its project, support partners at closer operational level and take up the role of piloting innovation in humanitarian programming.

1.1 Status of Implementation

Since 2017, DCA has increased its portfolio of the direct implemented projects. In 2021, DCA implemented projects targeting refugee and host community populations, while continuing to increase its partner implemented portfolio through continued partnerships with LWF and another new partner – Turkana Christian Development Mission (TCDM), which was identified to help enhance capacity of faith actors in their responding to the effects of COVID-19 pandemic..

Danida Strategic Partnership Funding – Project 1010375 -31

DCA has implemented the Danita strategic partnership funding since 2017. The project aims at ensuring the resilience of vulnerable refugees and host communities is strengthened through support for sustainable livelihoods and appropriate humanitarian response. This is being implemented in the context of the triple nexus approach within a protracted crisis.

The current project continued to build on the gains of the previous project interventions implemented in the last 4 years under different annual project cycles. The project objectives in 2021 are as follows:

Overall Project Objective

Resilience of vulnerable refugees and host community is strengthened through support to sustainable livelihoods and appropriate humanitarian response.

The project had 4 specific objectives, namely:

1. Vulnerable refugees and local communities are empowered and have enhanced sustainable livelihoods.
2. Refugee and local community youth are economically empowered to live dignified lives.
3. Improved financial inclusion for refugee and host communities
4. Enhanced and systematic programming that enhances attainment of Core Humanitarian Standards (CHS) commitments

Project interventions in 2021 have been focused on supporting vulnerable households in the host community and refugee communities in:

• Vegetable production using climate smart technologies such as multistory gardens (MSGs), cone gardens and shade houses
• Poultry rearing and insect (cricket) farming for improved household income and food and nutrition security
• Fish trading/marketing, through linkages to fisherfolk on Lake Turkana in the form of capacity building, market infrastructure development and provision of business grants, especially during the COVID-19 pandemic.
• Establishment of and support to Village Savings and Loan Associations (VSLAs) to advance affordable credit for borrowers and a return on their savings as well as grants for members in distress.
• Trialing the digitization of VSLA Facilitator training as part of a multi-country initiative to; this is currently being tested with VSLA facilitators through a simulation game App, the ledgers/records, and financial service linkages to digitize the cash box through financial account/wallets.
• Multipurpose cash transfers to cover basic survival needs for targeted vulnerable households
• Training youth on business and entrepreneurship skills using a blended learning approach and providing employability and work readiness program for youth job seekers as well as exploring online business targeting youth.
• Establishment of a Youth Enterprise fund – a revolving fund targeting youth entrepreneurs. The funds will be made available for youth in the form of loans. DCA has partnered with SMEP, a micro Finance agency in the disbursement of these funds to the youth applicants.

2. Evaluation Purpose Objectives and Intended Use

The purpose for this evaluation is two-fold. On the one hand, it will establish the substantial evidence of the contribution made towards the achievement of the principal objectives of the project by assessing the performance of the project (effectiveness, efficiency, relevance, impact and sustainability) and ensure accountability towards the donor and the project beneficiaries and on the other hand the evaluation will assess the lessons learnt in the implementation of the project. The evaluation will follow the Development Assistance Committee(DAC) criteria.

The Evaluation will have three objectives:

Objective 1: Evaluate to what extent the project has delivered effective, efficient, relevant, impactful and sustainable interventions to beneficiaries as set in the project log frame (especially in contributing to the set outcomes and goals).

Objective 2: Assess the key lessons learned for the project on the basis of the interventions that have been implemented and establish viability of some of the innovative interventions that DCA is currently introducing for future project sustainability and opportunities for redesign.

Objective 3: Assess the lessons learnt, performance, feasibility and recommended way forward for cricket farming that has been implemented for the last 3 years.

Objective 4: Analyze and document cross project synergies between projects 1010375-31,1010375-36 & 1010375-38 and make relevant recommendations to enhance it.

2a. Intended Users of the Evaluation

The intended users of the evaluation are:

• Organization
• Focal Person

Contact Details

Remarks/Possible Interest

DCA

• Head of Program – Kenya (Patrick Kibuku).
• Area Manager – (Edwin Siala). patrick.kenya@dca.dk; eosi@dca.dk

Lessons learnt, best practices & how they can be used to improve future programming.

• Other Stakeholders.

Edith Imbolokonye Ingutia

• Chair – Livelihoods Technical Working Group; ingutia@unhcr.org

Share lessons learnt with a view to improve Livelihoods programming in Kakuma/ Kalobeyei

3. Specific Evaluation Questions

The evaluation will assess the following evaluation criteria and include all of the following questions:

Objective 1: Evaluate to what extent the project has delivered effective, efficient, relevant and timely interventions to beneficiaries as set in the project log frame (especially in contributing to the set outcomes and goals).

I. Effectiveness:

The evaluation should assess the following:

• To what extent have the intended objectives (Outcomes and Goals) indicated in the project log frame been reached?
• To what extent have the project results contributed to the overall goal? Was the response effective in responding to the needs?
• What were the major factors influencing the achievement of the objectives of the project?
• What opportunities for collaboration have been utilized and how have these contributed to increased effectiveness? Or otherwise?
• Have proper accountability and risk management framework(s) been in place to minimize risks on program failure?
• Is the intervention relevant in relation to the needs and priorities of the intended beneficiaries?
• To what extent have the project beneficiaries been reached and what mechanisms were in place to improve coverage?

II. Efficiency:

• How efficient was the use of project resources(inputs) to realize the set results?
• Were the investment and recurrent costs justified?
• Was the project implementation modality considered to have been timely and cost-efficient? What choices were made for leveraging other opportunities for collaboration and non-collaboration during program design? Why were these choices made?
• What were the outcomes of these choices in ensuring effective and efficient program implementation?

III. Relevance/Impact

• How relevant were the interventions implemented in addressing community needs?
• Have the interventions contributed to addressing the community needs identified by project?
• How do beneficiaries perceive the relevance of the project and how have the interventions implemented improved their lives? Are there any stories of change?
• How has the collaboration between DCA and other stakeholders contributed to appropriate response of specific needs and priorities of the beneficiaries?
• To what extent was project able to adapt and provide appropriate response to context changes and emerging local needs/priorities of beneficiaries?

IV. Impact

• What positive and negative, primary and secondary long-term effects have been produced by the development intervention, directly or indirectly, intended or unintended?**
• Did the quality of activities delivered by project meet the needs and expectations of the beneficiaries? What improvements can be considered?

V. Sustainability

• What is the probability of long – term benefits as a result of the project interventions?
• Will the intended benefits continue when development co – operation is terminated?
• Is local ownership established?

Objective 2: Assess the key lessons learned for the project on the basis of the interventions that have been implemented and establish viability of some of the innovative interventions that DCA is currently introducing for future project sustainability and opportunities for redesign.

Learning

The evaluation should at least include one lesson learned and recommendation per evaluation category, i.e. effectiveness, efficiency, relevance, impact and sustainability.

• What are the key lessons learned?
• What improvements have been proposed to improve project impact?

Sustainability

• Is there evidence that the initiative is likely to grow – scaling up and out – beyond the project life?
• What are recommendations for the future and what will be the added value of implementing them? Consider at least the below questions:

Objective 3: Assess the lessons learnt, performance, feasibility and recommended way forward for cricket farming that has been implemented for the last 3 years.

• What are the lessons learnt with regards to cricket farming
• What is the feasibility of cricket farming in Kakuma?
• What are the recommendations on the way forward.

Objective 4: The evaluation is also expected to analyze and document cross project synergies between projects 1010375 – 31, 1010375 –36 and 1010375 – 38 and make relevant recommendations to enhance it.

This evaluation is expected to analyze and document the synergies that exist with other projects including TV collection 1010375-38, VSLA Gaming App (1010375 – 20) – a research project for training VSLA facilitators using VSLA Simulation Game App and DCA Enterprise Fund (1010375 – 36,) – that aims to provide capital to youth owned enterprises through revolving fund, and on the other hand receive individual donations to refinance the kitty, both implemented in Kakuma and Kalobeyei and the opportunities available to leverage the impact of these projects for the benefit of communities.

Scope of the Evaluation

Geographical area: This evaluation will be done in Kakuma and Kalobeyei areas of Turkana West Sub county, Turkana County where DCA implements this project. The sample size will be drawn from both host community and refugee communities in Kakuma and Kalobeyei settlement.

Time Frame: The evaluation will take place between December to February with initial preparatory activities and development of data collection tools being completed in December 2021 and actual data collection starting in early to mid January 2022. This period will cover designing of the survey tools, data collection, data analysis, report writing and dissemination.

Technical scope: Whereas the evaluation scope will primarily be informed by assessing the project contribution in realizing the objectives (outcome and goal level) as outlined by the relevant aspects in the log frame, it is expected that the following will be highlighted:

1. Application of innovative approaches and technologies in DCA work. This is expected to enable DCA and its partners account to its constituents, back donors and the government of Kenya for its commitments towards this project.
2. The application of Core Humanitarian standards in DCA work

DCA is a CHS certified organization. The evaluation will also assess the extent to which DCA applied the nine CHS commitments in working with communities in this project to ensure accountability to beneficiaries. This will also guide & compliment the above DAC criteria during the evaluation.

Approach and Methodology

The evaluation approach shall be utilization focused. As such, the evaluator should arrange individual meetings with intended users before and after the evaluation (de-briefing).

The following should be observed:

• Attention should be given to collect information: from all types of stakeholders, with special focus on women/youth (both girls and boys) from the refugees and host communities and project implementing staff.
• Initial findings and recommendations made as a result of the evaluation shall be shared with DCA, partners and right holders in a participatory way, so that they have an opportunity to discuss the recommendations before they are finalized.
• As much as possible, the evaluation shall recommend systems to check that recommendations are incorporated in future planning and proposals are documented and followed up.

Methodology

• Literature review of all relevant project documents including Strategy, Evaluation reports, progress reports, financial reports, documents and materials produced during the project including relevant documents (e.g. evaluation)
• Conducting Household surveys based on an appropriate sampling design.
• Individual Key Informants interviews and focus group interviews with stakeholders and target community representatives (both beneficiaries and non-beneficiaries), relevant Partners, senior management and relevant staff, relevant GoK departments, private sector partners and UN agencies.
• Market survey specifically related to input vouchers.

Evaluation management and values

The evaluator must not compromise the values of DCA and should adhere to the Guiding Principles for Evaluators of the American Evaluation Association.

This evaluation should adhere to and be guided by the DCA evaluation policy. The evaluator should refer any questions or emerging issues to the DCA Kenya Head of Program (patrick.kenya@dca.dk).

The general terms and conditions of this consultancy are:

Logistics: The consultant(s) will cover his/her own cost of travel to the field and back, meals, and accommodation during data collection.

Professional fee: The consultant(s) will be paid professional fees in accordance with this TOR and within DCA’s approved rates.

Tax 5% withholding income tax payable to the Government of Kenya (GoK) shall be deducted from the consultants’ fees during payment when relevant.

A contract will be signed by the consultant(s) prior to commencement of this consultancy which will detail additional terms and conditions of service, aspects on inputs and deliverables.

Full term of consultancy: document review, field work and report writing should not exceed 27 days.

Other specifics on who makes decisions on what and what resources does DCA mobilize to support the evaluation, e.g. logistical support will be contained in the consultancy contract.

Professional Qualifications of the Team

Required Qualifications

• A multi-disciplinary consultant (s) with a Master’s Degree in a relevant discipline in social science (or equivalent).
• Experienced in nexus programming especially in Sustainable Livelihoods, value chains and financial inclusion/inclusive markets (in humanitarian settings)
• Proven expertise on mainstreaming Rights Based Approach and Gender approaches in sustainable livelihoods programming.
• Proven experience in conducting evaluations and studies for NGO implementing humanitarian and development assistance in the Horn of Africa and Kenya in particular.
• Proven experience in conducting evaluations and research and using multiple methodologies including household surveys, participatory evaluation methodology, appreciative enquiry methods, focus group interviews, etc.

Reports

The final evaluation report should follow the format 1-3-25 as described in Annex 2. Failure to comply with this format results is considered breach of these Terms of Reference.

Meetings and Workshops

An initial meeting will be conducted between the consultant and DCA staff. This meeting will outline the scope of the evaluation and agree on the evaluation parameters including, tools, evaluation design, methodology, respondents that will be interviewed, locations to be covered and timelines to be used during the evaluation. The consultant will also outline the resources and documents that he/she will need to deliver the task and use the opportunity to clarify expectations of DCA. Alongside the review of the relevant existing literature and project documents, the consultant will embark on developing the tools that will be used for data collection. A meeting will be organized between the consultant and DCA to share and review these tools and to give feedback before the tools are validated for use in data collection.

The consultant will subsequently conduct a two day workshop with selected enumerators to train them on the tools, methods and approaches to data collection.

Suggested Timeline

The envisaged evaluation period should not exceed 27 consultancy days distributed as time for preparation, field work, travel, and report writing, to be outlined in the technical proposal. The timeline proposed by the consultant(s) should also take this into account, and ideally should propose preparation/desk research and any adherence to Covid19 protocols as laid down by the Ministry of Health.

Budget and Payment

• The consultant(s) will receive remuneration under the following terms of payment, which will be based on the output of the work and not on the duration that it might take:
• The Lead Consultant(s) shall be paid based on a daily rate.
• 30 % of the total shall be paid upon signing of the contractual agreement.
• The remaining 70% shall be paid after a final satisfactory report and other outputs are submitted and satisfactorily signed off by DCA.

Structure of the Proposal and Submission Guidelines

All expressions of interest should include:

Technical Proposal highlighting: brief explanation about the consultants (s) with evidence of previous experience in this kind of work; profile of the consultancy firm to be involved in undertaking the consultancy; understanding of the TOR, the task to be accomplished as well as draft consultancy framework and plan and at least three referees.

Financial Proposal: The financial proposal should provide cost estimates for services rendered including daily consultancy fees related to the consultants excluding accommodation and living costs; transport cost, stationeries, and supplies needed for data collection; costs related to persons that will participate from partners and government officers.

Curriculum Vitae: A detailed Curriculum vitae of the consultants(s) detailing the academic, professional and technical experience relevant to this job.

Additional References or Resources

Resources particularly relevant to the project are:

1. Project documents: a) 2021 Project proposal document and Logframe for 1010375-31, 36 &38
2. DCA Project progress reports and monitoring reports.
3. Danida Hum funding – End of Project Evaluation report/s of 2021.
4. DCA Evaluation guidelines & Humanitarian Assistance policy.
5. DCA Strategy document.