Consultant for an End-Term Program Evaluation

With severe mobility constraints and limited livelihood options, humanitarian assistance continues to be a vital lifeline for refugees. But surviving on a bare minimum of assistance means many have been living on the threshold of an emergency for close to three decades now. Their needs far outstrip what dwindling humanitarian assistance can provide for in the face of waning donor funding. Psychosocial support for the refugees population is important for continued trauma healing and peaceful co-existence in the camp and whenever the refugees return to Somalia.

The three-year Somalia Peace Program-Youth Development and Livelihood program Phase3 which ends in September 2021 is due for final/end term evaluation. The exercise will be valuable to inform the next phase and improve outcomes for the Somali youth. It will also explain program’s Relevance, effectiveness, efficiency, Impact, and sustainability. Information collected will be used to improve current and future program design and implementation.

Evaluation Objective

Purpose, objectives and uses of the evaluation to inform project stakeholders

The overall objective of the end term evaluation is to assess the achievement of the project objectives, its outcomes as well as assess the program’s performance, effectiveness, impact, efficiency, relevance, timeliness, and sustainability.

The project set out to contribute to the following goal “Somalia youths assume responsibilities and leading roles in their communities and actively participate in non-violent and innovative community-based initiatives, thus contributing towards building peaceful and safe communities in Somalia” and the objectives below.

1. By 2021, Young Somalis in Kismayo and Dadaab promote community healing and peace building through youth-led consultative spaces and economic development.
2. By 2021 four youth networks are engaged in advocacy for issues affecting youth locally and regionally in Somalia.
3. Two local partners have improved their skills in planning, implementation, and monitoring of their youth activities.

AFSC has used the following methods during implementation; Partnership and accompaniment, Continuous analysis monitoring to ensure learning among partners and with other peace actors, Public Achievement Model (PA) to mobilize and develop youth leadership skills to play a key role in peacebuilding, reconciliation, social change, and democracy through engaging the youth and helping them understand issues affecting them within their communities, Annual partners meetings attending partnership meetings and managing relationships with target groups:

Scope of Evaluation

The evaluation will gauge the level of community and other stakeholder participation and ownership of the implementation process. It shall identify the intended and unintended outcomes, best practices, lessons learned as well as challenges arising from program implementation. In addition, the evaluation will come up with conclusions and recommendations.

The specific evaluation objectives are as follows.

• To assess the program’s relevance, effectiveness, efficiency, impact, and sustainability.
• To verify the objectives achievement both qualitatively and quantitatively.
• To verify the activities implementation and the results achievement according to the expectations.
• To highlight success stories and uncover relevant learnings evident from the program implementation.

Key Evaluation Questions based on DAC Criteria

• Were the activities relevant, and were they implemented in an appropriate, effective, and efficient manner?
• What were the key program outputs and outcomes, and to what extent did the program activities contribute to the outcomes?
• What capacity building activities have been undertaken to strengthen implementing partners and how did they contribute to achieving the program objective?
• To what extent did the program lead to peace building in the areas of intervention?
• How were women and other vulnerable groups involved in the program?
• What were the major factors influencing the achievement or non-achievement of the objectives?

Impact:

• What has happened because of the project? (Intended and unintended impacts, equal opportunities for women and men, improvement of social and economic infrastructure, poverty reduction, cross – sectorial impact or other relevant cross-cutting issues).
• What real difference has the activity brought about for the beneficiaries? (What would have happened without the activity?
• How many people have been affected? Planned target group vis à vis really addressed?
• What are the short and medium term (intended and unintended) outcomes of the project/ program?
• To what extent was the selected target groups reached?

Sustainability of the project:

• To what extent will the positive impacts or changes of the project (are likely to) continue?
• Which measures are implemented to support continuity?
• What are the major factors influencing the achievement or non-achievement of sustainability of the project/ program?
• To what extend is the program exit strategy relevant?

The results of this external evaluation will be used internally and externally. The report will be made available electronically to AFSC staff, current and potential partners, and the donor.

Evaluation Methodology, process, and reporting

The evaluation will involve participatory methodologies and tools. The evaluator will creatively employ a mix of techniques for data collection and will among others hold meetings and discussions, key informant interviews with the project partners, direct beneficiaries and AFSC staff.

AFSC will make accessible project documents for review and secondary data collection. The documents will include the project proposal and budget, cooperation agreement, partnership documents, baseline study report, activity reports, AFSC internal and donor reports.

Evaluation process and timeline

The evaluation will be carried out in the month of July. While the evaluator will propose and negotiate the number of days to carry out the work, the report should be ready by 31^st July.

Proposal Submission Requirements

All proposals must be received by 5:00 pm Kenyan time, June 30^th, 2021. Proposals received after this time will not be given primary consideration. A cover letter and proposal with budget and timeline should go to the Country Representative, Somalia, at InfoAfrica@afsc.org . Proposals should include the complete scope of work and deliverables including the following sections:

a. Organization/Evaluator Background

Include the organization and/or individual’s name. Describe the general nature of work and the name of the reviewer that will be conducting the work. Describe any International peacebuilding and development experience, education, skills, and languages. Proposals must include three examples of related work completed and contact information for the organizations served.

b. Statement of Proposed Work

State in succinct terms an understanding of the work to be completed. Describe the methodologies proposed to complete the evaluation and a final report including a time frame for completion of specific tasks, the personnel needed to complete tasks, and expectations for support and assistance from AFSC. Describe the work plan for the review. Proposal may also include other activities deemed necessary by the evaluators and specified within the work plan.

Key Deliverables

The following outputs are expected from the consultant:

Inception report upon signing a contract, submit an inception report detailing the evaluation design, methodology and data collection tools to be discussed and agreed upon with AFSC.

Produce a draft report; The end-term evaluation report including stories of change and lessons learnt

1. Final end-term evaluation report and case study report incorporating comments from the reviewers.

The reports should include a detailed lesson learned component, most significant change stories and a list of all people interviewed in the annex. While the evaluators are expected to work independently, Somalia Program officer and Country Representative will assist in facilitating access to evaluation participants, documents, and solving problems and concerns that may develop throughout the course of the review. AFSC staff could help arrange transport and accommodation as needed and with prior approval of the Somalia Country Representative.

c. Budget and Deliverables

Provide a detailed budget as well as a description of the specific deliverables that will be submitted and expected schedule of compensation.

d. Evaluation Schedule

The proposal should include a work plan showing how the evaluation will be carried out.

Proposal Evaluation Procedures

After having received the responses from the applicants, a consultant will be selected based on an appropriate selection process in consultation with the Country Representative Somalia, Regional Director for Africa, and the international program support staff as needed. A signed agreement should be processed with the selected consultant and in accordance with AFSC vendor practices.

Profile of Evaluation Team

The Evaluation consultant should be fluent in English, spoken and written, have strong analytical skills, good listening and discernment skills, and proven experience in evaluating peace programs. Somali experience would be an added advantage.

Expected profile of consultant.

• Advanced university degree in relevant field.
• At least 5 -7 years of experience conducting similar assignments.
• Extensive experience in field research in Somalia.
• Excellent research, report writing and analytical skills.
• Well conversant with qualitative methods of research.
• Proven capacity to write analytically, understandable, and simple reports.
• Experience of working with secondary data analysis/desk reviews.
• Experience of developing research tools and carrying out research.
• Advanced knowledge of the new trends and developments in Somalia.
• Ability to provide clear guidance to field research teams.
• Proven ability to deliver against targets and meeting deadlines within short timeframe.
• Relevant computer skills: Word, Excel, internet, Power point.

Inquiries

Questions that help clarify the work to be completed may be submitted to Zaina Kisongoa, Somalia Country Representative, at ZKisongoa@afsc.org. Inquiries by email are preferred; telephone calls can be arranged via email as necessary.