TOR for Research Consultancy - YES Amhara Project

1. Introduction

Even though Ethiopia has seen a steady increase in access to better water sources, keeping these sources effective is still quite difficult. A significant percentage of water schemes are not working. The main reasons are poor repair and maintenance capability, lack of willingness to pay for water services by communities, and poor information management on the operational status of water schemes. In order to ensure that communities have a consistent and uninterrupted supply of water, the Ethiopian government has acknowledged that other actors, particularly the private sector, must be involved in the operation and maintenance of water delivery infrastructure.

Helvetas Ethiopia has launched the Youth Entrepreneurship for Sustainable WASH Services (YES) initiative as a pilot to support the sector in addressing these challenges in the Wag-hemira and North Gondar zones of the Amhara region. In this innovative approach, private local service providers (PLSPs) have been brought into fill the operational and maintenance gaps.

In the project intervention areas mentioned above, young women and men organized and established enterprises to provide maintenance services and spare part supply for rural water users. In order to improve the community's ownership of the water supplies, YES supported in the legalization of WASHCOs as Water User Associations (WUA) to ensure improved system management and raise community awareness of the need to pay for water services. This allows youth enterprises to be engaged in providing repair and maintenance services in exchange for payment through an easy-to-use direct contracting mechanism.

Considering the positive accomplishments of YES-Amhara during the first phase in Wag-hemira and North Gondar zones, the regional bureau of Water and Energy and lower-level government institutions highly appreciate the initiative and are interested in continuing the collaboration with Helvetas.

Accordingly, Helvetas Ethiopia is planning to launch the second phase of YES Amhara by expanding its intervention areas to additional three administrative zones in the Amhara region in 2024-2026. Thus, Helvetas Ethiopia would like to hire a competent consultancy firm to review the achievements of phase I of YES Ahmara and conduct a baseline survey for the second phase (YES-Amhara II). The consultant will have two assignments in this term of reference- reviewing phase I and conducting a baseline survey for the second phase of the project.

2. Endline Evaluation/Review of Phase I

2.1. Theory of Change

If water users, organized in well-functioning water committees, are willing and able to pay for post-construction water services, if such services are provided by local small enterprises in a timely and affordable manner, and if the local government sets the standards and enables these post-construction services to be provided on a semi-commercial basis, then an autonomous market for these services will be created, down-time of water systems will reduce and an increase in access to clean drinking water will be achieved.

2.2. Objective of the Final Evaluation

To establish the extent to which the projects objectives were achieved, understand the projects contribution to the WASH sector and youth enterprise development, and analyze lessons learned.

2.3. Scope of Review/Evaluation

Geographically, the evaluation is expected to encompass six woredas in two administrative zones; hence, the evaluation will be conducted in North Gondar zone: Janamora, Debarq & Dabata woredas, and Wag-Hemira zone: Sekota Zuria, Dehana & Ziquala woredas. Since this is an endline evaluation, the study will assess the progress of the project towards the project goal and objectives from January 2021 to December 2023. Thus, it will cover the following impact and outcome indicators:

Project Goal: Youth enterprise market system developed and enhanced for sustainable and affordable WASH services:

• Indicators

- % of non-functionality rate reduced

- Average downtime

- # of people with reliable water access

Outcome 1: Gainful employment ensured through youth enterprise development:

• Indicators

- # of youths earned at least 2 USD per day (gainful income)

- % of youth members satisfied with the employment opportunities in the youth enterprises.

Outcome 2: Community ownership and management created through well-functioning WASHCO and active community participation:

• Indicators

- # of well-functioning WASHCOs (# of WASHCOs which improved financial performance and scheme management practices)

- % of end users (hhs) paid water scheme repair & maintenance fees regularly

- # of households with access and use of improved hygiene and sanitation facilities

Outcome 3: Enabling environment for sustainable and affordable WASH services created at zonal level:

• Indicators

- % of households access affordable to WASH services

- # of YEs diversify their business and functioning well using the created enabling environment

Outcome 4: Project learnings shared and advocated at zonal and regional level:

• Indicators

- # of Policy and legal framework adopted

- # of initiatives applying project best practices

2.4. Evaluation Method

In this review/evaluation, both quantitative and qualitative methods shall be employed. To capture relevant information and to triangulate the findings of the assessment, mixed methods and tools would be used. The methodologies include,

1. A comprehensive household survey will be implemented to measure outcome indicators that were set in the log frame.
2. Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.
3. A thorough document review (project document, progress reports, and other relevant documents) should be reviewed to establish the set strategies and how they were addressed by the project.
4. Observation if applicable.

The consultant should prepare a detailed methodology for conducting the evaluation taking into consideration the local context. Scientifically appropriate and valid sampling techniques, data collection tools, and data analysis procedures and techniques shall be briefed. The sample size and proposed tools will be discussed and approved by the project team before the commencement of the evaluation.

2.5. Key deliverables of the Evaluation:

• Inception report with detailed work plan within two weeks after award. The report should include a thorough analysis of the literature on WASH governance and YE in the area, the research methodology, an outline of the report, anticipated questions, and a list of stakeholders to involve.
• First draft Report within the stipulated time,
• Presentations of key findings and recommendations to stakeholders
• Final report not exceeding 25 pages- excluding annexes.

3. Baseline Survey of Phase II

3.1. Objective of the Baseline Survey

The overall objective of this baseline survey is to provide strong and evidence-based baselines for measuring project impact and success based on the project log frame. The specific objectives of the baseline study are as follows:

• In consultation with the projects teams, review existing impact and outcome indicators and propose other indicators if applicable.
• Undertake baseline assessment and determine the baseline values of the indicators proposed indicators in the log-frame. Thus, the consultant is expected to deliver baseline figures on the following indicators:

Table 1: Indicator and expected information on which indicator values will be determined.

3.2. Scope of the Assignment

The baseline survey is expected to encompass seven woredas from six administrative zones. Accordingly, Wag-hemira zone: Sekota Zuria, Dehana & Ziquala woredas; North Gondar zone: Janamora, Debarq & Dabata woredas; East Gojjam zone: Gozamin and Hult Eju enessie woredas; Central Gondar: Alefa, Mirab Dembia & Gondar Zuria woredas, and South Gondar: Libokemkem & Guna Begemder. The technical scope comprises the following tasks: reviewing pertinent documents; creating an inception report; outlining the design and methodology of the baseline survey; creating tools for collecting survey data; conducting assessments at the field and organizational levels; and conducting a thorough analysis of the state of WASH governance and youth enterprise development initiatives in the project areas.

3.3. Methods

The baseline study will mainly adopt a cross-sectional study design with a blend of both quantitative and qualitative methods. However, a more detailed evaluation methodology is expected from the consultancy firm. The detailed design of the methodology should include the following:

• The baseline survey design
• Data collection instruments and approaches
• Procedures for analyzing quantitative and qualitative data.
• Report writing and sharing etc.

The Consultant is expected to make use of mobile data collection (Kobo Toolbox) and GPS tools in the baseline survey. This will range from data collection, analysis, and presentation of results.

3.4. Key Deliverables

The Consultant shall deliver:

• The consultancy firm will have a kick-off meeting together with the project team to understand the project and to collect required documents such as the project proposal, results framework, etc.
• An inception report detailing methodologies to be used and sample size calculations, a detailed execution plan, data-collection tools, and analytical methods,.
• First draft Report within the agreed timeline between Helvetas and the consultancy firm,
• Presentation/de-briefing on key findings and recommendations so that the stakeholders can have a clear understanding of the field findings.
• Final report not exceeding 25 pages- excluding annexes.

4. Duration for both studies

The assignments are expected to be completed over 40 days - this period includes the provision of all deliverables and travel time. The assessment will be conducted from 15 March to 22 April 2024. Thus, qualified individuals or firms are invited to submit a proposal in response to this Terms of Reference no later than 8^th March 2024.

Table 2: Tentative timeline of the consultancy work

Note: The consultant may include a proposed timeline for the completion of the mentioned activities in his/her technical proposal.

5. Payment Modality

The payment plan shall be based on deliverables outlined upon the successful and satisfactory completion of activities. Therefore, the payment terms shall be as follows:

• 35% upon submission of data gathering tools and inception reports.
• 30% on submission of the first draft reports.
• 35% on the final submission of the reports and with the approval of the project team.

6. Ethical Considerations

• The study is expected to respect basic ethical principles of HELVETAS Ethiopia and international standardized research codes of ethics.
• All research/study participants need to be informed primarily about the objectives and process of the study.
• All the study-related documents including data-gathering tools, checklists, and forms will be HELVETAS Ethiopia property.

7. Minimum qualification and experience

The assessments will be done by a local consultant/firm with a team composition of 2-3 individuals with a mix of expertise in:

• Vocational management, adult education, cooperative management, economics, project management, community development, social work, sociology, and other related fields with MA/MSc.
• Minimum of 6 years of relevant professional job experience (baseline assessments, monitoring and evaluation, impact evaluation, data collection and analysis, etc.).
• Knowledge of qualitative and quantitative methodologies, including statistical sampling.
• Present proof of at least three years of related consultancy and work experience in the sector.
• Provide a sample report of at least one consultancy work accomplished in the area is advantageous.
• Renewed and Valid professional license of the consultancy firm.
• Experience working with local communities and non-governmental organizations.
• Excellent writing, editing, attention to detail and organizational skills.
• The consultant should complete the whole work within the given time frame and deliver the required documents.

Note:

• Documents such as personal profiles and other credentials with a covering letter should be included to the technical proposal. The technical proposal should be typed in 12-point font, no longer than 7 pages.
• The applicant shall list and briefly describe the name(s), qualifications and responsibilities of the staff proposed to work on the assignment. (CVs of proposed personnel should be included in an annex and not counted toward the page limit).
• Technical and Financial proposals should be submitted with separate envelop.

1. Evaluation Criteria