Position: Consultant for the end-line survey and end project evaluation for Integrated Child/Youth in DRR/CCA Project (ICYDCP) KH09-003 (ChildFund Cambodia )__Deadline:10May

 

Term of Reference

The End-line survey and End Project Evaluation for Integrated Child/Youth in DRR/CCA Project (ICYDCP) KH09-003

1. Organisational context

ChildFund Cambodia is the representative office of ChildFund Australia – an independent international development organisation that works to reduce poverty for children in developing communities.

ChildFund Australia is a member of the ChildFund Alliance – a global network of 12 organisations which assists almost 23 million children and their families in over 70 countries. ChildFund Australia is a registered charity, a member of the Australian Council for International Development, and fully accredited by the Department of Foreign Affairs and Trade which manages the Australian Government’s overseas aid program.

ChildFund began working in Cambodia in 2007 and works in partnership to create community and systems change which enables vulnerable children and young people, in all their diversity, to assert and realise their rights. Projects are implemented in the rural districts of Svay Rieng, Kratie, Prey Veng and Battambang provinces, focused on improving living standards for excluded or marginalised communities.

With a focus on child protection and resilience, quality education, disaster risk reduction and climate change adaptation, improved local governance, water and sanitation, and youth empowerment, ChildFund Cambodia is also working to strengthen the government’s policy frameworks to improve early grade reading performance through technology interventions, and build community-based child protection mechanisms.

ChildFund Cambodia implements its programs in collaboration with local civil society organisations, and in partnership with the relevant ministries and government departments.

Life with Dignity (LWD) is a local non-government organisation serving vulnerable communities in Cambodia through development work prioritising human dignity since 1979. Its program themes include sustainable livelihoods and agriculture, disaster risk reduction and climate change, WASH, nutrition and health, education and social community engagement.

2. Background

From October 2021 to June 2023 LWD in partnership ChildFund Cambodia implemented the ‘Integrated Child/Youth in Disaster Risk Reduction and Climate Change Adaptation project (ICYDCP) in Kampong Trabaek District in Prey Veng Province. The project design was based on the results of stakeholder consultation and a Hazard Vulnerability Capacity Assessment (HVCA). These results highlighted:

1. the negative impact of natural disasters and climate change with increased occurrence of moderate flooding, drought, and degraded soil quality in the project location,
2. gaps in the knowledge and skills on DRR/CCA within these communities on the part of children, youth, and adults, and

• low levels of child and youth engagement in Commune Council Disaster Management (CCDMs) and Village Disaster Management Groups (VDMGs), and minimal opportunities more broadly for children and youth to raise their voices or participate in community decision-making and a lack of information about their rights.

ChildFund Cambodia projects within its Community Voices program demonstrate that promoting child and youth participation in community decision-making strengthens their confidence, leadership, and communication skills – three key social and emotional (SEL) skills – and positively influence how community officials perceive and value the unique contributions children and youth make to their communities. These findings complement Cambodia’s 2011 National Policy on Youth Development that calls for increased youth participation, expression, and decision-making in local communities and educational settings with support from policymakers, service providers, and leaders who acknowledge youth’s capacity and respect youth’s rights. The OECD’s subsequent 2016 Youth Well-being Policy Review of Cambodia states that this policy position not only helps communities but also equips young people with much-needed future workplace soft skills.

The project worked with the following key stakeholders: National Committee for Disaster Management (NCDM) Provincial Committee for Disaster Management (PCDM); District Committees for Disaster Management (DCDMs); Commune Committees for Disaster Management (CCDM) and Village Disaster Management Group (VDMG), youth leaders/members from 20 villages in 3 target communes in Kampong Trabaek district. Moreover, children council leaders/members, school teachers, school directors and School Support Committee from 6 targeted school in 3 communes in Kampong Trabaek district, Prey Veng Province.

The ICYDCP Project Goal: was that sub-national governments and communities have disaster Risk reduction processes and systems in place that are inclusive of children and youth.

There were 3 project outcomes and 9 indicators that helped the initiative achieve its goal.

Outcome 1: Strengthening formal mechanism from province to village level to be able to address issues related to DRR/CCA

Outcome Indicators:

• (CCDMs, VDMGs, youth groups and child council members) know how to assess and prioritise risks and develop and implement risk management plans with significant considerations to the needs of the most vulnerable groups. (70% of members; 27 mini-projects implemented; 27 DRR/CCA plans)
• Adolescents, young people and adults are playing supportive roles in community risk reduction activities, addressing barriers and sharing ownership of results
• Adolescent and youth participants in Youth DRR show higher level of resilience and a more positive outlook
• CCDMs and VDMGs are more representative of youth, women, men, boys, girls, people with disabilities and other vulnerable groups and have more inclusive planning and decision-making processes
• The sub-national government provides technical, financial and/or coordination support for the implementation of 12 school-level DRR/CCA plans (evidence of support provided; 12 school improvement plans)
• 6: The sub-national government provides technical, financial and/or coordination support for the implementation of commune-level DRR/CCA plans (evidence of support provided; 6 commune investment plans)

Outcome 2: Children and youth capacity using SEL framework is strengthened and to be able to contribute support on DRR/CCA issues at the communities’ level.

• 70% of Children Council and Youth Group members with increased SEL competencies
• Youth group and child council members better understand the root causes of disasters and understand how disasters can be managed in their context (70% have increased knowledge of the root causes of disaster; 60% have increased knowledge of managing climate and/or climate risk)

Outcome 3: Children and youth increased their voices, right to participate in decision making and take active engagement on issues related to DRR/CCA.

• 60% of Youth group and children council members lead, participate or contribute to positive change on DRR/CCA in their communities
• Evidence of DRR/CCA policies, systems and procedures that are influenced by youth groups and child councils

3. Purpose

Project endline: Conduct a comprehensive endline study against the ICYDCP Project Results M&E plan and tracking report (see annex) that entails collecting two sets of data: a.) for endline and b.) retrospectively collecting endline data due to variation from the current logical framework versus baseline data. The consultant will conduct an endline survey on level of knowledge and skills as well as project interventions to address key barriers among children, youths, key community members and relevant stakeholders.

End-of-project evaluation: Conduct a final evaluation of the project to identify the challenges and successes (best practices) and key suggestions for ways forward based in the DAC criteria. The end-of-project evaluation (hereafter, ‘the evaluation’) will ensure accountability towards ChildFund and the beneficiaries of the project. The findings and recommendations of the evaluation will be shared with the LWD and ChildFund management teams, government stakeholders and child and youth participants to guide future project development and learning.

Case study: Produce 2-3 case studies of different target groups (i.e: CWD, youth, and Government staff) and specific findings in a comprehensive report

Key requirements are:

• Use the main evaluation questions listed below to determine whether the project’s purpose, outcomes and related indicators have been met in accordance with the OECD DAC criteria;
• assess the project’s performance addressing cross-cutting issues including gender equality, disability inclusion, and child and youth participation;
• explore lessons learned and identify the strengths, weaknesses and potential gaps of the intervention;
• Provide specific findings and recommendations to inform organisational learning and dissemination with key stakeholders. These stakeholders include:
• National Level: National Committee for Disaster Management (NCDM)
• Provincial and District Levels: Provincial Committee for Disaster Management (PCDM); District Committee for Disaster Management (DCDM) and District Deputy Governor in charge of disaster.
• Commune Level: Commune Committee for Disaster Management (CCDM), Village Disaster Management Group (VDMG), Youth, School Director, Teachers, School Support Committee (School Management Committee) and Children Councils.

The evaluation methodology will be designed to answer the key evaluation questions set out in the table with the evaluation report outlining the findings of these questions. These findings need to be linked to the evaluation criteria.

OECD DAC Criteria

OECD DAC Criteria	Key evaluation questions
Coherence	HOW WELL DOES THE INTERVENTION FIT? ·     coherence addresses the synergies and interlinkages between the intervention and other interventions carried out by the same institution/government, ·     coherence considers the consistency of the intervention with other actors’ interventions in the same context. This includes complementarity, harmonisation and co-ordination with others, and the extent to which the intervention is adding value while avoiding duplication of effort.
Relevance	To what extent did the project address the main issues identified during the project design (and referenced in the background section above)?   How do project participants perceive the relevance of the project and how have the implemented activities improved their lives? Are there any stories of change?
Efficiency	How efficient was the delivery of the project in both expenditure and implementation of activities? Are there opportunities to improve efficiency?   To what extent were output indicator targets achieved and were these targets appropriate?   In what ways might the project have reached more beneficiaries with the available budget or reduced costs without compromising either beneficiary numbers or quality?   What changes were made to the project design during implementation based on the reality on the ground and how did these changes affect the efficiency of the project?
Effectiveness	To what extent was the project goal and 3 outcomes achieved? What factors influenced the achievement of these?   To what extent were all outcome indicators achieved and were these indicators appropriate?   What unintended outcomes, whether positive or negative, did the project achieve?
Impact	To what extent has the project benefited different marginalised groups including boys, girls, men, women, gender diverse people, children with disabilities and people with disability and minority ethnic groups?   How can the impact of the strengthened commune councils/CCDM be explained in terms of their capacity to prevent and respond to DRR/CCA?   How have children, youth and relevant stakeholders’ behaviours and practices changed?   How has the “Integrated Child/Youth into DRR/CCA” project strengthened sub-national duty bearers in terms of their capacity and influence to take into account disaster risk reduction and climate change adaptation?   What evidence exists of positive change in knowledge, attitude and practice among relevant stakeholders in responding to DRR/CCA issues in the community?
Sustainability	What is the likely sustainability of project achievements benefiting target communities and participants following project completion?   What key factors might support sustainability and replication of the project approach?   What level of ownership and independence did the commune committee for disaster management groups achieve in response to DRR/CCA issues by the end of the project and will this be sufficient for sustained work beyond the life of the project?

4. Scope of Evaluation

1. The project end evaluation must cover the whole project and implementation period from October 2021 to June 2023 lt must be carried out in line with ChildFund Cambodia’s guidelines and policies on Child Protection, ethical standards, and Covid-19 prevention measure. ChildFund Cambodia and local partner will be actively involved in and contributing to the evaluation process including providing support to access project participants and stakeholders, providing feedback on inception reports and final reports;
2. The OCED DAC Criteria should be followed: relevance, coherence, effectiveness, efficiency, impact and sustainability. The consultant will use the result of the baseline and endline for evaluation purpose and measure as the pre-designed the questionnaire for this evaluation. However, there were many variations in the baseline data which requires the consultant to assess pre-project data retrospectively against the last update in logical Framework with end-line data for a complete M&E plan and tracking report;
3. The evaluation needs to explore core components of the project against its objectives, outcome and indicators;
4. The selected consultant will then provide an inception report which will include a work plan specifying in detail the work plan. All the interactions are needed (in procedures and questions) due to the Covid-19 pandemic this must be clearly stated and reflected upon in the evaluation report; and
5. The consultant can start field work unless the inception report and plan has been submitted and approved by ChildFund Cambodia.

The consultant responsibilities will be to: 

• Develop and prepare the end project evaluation schedule/plan by consulting with ChildFund Cambodia field team, ChildFund provincial manager and LWD team at Kampong Trabaek disctrict, Prey veng province;
• Review relevant secondary data and available documents associated with the project proposal, project variations, project report (quarterly, semester and annually) including the baseline survey report and other relevant materials;
• Develop data collection tools including questionnaires, interview guides with structured questions, FGD guiding questions, and observation checklists that are in line with the project Logical Framework indicators;
• Submit the developed tools to ChildFund Cambodia and LWD for review and comments;
• Data collections tools will be prepared, piloted and tested before data collection;
• Collect data for endline M&E plan and retrospectively for new indicator variation against baseline data against update of logical framework indicators;
• Clearly show data presentation analysis and interpretation approaches of the evaluation. Provide outcome indicators matrix key linking tool questions to LF indicators;
• Consultant presents findings to LWD and ChildFund Cambodia team for discussion and feedback (1^st week of June 2023);
• The end project evaluation final report will be produced in English with baseline and end-line report figures from the data collection, all data both soft and hard copies included noted, records, photos, case study, and attendance list which can be used as an endorsement for the work done by ChildFund Cambodia; and
• Cover all field costs from the consultancy fee.

5. Methodology

The consultant should use both qualitative and quantitative methodologies for the evaluation. As one methodology, the consultant should follow the pre-designed questionnaire used during the baseline as well as any additional question will added. All data collected through the assessment must be disaggregated by ability, age and sex. Key definitions of CWD, children and youth including terminologies will be provided by ChildFund for consultant to follow.

The methodologies proposed needs to be participatory, capturing the views and opinions of stakeholders including the child and youth engagement in Commune Committee for Disaster Management (CCDM), Village Disaster Management Group (VDMG), Youth, School Director, Teachers, School Support Committee (School Management Committee) and Children Councils as well as Provincial Committee for Disaster Management (PCDM); District Committee for Disaster Management (DCDM) and District Deputy Governor in charge of disaster and National Committee for Disaster Management (NCDM)

The evaluation should provide evidence, including successful case stories, quotations, and high-quality photos, about the effectiveness that was contributed to or produced by the project. Follow Annex guidelines on case studies, baseline and mid-term evaluation questions, as well as new design to align with the outcomes of the projects.

The first output of the external consultant will be an inception report, which includes a thorough desk review and fieldwork plan (tools, sample and schedule). Only after the approval of the inception report, the fieldwork can begin.

6. Deliverables and Indicative Timetable

The consultant will provide as follows:

• 01 x inception report, which includes: the results of the desktop study; the fieldwork plan; and sampling techniques and tools. Only after the approval of the inception report can the fieldwork can begin. To be submitted by [15 May 2023];
• 01 x draft end project evaluation report submit to ChildFund and partner before presentation on preliminary findings;
• 01 x preliminary findings to ChildFund, partners, and key stakeholders. To be submitted by [First week of June 2023];
• 01 x final report which documents the good practices and lessons learnt; differentiating findings and recommendations which all data will reflect and measure against the project objectives, set indicators, and baseline result. The report should pull together the key findings from the project, analyses them, successful case stories, and photos (about ChildFund Cambodia programmer objectives and make programmatic conclusions and recommendations. To be submitted by [Second week of June 2023];​ and
• All data (raw, note-taking, and records) including interview outlines, list of people interviewed, successful stories, note, photo, consents form …etc. To be submitted by [second week of June 2023].

The evaluation process is estimated to take 21 working days from early May – 2^nd week of June 2023 including preparation, fieldwork assessment, analysis, and the report should be finalized by end of End of 2^nd week of June 2023.

Indicative dates	Outputs and Activities	Number of Days
2nd Week of May, 23	·       Develop inception report indicating the detail of baseline assessment plan, desk review, data analysis, and report	3 days
2nd Week of May,23	·       Conduct tools development orientation and field testing – (consultant pilots primary data collection tools)	3 days
3rd Week of May,23	·       Field data collection, coding, analysis, and presentation finding to ChildFund Cambodia	8 days
1st Week of June,23	·       Draft evaluation report	4 days
1st Week of June, 23	·       Present the preliminary findings to ChildFund, partner, and key stakeholders.	1 day
2nd Week of June,23	·       Final evaluation report	2 days
Total number of days		21 days

7. MANAGEMENT AND REPORTING ARRANGEMENTS

Support Team from ChildFund Cambodia and partner as follows:

No	Name	Position	Responsibilities
1	Mr. In Davy	Field Coordinator	To work with a partner (LWD) to coordination at field level
2	Mrs. Keo Socheat	SEL Specialist of ChildFund Cambodia	Technical support and contact person at the national level
3	Ms. Leng Putheavy	Admin Officer of ChildFund Cambodia	Logistic in PP
4	Mr. Nov Samnang	OiC-Provincial Manager of ChildFund Cambodia, PV	Overall Coordination at the provincial level
5	Mr. Phoung Phasith	Area Program Coordinator of LWD	Overall Coordination at the field
6	Mrs. Heng Veasna	LWD-Head of Program	Technical review and support
7	Mr. Matthew Brodie	SEL Technical Advisor of ChildFund Australia	Technical review
8	Mr. Michael MacDonal	DRM Technical Advisor of ChildFund Australia	Technical review
9	Mr. Chhun Sona	MEL Manager of ChildFund Cambodia	Take lead, M&E technical review
10	Mrs. Chhom Chakriya	MEL Coordinator of ChildFund Cambodia	Support review and check
11	Mr. Chan Narin	Head of Programs of ChildFund Cambodia	Quality assurance and endorsement
12	Mr. Prashant Verma	Country Director of ChildFund Cambodia	Oversight

The Consultant will report to Mr. Chhun Sona, MEL Manager of ChildFund Cambodia and Mr. Chan Narin, Head of Program of ChildFund Cambodia.   All reports must be written in English and provided in an electronic format (Microsoft Word).

• The inception report starts with a thorough desk review and analysis of the documentation provided. Based on the analysis, the inception report shall include the evaluation framework and plan, including suggested methodologies both to collect and analyse data for each key evaluation question and outlines for the evaluation timeline and activity plan. The consultant can only embark on fieldwork, once the inception report has been reviewed and approved by ChildFund Cambodia;
• The consultant is responsible for surveying objectively. However, LWD and ChildFund Cambodia will be actively involved in and contributing to the process. Monitoring, Evaluation and Learning Framework (MEL) in the ChildFund Australia’s Program Handbook and baseline will be followed as much as possible; and emphasis will be on learning, participation and accountability; and
• The consultant will present the preliminary findings to ChildFund Cambodia and conduct one day of validation workshop with key project stakeholders included key implementing partner (LWD) at Prey Veng province. The final survey report will be reviewed LWD and ChildFund Australia and approved by ChildFund Cambodia after all comments are addressed and agreed upon among stakeholders.

8. Confidentiality

All discussions and documents relating to this ToR will be treated as confidential by the parties.

9. Child Safeguarding

The Consultant will undertake the Services to a high standard; use its best endeavours to promote the best interests of ChildFund; protect the reputation of ChildFund and work in a manner consistent with the mission, vision and policies of ChildFund (see Child Safeguarding Policy/Child Safeguarding Code of Conduct PSEAH policy and Employee Code of Conduct). ChildFund Australia has a zero-tolerance policy to abuse, exploitation and harassment in all its forms.

10. Counter-Terrorism and Anti-Money Laundering

ChildFund Australia acknowledges its obligation under the Australian laws relating to counter-terrorism and anti-money laundering.  To meet its obligation, the consultant is obligated to provide the information required for ChildFund to undertake counter-terrorism screening before engagement.  The consultant’s name, date & place of birth and ID number will be checked against the Department of Foreign Affairs and Trade (DFAT) consolidated list, National Security Australia list, World Banks listing and the Asian Development bank listing to ensure not engage with entities or individuals appearing on the lists.

11. Conflict of Interest

The Consultant must declare any financial, personal, family (or close intimate relationship) interest in matters of official business which may impact the work of ChildFund Cambodia and KHEN.

12. Fraud and Corruption prevention and awareness

ChildFund Australia has a zero approach to fraud and corruption act. The successful consultant will be required to comply with ChildFund Australia’s fraud and corruption prevention and awareness Policy and act against any form of fraud or corruption and not offer, promise, give or accept any bribes.

13. Insurance

The successful applicant will be required to have in place insurance arrangements appropriate to the provision of the requirement in this TOR including (without limitation) travel insurance.

14. Acknowledgment and Disclaimer

ChildFund, its Board and staff make no express or implied representation or warranty as to the currency, reliability or completeness of the information contained in this ToR.  Nothing in this ToR should be construed to give rise to any contractual obligations or rights, expressed or implied, by the issue of this ToR or the submission of Expression of Interest in response to it.  No contract would be created until a formal written contract is executed between ChildFund and a selected consultant.

——————————————–

Selection Criteria for Consultant

• A minimum of a post-graduate degree in Humanitarian Development with sound knowledge of the Social Emotional learning Skill as well as Gender Equality, Disability and Social Inclusion- GEDSI, DRR, Climate Change Adaptation- CCA, Primary Education and Cambodia’s context;
• Excellent understanding and experience of community- based DRR/CCA, Education concept, youth/children development, and gender, especially for rural and underserved areas in Kampong Trabaek district, Prey Veng Province;
• High-quality presentation and reporting skills;
• Proven experience in conducting quality base/end-line, evaluations and assessing development programmes/ projects from a gender equality and DRR/ CCA;
• Thorough knowledge and experience of DRR/ CCA and Education programming in Cambodia preferred;
• Experience in conducting both quantitative and qualitative research;
• High level of fluency in spoken and written English essential; local language skills desirable but not compulsory;
• Cover letter and CV (maximum 3 pages; with references) of each person who would be involved in this end project evaluation;
• Company profile(s) and documentation of legal status, and registration as a Company.
• Technical proposal (maximum 6 pages) including the end evaluation questions, methodologies and proposed schedule;
• Experiencing on fields works and practical way of working with rural communities’ context where many issues are still their struggling, including education DRR/CCA barriers; and
• Financial Proposal:The financial proposal should provide cost estimates for services rendered including daily consultancy fees (detail of number of working day). The consultant has to cover all field related costs (i.e: accommodation, materials, per diem and transportation to the field to collect data, food and other related costs).

Interested applicants should submit their CV, proposal, and other relevant support documents to ChildFund Cambodia, Office Address: House #30, Street 228, Sangkat Chatomuk, Khan Daun Penh, Phnom Penh, Cambodia or via email at careers@childfund.org.khcareers@childfund.org.kh, no later than 5.00 pm (local time) on  10^th May 2023. Only short-listed applicants will be contacted.

All employees and consultants are required to abide by Child Fund’s Child Protection Policy and Code of Conduct.

Moreinfo:https://www.childfund.org.kh/opportunity/job-announcement

Please mention "www.Cambodiajobs.Biz" where you saw the ad when you apply!