4. Criteria of Evaluation
- Relevance: Degree to which the intervention responds to the needs, priorities, and context of the target population and stakeholders.
- Coherence: The extent to which the intervention is compatible and aligned with other interventions, policies, strategies, and needs, and how well it complements or avoids duplication with other actors’ efforts.
- Effectiveness: The extent to which the intervention has achieved, or is expected to achieve, its objectives and results, including differentiated results among groups.
- Efficiency: The extent to which the intervention delivers, or is likely to deliver, results in an economic and timely manner.
- Sustainability: Likelihood that the benefits of the intervention will continue after external support has ended.
Also, it will be important to consider a separate section for cross-cutting issues as the extent to which the intervention integrated and addressed key themes such as gender equality, human rights, environmental sustainability, and inclusion of vulnerable groups.
5. Questions of Evaluation
Below is a list of questions derived from the previously mentioned objectives and criteria. This list is not exhaustive and may be adjusted during the inception phase in discussion with the evaluator and based on the scope of the evaluation and the available resources and duration. A finalized version will be included in the inception report.
The inception report must include an evaluation matrix in which the evaluator specifies sub-questions, measurement indicators, sources of verification, and data collection and analysis methods aligned with the project performance rating matrix.
Criteria Evaluation questions RelevanceWere the intervention’s objectives and design appropriate to the country context, responsive to identified socioeconomic integration and aligned with national priorities? CoherenceTo what extent were there operational overlaps or duplications (if any) across actors and initiatives? What were the drivers (mandates, geography, targeting, timing), and what corrective options exist? EffectivenessTo what extent has the project achieved the proposed results, what factors and main challenges supported or hindered achievement, and how were those challenges addressed?Were the risks and contingencies faced by the project monitored and managed appropriately and in a timely manner, including those related to the institutional stability of the country?How effective were civil society engagement modalities (partnerships, referrals, outreach, co-delivery) in achieving intended results, and what enablers/barriers shaped IOM’s performance and participation? EfficiencyHow efficiently were the resources used to achieve the intended results in line with the implementation context?To what extent did coordination arrangements and/or overlaps with other initiatives affect efficiency and value for money, and what practical measures could have improved efficiency through coordination or sequencing? ImpactIs there systematic evidence of changes in the perception of socioeconomic integration among the Venezuelan migrant population, to which the project has contributed at the national and local levels?Has a positive change in behaviors and habits been objectively observed among populations that received MHPSS (Mental Health and Psychosocial Support) assistance?Did the project generate unintended results related to the perception of socioeconomic integration among Venezuelan migrants with the host community, or regarding IOM’s relationship with its counterparts?To what extent did labour market inclusion interventions contribute to improved employment status, income generation, and employment retention among beneficiaries?To what extent has the project contributed to reducing socioeconomic vulnerabilities among refugees, migrants, and host community members? SustainabilityTo what extent have local institutions adopted, replicated or institutionalized project approaches?What financial or operational mechanisms exist to continue services after project closure? Cross-cutting issuesTo what extent were rights-based, protection-sensitive, Do No Harm, gender equality, age considerations, and the specific needs of women, men, boys, girls, and marginalized groups effectively addressed and integrated into the interventions?
6. Methodology and methods
This final evaluation will use a non-experimental design and mixed-method approach including both qualitative and quantitative data. The evaluator is expected to propose an approach and data collection and analysis methods that enable credible, valid, and reliable answers to the evaluation questions, generate practical recommendations, and identify lessons and potential good practices from the project’s design, implementation, and monitoring processes—all while considering the cross-cutting issues mentioned above. Basic parameters for methodological proposal:
- Data collection methods must be carefully selected to produce reasonable empirical evidence in support of the evaluation criteria, questions, and objectives.
- Data triangulation will be used to ensure credibility and validity of findings. Conclusions and recommendations will be validated at key stages of the evaluation process with stakeholders—without compromising the evaluator’s independence.
- The proposed methodology must outline a mixed-method approach for data collection and analysis, clearly describing how different sources of evidence will be used to triangulate information and assess how the observed results can realistically be attributed to the project while taking into account other factors that might also have influenced those results.
Data Collection Methods may Include (but are not limited to):
- Document review to gain an understanding of the context, as well as the documents that support the planning, implementation, and results of the intervention.
- Semi-structured interviews and focus groups with stakeholders, partners, and beneficiaries.
- Surveys with beneficiaries and stakeholders.
- Secondary data analysis using project monitoring data for outcome indicators
MethodPossible SourcesDocumentReviewProject documents, interim and final reportsToRs for consultancyGovernment correspondenceNarrative reports from suppliers, socio implementing partners and consultantsMeans of verification de las activities del project (e.g., Training/activity/events reports elaborated by suppliers and socio implementing partners and its participats’ lists) Semi-Structured interview Key representatives from the DonorIOM project managerIOM team membersFocal points of Government counterparts Implementing partnersFocus GroupTeachers from educational institutions where the project was implemented (1 FGD in each region/in person)Migrants and host community members participated in project activities (1 FGDs per output 1, 2 and 4 and per region/ in person)SurveyOnline and/or phone-based surveys targeting beneficiaries.A stratified sample will be used, considering the regions of Lima and Callao, Tumbes, and Tacna and per output. Additionally, the sample design will consider a 95% confidence level and a 0.05 margin of error.Sample distribution: Total sample size : 354Lima: 200 Tumbes: 100 Tacna: 54 The modules to be considered in the instrument must be aligned with the outcome indicators:Perception of socioeconomic integration among migrants and refugees (applied to the full sample, including 10% of beneficiaries receiving MHPSS services)Effective labor market inclusion (applied to 30% of the sample, based on service received)Income improvements from business training/seed capital [6](applied to 30% of the sample)Legal guardians of children/adolescents demonstrating awareness of school enrollment procedures (applied to 30% of the sample)
The evaluation team is encouraged to use innovative approaches for data collection and analysis. Proposals must clearly define the specific role of each methodological approach in answering the evaluation questions.
7. Limitations
In line with the OECD-DAC evaluation criteria, this final evaluation seeks to assess the extent to which the project contributed to the intended higher-level results, including improvements in livelihoods, economic integration, social cohesion, and other relevant changes among beneficiaries and stakeholders. As such, the evaluation includes an analysis of the project's impact dimension.
However, it is important to note that this evaluation given its scope and budget is not designed as a formal impact evaluation. Consequently, findings related to impact should be interpreted with caution and understood primarily as evidence of contribution rather than proof of causality. The project's achievements and potential impacts will be assessed by triangulating information from multiple sources, including primary data collection with beneficiaries and stakeholders, project monitoring data, administrative records, and other secondary sources. This mixed-evidence approach will allow the evaluation to identify perceived and documented changes associated with the intervention and assess the extent to which project outcomes have contributed to broader development objectives. The findings should therefore be interpreted as an assessment of outcomes’ contributions, rather than a rigorous impact evaluation in the methodological sense.
8. Ethics, Norms and Evaluation Standards
Both in its design, execution, and dissemination of results, the evaluation must clearly integrate the rights-based, gender, and disability approaches in accordance with the UNEG and IOM guidelines. It is expected that methodology, methods, tools, and data analysis techniques be gender sensitive. Additionally, the findings, conclusions, and recommendations should reflect an analysis from a gender perspective.
9. Deliverables
The following are the expected products and deliverables resulting from the evaluation process. All documents must meet publishable quality standards, including linguistic, structural, and semantic aspects.
10. Specification and Roles
A Reference Group for the Evaluation (GRE) will be established to promote ownership and use of the evaluation findings. This group:
- Will be composed of the project manager, the Regional M&E Officer, a representative of the Fund, the Regional Thematic Specialist, and the coordinator of the thematic area in the country office.
- Will review the inception and final reports and provide written comments through the evaluation manager.
- Will participate in the presentation of preliminary findings, validation of recommendations, and the final presentation of results by the evaluator.
- Will provide information and guidance during the inception phase useful for defining the final design of the evaluation and identifying key data sources.
Donor: The Korea International Cooperation Agency (KOICA) will review the final draft report and the Evaluation Brief submitted by the evaluator to provide feedback and formally validate the deliverables.
11. Work Plan
Below is a summary of the main milestones:
Project phaseActivityResponsible PartyDuration (Days)ScheduleImplementation phase(Aug)Definition of the Evaluation Reference GroupEvaluation Manager1.00Week 1Kick-off meetingEvaluation Manager / Project Manager / RPMEO / Evaluator1.00Week 1Review of project documentsEvaluator5.00Week 1Design of data collection instrumentsEvaluator2.00Week 2Validation of data collection instrumentsEvaluation Manager3.00Week 2Preparation of inception report draftEvaluator2.00Week 2Review of inception reportEvaluation Manager / RPMEO3.00Week 3Finalization and presentation of the inception reportEvaluator2.00Week 3Closure phase(Set-Oct)Preparation and review of interview/focus group participant listsEvaluation Manager / Project Manager2.00Week 3Data/information collectionEvaluator20.00Week 4,5,6Processing of collected data/informationEvaluator4.00Week 7Analysis of qualitative dataEvaluator4.00Week 7, 8Pesentation of preliminary findingsEvaluator1.00Week 8Drafting of evaluation reportEvaluator5.00Week 8Review and feedback on draft evaluation reportEvaluation Reference Group /RPMEO3.00Week 9Production of final version of the evaluation reportEvaluator10.00Week 9,10Review and feedback on final evaluation reportEvaluation Reference Group /RPMEO5.00Week 10, 11Presentation of summary findings and conclusionsEvaluator1.00Week 11Preparation of Evaluation Information SheetEvaluator2.00Week 11Review and validation of Evaluation Info SheetEvaluator2.00Week 12Final version of Evaluation Info SheetEvaluation Reference Group /RPMEO3.00Week 12Closing meetingEvaluation Manager1.00Week 12
12. Budget
A maximum budget of USD 15,000.00 (fifteen thousand and 00/100 US dollars) is available, which will allow for the hiring of an external evaluator or a specialized provider for conducting evaluations. The evaluator or the provider offering the evaluation service must take into account all costs necessary to carry out a high-quality evaluation and ensure the quality of the deliverables in the financial proposal they submit.
International consultant
PAYMENT DATEAMOUNT BUDGET ALLOCATION WBLDEADLINEPayment 1: Within 10 days after submission of the inception report$2,250 (Two thousand two hundred fifty dollars and 00/100)IS0137 / Task X:1:2:00110 days after the start of the consulting service.Payment 2: Within 10 days after submission of the drafting of evaluation report$4,500 (four thousand five hundred and 00/100 soles)IS0137 / Task X:1:2:001 40 days after the start of the consulting service. Payment 3: Within 10 days after submission of the final evaluation report and information sheet.$8,250 (eight thousand two hundred fifty and 00/100 soles)IS0137 / Task X:1:2:001 82 days after the start of the consulting service.
National consultant
PAYMENT DATEAMOUNT BUDGET ALLOCATION WBLDEADLINEPayment 1: Within 10 days after submission of the inception reportS/8,190[16] (two thousand two hundred fifty 00/100 dollars)IS0137 / Task X:1:2:00110 days after the start of the consulting service.Payment 2: Within 10 days after submission of the drafting of evaluation reportS/16,380 [17] (sixteen thousand three hundred eighty and 00/100 soles)IS0137 / Task X:1:2:001 40 days after the start of the consulting service. Payment 3: Within 10 days after submission of the final evaluation report and information sheet.S/27,300 [18](twenty-seven thousand three hundred and 00/100 soles)IS0137 / Task X:1:2:001 82 days after the start of the consulting service.
[1] See OECD (2020) Mejores criterios para una mejor evaluación y OECD (2021) Applying Evaluation Criteria Thoughtfully. [2] Office of the Inspector General/OIM (2018), IOM Evaluation Policy.[3] Directrices de la OIM relativas al seguimiento y evaluación (2022) Capítulo 5[4]See OECD (2020) Mejores criterios para una mejor evaluación y OECD (2021) Applying Evaluation Criteria Thoughtfully. [5] While this evaluation includes an assessment of the OECD DAC impact criterion, it is not an impact evaluation per se and does not seek to establish causal attribution through a counterfactual design.[6] the survey methodology should include clearer parameters for assessing changes in employment status, employment retention, income generation, businesses continuity, and household economic stability.[7] UNEG (2016) Norms and Standards for Evaluation[8] HLCM (2018) UN Principles on Personal Data Protection Privacy[9] UNEG (2020) Ethical Guidelines for Evaluation[10] UNEG (2008) Code of Conduct for Evaluation in the UN system[11] Can download it in the web of UNEG: http://www.unevaluation.org/document/detail/2866[12] https://www.iom.int/data-protection[13] IOM (2015) IOM Data Protection Manual[14] IOM (2022) Guidance on Quality Management of IOM Evaluations. Quality Control Tool – Inception reports[15] IOM (2022) Guidance on Quality Management of IOM Evaluations. Quality Control Tool – Evaluation reports[16] This amount may vary depending on monthly exchange rates.[17] This amount may vary depending on monthly exchange rates.[18] This amount may vary depending on monthly exchange rates.
13. Evaluator Requirements
14. Proposal Submission
Proposals must consider the following:
- Submission of a CV aligned with the requirements specified in this call.
- Inclusion of supporting documents that demonstrate compliance with the requirements outlined in these terms of reference.
- Inclusion of technical proposal that must include:
- The applicant must declare any existing or potential conflict of interest in undertaking this evaluation assignment.
- Deadline for proposal submission: TBC
Additionally, the criteria for evaluating the proposals will be applied as follows:
DESCRIPCIÓNPUNTAJETechnical ProposalMáx. 24 points. (Weight x Score)Weight Each criterion will be evaluated based on the following scale:No cumple = 0 pts.Cumple parcialmente = 1 pts.Cumple totalmente = 2 pts.Supera = 3 pts.The technical proposal and timeline include all activities and are coherently developed according to the objective.2 The provider has at least 5 years of relevant experience and provides supporting evidence.2 The provider has experience in at least two previous assignments similar to those required in these terms of reference.2 The provider has professionals that meet the required profile and attaches the CVs of the team members who will carry out the service, indicating each member's role.1 The financial proposal is itemized, allowing for an evaluation of financial resource usage.1 ii. Financial Proposal Máx. 8 points. The evaluation is conducted using the following formula, assigning the maximum score to the lowest-priced offer and calculating the scores of the other offers as follows:Donde:i = OfferPi = Score of the evaluated offerOi = Socre of Offer iOm = Score of the lowestPMP = Maximum score of itTotal ScoreTotal : The final score is calculated with the following formula:Donde:PO = Score Obtained: sum of (I) + (II)PMP = Maximum Possible ScorePF = Final Score (in percentage)Total Máx. 100 puntos
[1] Can download it in the web of UNEG: http://www.unevaluation.org/document/detail/2866
Required Competencies
Notes
IOM covers Consultants against occupational accidents and illnesses under the Compensation Plan (CP), free of charge, for the duration of the consultancy. IOM does not provide evacuation or medical insurance for reasons related to non-occupational accidents and illnesses. Consultants are responsible for their own medical insurance for non-occupational accident or illness and will be required to provide written proof of such coverage before commencing work.
Any offer made to the candidate in relation to this vacancy notice is subject to funding confirmation.
Appointment will be subject to certification that the candidate is medically fit for appointment, accreditation, any residency or visa requirements, security clearances.
IOM has a zero-tolerance policy on conduct that is incompatible with the aims and objectives of the United Nations and IOM, including sexual exploitation and abuse, sexual harassment, abuse of authority and discrimination based on gender, nationality, age, race, sexual orientation, religious or ethnic background or disabilities.
IOM does not charge a fee at any stage of its recruitment process (application, interview, processing, training or other fee). IOM does not request any information related to bank accounts.
No late applications will be accepted. Only shortlisted candidates will be contacted.
