Resource mobilization is a critical function for child protection professionals working in Kenya, as it ensures that sufficient resources, financial, human, and material, are available to support interventions that safeguard vulnerable children. Evaluating the community resource mobilization process allows practitioners to determine the effectiveness and efficiency of their efforts, identify areas for improvement, and strengthen partnerships with stakeholders. This chapter provides a detailed guide to developing a robust evaluation plan tailored to child protection contexts, focusing on setting clear objectives, establishing evaluation criteria, and designing an evaluation framework.

6.1 Developing Evaluation Plan

Developing a comprehensive evaluation plan is foundational to assessing the success of resource mobilization initiatives in child protection. In Kenya, where community-based organizations, county governments, and international partners collaborate extensively, a systematic plan helps align evaluation activities with the unique socio-cultural dynamics and resource realities. This section breaks down the process of formulating clear evaluation objectives, setting measurable criteria, and creating a structured framework for conducting the evaluation.

6.1.1 Setting Evaluation Objectives for Resource Mobilization

Evaluation objectives define the specific goals the evaluation seeks to achieve, guiding the entire assessment process. In child protection, clear objectives ensure that evaluations focus on how well resources are mobilized to meet children's needs, support community engagement, and sustain interventions over time.

Purpose of Setting Evaluation Objectives

• Clarify focus areas: Objectives help pinpoint which aspects of resource mobilization need assessment, such as fundraising effectiveness or stakeholder participation.
• Guide data collection: They determine what information is necessary, whether financial records, community feedback, or partnership reports.
• Facilitate stakeholder alignment: Clear objectives ensure all partners, from government agencies to local leaders, understand the evaluation’s intent.
• Enhance accountability: Objectives provide benchmarks against which performance is measured, promoting transparency.
• Support decision-making: They inform strategic adjustments in resource mobilization strategies to better protect children.

Characteristics of Effective Evaluation Objectives

• Specific: Objectives should precisely state what is to be evaluated, such as "assess the adequacy of community contributions."
• Measurable: They must be quantifiable or qualitatively assessable to determine success.
• Achievable: Objectives should be realistic given available resources and timeframes.
• Relevant: They must align with broader child protection goals and community priorities.
• Time-bound: Clear timelines ensure evaluations are conducted promptly to inform decision-making.

Types of Evaluation Objectives in Child Protection Resource Mobilization

• Assess resource adequacy: Determine if resources meet program needs for child safety and welfare.
• Evaluate stakeholder engagement: Measure the involvement and commitment of community members and partners.
• Review transparency and accountability: Examine how resources are managed and reported.
• Identify capacity gaps: Highlight areas where skills or infrastructure limit resource mobilization.
• Determine sustainability prospects: Assess the likelihood that resource mobilization efforts can be maintained long-term.

Methods for Setting Evaluation Objectives

• Consultation with stakeholders: Engage community leaders, child protection committees, and donors to identify priority areas.
• Review of program goals: Align objectives with the strategic plan of the child protection initiative.
• Analysis of past evaluations: Use lessons learned to refine focus areas.
• Consideration of resource constraints: Set objectives that are feasible within budget and time limits.
• Incorporation of legal and policy frameworks: Ensure objectives reflect mandates from bodies like the Children’s Act and county child protection policies.

6.1.2 Establish an Evaluation Criterion for Resource Mobilization

Evaluation criteria are standards or benchmarks used to judge the success of resource mobilization efforts. They provide a structured basis for assessing whether the objectives have been met and help in comparing performance across different interventions or timeframes.

Definition and Purpose of Evaluation Criteria

Evaluation criteria specify the attributes or dimensions against which resource mobilization is assessed. In child protection, these criteria ensure that evaluations are objective, consistent, and focused on outcomes that matter for children’s safety and well-being.

Key Criteria for Resource Mobilization in Child Protection

• Effectiveness: Measures how well resource mobilization achieves intended results, such as funds raised or community participation levels.
• Efficiency: Assesses the cost-effectiveness of mobilization activities relative to resources used.
• Relevance: Examines whether mobilized resources align with the most urgent needs of children and communities.
• Sustainability: Evaluates the capacity to maintain resource flows over time without dependence on external aid.
• Equity: Ensures resources are mobilized and allocated fairly, reaching marginalized and vulnerable children.

Developing Measurable Indicators

• Quantitative indicators: Amount of funds raised, number of active community volunteers, frequency of stakeholder meetings.
• Qualitative indicators: Perceptions of transparency among community members, satisfaction levels of beneficiaries.
• Process indicators: Timeliness of resource mobilization activities, adherence to plans and budgets.
• Outcome indicators: Improvements in child protection services due to increased resources.
• Impact indicators: Long-term changes in child welfare attributed to resource mobilization success.

Using Criteria to Prioritize Evaluation Focus

• Align with strategic priorities: Focus on criteria that support key child protection objectives.
• Consider stakeholder interests: Emphasize criteria that matter most to funders and community members.
• Balance feasibility and importance: Select criteria that can be measured reliably within available resources.
• Adapt to context: Tailor criteria to reflect local socio-economic and cultural realities.
• Review periodically: Update criteria as programs evolve and new challenges emerge.

6.1.3 Develop an Evaluation Process Framework

An evaluation process framework outlines the systematic steps and methods to be followed during the evaluation of resource mobilization. This ensures that evaluations are comprehensive, transparent, and produce actionable findings.

Components of an Evaluation Process Framework

• Planning: Define scope, objectives, criteria, and timelines.
• Data collection: Identify sources, tools, and techniques for gathering information.
• Data analysis: Determine methods for interpreting both qualitative and quantitative data.
• Reporting: Establish formats and channels for sharing findings with stakeholders.
• Utilization: Plan for using evaluation results to improve resource mobilization practices.

Steps in Developing the Framework

1. Engage stakeholders: Include community members, child protection committees, and funders in framework design to ensure relevance.
2. Define evaluation questions: Develop clear questions that the evaluation will answer, such as "How effective is community fundraising?"
3. Select data collection methods: Choose appropriate tools like surveys, interviews, focus group discussions, and document reviews.
4. Develop data analysis plan: Specify how data will be coded, categorized, and interpreted to produce meaningful insights.
5. Set reporting mechanisms: Determine how and when evaluation findings will be communicated to various audiences.
6. Plan for feedback and follow-up: Establish processes for stakeholders to discuss findings and implement recommendations.

Methods of Data Collection for Evaluation

• Surveys and questionnaires: Useful for gathering quantitative data from community members and partners.
• Key informant interviews: Provide in-depth qualitative insights from leaders and resource mobilization coordinators.
• Focus group discussions: Facilitate collective reflection and identification of challenges and successes.
• Document analysis: Review budgets, meeting minutes, and reports for evidence of mobilization activities.
• Observation: Allows assessment of events such as fundraising drives or stakeholder meetings in real-time.

Ensuring Ethical Considerations in Evaluation

• Informed consent: Ensure participants understand the purpose and voluntary nature of their involvement.
• Confidentiality: Protect sensitive information, especially when dealing with vulnerable children and families.
• Cultural sensitivity: Respect local customs and norms during data collection and reporting.
• Transparency: Share evaluation objectives and findings openly with stakeholders.
• Avoid harm: Ensure that evaluation activities do not disrupt ongoing child protection services or stigmatize participants.

Chapter Summary

This chapter focused on the evaluation of the community resource mobilization process, starting with the development of an evaluation plan. It emphasized setting clear evaluation objectives that align with the goals of resource mobilization, followed by establishing appropriate evaluation criteria to measure effectiveness and impact. The chapter then explored the creation of a structured evaluation process framework to guide systematic assessment, including the use of written tests as one of the evaluation tools. Attention was given to the development of various evaluation tools designed to gather relevant data and insights. The administration of these tools was discussed, highlighting the importance of creating effective instruments that accurately capture the necessary information. Finally, the chapter examined the structure of an evaluation report, detailing how findings should be presented clearly and comprehensively to inform decision-making and improve future resource mobilization efforts.