The first day activities were related to build the understanding level of the impact evaluation of the interventions in terms of address the social issues and risk mitigation for future interventions. The second-day activities were related to understand the challenges and mitigate the risk while working with agencies for impact evaluation studies and ensure the quality control checks already in place. The third-day activities were related to know the importance of data quality checks and how it will be supportive to get validated impact evaluation results. The fourth-day activities were related to the importance of privacy and confidentiality of respondent data and issues related to big data management. The fifth-day activities were related to understand the relationship between impact evaluation and progress monitoring using geospatial data.
Key learning points:
- Strategic planning and timelines play a significant role to manage successful impact evaluation
- Around 4-6 months required to get a validated questionnaire for baseline and endline of an intervention
- SurveySolutions software designed by World Bank for survey data collection and freely available for public
- Evaluate the survey firms and data collectors before final selection as it is a key component for impact evaluation studies
- Regardless of field challenges, it is important to document the field insights as an evidence to measure the successful impact evaluation in a transparent way
- Organize the data analysis codes and implementation protocols to help teams for future interventions
- Field coordinators provide extensive support to communicate effectively with regulators/policymakers to ensure the positive impact of interventions
- Regular effective communication with the field supervisors and high-frequency checks is the key component to manage the successful impact evaluation
- Regulators/policymakers can be influenced by direct and indirect impact evaluation results if four principles considered, i.e. building the relationship, share ownership, good timing and clear communication
- Qualitative research helps to find new directions and strategy to create impactful results
- Impact evaluation depends on the information that will be collected from respondents. It will be good if the community participants ready to give consent in order to get in-depth information about the intervention
- Statistical software can be supportive to analyzed the program data and design the impact evaluation tools
- Develop a continuous M&E system for the project to ensure the impactful results
- Project monitoring indicators generate data which provide extensive support to evaluate the program
- Use online sources of data collection to track the progress for impact evaluation
- Graphical presentation of data will help policymakers and strategist to better understand the impact
Resources:
World Bank work on Impact Evaluation
World Bank Experts for Impact Evaluation
Impact Evaluation Training material for enumerators
Impact Evaluation Data Management Tools and Techniques
Data quality monitoring for impact evaluation
Theory of Change for Impact Evaluation
World Bank FREE online software for data collection
18BL-2
