Foreign assistance has been evolving and improving as the demand for evidence-based decisions has increased. By focusing on rigorous evaluation of their programs, donors are ensuring that their investments achieve their objectives and produce results in a cost effective way.
Rigorous evaluation of aid effectiveness has become a core priority to development agencies and partners. Evidence-based policies and programs build local ownership, focus long-term objectives, and ensure activities meet their goals cost effectively.
Data-driven Development Decisions
Like our clients, we envision an equitable world driven by engaged and educated citizens, mobilized communities, informed policies. Through practical, data-driven solutions, our work is affecting millions of people across the globe.
IMPAQ’s capabilities in evaluation design and implementation, combined with our significant experience and expertise in client capacity building, make us an ideal partner to help our clients adapt an evidence-based decision-making approach to managing their global development portfolios.
We collaborate with development agencies, non-government organizations, foundations, and the private sector, providing program measurement, design, and implementation services. Our clients receive the tools, resources and information they need to reduce poverty, improve health outcomes, and create sustainable change.
Below are a few recent projects which highlight how IMPAQ is helping create a more equitable world:
Impact and Performance Evaluations
IMPAQ is a leading innovator in conducting random assignment and quasi-experimental design evaluation studies. Our studies have been used to evaluate and improve development programs in dozens of countries, ranging from global health and education to job training or transportation infrastructure.
In Senegal, for example, IMPAQ evaluated the performance, management and implementation of a large-scale, $15.7 million education initiative which served approximately 264 schools and 100,000 middle-school students in six regions. Our performance evaluation considered issues as diverse as gender and community mobilization, as well as the success of the student remediation classes.
In Bosnia and Herzegovina, IMPAQ conducted an impact evaluation of the a IMPAQ recently completed an impact evaluation of the $22.2 million Fostering Agricultural Market Activity (FARMA). Through joint funding, USAID and the Swedish International Development Cooperation Agency designed the FARMA program to increase Bosnia’s agricultural competitiveness, meet EU accession standards, and reduce poverty. The evaluation included key informant interviews with 187 FARMA beneficiaries including government employees, ministries and agencies. We used a stratified random sampling approach to select key informants for the semi-structured interviews. IMPAQ also conducted a desk review of Work Plans, periodic reporting, including activity level M&E Plans.
IMPAQ conducted a performance evaluation of USAID’s Education Priorité Qualité (EPQ) program. EPQ’s objective was to assist Senegal in decentralizing and strengthening its teacher preparation process; improving school governance and management; strengthening students’ basic skills in French and math; and providing life skills and employability opportunities to middle school-aged youth in six regions of Senegal. IMPAQ is assessing the project’s achievements, focusing specifically on project management, implementation, and sustainability. Gender and community mobilization are also key elements of IMPAQ’s evaluation criteria, as well as evaluating the success of the student remediation classes.
Under the US Department of Labor/ILAB, IMPAQ is implementing one of the most rigorous research and evaluation programs to understand child labor around the world. Our experts are conducting randomized control trials (RCT) evaluations of child labor interventions in Costa Rica, Ecuador, India, Malawi, and Rwanda. In Malawi, for example, IMPAQ is comparing villages where programs are provided with similar villages where programs are not provided. The initial survey of the 3,516 children in our treatment and control groups allows us to estimate the impact of the intervention on outcomes of interest related to child labor.
Performance Monitoring and Management
IMPAQ builds close relationships with the organizations we support, to better assess and address their specific needs. Our expertise in technology and database systems helps clients like USAID capture, track and monitor outputs of their activities. We can help you think about data in a broader context, to use data for effective policy decisions and program implementation.
For example, we are creating a comprehensive toolkit with documentation and guidance for the U.S. Department Of Labor, Bureau of International Labor Affairs’ Direct Beneficiary Monitoring System (DBMS). Our work is helping ensure that child labor elimination projects capture information in a systematic and usable way.
IMPAQ built a public-facing website so participants of ILAB’s Tarladan Okula (From Field to School) program could register themselves through the Participant Tracking System (PTS). IMPAQ designed the website and database to be available in English and Turkish. The Turkish-language PTS identified over 8,000 working and at-risk children. This management information system also monitored the status of the children through their participation in program interventions, collecting and managing data that was then entrusted to Turkey’s Ministry of National Education for long-term sustainability and information sharing.
As a leader in innovative research methodologies, IMPAQ trains and builds capacity of local institutions to conduct large scale research and evaluation studies. We are also helping governments build capacity to collect data systematically, so agencies are better able to share trends and data points across divisions, regions, or activities.
In support of USAID’s Monitoring and Evaluation Capacities (MECAP) program, we are helping USAID plan and implement high-quality monitoring and evaluation projects, as prioritized by agency policies and directives and field office needs. These enhancements will improve USAID programs and international development outcomes.
In Bosnia and Herzegovina, IMPAQ is providing training for USAID Mission staff and implementing partners. IMPAQ is developing and implementing monitoring and training plans for implementing based on M&E needs to ensure long term sustainability. For USAID Mission staff, IMPAQ’s training includes topics like performance management, logical framework, planning evaluations and designing and testing survey instruments. IMPAQ conducted an in-depth training needs assessment based on multiple surveys with USAID and partner staff.
EVAL-ME: IMPAQ is helping to shape USAID development programs and policies around the world through the USAID PPL Monitoring and Evaluation (EVAL-ME) IDIQ. Through this contract, IMPAQ will ensure that development data and evaluation research is both transparent and accessible. IMPAQ is supporting the EVALME IDIQ consortium through performance and impact evaluations. IMPAQ is also providing training and assistance to build capacity within local organizations. IMPAQ’s work under the EVAL-ME IDIQ will help bring accessible, consumable data to counterparts at all levels.
Data Collection and Analysis
We can deploy our full range of survey research services to many regions of the world. Our staff are experts in survey methodology, questionnaire design, electronic data capture, multi-mode data collection, and all manner of quantitative and qualitative analysis. We often utilize and train local staff, and bring to our international clients capabilities in mobile device capture, remote focus groups, and local in-depth key informant interviews.
For example, in Vietnam, IMPAQ is helping ensure that the data collected on 600 school principals, 3,600 teachers, and 8,800 students and their parents, meet the rigorous standards required by the World Bank. We are ensuring reliable methodologies are used in survey data collection and are giving the Vietnam Ministry of Education and Training confidence in the data of their Vietnam Escuela Nueva Project.
In Georgia, IMPAQ performed a Data Quality Review (DQR) of the $400 million Millennium Challenge Georgia Fund (MCG) compact to provide recommendations for standardizing data management procedures within MCC Georgia. IMPAQ validated data quality of major surveys across the MCC portfolio including the $15 million Agribusiness Development activity (ADA). The ADA surveys were developed by MCG to support the impact evaluations of the Compact. There were three components to the ADA Beneficiary Survey: the Primary Producer Survey, Value Adders-Value Chain Initiative, and the Farm Service Centers. Beyond data assessment, IMPAQ delivered direct technical assistance to MCG in enhancing the quality and efficacy of their database system.
The Privatization Social Support project assisted the Turkish government with technical experts in a variety of fields, including survey design and development, qualitative impact analysis, and experimental design of evaluation impact.to assess the social impact of privatization. The study incorporated three separate studies, each with its own objective and implementation methodology. IMPAQ helped with quantitative surveys from over 3000 workers across Turkey.
IMPAQ conducted a mid-term review of the progress and performance of the Millennium Development Authority, through the MCA-Ghana Compact. Our team designed and conducted 71 stakeholder interviews to assess the health and success of MiDA’s programs to ensure effective completion of Compact goals. Leveraging local expertise, IMPAQ evaluated the implementation approaches, methodologies, and strategies in sectors like agriculture, transportation, and rural infrastructure.
Research and Assessments
Where impact evaluations look to the past, to understand what elements of a program made a difference, an assessment looks forward, to help organizations understand what is likely or feasible. IMPAQ helps international donor agencies such develop more effective policies and activities to meet their objectives
For example, in Bosnia and Herzegovina, we are conducting a Judicial Efficiency Index to help ensure that the justice system is transparent, credible and responsive to the needs of all people in BiH.
In Jamaica, the IMPAQ team conducted a multivariate analysis of pre-reform data from the 2002 Jamaica Survey of Living Conditions. The results of this analysis laid a foundation of understanding for future studies and surveys of Jamaica’s legislative reforms. In addition to data analysis, IMPAQ advised the lead evaluation team on best practices in monitoring and evaluation procedures for social safety net programming.
IMPAQ International partnered with the Centre for Economic and Financial Research (CEFIR) in Moscow, Russia, and the National Research Institute on Labor and Social Protection (NRILSP) in Bucharest, Romania to contribute to the knowledge base on evaluation methodology regarding public policy programs assessments around the world.
Contact us, or call (443) 259-5500.