Increasingly, development funding is directed to programmes aiming to make market systems more favourable for smallholders and low-income consumers of food. The development outcomes of these programmes are not self-evident. Programmes operate in dynamic markets full of uncertainties and surprises and depend on many other factors not under their control.
Watch the launch event
Assessing whether a programme indeed contributed to development outcomes is challenging. Building on real-world experiences with theory-based evaluation in inclusive business programmes, this IDS Bulletin discusses approaches and methods for meaningful impact evaluation. It examines how these evaluations provided information that made programmes accountable to the donors while also helping the implementing agencies to learn and adapt their programmes.
In this IDS Bulletin, the authors discuss the experiences of practitioners and academics in finding doable and creative ways to conduct impact evaluations of inclusive business programmes in the domain of food and agriculture. Inclusive business programmes that work in the area of food and agriculture aim to change current business practices of small and medium enterprises in a way that these include smallholders as producers or target poor consumers as consumers.
The examples show a convergence in methodological approaches, with ‘What works for whom under what conditions’ as the key learning question. All use a combination of methods that complement and build upon each other. However, smart data collection and sharp analysis and synthesis alone are not enough. The evaluation process and outputs also need to be informative for the stakeholders involved. More interaction and sense-making between implementers and evaluators are needed.
All experiences presented in this IDS Bulletin acknowledge that it is not easy to find ways to make learning useful for evaluation commissioners and implementing agencies. Under the right conditions, the presented approaches and tools might work and accelerate the learning loops for adaptive management. Crucially, three conditions appear as necessary for a good theory-based evaluation:
- having interested ‘listeners’ as the audience of the evaluation;
- applying rigour in anticipating and addressing validity threats to the conclusions;
- sufficient resources for an appropriate mix of methods.
Table of contents
Introduction: Contribution, Causality, Context, and Contingency when Evaluating Inclusive Business Programmes
Giel Ton and Sietze Vellema
Systems, Sapiens, and Systemic Change in Markets: The Adopt-Adapt-Expand-Respond Framework
Ben Taylor and Jake Lomax
Using Theory-Based Evaluation to Evaluate Systemic Change in a Market Systems Programme in Nepal
Edward Hedley and Gordon Freer
Assessing the Contribution to Market System Change of the Private Enterprise Programme Ethiopia
Giel Ton, Ben Taylor and Andrew Koleros
The Search for Real-Time Impact Monitoring for Private Sector Support Programmes
Fédes van Rijn, Haki Pamuk, Just Dengerink and Giel Ton
Monitoring Systemic Change in Inclusive Agribusiness
Sietze Vellema, Greetje Schouten and Marijn Faling
Assessing Contributions Collaboratively: Using Process Tracing to Capture Crowding In
Marijn Faling
Understanding Behaviour Change in Theory-Based Evaluation of Market Systems Development Programmes
Jodie Thorpe
Editors
