Inclusive Rigor as a Transformative Compass: An Experience from Colombia

The challenge of evaluating what is already participatory

by Ángela María Báez-Silva Arias

When we set out to evaluate Co-Inspira, a peacebuilding initiative in Colombia, we knew we were facing an unconventional challenge. This was not about assessing a traditional intervention, but something far more complex: a Systemic Action Research (SAR) process that was, in itself, already a collective exercise in knowledge generation.

How do we evaluate a process that is, by nature, an exercise in Participatory Research? How do we avoid overburdening participants with an additional layer of evaluation work when they are already leading their own knowledge-generation process? In the chapter Lessons from practicing Inclusive Rigor in the evaluation of a peace initiative in Colombia”, published in the book Evaluation, Democracy and Transformation”, we share how we approached this methodological challenge through an evaluative learning process guided by the Inclusive Rigor framework.

Continue reading

A PATH OF NO RETURN TOWARDS PARTICIPATION

A Costa Rican experience of participatory evaluation that transformed perspectives and practices

by Karol Cruz Ugalde, Eddy García Serrano and Juan Murciano

What happens when those who have historically been evaluated become co-evaluators? How can such a change be fostered, managed, and capitalized upon? Is it possible to promote participatory evaluation from within public institutions? How?

These were some of the questions that prompted us to write this chapter about the evaluation of the Program for the Promotion of the Autonomy of Persons with Disabilities in Costa Rica. We did not want to recount a technical process full of methodologies and results, but rather to share, from within, a living, challenging, and deeply human experience.

Within these pages, readers will find the Costa Rican context —a country with a legal framework that recognizes the rights of persons with disabilities, but which still faces great challenges in making those rights a part of daily life. Presenting this backdrop was essential, as it grounds the very purpose of our work: to show how evaluation can be a tool for transformation and democratic strengthening.

Continue reading

EVALPARTICIPATIVA: A COMMUNITY THAT LEARNS AND GROWS

In the third episode of this new podcast season, we share a chapter from the book ‘Evaluation, Democracy, and Transformation: Experiences of Participatory Evaluation in Latin America‘ (only in Spanish). With the help of artificial intelligence, we recreate a conversation between two hosts who explore the main ideas of the chapter and discuss how the EvalParticipativa community works to strengthen evaluation capacities across the region.

The chapter, written by Esteban Tapella and Pablo Rodríguez Bilella, describes EvalParticipativa’s approach. At its core, it brings together two things: a community of practice and a community of learning. The text explains the role of adult education, built on a dialogic and participatory methodology. It also looks at the goals of the training process, the topics covered, the teaching tools that were developed, and the different training opportunities offered over time. The chapter also reflects on some key lessons from this experience. One of the most important is the role of professional training in promoting participatory approaches to evaluation, while still maintaining the methodological rigor that evaluation requires in different contexts across Latin America.

Continue reading

WHEN EVALUATION LEADS TO CHANGE: A PIONEERING EXPERIENCE OF PARTICIPATORY EVALUATION IN JALISCO (MEXICO)

by Mónica Ballescá

I’m genuinely delighted to share a personal take on Chapter 7: Participatory evaluation of a public transport support policy: an inclusion and transformation perspective – Jalisco (Mexico), recently published in the book Evaluation, Democracy and Transformation: Experiences of Participatory Evaluation in Latin America. I co-wrote it with Sugey Salazar and Selene Michi, and together with other colleagues we reflect on what it really means to carry out public policy evaluation using participatory approaches from within the public sector.

This chapter sets out the details, practical insights and lessons from an evaluation process that, in my view, marked a real turning point in government practice in Mexico. It was one of the first participatory evaluations promoted from within the public sector at subnational level in the country, and the first to use a methodology that was later formalised and replicated in the years that followed.

Continue reading

Foceval and Focelac: 10 Years of Cooperation for the Development of Participatory Evaluation Capacities in the Region

by Andrea Meneses Rojas

In Chapter 13 of the book Evaluation, Democracy, and Transformation, I invite you to explore how, over ten years of international cooperation, diverse intentions and shared learning have come together so that participatory evaluation has moved from being a mere ideal to becoming a transformative practice in Latin America and the Caribbean.

Throughout this decade, cooperation between the German Institute for Development Evaluation (DEval) and Costa Rica’s Ministry of National Planning and Economic Policy (Mideplan) has established participatory evaluation as a strategic commitment in actions carried out in the region. Between 2014 and 2024, this joint effort was channeled through two projects (Foceval and Focelac) with a common purpose: to strengthen evaluation capacities and contribute to evidence-based decision making.

Continue reading

DESIGNS AND METHODS FOR IMPACT ASSESSMENT

by Pablo Rodríguez Bilella

Over the past two decades, the movement aimed at achieving evidence-based policies has gained importance and prominence. It holds that policymakers should base their decisions on the best available evidence regarding “what works,” rather than on ideologies or in response to particular interests.

One of its assumptions is that not all evidence has been rigorous enough to provide certainty in decision-making. This accentuated the orientation toward supporting certain approaches and methodologies that, given their rigorous formulation, would lead to superior results. This general context has favored debate and discussion on impact evaluation from different spheres and spaces (political, academic, social, etc.).

Continue reading

Quality criteria for monitoring in development cooperation

by Dagmar Schumann

The idea for the document shared in this post was first discussed during a conference on monitoring in Germany. Our objective was to identify literature on broadly applicable quality standards or criteria for monitoring that could be considered nearly universal in their validity and application. While such documents exist for evaluation and research, no comparable paper could be found for monitoring.

A team of experienced German consultants specialising in planning, monitoring, and evaluation undertook the task of carefully examining this knowledge gap and developing a detailed document in response. We started by asking ourselves what ‘effective’ monitoring looks like. The first step was to conduct an extensive literature review. Subsequently, we developed the document ‘Quality Criteria for Monitoring in Development Cooperation‘ based on a thorough qualitative analysis of all available information.

Continue reading

INTRODUCING THE BOOK ‘EXPERIENCIAS EN EVALUACIÓN PARTICIPATIVA’

by Maria José Garcia Oramas

The book ‘Experiencias en Evaluación Participativa’ (Participatory Evaluation Experiences, available only in Spanish) was published by the Veracruz Ministry of Education, Mexico, in 2009. It is a compilation of participatory evaluations carried out in community and educational settings carried out by diploma students at the Institute of Psychological Research, Veracruz.

Long-standing problems in education, health, environmental care, gender equality and inclusion continue to exist in 2023 and we remain obliged to seek creative ways of resolving inequalities of gender, ethnicity and class derived from patriarchal, racist and capitalist political systems that are still prevalent in our Latin American countries.

Continue reading

STAKEHOLDER MAPPING: A PARTICIPATORY EVALUATION TOOL

by Esteban Tapella

Over the last fifteen years, public discourse on development policies and programmes has emphasised the need to reinforce the leading role of civil society in the interventions that implicate them. Increasingly, concepts such as ‘participation’, ‘accompaniment’ and ‘stakeholder perspective’ are heard.

This trend can also be detected in the field of evaluation, in approaches such as Democratic Evaluation, Systematisation of Experiences, Most Significant Change, Collaborative Approaches to Evaluation and -of particular interest to us- Participatory Evaluation, all of which seek to increase the involvement of a range of social actors. These approaches reflect an emerging sensibility in the field of evaluation that seeks to capture stakeholder perspectives when it comes to assessing outcomes and impacts and attributing them (or not) to a particular intervention.

We describe an evaluation as participatory when the parties involved in a programme or project define what will be evaluated, what the objectives will be, when the evaluation will be carried out, what data collection and analytical methods will be used and how the results will be communicated. Thus, a participatory evaluation aims to encourage an active and conscious incorporation of the so-called key stakeholders that are linked to the intervention being evaluated. But who are these key stakeholders? How are they related to each other and to the programme or project? In this post, I will attempt to respond to these questions and at the same time present the working document ‘Key Stakeholder Mapping’ (KSM) which introduces this tool, which I consider to be useful in evaluations that value social inclusion and participation.

Continue reading

NEW TRAINING SET: “SOWING AND HARVESTING HANDBOOK” IN WHITEBOARD-ANIMATION FORMAT

It is with great joy that we share the news of the launch of a new resource in our community of practice and learning EvalParticipativa, aimed at accompanying and illustrating the Sowing and Harvesting, participatory evaluation handbook .

This is a set of five short videos, one for each core chapter of the manual, done in Whiteboard-animation format.

The Whiteboard-animation format (or whiteboard animation) has gained popularity as a form of communication and distance training. The logic of this tool is to tell an illustrated story, simulating that it unfolds and develops on a blackboard. The animations are accompanied by a scripted narration with the purpose of explaining, in an entertaining and simple way, concepts that, explained in another way, would not be easy to grasp in a few minutes.

Continue reading