Inclusive Rigor as a Transformative Compass: An Experience from Colombia

The challenge of evaluating what is already participatory

by Ángela María Báez-Silva Arias

When we set out to evaluate Co-Inspira, a peacebuilding initiative in Colombia, we knew we were facing an unconventional challenge. This was not about assessing a traditional intervention, but something far more complex: a Systemic Action Research (SAR) process that was, in itself, already a collective exercise in knowledge generation.

How do we evaluate a process that is, by nature, an exercise in Participatory Research? How do we avoid overburdening participants with an additional layer of evaluation work when they are already leading their own knowledge-generation process? In the chapter Lessons from practicing Inclusive Rigor in the evaluation of a peace initiative in Colombia”, published in the book Evaluation, Democracy and Transformation”, we share how we approached this methodological challenge through an evaluative learning process guided by the Inclusive Rigor framework.

Continue reading

A PATH OF NO RETURN TOWARDS PARTICIPATION

A Costa Rican experience of participatory evaluation that transformed perspectives and practices

by Karol Cruz Ugalde, Eddy García Serrano and Juan Murciano

What happens when those who have historically been evaluated become co-evaluators? How can such a change be fostered, managed, and capitalized upon? Is it possible to promote participatory evaluation from within public institutions? How?

These were some of the questions that prompted us to write this chapter about the evaluation of the Program for the Promotion of the Autonomy of Persons with Disabilities in Costa Rica. We did not want to recount a technical process full of methodologies and results, but rather to share, from within, a living, challenging, and deeply human experience.

Within these pages, readers will find the Costa Rican context —a country with a legal framework that recognizes the rights of persons with disabilities, but which still faces great challenges in making those rights a part of daily life. Presenting this backdrop was essential, as it grounds the very purpose of our work: to show how evaluation can be a tool for transformation and democratic strengthening.

Continue reading

READINESS FOR PARTICIPATORY EVALUATION

by Ricardo Ramírez & Joaquín Navas

‘Readiness’ is an English language term that is difficult to translate into Spanish as it encompasses various themes: preparation, availability, propensity, timeliness, agility, competency, willingness – among others.  In the Spanish version of this entry, we use ‘availability’ (‘disposición’) with the understanding that it covers the other themes. In the field of evaluation, readiness is foremost across the first two steps of Utilization-focused Evaluation (UFE) as proposed by Michael Quinn Patton (2008). Readiness is also referenced in other fields, for instance in communication strategy design (Ramelan, 2014).

While the goal of UFE is the actual use of evaluation, the approach relies on the direct participation of ‘evaluation users’; it is their direct engagement that provides them with a sense of ownership over the process and the findings. In other words, UFE confirm that it is very much part of other collaborative approaches to evaluation (Ramírez & Brodhead, 2020).

Continue reading

WHEN EVALUATION LEADS TO CHANGE: A PIONEERING EXPERIENCE OF PARTICIPATORY EVALUATION IN JALISCO (MEXICO)

by Mónica Ballescá

I’m genuinely delighted to share a personal take on Chapter 7: Participatory evaluation of a public transport support policy: an inclusion and transformation perspective – Jalisco (Mexico), recently published in the book Evaluation, Democracy and Transformation: Experiences of Participatory Evaluation in Latin America. I co-wrote it with Sugey Salazar and Selene Michi, and together with other colleagues we reflect on what it really means to carry out public policy evaluation using participatory approaches from within the public sector.

This chapter sets out the details, practical insights and lessons from an evaluation process that, in my view, marked a real turning point in government practice in Mexico. It was one of the first participatory evaluations promoted from within the public sector at subnational level in the country, and the first to use a methodology that was later formalised and replicated in the years that followed.

Continue reading

Design of a participatory evaluation of a public service for older adults in Ecuador

by Carmen Lucía Jaramillo 

The invitation we received to share the experience of designing the first participatory evaluation promoted from within the public sector in Ecuador represented a challenge both for me, as the facilitator of the process, and for Joselyn Corrales, who at that time was serving as Undersecretary for Evaluation in the state body responsible for evaluation.

The challenge lay in communicating clearly not only the methodological and conceptual aspects, but also the uncertainties, challenges and lessons learned arising from the design of the participatory evaluation of the Socialisation and Meeting Spaces for Older Adults, an intervention implemented by the Ministry of Economic and Social Inclusion.

Continue reading

Foceval and Focelac: 10 Years of Cooperation for the Development of Participatory Evaluation Capacities in the Region

by Andrea Meneses Rojas

In Chapter 13 of the book Evaluation, Democracy, and Transformation, I invite you to explore how, over ten years of international cooperation, diverse intentions and shared learning have come together so that participatory evaluation has moved from being a mere ideal to becoming a transformative practice in Latin America and the Caribbean.

Throughout this decade, cooperation between the German Institute for Development Evaluation (DEval) and Costa Rica’s Ministry of National Planning and Economic Policy (Mideplan) has established participatory evaluation as a strategic commitment in actions carried out in the region. Between 2014 and 2024, this joint effort was channeled through two projects (Foceval and Focelac) with a common purpose: to strengthen evaluation capacities and contribute to evidence-based decision making.

Continue reading

ELEVATING TSAATAN VOICES: SOWING THE SEEDS OF EVALUATION IN MONGOLIA

 by Gereltsetseg Adiya, Oyuntulkhuur Jukov, Itgemjit Gankhuyag and Azjargal Amarsanaa

With the enforcement of Mongolia’s Law on Special Protected Area (*),  97% of Tsagaannuur soum in Khuvsgul province where the Tsaatan live has been declared a strictly protected zone. This has placed major restrictions on their traditional way of life: hunting, seasonal migration, reindeer herding, and pasture use have all become increasingly limited. These restrictions directly affect their food security, cultural traditions, and quality of life.

Recognizing that the Tsaatan voices have been systematically excluded from designing, implementing and evaluating policies, this participatory and culturally responsive evaluation demonstrates how meaningful participation can transform the evaluation of conservation policies – by centering Tsaatan people’s traditional knowledge and ensuring their perspectives directly shape evaluations and are considered in policy making, that affect their ancestral lands.

Continue reading

DESIGNS AND METHODS FOR IMPACT ASSESSMENT

by Pablo Rodríguez Bilella

Over the past two decades, the movement aimed at achieving evidence-based policies has gained importance and prominence. It holds that policymakers should base their decisions on the best available evidence regarding “what works,” rather than on ideologies or in response to particular interests.

One of its assumptions is that not all evidence has been rigorous enough to provide certainty in decision-making. This accentuated the orientation toward supporting certain approaches and methodologies that, given their rigorous formulation, would lead to superior results. This general context has favored debate and discussion on impact evaluation from different spheres and spaces (political, academic, social, etc.).

Continue reading

Exploring Participation in Evaluation: Scope, Limits, and Lessons from Chile

by Rodrigo Quiroz Saavedra

When I wrote this paper (only in Spanish), my intention was not merely to present a case of participatory evaluation, but to invite the reader to delve into real evaluative practice and to look closely at what it truly means to open up spaces for participation in contexts where diverse actors are involved and significant asymmetries exist among them.

I chose as a case study the “Transition to Independent Living Programme” (PTVI) in Chile, implemented by Fundación Eres, because it brings together two key features: it works with young people with intellectual disabilities — a historically marginalised group — and it proposes a social and labour inclusion approach that places self-determination and the rights of persons with disabilities at its core.

Continue reading

ICONOCLASISTAS: an invitation to collective creation for understanding processes of change and transformation

DEVICES FOR COLLABORATIVE RESEARCH, ITINERANT COLLECTIVE MAPPING, CRITICAL CARTOGRAPHIES AND PEDAGOGICAL RESOURCES FOR COMMUNITY USE

by Pablo Ares and Julia Risler

Iconoclasistas was born in 2006 as a space that brings together graphic art, activism, critical pedagogy and collective working methodologies. Since then, the initiative has consolidated as a device that combines visual poetics, political reflection and critical pedagogies, always incorporating the environmental dimension.

We see ourselves as activists, though not in the partisan or institutional sense. We understand our practice as a militancy of doing, sustained through networks, ties and affections activated from the body, the territory and collaborative practices. We recognise ourselves as part of a broad and dynamic fabric made up of collectives, social movements and organised communities, articulated more by political, ethical, aesthetic and environmental affinities than by rigid structures.

Continue reading