When Participation Becomes Data

Reflections on Artificial Intelligence and the Future of Participatory Evaluation

by Angie Pereira Calvo

A few months ago, I sat for more than two hours with a group of women, listening to their experiences with a social program. There was no recorder running. I held no questionnaire. There was silence, pause, chocolate, and a trust that had taken weeks to build. In that conversation, I learned more about the real determinants of access to health services than from any dataset I had ever processed.

I genuinely wonder what part of that conversation an artificial intelligence (AI) system would have captured. And I also wonder what part of it we would have sacrificed if the methodological emphasis had been placed on the efficiency of data processing rather than on the quality of listening. This, in my view, is the central question the Latin American evaluation community must ask itself right now: before the adoption of AI tools silently redefines what we mean by participation.

Continue reading

IS HUMBLE EVALUATION POSSIBLE? A Debate Between Two Extremes: The ‘Expert’ Evaluator versus the ‘Facilitator’ Evaluator

A Reflection in Podcast Format Inspired by the Contributions of Silva Ferretti

We are pleased to present Episode 14 of the EvalParticipativa podcast, now in its new AI-assisted format. This episode explores an ongoing debate within the field of evaluation, drawing on the ideas of Silva Ferretti, an international consultant who advocates for rethinking how programmes and projects are evaluated.

Through a conversation between two fictional characters, the episode examines two different ways of understanding evaluation. On the one hand, there is an approach focused on meeting technical and methodological requirements. On the other, there is a more open and collaborative perspective, where evaluators move away from the role of the all-knowing expert and instead act as facilitators of learning.

Continue reading

Evaluating to strengthen communities: lessons from a participatory evaluation in urban neighbourhoods in southern Chile

                                         by Alba Ximena Zambrano Constanzo, Vaite Trujillo Burgos, Mauricio García Ojeda, Francisca Román Mella

In contexts of urban vulnerability, evaluation is never neutral. Every evaluation reflects a way of seeing reality, deciding what counts as a problem, what is considered an achievement, and who gets to interpret it. From this perspective came the article Community Strengthening in Urban Neighbourhoods: Psychosocial Dynamics in Vulnerable Contexts, which reports on a participatory evaluation of community strengthening processes carried out alongside urban communities in southern Chile.

The article is part of a broader comparative study involving five urban neighbourhoods: three in Chile and two in Brazil. This publication focuses specifically on the Chilean cases, developed in the city of Temuco, in the La Araucanía Region, areas marked by socio-spatial segregation, urban precarity, and a historically unequal relationship with public policy.

Continue reading

Inclusive Rigor as a Transformative Compass: An Experience from Colombia

The challenge of evaluating what is already participatory

by Ángela María Báez-Silva Arias

When we set out to evaluate Co-Inspira, a peacebuilding initiative in Colombia, we knew we were facing an unconventional challenge. This was not about assessing a traditional intervention, but something far more complex: a Systemic Action Research (SAR) process that was, in itself, already a collective exercise in knowledge generation.

How do we evaluate a process that is, by nature, an exercise in Participatory Research? How do we avoid overburdening participants with an additional layer of evaluation work when they are already leading their own knowledge-generation process? In the chapter Lessons from practicing Inclusive Rigor in the evaluation of a peace initiative in Colombia”, published in the book Evaluation, Democracy and Transformation”, we share how we approached this methodological challenge through an evaluative learning process guided by the Inclusive Rigor framework.

Continue reading

A PATH OF NO RETURN TOWARDS PARTICIPATION

A Costa Rican experience of participatory evaluation that transformed perspectives and practices

by Karol Cruz Ugalde, Eddy García Serrano and Juan Murciano

What happens when those who have historically been evaluated become co-evaluators? How can such a change be fostered, managed, and capitalized upon? Is it possible to promote participatory evaluation from within public institutions? How?

These were some of the questions that prompted us to write this chapter about the evaluation of the Program for the Promotion of the Autonomy of Persons with Disabilities in Costa Rica. We did not want to recount a technical process full of methodologies and results, but rather to share, from within, a living, challenging, and deeply human experience.

Within these pages, readers will find the Costa Rican context —a country with a legal framework that recognizes the rights of persons with disabilities, but which still faces great challenges in making those rights a part of daily life. Presenting this backdrop was essential, as it grounds the very purpose of our work: to show how evaluation can be a tool for transformation and democratic strengthening.

Continue reading

EVALPARTICIPATIVA: A COMMUNITY THAT LEARNS AND GROWS

In the third episode of this new podcast season, we share a chapter from the book ‘Evaluation, Democracy, and Transformation: Experiences of Participatory Evaluation in Latin America‘ (only in Spanish). With the help of artificial intelligence, we recreate a conversation between two hosts who explore the main ideas of the chapter and discuss how the EvalParticipativa community works to strengthen evaluation capacities across the region.

The chapter, written by Esteban Tapella and Pablo Rodríguez Bilella, describes EvalParticipativa’s approach. At its core, it brings together two things: a community of practice and a community of learning. The text explains the role of adult education, built on a dialogic and participatory methodology. It also looks at the goals of the training process, the topics covered, the teaching tools that were developed, and the different training opportunities offered over time. The chapter also reflects on some key lessons from this experience. One of the most important is the role of professional training in promoting participatory approaches to evaluation, while still maintaining the methodological rigor that evaluation requires in different contexts across Latin America.

Continue reading

READINESS FOR PARTICIPATORY EVALUATION

by Ricardo Ramírez & Joaquín Navas

‘Readiness’ is an English language term that is difficult to translate into Spanish as it encompasses various themes: preparation, availability, propensity, timeliness, agility, competency, willingness – among others.  In the Spanish version of this entry, we use ‘availability’ (‘disposición’) with the understanding that it covers the other themes. In the field of evaluation, readiness is foremost across the first two steps of Utilization-focused Evaluation (UFE) as proposed by Michael Quinn Patton (2008). Readiness is also referenced in other fields, for instance in communication strategy design (Ramelan, 2014).

While the goal of UFE is the actual use of evaluation, the approach relies on the direct participation of ‘evaluation users’; it is their direct engagement that provides them with a sense of ownership over the process and the findings. In other words, UFE confirm that it is very much part of other collaborative approaches to evaluation (Ramírez & Brodhead, 2020).

Continue reading

WHEN EVALUATION LEADS TO CHANGE: A PIONEERING EXPERIENCE OF PARTICIPATORY EVALUATION IN JALISCO (MEXICO)

by Mónica Ballescá

I’m genuinely delighted to share a personal take on Chapter 7: Participatory evaluation of a public transport support policy: an inclusion and transformation perspective – Jalisco (Mexico), recently published in the book Evaluation, Democracy and Transformation: Experiences of Participatory Evaluation in Latin America. I co-wrote it with Sugey Salazar and Selene Michi, and together with other colleagues we reflect on what it really means to carry out public policy evaluation using participatory approaches from within the public sector.

This chapter sets out the details, practical insights and lessons from an evaluation process that, in my view, marked a real turning point in government practice in Mexico. It was one of the first participatory evaluations promoted from within the public sector at subnational level in the country, and the first to use a methodology that was later formalised and replicated in the years that followed.

Continue reading

Design of a participatory evaluation of a public service for older adults in Ecuador

by Carmen Lucía Jaramillo 

The invitation we received to share the experience of designing the first participatory evaluation promoted from within the public sector in Ecuador represented a challenge both for me, as the facilitator of the process, and for Joselyn Corrales, who at that time was serving as Undersecretary for Evaluation in the state body responsible for evaluation.

The challenge lay in communicating clearly not only the methodological and conceptual aspects, but also the uncertainties, challenges and lessons learned arising from the design of the participatory evaluation of the Socialisation and Meeting Spaces for Older Adults, an intervention implemented by the Ministry of Economic and Social Inclusion.

Continue reading

Key Stakeholder Mapping: A Tool for Understanding Social Complexity

THE EVALPARTICIPATIVA PODCAST

The EvalParticipativa Podcast is a space for dialogue, exchange, and articulation within the Community of Practice and Learning in Participatory Evaluation in Latin America. It is conceived as a platform to strengthen collective learning, make situated experiences visible, and promote an approach to evaluation that is collaboratively constructed and grounded in local territories.

Each episode invites leading figures in participatory evaluation from the region to share not only their technical expertise and professional trajectories, but also their motivations, experiences, and personal journeys. In this way, evaluation is presented as a living practice, deeply connected to specific contexts, social processes, and the histories of those who carry it forward. The podcast seeks to build bridges between reflection and action, between expert knowledge and practice-based knowledge, reinforcing an inclusive and critical perspective committed to the use of evaluation for learning, improvement, and social transformation.

Continue reading