Inclusive Rigor as a Transformative Compass: An Experience from Colombia

The challenge of evaluating what is already participatory

by Ángela María Báez-Silva Arias

When we set out to evaluate Co-Inspira, a peacebuilding initiative in Colombia, we knew we were facing an unconventional challenge. This was not about assessing a traditional intervention, but something far more complex: a Systemic Action Research (SAR) process that was, in itself, already a collective exercise in knowledge generation.

How do we evaluate a process that is, by nature, an exercise in Participatory Research? How do we avoid overburdening participants with an additional layer of evaluation work when they are already leading their own knowledge-generation process? In the chapter Lessons from practicing Inclusive Rigor in the evaluation of a peace initiative in Colombia”, published in the book Evaluation, Democracy and Transformation”, we share how we approached this methodological challenge through an evaluative learning process guided by the Inclusive Rigor framework.

Continue reading

WHEN EVALUATION LEADS TO CHANGE: A PIONEERING EXPERIENCE OF PARTICIPATORY EVALUATION IN JALISCO (MEXICO)

by Mónica Ballescá

I’m genuinely delighted to share a personal take on Chapter 7: Participatory evaluation of a public transport support policy: an inclusion and transformation perspective – Jalisco (Mexico), recently published in the book Evaluation, Democracy and Transformation: Experiences of Participatory Evaluation in Latin America. I co-wrote it with Sugey Salazar and Selene Michi, and together with other colleagues we reflect on what it really means to carry out public policy evaluation using participatory approaches from within the public sector.

This chapter sets out the details, practical insights and lessons from an evaluation process that, in my view, marked a real turning point in government practice in Mexico. It was one of the first participatory evaluations promoted from within the public sector at subnational level in the country, and the first to use a methodology that was later formalised and replicated in the years that followed.

Continue reading

Design of a participatory evaluation of a public service for older adults in Ecuador

by Carmen Lucía Jaramillo 

The invitation we received to share the experience of designing the first participatory evaluation promoted from within the public sector in Ecuador represented a challenge both for me, as the facilitator of the process, and for Joselyn Corrales, who at that time was serving as Undersecretary for Evaluation in the state body responsible for evaluation.

The challenge lay in communicating clearly not only the methodological and conceptual aspects, but also the uncertainties, challenges and lessons learned arising from the design of the participatory evaluation of the Socialisation and Meeting Spaces for Older Adults, an intervention implemented by the Ministry of Economic and Social Inclusion.

Continue reading

Foceval and Focelac: 10 Years of Cooperation for the Development of Participatory Evaluation Capacities in the Region

by Andrea Meneses Rojas

In Chapter 13 of the book Evaluation, Democracy, and Transformation, I invite you to explore how, over ten years of international cooperation, diverse intentions and shared learning have come together so that participatory evaluation has moved from being a mere ideal to becoming a transformative practice in Latin America and the Caribbean.

Throughout this decade, cooperation between the German Institute for Development Evaluation (DEval) and Costa Rica’s Ministry of National Planning and Economic Policy (Mideplan) has established participatory evaluation as a strategic commitment in actions carried out in the region. Between 2014 and 2024, this joint effort was channeled through two projects (Foceval and Focelac) with a common purpose: to strengthen evaluation capacities and contribute to evidence-based decision making.

Continue reading

Exploring Participation in Evaluation: Scope, Limits, and Lessons from Chile

by Rodrigo Quiroz Saavedra

When I wrote this paper (only in Spanish), my intention was not merely to present a case of participatory evaluation, but to invite the reader to delve into real evaluative practice and to look closely at what it truly means to open up spaces for participation in contexts where diverse actors are involved and significant asymmetries exist among them.

I chose as a case study the “Transition to Independent Living Programme” (PTVI) in Chile, implemented by Fundación Eres, because it brings together two key features: it works with young people with intellectual disabilities — a historically marginalised group — and it proposes a social and labour inclusion approach that places self-determination and the rights of persons with disabilities at its core.

Continue reading

Conceptualising Participatory Evaluation in a pluralistic and collective way

by Esteban Tapella

Dear colleagues and friends of the EvalParticipativa community, in this article we will present two tools to facilitate the construction of a shared conceptual framework around Participatory Evaluation.

These tools were designed within the framework of our community’s capacity building strategy, and are aimed at project leaders, socio-cultural animators and professionals working in the field of programme and project management and evaluation.

Continue reading

Outcome Harvesting for Participatory Monitoring: A Conversation Between Colleagues

By Giovanna Montagner and Carmen Wilson-Grau

Outcome Harvesting is a participatory method used to identify, formulate, analyze, and learn from the changes brought about by an intervention, especially when cause-effect relationships are complex or unknown.

Rather than focusing on predefined objectives, it looks at what has actually changed and how the program contributed to those changes. This method emphasizes utilization, enabling evaluators, donors, and project/program managers to identify, formulate, verify, and make sense of the outcomes of an intervention.

This method brought us together. We met in 2019, when Giovanna, after attending a training on Outcome Harvesting, contacted Carmen to practice with her. Since then, we’ve kept up the habit of having virtual coffee chats every now and then. Today, we’ve come together to talk about Carmen’s experience using Outcome Harvesting for monitoring.

Continue reading

Disability inclusive evaluation & research: What is it and how can we do it?

by Mary Wickenden

Introduction

In the past, people with disabilities have been left out of many aspects of life including research and evaluation. They have not usually been included in ‘mainstream’ studies about key topics such as health, education, WASH, gender empowerment, social and political participation, while other groups in populations are more routinely asked for their views and their qualitative data is collected.

It is often perceived to be too difficult or expensive to include disabled people. This is discriminatory and leads to continued lack of understanding about their lives. We need to collect, both in research and evaluation, disability-inclusive data to understand disabled people’s  perspectives, situations and needs, alongside others’ views.

Continue reading

Different methods of storytelling in Africa. The ‘story tellers’ and their perspectives.

At the beginning of 2024 we shared the article “The arrival of the two rivers. Scientific storytelling”, in which we analyzed the role of stories rooted in each community when it comes to linking scientific advances and the dissemination of knowledge with the work of local populations, their culture and their impact on research and -why not!- the evaluative field.

In September of the same year we reported on the lessons learned from the Retreat on Storytelling and Participatory Evaluation, that was held in Limbe, Cameroon, organized together with eBASE AFRICA. During this meeting we documented and socialized the rich African traditions of storytelling and its contribution to participatory approaches in evaluation.

Continue reading

ECUADOR AND ITS EXPERIENCE WITH PARTICIPATORY EVALUATION

by Joselyn Michelle Corrales Vallejo

In this post, I will share some key experiences from a participatory evaluation in Ecuador, including the selection of the intervention to be evaluated and the final presentation of results and recommendations. This participatory evaluation—the first of its kind by the Ecuadorian government—assessed the Ministry of Economic and Social Inclusion’s Servicio de Espacios de Socialización y Encuentro para Personas Adultas Mayores (Social Interaction Spaces for Older Adults).

Leading this participatory evaluation was an invaluable experience both personally and professionally. There were certainly challenges and concerns, but thanks to the dedication and training of a strong team, we were able to turn these obstacles into valuable lessons and best practices. My sincere thanks to everyone who helped and supported the initiative which began when I had the opportunity to learn about participatory evaluation processes in Mexico and Costa Rica through my involvement with EvalParticipativa

Continue reading