A PATH OF NO RETURN TOWARDS PARTICIPATION

A Costa Rican experience of participatory evaluation that transformed perspectives and practices

by Karol Cruz Ugalde, Eddy García Serrano and Juan Murciano

What happens when those who have historically been evaluated become co-evaluators? How can such a change be fostered, managed, and capitalized upon? Is it possible to promote participatory evaluation from within public institutions? How?

These were some of the questions that prompted us to write this chapter about the evaluation of the Program for the Promotion of the Autonomy of Persons with Disabilities in Costa Rica. We did not want to recount a technical process full of methodologies and results, but rather to share, from within, a living, challenging, and deeply human experience.

Within these pages, readers will find the Costa Rican context —a country with a legal framework that recognizes the rights of persons with disabilities, but which still faces great challenges in making those rights a part of daily life. Presenting this backdrop was essential, as it grounds the very purpose of our work: to show how evaluation can be a tool for transformation and democratic strengthening.

Continue reading

WHEN EVALUATION LEADS TO CHANGE: A PIONEERING EXPERIENCE OF PARTICIPATORY EVALUATION IN JALISCO (MEXICO)

by Mónica Ballescá

I’m genuinely delighted to share a personal take on Chapter 7: Participatory evaluation of a public transport support policy: an inclusion and transformation perspective – Jalisco (Mexico), recently published in the book Evaluation, Democracy and Transformation: Experiences of Participatory Evaluation in Latin America. I co-wrote it with Sugey Salazar and Selene Michi, and together with other colleagues we reflect on what it really means to carry out public policy evaluation using participatory approaches from within the public sector.

This chapter sets out the details, practical insights and lessons from an evaluation process that, in my view, marked a real turning point in government practice in Mexico. It was one of the first participatory evaluations promoted from within the public sector at subnational level in the country, and the first to use a methodology that was later formalised and replicated in the years that followed.

Continue reading

CLOSING A CYCLE AT EVALPARTICIPATIVA: GRATITUDE FOR WHAT WE HAVE SHARED, NEW CHALLENGES, AND RENEWED HOPES

Dear members of the EvalParticipativa community,

As we close this seven-year cycle of collective work, we wish to celebrate what we have built together: a vibrant community of practice and learning around participatory evaluation and inclusive approaches. Within it, every voice has contributed, every shared experience has enriched us, and every encounter has woven bonds that go beyond isolated practices, now reaching more than four thousand people and multiple organizations.

Throughout these years, we have shared questions, experiences, doubts, tools, and learnings. We created spaces for meeting, training, and reflection where knowledge circulated horizontally, strengthening capacities and broadening perspectives.

None of this would have been possible without the willingness to walk together, to listen to one another, to extend a helping hand, and to build through dialogue—even in complex and uncertain contexts. Today, we know that the most meaningful progress emerges when we bring knowledge together, trust in collective intelligence, and understand that individual growth finds its true meaning within a shared project, as EvalParticipativa itself demonstrates.

Continue reading

EvalParticipativa turns seven… and we want to celebrate by opening a new chapter together

Dear friends of EvalParticipativa,

Seven years ago, we began a shared journey, convinced that evaluation can be a space for connection, listening, and transformation. Today, more than four thousand people are part of this community, which grows with every story, every experience shared, and every perspective dedicated to fostering social change through participation.

Behind each name there is a path, a voice, a story of commitment. In every country and every organisation, there are people who, like you, believe in the power of building knowledge collectively. That is why we want to take a new step: to bring a human face to our community.

Continue reading

WEAVING NETWORKS THROUGH THE EXCHANGE OF KNOWLEDGE

INTERNATIONAL TRAINING MOBILITY EXPERIENCE IN COSTA RICA

Dr Vanesa Castro, professor and researcher from PETAS, the Research Program on Employment, Environment and Society at the National University of San Juan, Argentina (UNSJ), participated in an intense and enriching experience in Costa Rica within the framework of the International Mobility Program promoted by the Secretariat of Postgraduate Studies and International Relations (SEPRI) of the UNSJ.

For two weeks, between March 10 and 20, Vanesa carried out a process of academic exchange and knowledge sharing, working with leading actors of Costa Rican State and academic institutions. The main objective of this program, supported by SEPRI, is to strengthen the global involvement of UNSJ through the exchange of experiences, inter-institutional collaboration and the development of joint research projects, generating cooperation networks and promoting the transfer of knowledge that contributes to the improvement of public policies and the formation of an academic community committed to regional development.

MOBILITY PROGRAM

The working agenda is part of the Technological and Social Development Project 2023-2025, developed by PETAS, which is aimed at strengthening the exchange and interaction with institutions in the region interested in deepening knowledge and strengthening experiences in collaborative and inclusive approaches to evaluation. The work plan was designed jointly with relevant Costa Rican institutions, including the Monitoring and Evaluation Unit of the Ministry of National Planning and Economic Policy (MIDEPLAN), the Latin American Department of Social Sciences of Costa Rica (FLACSO) and the Graduate Program in Evaluation of Development Programs and Projects of the University of Costa Rica (UCR). These entities collaborated closely to define an itinerary that combined workshops, seminars and trainings within the framework of the EvalParticipativa initiative implemented by PETAS in alliance with the German Institute for the Evaluation of Development Cooperation (DEval). This collaboration was key to align efforts and generate a space for exchange and mutual learning.

WORKSHOP ON THE DESIGN AND USE OF DATA COLLECTION INSTRUMENTS

In this first activity, Vanesa facilitated a training session for the team in charge of the Evaluation of the Promotion of Organic Agriculture in Costa Rica, with the participation of representatives from MIDEPLAN, the Ministry of Agriculture and Livestock (MAG) and the Universidad Estatal a Distancia (UNED). The activity took place at the UNED and began with a development of a conceptual framework on the importance of designing data collection tools and the general criteria for selecting and using participatory tools.

Subsequently, the team worked with the Stakeholder Mapping previously built, identifying the information needs for each social actor in the evaluation. Based on this identification, some stakeholders were prioritized and working groups were organized to start designing specific instruments, considering the particularities of each selected stakeholder and the criteria shared in the workshop. To guide this process, Vanesa presented a scheme of collection tools classified according to modality and purpose, in addition to sharing participatory evaluation (PE) methodologies developed in the EvalParticipativa initiative’s Toolbox, with the aim of providing inputs to facilitate the development of instruments adapted to the team’s needs. The purpose of this activity was to contribute to the ongoing evaluation process, strengthening the design of tools to collect relevant and useful information for decision making.

RESEARCH SEMINAR ON PARTICIPATORY EVALUATION METHODOLOGIES

This seminar was developed online and onsite through the Postgraduate Program in Evaluation of Development Programs and Projects that has being implemented by the University of Costa Rica for more than twenty years. The activity brought together advanced students of the master’s program, graduate professionals and professors interested on adopting participatory approaches in their research or professional practices.

The purpose of the seminar was to provide a conceptual and methodological framework on PE, with a specific focus on its use in social research. During the session, the principles of PE, its methodological advantages and challenges, and its potential to generate critical and applicable knowledge in the evaluation of development programs and projects were explored. In addition, through the analysis of these principles, methodological guidelines and tools, participants identified ways to integrate PE into their own projects, considering key aspects such as research design, data collection, analysis and interpretation of results.  The dynamics of the seminar promoted interdisciplinary dialogue and the exchange of experiences among those interested in the design, implementation and evaluation of public policies, social programs and development projects.

TRAINING COURSE ON PARTICIPATORY EVALUATION

A third activity was the training on conceptual and instrumental approaches to evaluation with focus on social inclusion, held at the Ministry of National Planning and Economic Policy (MIDEPLAN) and jointly organized with the Evaluation and Monitoring Unit of MIDEPLAN, FLACSO and the Postgraduate Program in Evaluation of Development Programs and Projects of the University of Costa Rica (UCR-PEPPD).

The activity brought together representatives from various public and academic institutions in Costa Rica. The purpose of the workshop was to learn about and experiment with tools for the incorporation of PE in different areas of work of the Costa Rican government. The workshop explored the key principles of this approach, its advantages and challenges, as well as strategies for its application in different institutional contexts. Through group work dynamics and practical exercises, participants identified opportunities to integrate participatory evaluation into their evaluation processes, adapting it to the needs and context of each sector.

The diversity of the participants’ profiles enriched the debate and consolidated the co-construction of knowledge that characterized this workshop. Representatives of the following entities and organizations participated in this training session: MIDEPLAN-UEV (Evaluation and Monitoring Unit, Ministry of National Planning and Economic Policy), MAG-SEPSA (Executive Secretariat for Agricultural Sector Planning, Ministry of Agriculture and Livestock), DESAF-UEVAL (Evaluation Unit of the Office of Strategic Affairs of the Government of Costa Rica), MCJ (Ministry of Culture and Youth), MEIC (Ministry of Economy, Industry and Commerce), MINAE (Ministry of Environment and Energy), PANI (National Child Welfare Agency), FLACSO, UCR-PEPPD (Postgraduate Program in Evaluation of Development Programs and Projects of the University of Costa Rica), MCJ-SEPLA (Planning Secretariat of the Ministry of Culture and Youth).

TRAINING ON EVALUATION OF SOCIAL INTERVENTIONS: MAIN CONCEPTS, APPROACHES AND TOOLS

This last training, held at FLACSO Costa Rica’s headquarters, was organized jointly with the Institute for Municipal Development and Advisory Services (IFAM). The purpose of the training was to strengthen the planning and evaluation capacities of municipal officials.

The workshop was attended by professionals with diverse knowledge and experience in evaluation, who are responsible for implementing and monitoring public and social interventions at the local level. The workshop brought together professionals from different municipalities in Costa Rica, who play strategic roles in project management and public policy evaluation. Among the participants were institutional planners, public investment analysts, municipal strategy managers and support professionals in citizen participation. In addition to strengthening their institutional capacities, the conference provided a valuable horizontal exchange among participants, who shared experiences, challenges and lessons learned from their own contexts.

Throughout the day, the participants worked on the fundamental concepts of evaluation, its importance in public management and the different approaches and methodologies available. The proposal combined theoretical presentations with dynamic activities, allowing participants to understand how to apply practical tools in their respective municipalities.  The day ended with a space for dialogue and exchange of ideas on how to integrate evaluation into municipal management effectively, and the challenges it represents, ensuring that the processes are useful for decision making and continuous improvement of local interventions.

FINAL REMARKS ON MOBILITY EXPERIENCE

The international mobility of professors and researchers represents multiple benefits for all the institutions involved. On the one hand, it allowed Costa Rican institutions to access methodologies and tools developed by EvalParticipativa, enriching their institutional capacities and fostering inclusive and collaborative approaches in their evaluation processes. On the other hand, for the UNSJ and particularly for the PETAS team, the experience represented an opportunity for field learning, validation of instruments and strengthening of academic and technical links with counterpart organizations in the region. In addition, a regional collaboration network was consolidated with potential for future joint interventions, development of methodological resources and new opportunities for shared training.

This experience reaffirms SEPRI UNSJ’s commitment to its objective of promoting significant academic internationalization processes, generating new institutional alliances and favouring the circulation of knowledge between territories. Establishing ties with institutions such as MIDEPLAN, UNED, UCR, FLACSO and IFAM not only represents a concrete achievement for the team that participated in the mobility, but also opens the way for future initiatives to strengthen research and training with regional projection. We invite you to see the photo gallery of these activities.

This slideshow requires JavaScript.

STORYTELLING & PARTICIPATORY EVALUATION. A SOUTH-SOUTH-NORTH COLLABORATION INITIATIVE

Last month, in Limbe, Cameroon, we had the Storytelling & Participatory Evaluation Retreat, named “Leveraging Indigenous Heritage for Participatory and Innovative Evaluation”.

This is a joint cooperation experience between three main partners, the German Institute for Development Evaluation (DEval), the Community of Practice and Learning for Participatory Evaluation (EvalParticipativa) and eBASE AFRICA to document and learn from Africa’s rich storytelling traditions and Latin America participatory approaches in evaluation.

Continue reading

BOOK ON EVALUATION, INCLUSION AND DEMOCRACY IN LATIN AMERICA: EXPERIENCES AND LESSONS

OPEN CALL

A while back, we began working with colleagues in the region on the concepts of evaluation, inclusion and democracy in Latin America and the Caribbean. In the new EvalParticipativa project (2023-2024) we plan to revisit these ideas and produce a book on the subject. Our aim is to identify participatory evaluation experiences in Latin America and the Caribbean, analysing dimensions of inclusion and democracy, and emphasising the learning components generated by these experiences.

The book’s target audience is made up of individuals who are responsible for designing and carrying out evaluations, in the hope of increasing their awareness of the possibility and feasibility of conducting evaluations with civil society participation. We seek to bring this awareness both into their consciousness and onto their agendas. The book is intended for Latin American bodies that provide capacity building and training in evaluation, in the hope that it will make available real cases of evaluations carried out with the participation of civil society in the region. Our target readers are teachers and students in diploma courses, master’s degrees or other specialisations focused on evaluation and social planning, in the hope of influencing the training of professionals who will in the future be conducting, commissioning, supervising and assessing participatory evaluations in the region.

how to participate?

In this document we present a general, preliminary overview of the aspects we intend the book to address. We are clear that the focus should be on presenting one or more existing evaluation experiences as the core data for analysis, without excluding the possibility that some general remarks or proposals may be added where appropriate. In other words, a substantial part of each chapter should be devoted to a descriptive and analytical account of one or several evaluation experiences, while a smaller part may be dedicated to more general or propositional reflections that build on the first section.

This brief post is therefore an invitation to friends and colleagues of EvalParticipativa who are interested in contributing a chapter to the book to email their ideas to eval.participativa@gmail.com.

We will select the chapters that will be included in the book from the submissions we receive. We thank you in advance for sharing this announcement with colleagues and contacts interested in these topics.

Best wishes,
The EvalParticipativa team

EVALPARTICIPATIVA AT GLOBAL EVALUATION WEEK – GLOCAL2023

Greetings fellow EvalParticipativa colleagues,

Earlier this week we took part in the gLOCAL 2023 roundtable discussion, CHALLENGES IN PARTICIPATORY EVALUATION: A FEMINIST AND DECOLONIAL APPROACH. The activity was organised jointly with Kalidadea, a feminist consultancy network, working in the field of international cooperation and development.

Evaluations entail several different challenges including ensuring that the process empowers those involved by achieving a sufficient level of effective participation across a diverse set of participants. Another challenge is to ensure meaningful gender mainstreaming and a move towards feminist evaluations rooted in human rights.

The aim of the roundtable was to create space for reflection on these challenges and on how to integrate participatory and feminist approaches successfully into our evaluations in a way that is relevant, effective and appropriate to the groups we work with, be they local communities or the general public.

Our speakers—Esteban Tapella from PETAS, Lara González Gómez, director of Kalidadea and Alejandra Lucero Manzano, member of PETAS and Kalidadea— introduced some of these challenges and suggested ways to overcome them. They shared concrete strategies and ecofeminist principles intended to contribute new perspectives for developing empowering evaluation processes based on a decolonial perspective. The roundtable was moderated by Vanesa Castro (a PETAS researcher). You can click the link below to watch the recording which includes a Q&A session with the participants.

The gLOCAL Evaluation Week is a unique knowledge-sharing event, connecting a global community of people across sectors and regions. Over the course of a week, participants join events—in their own regions and further afield—to learn from each other on a vast number of topics and experiences. By helping participants understand how their work fits in with monitoring and evaluation (M&E) ecosystems in their region and the larger M&E community worldwide, gLOCAL helps to inspire and energise a global movement: individuals and organisations that value the power of evidence to improve people’s lives. gLOCAL, is convened and supported by the Global Evaluation Initiative (GEI), a network of organisations and experts that supports countries with strengthening their M&E systems in order to help governments gather and use evidence that improves the lives of their citizens.

We were delighted to take part in this event again this year!

EVALPARTICIPATIVA AWARD FOR ACADEMIC PRODUCTION. “AND THE WINNERS ARE…”

Dear colleagues, we are thrilled to announce that the winners of the EVALPARTICIPATIVA AWARD FOR ACADEMIC PRODUCTION have been selected.

We put out the call for papers at the end of 2021 with the aim of deepening academic and scientific knowledge concerning participatory evaluation as part of a wider approach of inclusive evaluation that is relevant to the 2030 Agenda.

The call was open for four months, during which time we received a variety of theoretical and empirical papers. Most of the papers prioritised an empirical approach, providing new elements for action-based reflection on participatory evaluation approaches, addressing case studies or comparing initiatives developed in the region.

Continue reading

gLOCAL Evaluation Week 2022

We invite you to be part of the gLOCAL Evaluation Week 2022.

The gLOCAL Evaluation Week (”gLOCAL”), is an annual dedicated week for Monitoring and Evaluation (“M&E”) knowledge and experience sharing events around the globe, was launched in 2019. In the short time since gLOCAL was launched, organizing partners from around the world have hosted nearly 1000 M&E focused events across five continents in multiple languages. During gLOCAL, government officials, evaluation practitioners, academics and researchers, and students, among many others, have joined this global movement to discuss M&E issues, connecting with one another to share their knowledge and experiences in this field.

Continue reading