Transforming policies and strengthening democracies

The role of participatory evaluation in contexts of polarization in Latin America

by Leopoldo Font

At a crucial moment for Uruguay (my country) and the region, reflection on the role of participatory evaluation takes on particular relevance. Despite their limitations, evaluation tools offer a unique opportunity to address current challenges in an effective and sustainable manner. On the one hand, these tools can contribute to reducing polarization, foster collaboration and promote more inclusive solutions; on the other hand, they require significant resources and face the risk of bias in their implementation.

This article, based on my publication in La Diaria, seeks to connect the central ideas developed in that text with the participatory and transformative perspective that characterizes the EvalParticipativa community of practice and learning. Thus, it explores how these tools can act as a catalyst to overcome divisions, build bridges between diverse sectors and promote a more just and equitable development.

Continue reading

Storytelling and the Testimonial Series. Part 2

Storytelling is a universal feature of human culture that is used to communicate, educate and entertain. The simplicity of storytelling ensures that the audience participates and understands the messages the storyteller intends to convey. But storytelling is not simple; it is an art that has evolved and transformed throughout human existence.

With the intention of learning more about this topic and strengthening capacities for its use, we called Storytellers and asked them to share their different perspectives, as well as the different forms and techniques for storytelling. This is how we created the series “INVISIBLE STORIES, MADE VISIBLE. STORY TELLING IN AFRICA”. The series features new and old generation artists, academics, researchers and the local community showing how storytelling and evaluation can be connected in different ways, from data collection and analysis to dissemination of the knowledge generated.

Today we share the second part of the series, where Bambo Idriss Waintum presents a unique way of telling stories through painting one’s own body with natural dyes.

Continue reading

WEAVING NETWORKS THROUGH THE EXCHANGE OF KNOWLEDGE

INTERNATIONAL TRAINING MOBILITY EXPERIENCE IN COSTA RICA

Dr Vanesa Castro, professor and researcher from PETAS, the Research Program on Employment, Environment and Society at the National University of San Juan, Argentina (UNSJ), participated in an intense and enriching experience in Costa Rica within the framework of the International Mobility Program promoted by the Secretariat of Postgraduate Studies and International Relations (SEPRI) of the UNSJ.

For two weeks, between March 10 and 20, Vanesa carried out a process of academic exchange and knowledge sharing, working with leading actors of Costa Rican State and academic institutions. The main objective of this program, supported by SEPRI, is to strengthen the global involvement of UNSJ through the exchange of experiences, inter-institutional collaboration and the development of joint research projects, generating cooperation networks and promoting the transfer of knowledge that contributes to the improvement of public policies and the formation of an academic community committed to regional development.

MOBILITY PROGRAM

The working agenda is part of the Technological and Social Development Project 2023-2025, developed by PETAS, which is aimed at strengthening the exchange and interaction with institutions in the region interested in deepening knowledge and strengthening experiences in collaborative and inclusive approaches to evaluation. The work plan was designed jointly with relevant Costa Rican institutions, including the Monitoring and Evaluation Unit of the Ministry of National Planning and Economic Policy (MIDEPLAN), the Latin American Department of Social Sciences of Costa Rica (FLACSO) and the Graduate Program in Evaluation of Development Programs and Projects of the University of Costa Rica (UCR). These entities collaborated closely to define an itinerary that combined workshops, seminars and trainings within the framework of the EvalParticipativa initiative implemented by PETAS in alliance with the German Institute for the Evaluation of Development Cooperation (DEval). This collaboration was key to align efforts and generate a space for exchange and mutual learning.

WORKSHOP ON THE DESIGN AND USE OF DATA COLLECTION INSTRUMENTS

In this first activity, Vanesa facilitated a training session for the team in charge of the Evaluation of the Promotion of Organic Agriculture in Costa Rica, with the participation of representatives from MIDEPLAN, the Ministry of Agriculture and Livestock (MAG) and the Universidad Estatal a Distancia (UNED). The activity took place at the UNED and began with a development of a conceptual framework on the importance of designing data collection tools and the general criteria for selecting and using participatory tools.

Subsequently, the team worked with the Stakeholder Mapping previously built, identifying the information needs for each social actor in the evaluation. Based on this identification, some stakeholders were prioritized and working groups were organized to start designing specific instruments, considering the particularities of each selected stakeholder and the criteria shared in the workshop. To guide this process, Vanesa presented a scheme of collection tools classified according to modality and purpose, in addition to sharing participatory evaluation (PE) methodologies developed in the EvalParticipativa initiative’s Toolbox, with the aim of providing inputs to facilitate the development of instruments adapted to the team’s needs. The purpose of this activity was to contribute to the ongoing evaluation process, strengthening the design of tools to collect relevant and useful information for decision making.

RESEARCH SEMINAR ON PARTICIPATORY EVALUATION METHODOLOGIES

This seminar was developed online and onsite through the Postgraduate Program in Evaluation of Development Programs and Projects that has being implemented by the University of Costa Rica for more than twenty years. The activity brought together advanced students of the master’s program, graduate professionals and professors interested on adopting participatory approaches in their research or professional practices.

The purpose of the seminar was to provide a conceptual and methodological framework on PE, with a specific focus on its use in social research. During the session, the principles of PE, its methodological advantages and challenges, and its potential to generate critical and applicable knowledge in the evaluation of development programs and projects were explored. In addition, through the analysis of these principles, methodological guidelines and tools, participants identified ways to integrate PE into their own projects, considering key aspects such as research design, data collection, analysis and interpretation of results.  The dynamics of the seminar promoted interdisciplinary dialogue and the exchange of experiences among those interested in the design, implementation and evaluation of public policies, social programs and development projects.

TRAINING COURSE ON PARTICIPATORY EVALUATION

A third activity was the training on conceptual and instrumental approaches to evaluation with focus on social inclusion, held at the Ministry of National Planning and Economic Policy (MIDEPLAN) and jointly organized with the Evaluation and Monitoring Unit of MIDEPLAN, FLACSO and the Postgraduate Program in Evaluation of Development Programs and Projects of the University of Costa Rica (UCR-PEPPD).

The activity brought together representatives from various public and academic institutions in Costa Rica. The purpose of the workshop was to learn about and experiment with tools for the incorporation of PE in different areas of work of the Costa Rican government. The workshop explored the key principles of this approach, its advantages and challenges, as well as strategies for its application in different institutional contexts. Through group work dynamics and practical exercises, participants identified opportunities to integrate participatory evaluation into their evaluation processes, adapting it to the needs and context of each sector.

The diversity of the participants’ profiles enriched the debate and consolidated the co-construction of knowledge that characterized this workshop. Representatives of the following entities and organizations participated in this training session: MIDEPLAN-UEV (Evaluation and Monitoring Unit, Ministry of National Planning and Economic Policy), MAG-SEPSA (Executive Secretariat for Agricultural Sector Planning, Ministry of Agriculture and Livestock), DESAF-UEVAL (Evaluation Unit of the Office of Strategic Affairs of the Government of Costa Rica), MCJ (Ministry of Culture and Youth), MEIC (Ministry of Economy, Industry and Commerce), MINAE (Ministry of Environment and Energy), PANI (National Child Welfare Agency), FLACSO, UCR-PEPPD (Postgraduate Program in Evaluation of Development Programs and Projects of the University of Costa Rica), MCJ-SEPLA (Planning Secretariat of the Ministry of Culture and Youth).

TRAINING ON EVALUATION OF SOCIAL INTERVENTIONS: MAIN CONCEPTS, APPROACHES AND TOOLS

This last training, held at FLACSO Costa Rica’s headquarters, was organized jointly with the Institute for Municipal Development and Advisory Services (IFAM). The purpose of the training was to strengthen the planning and evaluation capacities of municipal officials.

The workshop was attended by professionals with diverse knowledge and experience in evaluation, who are responsible for implementing and monitoring public and social interventions at the local level. The workshop brought together professionals from different municipalities in Costa Rica, who play strategic roles in project management and public policy evaluation. Among the participants were institutional planners, public investment analysts, municipal strategy managers and support professionals in citizen participation. In addition to strengthening their institutional capacities, the conference provided a valuable horizontal exchange among participants, who shared experiences, challenges and lessons learned from their own contexts.

Throughout the day, the participants worked on the fundamental concepts of evaluation, its importance in public management and the different approaches and methodologies available. The proposal combined theoretical presentations with dynamic activities, allowing participants to understand how to apply practical tools in their respective municipalities.  The day ended with a space for dialogue and exchange of ideas on how to integrate evaluation into municipal management effectively, and the challenges it represents, ensuring that the processes are useful for decision making and continuous improvement of local interventions.

FINAL REMARKS ON MOBILITY EXPERIENCE

The international mobility of professors and researchers represents multiple benefits for all the institutions involved. On the one hand, it allowed Costa Rican institutions to access methodologies and tools developed by EvalParticipativa, enriching their institutional capacities and fostering inclusive and collaborative approaches in their evaluation processes. On the other hand, for the UNSJ and particularly for the PETAS team, the experience represented an opportunity for field learning, validation of instruments and strengthening of academic and technical links with counterpart organizations in the region. In addition, a regional collaboration network was consolidated with potential for future joint interventions, development of methodological resources and new opportunities for shared training.

This experience reaffirms SEPRI UNSJ’s commitment to its objective of promoting significant academic internationalization processes, generating new institutional alliances and favouring the circulation of knowledge between territories. Establishing ties with institutions such as MIDEPLAN, UNED, UCR, FLACSO and IFAM not only represents a concrete achievement for the team that participated in the mobility, but also opens the way for future initiatives to strengthen research and training with regional projection. We invite you to see the photo gallery of these activities.

This slideshow requires JavaScript.

THINKING TOGETHER ABOUT PARTICIPATORY EVALUATION

DOSSIER # 3

A few months ago, we publicly presented Dossier # 2, Thinking Together about Participatory Evaluation, with the aim of compiling and showcasing the various contributions generated by our community of practice and learning. This publication brought together brief case studies, concrete experiences, and reflective articles that highlight the richness, diversity, and complexity of participatory evaluation practices in Latin America and the Caribbean, while also welcoming contributions from colleagues in other global contexts.

The compilation of these texts in the Dossier format has facilitated their dissemination, providing broader access to a significant body of reflections that illustrate the current vitality of participatory evaluation in the region. In this same spirit, Dossier # 3 continues along this path, reaffirming our commitment to incorporating a multiplicity of voices and experiences. We also hope that this material will serve as a resource for consultation and debate within public institutions, foundations, civil society organizations, and emerging evaluators, as well as a valuable pedagogical tool in graduate programs focused on training evaluators with a participatory perspective.

Continue reading

Launch of INCE in Africa

New inter-learning opportunities to strengthen National Evaluation Systems

by Celeste Ghiano

During the last week of March, I had the privilege to participar as a consultant for the World Food Program in the Launch of the first pilot of the Index of National Capacities in Evaluation (INCE) in six countries in Africa.

This privilege is an enhanced fruit of my participation in the first workshop to create the INCE in and for Latin America in 2019. From there, I was hooked on this initiative that promotes the strengthening of National Evaluation Systems. That is how I was invited  to participate as a consultant for its development and then to carry out the pilot test. Currently, I continue to be part of this exercise that has already taken up to three measurements in some of the eleven countries that already use this tool to self-evaluate their evolution, enhance their strengths and work on the challenges they still present, as well as learn from other countries.

Continue reading

Disability inclusive evaluation & research: What is it and how can we do it?

by Mary Wickenden

Introduction

In the past, people with disabilities have been left out of many aspects of life including research and evaluation. They have not usually been included in ‘mainstream’ studies about key topics such as health, education, WASH, gender empowerment, social and political participation, while other groups in populations are more routinely asked for their views and their qualitative data is collected.

It is often perceived to be too difficult or expensive to include disabled people. This is discriminatory and leads to continued lack of understanding about their lives. We need to collect, both in research and evaluation, disability-inclusive data to understand disabled people’s  perspectives, situations and needs, alongside others’ views.

Continue reading

Different methods of storytelling in Africa. The ‘story tellers’ and their perspectives.

At the beginning of 2024 we shared the article “The arrival of the two rivers. Scientific storytelling”, in which we analyzed the role of stories rooted in each community when it comes to linking scientific advances and the dissemination of knowledge with the work of local populations, their culture and their impact on research and -why not!- the evaluative field.

In September of the same year we reported on the lessons learned from the Retreat on Storytelling and Participatory Evaluation, that was held in Limbe, Cameroon, organized together with eBASE AFRICA. During this meeting we documented and socialized the rich African traditions of storytelling and its contribution to participatory approaches in evaluation.

Continue reading

QUESTION DICE. A TOOL TO HELP PEOPLE TALK ABOUT THEIR PROJECTS

by Juan Murciano

Hello community EvalParticipativa. In this post, I will present a tool that has been designed to help people talk about their projects by answering important questions that underpin their intervention’s Theory of Change (ToC).

What is a Theory of Change?

A project’s ToC is a collection of ideas that, on the one hand, seeks to explain the different reasons why an intervention is necessary, and on the other, describes how this intervention is going to solve the problems that have been prioritised. It is a detailed description of how and why the project designers think a project or programme will produce specific changes or impacts. It includes an analysis of the contexts, assumptions, interventions and impacts that are expected in the long-term.

Continue reading

INCORPORATING PARTICIPATION IN PERFORMANCE EVALUATION

Lessons from a Mexican programme providing financial assistance for individuals with permanent disabilities

by Karen Azucena Hernández González

The ideas I share in this post are largely based on my experience working as an analyst and consultant in the 2018 evaluation of the Mexican Pensión para el Bienestar de las Personas con Discapacidad Permanente (Financial assistance to promote the wellbeing of individuals with permanent disabilities; hereafter PBPDP as per its abbreviation in Spanish) during its first year of implementation. This social programme is aimed at people with permanent disabilities aged between 0 and 29 years; Afro-Mexicans with permanent disabilities aged between 30 and 64; and people with permanent disabilities that live in severely marginalised areas (ROP, 2021).

As a young evaluator in the evaluation team, I had the opportunity to familiarise myself with the programme, conduct fieldwork and play a role in its respective analysis. While there was no explicit request in the project’s terms of reference to include a gender, intercultural or intersectional perspective, I was able to identify spaces where the issue should be explored in depth and where we could study ways in which the programme could contribute to finding solutions.

Continue reading

PARTICIPATORY EVALUATION AND SOCIAL LEARNING

A NEW EPISODE OF THE EVALPARTICIPATIVA PODCAST

We continue to share the knowledge and feelings of colleagues and friends who are leaders in participatory evaluation in Latin America and other regions as well. In these podcasts we want to give a close and human perspective, where evaluative practice is closely linked to the personal experiences, stories and territorialities of the interviewees.

Continue reading