WEAVING NETWORKS THROUGH THE EXCHANGE OF KNOWLEDGE

INTERNATIONAL TRAINING MOBILITY EXPERIENCE IN COSTA RICA

Dr Vanesa Castro, professor and researcher from PETAS, the Research Program on Employment, Environment and Society at the National University of San Juan, Argentina (UNSJ), participated in an intense and enriching experience in Costa Rica within the framework of the International Mobility Program promoted by the Secretariat of Postgraduate Studies and International Relations (SEPRI) of the UNSJ.

For two weeks, between March 10 and 20, Vanesa carried out a process of academic exchange and knowledge sharing, working with leading actors of Costa Rican State and academic institutions. The main objective of this program, supported by SEPRI, is to strengthen the global involvement of UNSJ through the exchange of experiences, inter-institutional collaboration and the development of joint research projects, generating cooperation networks and promoting the transfer of knowledge that contributes to the improvement of public policies and the formation of an academic community committed to regional development.

MOBILITY PROGRAM

The working agenda is part of the Technological and Social Development Project 2023-2025, developed by PETAS, which is aimed at strengthening the exchange and interaction with institutions in the region interested in deepening knowledge and strengthening experiences in collaborative and inclusive approaches to evaluation. The work plan was designed jointly with relevant Costa Rican institutions, including the Monitoring and Evaluation Unit of the Ministry of National Planning and Economic Policy (MIDEPLAN), the Latin American Department of Social Sciences of Costa Rica (FLACSO) and the Graduate Program in Evaluation of Development Programs and Projects of the University of Costa Rica (UCR). These entities collaborated closely to define an itinerary that combined workshops, seminars and trainings within the framework of the EvalParticipativa initiative implemented by PETAS in alliance with the German Institute for the Evaluation of Development Cooperation (DEval). This collaboration was key to align efforts and generate a space for exchange and mutual learning.

WORKSHOP ON THE DESIGN AND USE OF DATA COLLECTION INSTRUMENTS

In this first activity, Vanesa facilitated a training session for the team in charge of the Evaluation of the Promotion of Organic Agriculture in Costa Rica, with the participation of representatives from MIDEPLAN, the Ministry of Agriculture and Livestock (MAG) and the Universidad Estatal a Distancia (UNED). The activity took place at the UNED and began with a development of a conceptual framework on the importance of designing data collection tools and the general criteria for selecting and using participatory tools.

Subsequently, the team worked with the Stakeholder Mapping previously built, identifying the information needs for each social actor in the evaluation. Based on this identification, some stakeholders were prioritized and working groups were organized to start designing specific instruments, considering the particularities of each selected stakeholder and the criteria shared in the workshop. To guide this process, Vanesa presented a scheme of collection tools classified according to modality and purpose, in addition to sharing participatory evaluation (PE) methodologies developed in the EvalParticipativa initiative’s Toolbox, with the aim of providing inputs to facilitate the development of instruments adapted to the team’s needs. The purpose of this activity was to contribute to the ongoing evaluation process, strengthening the design of tools to collect relevant and useful information for decision making.

RESEARCH SEMINAR ON PARTICIPATORY EVALUATION METHODOLOGIES

This seminar was developed online and onsite through the Postgraduate Program in Evaluation of Development Programs and Projects that has being implemented by the University of Costa Rica for more than twenty years. The activity brought together advanced students of the master’s program, graduate professionals and professors interested on adopting participatory approaches in their research or professional practices.

The purpose of the seminar was to provide a conceptual and methodological framework on PE, with a specific focus on its use in social research. During the session, the principles of PE, its methodological advantages and challenges, and its potential to generate critical and applicable knowledge in the evaluation of development programs and projects were explored. In addition, through the analysis of these principles, methodological guidelines and tools, participants identified ways to integrate PE into their own projects, considering key aspects such as research design, data collection, analysis and interpretation of results.  The dynamics of the seminar promoted interdisciplinary dialogue and the exchange of experiences among those interested in the design, implementation and evaluation of public policies, social programs and development projects.

TRAINING COURSE ON PARTICIPATORY EVALUATION

A third activity was the training on conceptual and instrumental approaches to evaluation with focus on social inclusion, held at the Ministry of National Planning and Economic Policy (MIDEPLAN) and jointly organized with the Evaluation and Monitoring Unit of MIDEPLAN, FLACSO and the Postgraduate Program in Evaluation of Development Programs and Projects of the University of Costa Rica (UCR-PEPPD).

The activity brought together representatives from various public and academic institutions in Costa Rica. The purpose of the workshop was to learn about and experiment with tools for the incorporation of PE in different areas of work of the Costa Rican government. The workshop explored the key principles of this approach, its advantages and challenges, as well as strategies for its application in different institutional contexts. Through group work dynamics and practical exercises, participants identified opportunities to integrate participatory evaluation into their evaluation processes, adapting it to the needs and context of each sector.

The diversity of the participants’ profiles enriched the debate and consolidated the co-construction of knowledge that characterized this workshop. Representatives of the following entities and organizations participated in this training session: MIDEPLAN-UEV (Evaluation and Monitoring Unit, Ministry of National Planning and Economic Policy), MAG-SEPSA (Executive Secretariat for Agricultural Sector Planning, Ministry of Agriculture and Livestock), DESAF-UEVAL (Evaluation Unit of the Office of Strategic Affairs of the Government of Costa Rica), MCJ (Ministry of Culture and Youth), MEIC (Ministry of Economy, Industry and Commerce), MINAE (Ministry of Environment and Energy), PANI (National Child Welfare Agency), FLACSO, UCR-PEPPD (Postgraduate Program in Evaluation of Development Programs and Projects of the University of Costa Rica), MCJ-SEPLA (Planning Secretariat of the Ministry of Culture and Youth).

TRAINING ON EVALUATION OF SOCIAL INTERVENTIONS: MAIN CONCEPTS, APPROACHES AND TOOLS

This last training, held at FLACSO Costa Rica’s headquarters, was organized jointly with the Institute for Municipal Development and Advisory Services (IFAM). The purpose of the training was to strengthen the planning and evaluation capacities of municipal officials.

The workshop was attended by professionals with diverse knowledge and experience in evaluation, who are responsible for implementing and monitoring public and social interventions at the local level. The workshop brought together professionals from different municipalities in Costa Rica, who play strategic roles in project management and public policy evaluation. Among the participants were institutional planners, public investment analysts, municipal strategy managers and support professionals in citizen participation. In addition to strengthening their institutional capacities, the conference provided a valuable horizontal exchange among participants, who shared experiences, challenges and lessons learned from their own contexts.

Throughout the day, the participants worked on the fundamental concepts of evaluation, its importance in public management and the different approaches and methodologies available. The proposal combined theoretical presentations with dynamic activities, allowing participants to understand how to apply practical tools in their respective municipalities.  The day ended with a space for dialogue and exchange of ideas on how to integrate evaluation into municipal management effectively, and the challenges it represents, ensuring that the processes are useful for decision making and continuous improvement of local interventions.

FINAL REMARKS ON MOBILITY EXPERIENCE

The international mobility of professors and researchers represents multiple benefits for all the institutions involved. On the one hand, it allowed Costa Rican institutions to access methodologies and tools developed by EvalParticipativa, enriching their institutional capacities and fostering inclusive and collaborative approaches in their evaluation processes. On the other hand, for the UNSJ and particularly for the PETAS team, the experience represented an opportunity for field learning, validation of instruments and strengthening of academic and technical links with counterpart organizations in the region. In addition, a regional collaboration network was consolidated with potential for future joint interventions, development of methodological resources and new opportunities for shared training.

This experience reaffirms SEPRI UNSJ’s commitment to its objective of promoting significant academic internationalization processes, generating new institutional alliances and favouring the circulation of knowledge between territories. Establishing ties with institutions such as MIDEPLAN, UNED, UCR, FLACSO and IFAM not only represents a concrete achievement for the team that participated in the mobility, but also opens the way for future initiatives to strengthen research and training with regional projection. We invite you to see the photo gallery of these activities.

This slideshow requires JavaScript.

Launch of INCE in Africa

New inter-learning opportunities to strengthen National Evaluation Systems

by Celeste Ghiano

During the last week of March, I had the privilege to participar as a consultant for the World Food Program in the Launch of the first pilot of the Index of National Capacities in Evaluation (INCE) in six countries in Africa.

This privilege is an enhanced fruit of my participation in the first workshop to create the INCE in and for Latin America in 2019. From there, I was hooked on this initiative that promotes the strengthening of National Evaluation Systems. That is how I was invited  to participate as a consultant for its development and then to carry out the pilot test. Currently, I continue to be part of this exercise that has already taken up to three measurements in some of the eleven countries that already use this tool to self-evaluate their evolution, enhance their strengths and work on the challenges they still present, as well as learn from other countries.

Continue reading

Action research and participatory evaluation

Five ways to improve your research or social change work

by Joanna Howard and Danny Burns

At IDS (Institute of Development Studies, Brighton, United Kingdom) we are passionate about our rich legacy of participatory methods, and we believe that Participatory Action Research (PAR) and evaluation are more important than ever in the current context of complex and polarising challenges.

Both participatory evaluation and PAR are methodologies that bring different perspectives into dialogue, help to identify systemic issues and generate actions to address them.

We have been running a short course in Participatory Action Research (PAR) for five years now, so it seems like a good moment to reflect on what we are learning about how this methodology can improve research and social change work, and its close links with participatory evaluation.

Continue reading

NEW TRAINING SET: “SOWING AND HARVESTING HANDBOOK” IN WHITEBOARD-ANIMATION FORMAT

It is with great joy that we share the news of the launch of a new resource in our community of practice and learning EvalParticipativa, aimed at accompanying and illustrating the Sowing and Harvesting, participatory evaluation handbook .

This is a set of five short videos, one for each core chapter of the manual, done in Whiteboard-animation format.

The Whiteboard-animation format (or whiteboard animation) has gained popularity as a form of communication and distance training. The logic of this tool is to tell an illustrated story, simulating that it unfolds and develops on a blackboard. The animations are accompanied by a scripted narration with the purpose of explaining, in an entertaining and simple way, concepts that, explained in another way, would not be easy to grasp in a few minutes.

Continue reading

“TELL ME AND I FORGET, TEACH ME AND I MAY REMEMBER, INVOLVE ME AND I LEARN”

EVALPARTICIPATIVA’S CAPACITY DEVELOPMENT STRATEGY

The Benjamin Franklin quote that we have used as the title is perhaps the best way to introduce this post, in which we wish to share some of EvalParticipativa’s recent experiences as part of its capacity development strategy in the region. Our contribution to capacity strengthening in Participatory Evaluation (PE) has made use of both online and face-to-face formats, and has focused on specific personal and organisational contexts.

The aim of these capacity development sessions was to ensure that participants were familiar with conceptual and methodological features of PE, based on participants’ own experiences and the contents of the “Sowing & Harvesting” handbook. Didactic tools and documentary videos prepared specifically for each context were combined so that participants could:

      • develop their knowledge, skills and capacities concerning the aims, steps and critical moments involved in this kind of evaluation;
      • acquire an initial understanding of how to implement a participatory approach and facilitate inclusive processes; and
      • gain a basic understanding of how to use the methodology, both to improve their own evaluation practice and to contribute to development processes across the region.

In this post, we share an account of three capacity development workshops, held in late July and early August in Ecuador, Colombia and Costa Rica. These training experiences were organised and facilitated jointly with local teams drawn from different academic and social organisations. Around sixty people were trained in three countries. This account speaks of the joint efforts and lessons learnt, of networking and synergy, of real-life challenges that were overcome, and of hopes about the possibility of constructing a Latin American society that is more just and inclusive and where, one day, nobody will be left behind.

Continue reading

ONLINE TRAINING ON PARTICIPATORY EVALUATION

Dear community,

A few weeks ago, we shared an interesting conversation on our platform about participatory evaluation possibilities in times of covid-19.

Many of you had already demonstrated great optimism and confidence that it could work and today we are pleased to be able to back this up with a little more information.

As you know, online formats have become the safest, if not the only, way to build capacity in these pandemic times. This has also been understood by the EvalYouth initiative and Focelac project leaders who have arranged a series of online workshops aimed at strengthening the capacity of young and/or emerging evaluators (YEEs) in the region. The University of Costa Rica has taught a Masters in Evaluation for over 17 years and is now delivering its program fully online and asked us to participate in the section on Participatory Evaluation which features in the modules on evaluation approaches for the Latin American reality.

Continue reading

THE FAIR HAS COME TO TOWN!

The last day of the First Gathering of Participatory Evaluation Experiences for Latin America and the Caribbean began with an invitation to reflect on the various techniques, tools and instruments used in PE.

Participants took it in turns to select tools that they felt comfortable using and put them into different categories: audiovisuals, narratives, graphics and texts, group/experiential activities. Then, they exchanged their experiences and perspectives on them.

The narrative tools included systematisation, testimonies, journals, the More Significant Change, stories from the future, studies of good practice, lifestyle analysis. Graphics and textual tools included collaborative drawings, transects and maps, stones and fishes, mind maps (of networks, resources and stakeholders), calendars, diagrams and matrices.

For group/experiential experiences, participants proposed simulation games, maps, sociometry, focus groups, collective mapping, community meetings and assemblies, timelines, workshops on varied themes.

Finally, in terms of audiovisual tools, they focused on techniques which include videos and photolanguage.

Then, armed with advice to practise active listening, we held a conversation over coffee around the following question: What is the main challenge we face in making sure that PE tools and instruments reach their full potential?

Continue reading

THE ART OF BEING A FACILITATOR

One of the most eagerly awaited sessions began with a challenge for those participants who arrived late: to carry out the Make an Eight forfeit, which involved drawing a figure of 8 with their bodies. This was a fun way to start our discussion on the following question: “What are we talking about when we refer to facilitation and facilitators?”.

Using a kinaesthetic version of multiple choice, the participants decided between true and false options regarding evaluation matrices, questions, social action theory, sources and tools.

Jorge Chávez–Tafur ran the session for facilitators and invited us to use introspection and hindsight to evaluate our own practice. He also took us on a tour of accepted international definitions of the term facilitation, which included entries as varied as yanapai -a Quechua term which means help- and Voorlichtingskunde -which alludes to the science of “lighting the way” in Dutch-. Taking into account the diversity of names, which at times shared little in common, he insisted that rather than agree on terms, the important thing was to capture all that they covered: content, effects and impact.

Continue reading

LEARNING AS A COMPASS FOR PARTICIPATORY EVALUATION

The sun decided to shine brightly, expressing its desire to participate in today’s activities. And so we began the second day in the hotel gardens. We summarised and reassessed the first day’s sessions with an evaluation which went beyond the scope of being a fun activity to enable us to reaffirm that learning is always better when done as a group.

The first part of the morning consisted in presenting three experiences which had the common theme of learning as a tool for collective empowerment.

Continue reading

PARTICIPATORY EVALUATION AS A KEY TO EMPOWERMENT FIRST DAY OF THE GATHERING FROM THE EARTH’S ‘CENTRE’.

With welcoming smiles and anticipation in their eyes, the participants shared their accents, nuances and idioms around a single topic: their experiences with Participatory Evaluation.

After personal and institutional introductions, one question caught the participants by surprise: “What do I like about myself.

Despite their humility and the fact that they were not used to talking so openly about themselves, everyone agreed on the same characteristics; passionate, intrepid, curious, humble and ready to learn. It was as if Participatory Evaluation attracts all those willing to be disruptive, not only in their personal lives but also in all the domains they come into contact with.

Continue reading