Whose story are we telling and who are the storytellers? The Most Significant Change

by Thomas Aston

Nowadays Most Significant Change (MSC) is used so loosely that it’s worth reflecting on the method’s original purpose. Rick Davies, who designed the method has an online list of MSC publications which comprises over 200 documents. Yet, I suspect, there is a widely varying quality of application.

The method emerged from an experience in Bangladesh where partners couldn’t agree upon indicators, so instead, the evaluation relied on people retelling their stories of significant change they had witnessed as a result of the project and explaining why they thought their story was significant. In a nutshell, programme participants became the storytellers.

Continue reading

A NEW EPISODE OF EVALPARTICIPATIVA PODCAST

We continue to share the knowledge and feelings of colleagues and friends who are leaders in participatory evaluation in Latin America and other regions as well. In these podcasts we want to give a close and human perspective, where evaluative practice is closely linked to the personal experiences, stories and territorialities of the interviewees.

In this second episode we present “Leading to Participate“, by Fabiola Amariles, a Colombian from Cali, who shares her learning and experiences in the field of evaluation from her extensive international experience, with a clear gender perspective and a central concern for the quality and usefulness of evaluation.

Continue reading

USE OF DRAWING AND DIAGRAMMING TO CAPTURE MULTIPLE PERSPECTIVES IN HIGHLY VULNERABLE POPULATION GROUPS (PERÚ)

Dear colleagues, we would like to share with you a new contribution to the EvalParticipativa Toolkit. It is a very unique tool, which appeals to the free expression and creativity of children and adolescents. We invite you to read the note and watch the video where Emma Rotondo presents the process of applying the technique of drawing and diagrams as an instrument capable of capturing multiple perspectives.

The use of this tool has been carried out with highly vulnerable populations in fragile and changing social contexts. Three cases are presented and recommendations are offered to incorporate this technique in individual interviews, focus groups and workshops, within the framework of program evaluation processes and systematization of experiences.

Continue reading

SIMILARITIES BETWEEN PARTICIPATORY EVALUATION AND OTHER LATIN AMERICAN APPROACHES

Relationships and connections between Participatory Evaluation and Popular Education, Participatory Action Research, the Systematisation of Experiences and Collaborative Evaluation

by Valdo Nicolas Cerpa Ubilla 

Participatory Evaluation (PE) has become established as a way of addressing challenges in the fields of education and community development in Latin America and the Caribbean. Our region is well known for its cultural diversity, wealth of traditions, and the challenges to community development posed by its high rates of poverty. In this context, PE is a beacon of hope that illuminates a more inclusive and participatory path.

The first aim of this text is to examine and reflect on the nature of PE and the ways it relates to Popular Education, Participatory Action Research (PAR), and the Systematisation of Experiences. The second aim is to contrast PE with Collaborative Evaluation. It is hoped that this reflection will catalyse the transformational potential of PE and its role in building fairer, more participatory societies in Latin America and the Caribbean.

Continue reading

WE EMBARK ON A NEW JOURNEY!

The EvalParticipativa Podcast

Today we welcome you to this new channel of exchange and articulation with our community of practice and learning (Spanish).

In each of its chapters we want to get to know and share the knowledge and feelings of different key players of participatory evaluation in Latin America and other regions as well. The podcasts aim to give a close and human perspective, where the professional intersects with the personal, and the evaluative practice appears closely linked to the personal experiences, stories and territorialities of the interviewees.

Continue reading

Evaluation and participation in socially committed university education: when everyone learns

by Andrés Peregalli

Tell me how you evaluate and I will tell you what kind of education you promote

The complex world that we inhabit values measurements and their virtues, often to an excessive degree. We thus live with the constant pressure to capture and make sense of learning that is taking place among individuals, groups and institutions.

Within such a context, the evidence that results from an evaluation instrument will be used as a proxy. In the best-case scenario, it is a solid and robust proxy. I once heard it said that evaluation in a university setting involves one person who is terrified (the student) and another who is bored (the lecturer). While all images are unfair to a point, this characterisation (still very common) is useful for identifying concepts/representations that allude to ways of understanding education, learning, teaching, evaluation and participation, and the effects they have on those who experience them. To put it another way: tell me how (what, why, when, who, where…) you evaluate and I will tell you what kind of education you promote.

This post describes a participatory evaluation experience in an undergraduate university setting. More specifically, it describes a Theoretical-Practical Seminar (TPS) within the department of Philosophy and Theology at the Catholic University of Argentina (UCA) that has been running for 10 years and is based on the Service-Learning (SL) pedagogy. The experience exemplifies a more profound epistemological and evaluative approach and another way of understanding teaching and learning. These political-pedagogical and didactic foundations are consistent with the educational model we are striving to pursue: a process of humanisation centred around the people who teach and learn. In this approach, there is no room for terror or boredom. Rather, the focus is on agency so that learning can flourish, be enjoyed and celebrated.

Continue reading

The Comings of the Two Rivers: Storytelling Science Data

By Patrick Okwen, Nange Lisette & Leonel Ayafor

Prelude to the Two Rivers

“Once upon a time on the planet Earth, science gathered loads of data from hard work by assiduous scientists. Unfortunately, this data was hidden behind barriers of complex scientific terms, financial paywalls, and languages that were not comprehensible to everyone. This River of Science flowed downhill but was not accessible to all. Then came the River of Stories, the storytellers worked with researchers to break down scientific language into stories, remove paywalls, and tell science stories in simple local languages. The two rivers flowed downhill and were now accessible to all” (Le Nomade).

Continue reading

Establishing the National Evaluation System: Opportunities for strengthening public policies in Paraguay

by Ana Rojas Viñales

The aim of this article is to highlight the need to institutionalise the valuable, yet still incipient, efforts being made in Paraguay to establish a culture of evaluation.

Why does Paraguay need a National Evaluation System (SNEP)?

Over the past 20 years, Paraguay has been working towards developing a system for the evaluation of public policies, with significant support from multilateral banks and bilateral cooperation. One of the most important advances has been the identification and measurement of the supply and demand for evaluation, together with a diagnosis of institutional and professional capacities to evaluate policies, programmes and projects.

If we consider the IDB’s Monitoring and Evaluation indicators (2015), Paraguay has only 0.7 points out of a possible 5, which highlights the need to strengthen the country’s evaluation capacities and supply. The National Evaluation Capacity Index (INCE) can be used as a snapshot of the situation in Paraguay in terms of evaluation in five dimensions (institutional structure, supply, quality, multi-agent spaces and use), showing the challenges and opportunities for the SNEP.

Continue reading

THE GREATER THE PARTICIPATION, THE GREATER THE USE OF EVALUATION

CASES OF MEXICO AND COSTA RICA

The principles outlined in the 2030 Agenda provide us with the opportunity to promote government-led evaluations in which the active participation of all stakeholders is the key element that allows us to advance along the road to social transformation and sustainable development while ‘leaving no one behind’.

Within this framework, two participatory evaluation experiences were carried out between 2019 and 2021 by the governments of Mexico and Costa Rica, with the support of the Focelac+ project ‘Strengthening a Culture of Evaluation and Learning in Latin America with a Global Outlook’, run by Deval, the German Institute for Development Evaluation.

Continue reading

Can digital approaches to monitoring, evaluation, research and learning support participation?

by Linda Raftree 

Back in the 2010s, the world was buzzing about the potential for digital tools to revolutionize and democratize most everything – SMS for community feedback loops, mobile phones for citizen journalism, open data to improve transparency and accountability, social media platforms for people to make themselves heard without needing to be part of the elite, and networks so that social movements could organize in resilient ways at very low cost.

A decade later, there have been enormous shifts and changes that have benefited participation. However as often happens, these spaces have also been appropriated and taken advantage of by those who are seeking to maintain their status and power.

Continue reading