ELEVATING TSAATAN VOICES: SOWING THE SEEDS OF EVALUATION IN MONGOLIA

 by Gereltsetseg Adiya, Oyuntulkhuur Jukov, Itgemjit Gankhuyag and Azjargal Amarsanaa

With the enforcement of Mongolia’s Law on Special Protected Area (*),  97% of Tsagaannuur soum in Khuvsgul province where the Tsaatan live has been declared a strictly protected zone. This has placed major restrictions on their traditional way of life: hunting, seasonal migration, reindeer herding, and pasture use have all become increasingly limited. These restrictions directly affect their food security, cultural traditions, and quality of life.

Recognizing that the Tsaatan voices have been systematically excluded from designing, implementing and evaluating policies, this participatory and culturally responsive evaluation demonstrates how meaningful participation can transform the evaluation of conservation policies – by centering Tsaatan people’s traditional knowledge and ensuring their perspectives directly shape evaluations and are considered in policy making, that affect their ancestral lands.

Continue reading

DESIGNS AND METHODS FOR IMPACT ASSESSMENT

by Pablo Rodríguez Bilella

Over the past two decades, the movement aimed at achieving evidence-based policies has gained importance and prominence. It holds that policymakers should base their decisions on the best available evidence regarding “what works,” rather than on ideologies or in response to particular interests.

One of its assumptions is that not all evidence has been rigorous enough to provide certainty in decision-making. This accentuated the orientation toward supporting certain approaches and methodologies that, given their rigorous formulation, would lead to superior results. This general context has favored debate and discussion on impact evaluation from different spheres and spaces (political, academic, social, etc.).

Continue reading

Exploring Participation in Evaluation: Scope, Limits, and Lessons from Chile

by Rodrigo Quiroz Saavedra

When I wrote this paper (only in Spanish), my intention was not merely to present a case of participatory evaluation, but to invite the reader to delve into real evaluative practice and to look closely at what it truly means to open up spaces for participation in contexts where diverse actors are involved and significant asymmetries exist among them.

I chose as a case study the “Transition to Independent Living Programme” (PTVI) in Chile, implemented by Fundación Eres, because it brings together two key features: it works with young people with intellectual disabilities — a historically marginalised group — and it proposes a social and labour inclusion approach that places self-determination and the rights of persons with disabilities at its core.

Continue reading

ICONOCLASISTAS: an invitation to collective creation for understanding processes of change and transformation

DEVICES FOR COLLABORATIVE RESEARCH, ITINERANT COLLECTIVE MAPPING, CRITICAL CARTOGRAPHIES AND PEDAGOGICAL RESOURCES FOR COMMUNITY USE

by Pablo Ares and Julia Risler

Iconoclasistas was born in 2006 as a space that brings together graphic art, activism, critical pedagogy and collective working methodologies. Since then, the initiative has consolidated as a device that combines visual poetics, political reflection and critical pedagogies, always incorporating the environmental dimension.

We see ourselves as activists, though not in the partisan or institutional sense. We understand our practice as a militancy of doing, sustained through networks, ties and affections activated from the body, the territory and collaborative practices. We recognise ourselves as part of a broad and dynamic fabric made up of collectives, social movements and organised communities, articulated more by political, ethical, aesthetic and environmental affinities than by rigid structures.

Continue reading

Conceptualising Participatory Evaluation in a pluralistic and collective way

by Esteban Tapella

Dear colleagues and friends of the EvalParticipativa community, in this article we will present two tools to facilitate the construction of a shared conceptual framework around Participatory Evaluation.

These tools were designed within the framework of our community’s capacity building strategy, and are aimed at project leaders, socio-cultural animators and professionals working in the field of programme and project management and evaluation.

Continue reading

Outcome Harvesting for Participatory Monitoring: A Conversation Between Colleagues

By Giovanna Montagner and Carmen Wilson-Grau

Outcome Harvesting is a participatory method used to identify, formulate, analyze, and learn from the changes brought about by an intervention, especially when cause-effect relationships are complex or unknown.

Rather than focusing on predefined objectives, it looks at what has actually changed and how the program contributed to those changes. This method emphasizes utilization, enabling evaluators, donors, and project/program managers to identify, formulate, verify, and make sense of the outcomes of an intervention.

This method brought us together. We met in 2019, when Giovanna, after attending a training on Outcome Harvesting, contacted Carmen to practice with her. Since then, we’ve kept up the habit of having virtual coffee chats every now and then. Today, we’ve come together to talk about Carmen’s experience using Outcome Harvesting for monitoring.

Continue reading

Transforming policies and strengthening democracies

The role of participatory evaluation in contexts of polarization in Latin America

by Leopoldo Font

At a crucial moment for Uruguay (my country) and the region, reflection on the role of participatory evaluation takes on particular relevance. Despite their limitations, evaluation tools offer a unique opportunity to address current challenges in an effective and sustainable manner. On the one hand, these tools can contribute to reducing polarization, foster collaboration and promote more inclusive solutions; on the other hand, they require significant resources and face the risk of bias in their implementation.

This article, based on my publication in La Diaria, seeks to connect the central ideas developed in that text with the participatory and transformative perspective that characterizes the EvalParticipativa community of practice and learning. Thus, it explores how these tools can act as a catalyst to overcome divisions, build bridges between diverse sectors and promote a more just and equitable development.

Continue reading

Storytelling and the Testimonial Series. Part 2

Storytelling is a universal feature of human culture that is used to communicate, educate and entertain. The simplicity of storytelling ensures that the audience participates and understands the messages the storyteller intends to convey. But storytelling is not simple; it is an art that has evolved and transformed throughout human existence.

With the intention of learning more about this topic and strengthening capacities for its use, we called Storytellers and asked them to share their different perspectives, as well as the different forms and techniques for storytelling. This is how we created the series “INVISIBLE STORIES, MADE VISIBLE. STORY TELLING IN AFRICA”. The series features new and old generation artists, academics, researchers and the local community showing how storytelling and evaluation can be connected in different ways, from data collection and analysis to dissemination of the knowledge generated.

Today we share the second part of the series, where Bambo Idriss Waintum presents a unique way of telling stories through painting one’s own body with natural dyes.

Continue reading

Disability inclusive evaluation & research: What is it and how can we do it?

by Mary Wickenden

Introduction

In the past, people with disabilities have been left out of many aspects of life including research and evaluation. They have not usually been included in ‘mainstream’ studies about key topics such as health, education, WASH, gender empowerment, social and political participation, while other groups in populations are more routinely asked for their views and their qualitative data is collected.

It is often perceived to be too difficult or expensive to include disabled people. This is discriminatory and leads to continued lack of understanding about their lives. We need to collect, both in research and evaluation, disability-inclusive data to understand disabled people’s  perspectives, situations and needs, alongside others’ views.

Continue reading

Quality criteria for monitoring in development cooperation

by Dagmar Schumann

The idea for the document shared in this post was first discussed during a conference on monitoring in Germany. Our objective was to identify literature on broadly applicable quality standards or criteria for monitoring that could be considered nearly universal in their validity and application. While such documents exist for evaluation and research, no comparable paper could be found for monitoring.

A team of experienced German consultants specialising in planning, monitoring, and evaluation undertook the task of carefully examining this knowledge gap and developing a detailed document in response. We started by asking ourselves what ‘effective’ monitoring looks like. The first step was to conduct an extensive literature review. Subsequently, we developed the document ‘Quality Criteria for Monitoring in Development Cooperation‘ based on a thorough qualitative analysis of all available information.

Continue reading