Design of a participatory evaluation of a public service for older adults in Ecuador

by Carmen Lucía Jaramillo 

The invitation we received to share the experience of designing the first participatory evaluation promoted from within the public sector in Ecuador represented a challenge both for me, as the facilitator of the process, and for Joselyn Corrales, who at that time was serving as Undersecretary for Evaluation in the state body responsible for evaluation.

The challenge lay in communicating clearly not only the methodological and conceptual aspects, but also the uncertainties, challenges and lessons learned arising from the design of the participatory evaluation of the Socialisation and Meeting Spaces for Older Adults, an intervention implemented by the Ministry of Economic and Social Inclusion.

Continue reading

DESIGNS AND METHODS FOR IMPACT ASSESSMENT

by Pablo Rodríguez Bilella

Over the past two decades, the movement aimed at achieving evidence-based policies has gained importance and prominence. It holds that policymakers should base their decisions on the best available evidence regarding “what works,” rather than on ideologies or in response to particular interests.

One of its assumptions is that not all evidence has been rigorous enough to provide certainty in decision-making. This accentuated the orientation toward supporting certain approaches and methodologies that, given their rigorous formulation, would lead to superior results. This general context has favored debate and discussion on impact evaluation from different spheres and spaces (political, academic, social, etc.).

Continue reading

Exploring Participation in Evaluation: Scope, Limits, and Lessons from Chile

by Rodrigo Quiroz Saavedra

When I wrote this paper (only in Spanish), my intention was not merely to present a case of participatory evaluation, but to invite the reader to delve into real evaluative practice and to look closely at what it truly means to open up spaces for participation in contexts where diverse actors are involved and significant asymmetries exist among them.

I chose as a case study the “Transition to Independent Living Programme” (PTVI) in Chile, implemented by Fundación Eres, because it brings together two key features: it works with young people with intellectual disabilities — a historically marginalised group — and it proposes a social and labour inclusion approach that places self-determination and the rights of persons with disabilities at its core.

Continue reading

Evaluating participation from a human rights perspective

by Solana Yoma

From very early on in my professional training, I saw human rights as a tool for challenging and transforming ethically unjust realities. Accordingly, when I graduated as a psychologist, I did not focus on addressing people’s suffering on an individual basis, but rather on understanding it in its collective dimension, designing strategies that sought to transform the social conditions that generate this discomfort.

This motivated my interest in integrating contributions from clinical psychology into the design, planning, implementation and evaluation of health policies, plans and programmes. Later, while working on my doctoral thesis, I set out to evaluate a mechanism for citizen participation in mental health from a human rights perspective, and there I identified a gap that I managed to fill with my research. In this post, I will talk about this modest contribution.

Continue reading

BOOK ON EVALUATION, INCLUSION AND DEMOCRACY IN LATIN AMERICA: EXPERIENCES AND LESSONS

OPEN CALL

A while back, we began working with colleagues in the region on the concepts of evaluation, inclusion and democracy in Latin America and the Caribbean. In the new EvalParticipativa project (2023-2024) we plan to revisit these ideas and produce a book on the subject. Our aim is to identify participatory evaluation experiences in Latin America and the Caribbean, analysing dimensions of inclusion and democracy, and emphasising the learning components generated by these experiences.

The book’s target audience is made up of individuals who are responsible for designing and carrying out evaluations, in the hope of increasing their awareness of the possibility and feasibility of conducting evaluations with civil society participation. We seek to bring this awareness both into their consciousness and onto their agendas. The book is intended for Latin American bodies that provide capacity building and training in evaluation, in the hope that it will make available real cases of evaluations carried out with the participation of civil society in the region. Our target readers are teachers and students in diploma courses, master’s degrees or other specialisations focused on evaluation and social planning, in the hope of influencing the training of professionals who will in the future be conducting, commissioning, supervising and assessing participatory evaluations in the region.

how to participate?

In this document we present a general, preliminary overview of the aspects we intend the book to address. We are clear that the focus should be on presenting one or more existing evaluation experiences as the core data for analysis, without excluding the possibility that some general remarks or proposals may be added where appropriate. In other words, a substantial part of each chapter should be devoted to a descriptive and analytical account of one or several evaluation experiences, while a smaller part may be dedicated to more general or propositional reflections that build on the first section.

This brief post is therefore an invitation to friends and colleagues of EvalParticipativa who are interested in contributing a chapter to the book to email their ideas to eval.participativa@gmail.com.

We will select the chapters that will be included in the book from the submissions we receive. We thank you in advance for sharing this announcement with colleagues and contacts interested in these topics.

Best wishes,
The EvalParticipativa team

EXPERIENCE CAPITALISATION: LEARNING BY DOING

by Jorge Chavez-Tafur

The term “experience capitalisation” is increasingly used to refer to the process of describing and analysing a project, programme or specific experience in detail, and producing lessons that can be shared and used to improve development interventions.

As in a systematisation process, this approach is believed to help identify specific innovations and practices, and -above all- to understand the reasons behind their successes or failures. One of the major benefits of an experience capitalisation process is that it involves all those who are -or were- part of the experience.

But how do we promote such a process, and what are the steps to be followed? And once we have decided to go ahead, how do we facilitate the participation of different people? These were some of the questions that we asked ourselves at the Technical Centre for Agricultural and Rural Cooperation (CTA) about five years ago, prompting us to initiate a project together with the Inter-American Institute for Cooperation on Agriculture (IICA) and the United Nations Food and Agriculture Organization (FAO). Financial support was provided by the International Fund for Agricultural Development (IFAD). From 2016 to the end of 2019, the project responded to the need to develop specific skills for describing and analysing specific experiences, identifying and disseminating lessons and recommendations, and putting these to use. Working in different parts of the world and focusing on analysing the steps that should be taken in processes of this kind, the project sought to encourage the adoption of a capitalisation process at different levels. To this end, we sought to capitalise on the experience we had embarked upon, to learn lessons about the process itself and to validate the approach followed.

Continue reading

Aligning agendas to promote participation in public policies

por Susana Menéndez-Roldán, María Dolores Torralbo-Obrero y Salustiano Luque-Lozano

A few months ago, the Practical Guide for Participatory Planning and Evaluation of Public Policies: Mainstreaming Participation (available in Spanish) was added to the EvalParticipativa Resources section. We, Susana Menéndez-Roldán, María Dolores Torralbo-Obrero and Salustiano Luque-Lozano, from the Andalusian Institute of Public Administration (Andalusia, Spain), have written this post to tell you more about this guide.

Citizen participation is the best way to achieve social inclusion. It is, after all, one of the goals included in the UN’s Sustainable Development Agenda (SDGs). More specifically, it aims to promote peaceful and inclusive societies that can achieve sustainable development, facilitate access to justice for all people, and build effective, inclusive and accountable institutions at all levels. Gender equality is another important goal to ensure the full and effective participation of women and equal leadership opportunities at all decision-making levels in political, economic and public life.

Continue reading

Empowerment evaluation: new materials at EvalParticipativa

by Pablo Rodríguez Bilella

As outlined in the planned activities for EvalParticipativa’s second stage, we are keen to keep adding to the RESOURCES section of our community of practice and learning.

As our colleagues and friends already know, the section already hosts a wide variety of testimonial videos, guides and manuals, tools, case studies and significant lessons. We highlight new and updated material that we add to the repository on our social networks, Facebook, Instagram and LinkedIn: another reason to follow us online!

In this post, we want to highlight four recent additions to the Guides and Manuals section. They all share a clear theme: the empowerment evaluation approach. Although participatory evaluation is the general or umbrella term that refers to stakeholder involvement in evaluation processes in Latin America, the same is not true in the Anglo-Saxon context, where nuances between different evaluation approaches that include or involve stakeholders are more commonly accentuated.

Continue reading