Detailed programme
Methods workshops
Methods worskhop 1: Participatory GIS for evaluation | Dr. Dorothea Deus
Description workshop
Geographic information system (GIS) is used for solving various societal problems, as a tool for decision making, automation, map creation and communication. GIS has become highly widespread in our society as platforms for doing many core functions in monitoring and evaluation. Participatory GIS have gained much prominence in monitoring and evaluation because of its inclusion and involvement of stakeholders and its capability to provide first hand spatial-temporal information regarding program/project implementation status and sustainability. The use of PGIS in evaluation of activities is intended to support informed decisions for sustainable programs and projects. PGIS in evaluation improves the efficiency and communications of the program/project outcomes to decision makers and beneficiaries. The aim of the upcoming workshop is to provide some understandings and develop capacity on PGIS evaluation technique. The PGIS workshop contents include; Introduction to evaluation and participatory evaluation; Introduction to GIS and PGIS; Application of PGIS in evaluation for sustainable program/project; Participatory data collection for evaluation (data collection approaches and tools); Integration of evaluation and spatial data in to GIS (data input and management); Evaluation data analysis and visualization using GIS for informed decision making (Information derivation, map creation and presentation). The PGIS workshop will consist of a presentaion, discussions, and hands on practical.
Bio presenter
Dr. Dorothea Deus is a Head of Department and Senior Lecturer in the Department of Geospatial Sciences and Technology at Ardhi University, Dar es Salaam, Tanzania. She holds a PhD in Remote Sensing and Environmental Geoscience from Freiberg University of Mining and Technology, Germany, MSc. in Geomatics from Ardhi University, Tanzania and BSc. in Land Surveying from the University of Dar es Salaam, Tanzania. Her research interest focuses on Geographical Information Systems (GIS), Participatory GIS, web-GIS, remote sensing, disaster risks, mapping, spatial analysis and modeling, climate change, water resources, monitoring and evaluation, and environmental applications related to geospatial solutions.
Methods workshop 2: Visual methods for evaluation | Dr. David Musoke
Description workshop
The workshop will introduce participants to visual methods for research and evaluation, providing examples such as photo elicitation, photovoice, participatory video, and video diaries. Photovoice will be explored in more detail as a case study of using visual methods for research and evaluation. Some of the key topics to be covered will include: what is photovoice; the photovoice methodology; benefits and challenges of using photovoice; experiences of using photovoice in Uganda; and use of photovoice in evaluation. The workshop will include a practical session on the use of photovoice in evaluating a community-based project.
Bio presenter
Dr. David Musoke is a Senior Lecturer at Makerere University School of Public Health, Uganda. He is Co-Chair of the Community Health Workers Thematic Working Group of Health Systems Global, a Senior Visiting Fellow at Nottingham Trent University (UK), and an Affiliate Member of the African Academy of Sciences. He has done vast public health research using photovoice in Uganda which has been published extensively. Dr. Musoke has published over 100 peer-reviewed articles and 4 book chapters, and is an Academic Editor for BMC Public Health, BMC Health Services Research, and PLOS Global Public Health journals.
Methods workshop 3: Life stories and narrative tools for evaluation | Martha Mutua
Description workshop
Martha's session in the workshop on narrative methods for evaluation will delve into the captivating realm of qualitative narrative life stories as an interactive evaluation method. She will guide participants through the art of using life stories as a powerful tool for evaluating programs and projects. Attendees can expect to gain a comprehensive understanding of critical aspects involved in life stories research, encompassing research design, sampling techniques, data collection methods, analysis, interpreting and creating visualizations, and how these narratives yield valuable insights into the impact of interventions across a wide array of topics. This hands-on workshop promises to equip participants with a deeper understanding of narrative life stories for evaluation and their application in real-world contexts, including a dedicated session for practical participation.
Bio presenter
Martha Mutua’s expertise centers on the comprehensive management and execution of research programs, backed by eleven years of dedicated experience covering a wide spectrum of sectors, including socioeconomic empowerment, agriculture, citizen science, community engagement, cash transfer, education, digital financial inclusion, and more. She is proficient in both quantitative and qualitative research methods and has experience working with teams in diverse settings across East and West Africa. For further details, you can visit Martha's LinkedIn page https://www.linkedin.com/in/martha-mutua-878ba420b/
Methods workshop 4: Social network analysis for evaluation | Sara Dewachter
Description workshop
The workshop “ Social Network Analysis and Evaluation” will introduce the participants into the basics of social network analysis and illustrate its use for evaluation. In a first part of the workshop, some basic concepts and measures will be explained using for simple, specific and interactive examples and exercises. In a second, part of the workshop, the participants will themselves already do some basic social network analysis using the UCINET software. Some basic exercises will illustrate how SNA can be used and what type of questions it could tackle. The workshop closes by zooming on the use and applications of social network analysis for evaluation.
[Participants are invited to bring their laptops and install the software on beforehand as well as download a folder with datasets to practice on. Participants ideally work together in groups of two. So if you do not have a laptop available, you can be paired to a participant who does have one.]
Bio presenter
Sara Dewachter holds a doctorate in Political Science and is a post-doctoral researcher at the Institute of Development Policy and Management, University of Antwerp. Recent research focuses on political participant and efficacy, national evaluation societies, local-level M&E, community-based monitoring, citizen science and cash transfers. Together with Nathalie Holvoet she has organized several short term evaluation capacity building seminars.
Thematic workshops
Thematic workshop 1: Indignizing evaluation | Rosetti Nabbumba Nayenga & Josephine Watera
Description workshop
The session will explore the conceptual and practical applications of the Made in Africa Evaluation (MAE) and Indigenizing Evaluation in light of the changing trends in global thinking. The Barazzas, African Evaluation Principles (AEP) and the Indigenous African Ethical Protocol for Evaluations offer important examples of the practical applications of these innovative concepts. The recent signing of a proclamation between the African Evaluation Association(AfrEA) and the African Evaluation Association (AEA) Democracy, Rights and Governance Thematic Interest Group represents an innovative model for sister partnership to foster learning in evaluative practices between the Global North and Global South.
Bio presenters
Rosetti Nabbumba Nayenga is an Agricultural Economist and a Monitoring and Evaluation Practitioner. She is the Deputy Head, Budget Monitoring and Accountability Unit, Ministry of Finance, Planning and Economic Development in the Government of Uganda. Serves as the President of the African Evaluation Association (AFREA); Member of Advisory Council for CLEAR-AA; Expert on the UN Evaluation Advisory Committee for the Inspection and Evaluation Division; Council Member for the International Evaluation Academy; Member of Rotary International Joint Strategic Planning Committee. She is past Rotary District Governor for Uganda and Tanzania.
Josephine Watera is the Assistant Director, Research Services and previous Head of the Monitoring and Evaluation Division in the Parliament of Uganda. She has over 16 years experience in research, monitoring and evaluation and evidence-based systems. Josephine supported development of responsible evaluation guidelines for the Independent Evaluation Group of the World Bank. Led development of the African Evaluation Principles, 2021. She is a member of the Independent Evaluation Panel of the Global Fund, former Board Member of the International Development Evaluation Association, and Vice President Uganda Evaluation Association. PhD candidate in Programme Evaluation.
Thematic workshop 2: Citizen & community based monitoring | Nathalie Holvoet & Doreen Kyando
Description workshop
The workshop will introduce participants to the topic of citizen and community-based monitoring (CBM). They will be familiarized with CBM’s rationale, different objectives, possible benefits and challenges. We will discuss different types of CBM, taking into account different degrees of participation of various stakeholders and its implications on benefits and challenges. Additionally, we will introduce a possible analytical framework to understand and analyse CBM and more broadly, social accountability initiatives. Insights from theory and literature will be combined with discussion and several exercises in which participants will be invited to apply insights and bring in their own experiences and reflections on the topic.
Bio presenters
Nathalie Holvoet (PhD Applied Economics, University of Antwerp) is a full-time professor at the Institute of Development Policy, University of Antwerp. She has a long track record of academic teaching and training, research and policy advisory work in the area of monitoring & evaluation (methodological aspects, systemic and policy-related dimensions) and gender & development (macro & micro dimensions, including gender budgeting, gender-sensitivity of national policies & institutions & aid, intrahousehold resource allocation). Together with Sara Dewachter and Lisa Popelier she organized a short term evaluation capacity building seminar in 2015, 2016 and 2018. Nathalie has been/is leading various research projects funded by Flemish Research fund, European Commission, UN Women, etc. She is also involved in various north and south projects of university development cooperation. Current research and evaluation projects more specifically focus on community-based monitoring, use/influence of M&E, evaluability, intrahousehold decision-making and climate change, cash transfers. She has published in different publication outlets and is a member of the European Evaluation Society (EES), the International Development Evaluation Association (IDEAS), the European Association of Development Institutes (EADI) and an active co-founding member of the Flemish Evaluation Platform (VEP).
Doreen Kyando is a lecturer at Mzumbe University and a PhD student at the Institute of Development Policy (IOB) of the University of Antwerp. She is studying the implementation of the Community-Based Monitoring approach in the water sector in rural Tanzania. As part of her doctoral path, she is involved in EndFragmentFuatilia Maji project. This is a mobile Community-Based water monitoring project implemented in Mvomero District, Morogoro, Tanzania. Before joining the IOB PhD program, Doreen was assistant lecturer at Mzumbe University in Tanzania. Her research interests include natural resources management, economics, water services
Thematic workshop 3: Use of (big) data | Morine Amutorine, Bright Onapito & Marian Muyingo
Description workshop
Presentation: The Future of Evaluation with Big Data and Digital Innovation
Session summary: The presentation will introduce participants to UNGP and its work in Uganda, focusing on performance monitoring. It will showcase data-centric digital innovations in and outside Uganda that have the potential to influence evaluation practices. Additionally, it will discuss our efforts in fostering an enabling environment for increased data usage and promoting a data-driven culture in Uganda.
Practical Session - a futures and foresight activity
The Future of Evaluation and Data using Strategic Foresight
Session Summary: Now that the participants appreciate the cruciality of data for monitoring and evaluation, the practical session will be a space to anticipate, prepare, and shape the desired future regarding data governance. While the future cannot be known, exploring different future scenarios can help us imagine the plausible risks and opportunities and, with that awareness, make better decisions. The participants, therefore, will explore the implications of alternative futures regarding data governance for different stakeholders and strengthen long-term thinking, emphasizing the consequences of inaction.
Bio presenters
Morine Amutorine is a data analyst who is passionate about data-driven narratives, and her work has been about analyzing, visualizing, and communicating data for humanitarian action. She has worked with several datasets including public radio data, Google search data, and mainstream social media, analyzing public perceptions on topics that inform the work of the SDGs. She is also a researcher, and a teacher, and loves storytelling. Connect with Morine via her medium channel https://medium.com/@amutorine, LinkedIn: morine-amutorine, or Twitter: @theAmutorine.
Bright Onapito is a Data and AI Governance expert and a professional Software and Data Engineer with 14 years of experience in the IT industry. He has worked in the international development sector, nongovernment, government and private sector to leverage technology and data to solve real-world problems. Bright is passionate about leadership, mentorship and community development. He is also a hobbyist musician who plays the guitar and piano, a writer and Space enthusiast. Contacts: Cell: +256 776 629007; Email: onabright@gmail.com / bright.onapito@undp.org ; Online: www.brightonapito.com
Thematic workshop 4: Conflict / fragility and evaluation | Sonya Ochaney & Hur Hassnain
Description workshop
The workshop is focused on the knowledge and learning outlined in the IDEAS’ book on ‘Evaluation in Contexts of Fragility, Conflict and Violence’. It delves into the intricacies of evaluation in uncertain environments. It offers insights into the challenges posed by fragile and conflict-affected contexts and outlines key steps to navigate them while measuring different levels of results. The workshop extends its focus to contemporary approaches, emphasizing the significance of remote and ICT-enabled data collection, accompanied by real-life examples for practical understanding. A critical aspect covered is the closure of the evaluation learning loop and deriving meaningful insights from it. Participants can expect a comprehensive exploration of strategies and techniques tailored for evaluating projects and outcomes in contexts marked by fragility, unpredictability, and volatility.
Bio presenters
o Hur Hassnain (MDS, MBA) is an evaluation specialist, author, the founder of Pakistan Evaluation Association and treasurer at the International Evaluation Academy. Based in Brussels, Belgium, he is the senior evaluation specialist for the European Commission, DG INTPA and DG NEAR’s external service on Monitoring, Evaluation, Learning, and Design for External Action supporting the headquarter units, and about 96 EU Delegations around the world (since 2019). He has conducted and led evaluations for civil society, multilateral and bilateral development organisations in a range of thematic areas such as gender equality, education, rural development, agriculture, environment, and women’s economic empowerment. Hur has authored several internationally peer reviewed publications, including a book as lead author: Evaluation in Contexts of Fragility, Conflict and Violence (2021) which presents an interesting argument that “evaluation” – like development aid itself – can unintentionally exacerbate tensions in ways that can negatively affect people and institutions if care is not taken in designing and approaching it with caution and sensitivity.
Other workshops
Ideas lab: How VOPEs can strenghten evaluation
Team captains:
Youth (Naser Quadous & Frankline Ojong), VOPE (Tsigereda Bekele & Michée Sagara) Policy actors ( Sakina Mwinyimkuu & Myranda Lutempo), International actors (Eddah Kanini & Awuor Ponge), Academia ( Shyam Singh & Solomon Mwije)
Description workshop
In a rapidly changing world, the future holds interesting opportunities as well as daunting challenges. During this Ideas Lab workshop several M&E professionals working jointly brainstorm on identifying some of those opportunities and challenges for the future of Monitoring and Evaluation (M&E). All participants choose a "sector" working group, which will look at the future of M&E for one particular subsector within the evaluation eco-system, namely Youth in evaluation, VOPEs, Policy actors, International actors, Academia. After a general introduction to the future challenges and opportunities, the captains with their working group set out to identify those challenges and opportunities specific to their sectors. Subsequently they discuss some of the features of these identified future evolution, such as the size of the effect, the extent to which these trends are already ongoing in their everyday work today, and to what extend these trends will generate positive and/ or negative effects for the future of M&E?
Co-creation workshop: Actions for the future of M&E
Team captains:
Youth (Naser Quadous & Frankline Ojong), VOPE (Tsigereda Bekele & Michée Sagara) Policy actors ( Sakina Mwinyimkuu & Myranda Lutempo), International actors (Eddah Kanini & Awuor Ponge), Academia ( Shyam Singh & Solomon Mwije)
Description workshop:
In the co-creation workshop the working groups and their captains build further on the identification work done during the ideas lab. Identifying challenges and opportunities is not enough? What can we do about it? In the respective groups the experts jointly specify possible actions to undertake within their sectors to capitalize on the opportunities ahead and to prevent some of the future challenges. Afterwards, during a world café exercise all participants can review the output of the other sector groups and give input on the actions proposed. In a final step, the group jointly decides on what they see as a possible materialization of the work done in this exercises and whether they would like to create some tangible output ( blog, infographic, ..) based on this exercise.
Keynote speaker: Matthew Lubuulwa
Description:
Mr. Lubuulwa builds on his impressive experience as a seasoned M&E professional and on his leadership of the Ugandan evaluation Association, to share his perspectives on the added value of National Evaluation societies in the M&E ecosystem. He illustrates how to strengthen VOPEs using the UEA as an example and as such serves as an inspiration for other VOPE members to strengthen their own VOPES.
Bio Keynote:
Lubuulwa Matthew is a seasoned Monitoring and Evaluation Specialist, with extensive experience in M&E, research, Information technology, public finance and public investment management, Agri-business Value chains, strategic planning and education for sustainable development. Matthew has worked for close to 17 years in Uganda as a Monitoring and Evaluation Specialist, IT Officer, and Business Development Analyst. He has spent 11 years consulting with the Budget Monitoring and Accountability Unit (BMAU) of the Ministry of Finance, Planning and Economic Development where he served as Monitoring and Evaluation Expert supporting the Accountability, Infrastructure, Tourism, Trade and Industry, and Science, Technology and Innovations sectors. He has supported several Business Development Initiates with Small and Medium Enterprises in Uganda and the East African Region. He has led teams and participated in several Research and Evaluation studies with both state and non-state actors including; the Ministry of Finance, Planning and Economic Development, Ministry of Education and Sports, National Commission for UNESCO, Ministry of Foreign Affairs, National Information Technology Authority, Ministry of ICT, Danish International Development Agency (DANIDA), UNICEF, Netherlands Enterprise Agency, Uganda Manufacturer’s Association, National Agricultural Research Organisation, Makerere University School of Economics, private Education Institutions, among others. He is a graduate of Carleton University, Canada (International Program for Development Evaluation Training), United States Telecommunications Training Institute (Diploma in eGovernment, Washington DC), Vrije Universitiet Brussels: Post Graduate Diploma in Scientific and Technological Information Management and Makerere University where he obtained a Master of Science in Computer Science-Management Information Systems. For the last 10 years, Matthew is a fully subscribed member of Uganda Evaluation Association (UEA) where he has severed on the UEA Standards Development Committee (2014-15), Vice-President (2018-2020) and he is currently the President of the Association.