EES EvalEdge

EvalEdge ep.08: A conversation with Burt Perrin on How to - and how not to - Evaluation Innovation

How can evaluation support innovation in uncertain environments? In this episode, hosts Tom Ling and Mariana Branco discuss insights on evaluating innovation with expert Burt Perrin. Burt shares tips for evaluators on recognizing outliers, unintended effects, and adapting to change when innovation involves uncertainty. This episode also explore how evaluation can assess innovation-friendly systems and help organizations embrace learning from failures.

EvalEdge ep.23: AI and Evaluation: Balancing Innovation and Integrity

In this Eval Edge episode hosted by Marco Lorenzoni and Valentine Gandhi, leading expert Stefanie Schuerz (fteval) shares insights on navigating the intersection of AI and policy evaluation. Discover the key principles organizations must consider, from respecting human autonomy to ensuring transparency and fairness. You can find the full report here: https://doi.org/10.22163/fteval.2024.660. This episode complements previous EvalEdge AI episodes, including AI in third-party monitoring, and how AI is impacting the evaluation landscape. Whether you're an evaluator or simply interested in the ethical application of emerging tech, this is a must-listen to stay ahead of the curve in this rapidly evolving landscape

EvalEdge ep.22: Changing M&E Landscapes

How can artificial intelligence enhance M&E? In this episode, hosts Valentine Gandhi and Marco Lorenzoni discuss with Isabella Wagner from fteval on how AI is impacting the evaluation landscape. Wagner shares the work of fteval's AI working group analyzing how AI changes relationships between traditional evaluation stakeholders. To read the full report discussed in the episode, click here https://repository.fteval.at/id/eprint/707/. Tune in to understand an innovative perspective on AI's effects at both the individual actor and systemic levels of evaluation. More dicsussions about evaluation and AI, particularly in the field of research policy, can be expected as this year's REvaluation Conference taking place in Vienna 4-6 December.

EvalEdge ep21: AI, Monitoring & Evaluation in Challenging Environments

How can artificial intelligence enhance monitoring and evaluation work in challenging environments? In this episode, hosts Valentine Gandhi and Alena Lappo discuss the opportunities and ethical considerations of using AI tools like ChatGPT for qualitative data analysis with their guest Dr. Carolyn Fonseca. Dr. Fonseca shares her experiences piloting AI to code interview transcripts from third party monitoring projects in conflict-affected South Sudan and Nigeria. Learn how she tested ChatGPT's abilities against traditional coding methods and involved stakeholders in the design of her AI-assisted research. Dr. Fonseca also explores a proof-of-concept study using image recognition software to remotely monitor warehouse inventories in Nigeria. Find out how AI can help speed data collection, reduce burdens on participants, and augment monitoring in hard-to-reach areas.

EvalEdge ep20 - Digitalising for Impact: Lessons from Naples' Archeology Museum

How to evaluate the social impact of a digitization policy of a Museum? In this EvalEdge episode, hosts Marco Lorenzoni and Alena Lappo interview Dr. Erica Melloni and Dr. Ludovico Solima about their evaluation of this aspect of Naples' National Archaeology Museum, conducted in 2020. Faced with challenges defining wellbeing and limitations from COVID-19, Erica and Ludovico tailored an evaluation approach using available secondary data. Within the frame of their evaluation, the definition of social impact include reputation, connectedness, and emotional resonance. Erica and Ludovico share lessons for leveraging digitization, stressing that museums must listen to staff, local communities, and online audiences to steer strategy.