Online Evaluation of Development Education: Not a new Universe

Compared with face-to-face work, the organisation and delivery of Development Education online is challenging, time consuming and requires new ways of supporting participants’ learning.  Does that mean that online evaluation also requires a new way of thinking and new approaches?

 

As discussed at two IDEA training-workshops on online evaluation (14th and 20th April 2021), the short answer is ‘no’ and ‘yes’.  ‘No’ because various online approaches give opportunities to use the same or similar approaches as offline.  Also, ‘yes’, as with almost all online work, online evaluation requires a significant investment in planning.  Knowing what you want to find out about and why, and then finding the appropriate online tools takes, certainly initially, more time than it would for offline work. 


The first of the two training-workshops, with 25 participants, started from the point that participatory learning forms a key component of Development Education.  For workshop participants this revolved around collective and individual learning that stimulates learners’ interaction and collaboration, their engagement and motivation, learning by doing, relevance of the learning to the learner, and shared reflective action.  Evaluation of those aspects of a Development Education programme or project requires an insight into, for example: 


  • The level of enjoyment of learners in taking part and their engagement with the learning
  • The extent to which learners have gained new knowledge, understanding and skills
  • The effect of the process and the content on learners’ performance
  • The impact on learners’ behaviour and actions
  • The consequences of it all on moving the organisation’s aims forward
  • The process of the project or programme. 


Each project or programme will of course have its own specific evaluation questions to be addressed.  In finding answers to those questions using a range of online tools can be helpful.  Tools such as: 


  • Online quizzes and other game-type activities – to assess skills and knowledge
  • Drop-and-drag activities – to make connections between two or more different phenomena, such as different development issues, causes, or effects
  • Dialogue simulations – to present different perspectives and arguments
  • Forum posts and blogs – giving learners an opportunity to interact, whilst giving the evaluator an opportunity to check levels of comprehension of an issue
  • Open-ended essay style questions – to evaluate higher level learning and its application
  • Online peer reviews – to give each participant an opportunity to reflect on their own learning and then communicate that to other participants for feedback and further discussion 
  • Observations – either live or from a recording of online events, for example to gain an insight into the level of interaction/participation of participants, of their understanding of an issue, or of their creativity in addressing an issue
  • Online polls or surveys – to obtain feedback on the process, the level of interest in the learning or the relevance to learners of what has been learned. 


The second of the two training-workshops added to these techniques by discussing eleven different online evaluation scenarios suggested by participants for further exploration.  The discussions gave practical examples of how techniques such as those above can be integrated into real-life DE projects and gave additional suggestions for online evaluation, including: 


  • Evaluating the effectiveness of webinars – by referring to registrations, participants and retentions, the interest shown in relevant resources after the events (downloads), the use (and quality) of the chat box and the use of opportunities to ask questions during the webinar, 
  • Assessing creativity – in work groups/breakout rooms use Padlet, Googledocs or Jamboard to capture ideas that have been developed, 
  • Assessing learner enjoyment and engagement – during a multi-event online project using online journals (completed by learners, if need be anonymised) to provide summary recordings of their feelings and learning highlights and lowlights, 
  • Evaluating the development of self-confidence/self-esteem of individual learners – doing this online (through one-to-one interviews) will require a level of familiarity of the learners with the evaluator, i.e. s/he needs to be known by the learners as part of online events.  Obtaining one-to-one engagement after the online event is problematic but may be possible, for example, in a break-out room during an ongoing project event/lesson 
  • Assessing the quality of the learning process – using a ‘360 degrees peer review (online)’. 


To keep track of all online techniques and their results, the use of an online whiteboard (such as Miro or Jamboard) can be very helpful: showing the evaluation questions asked with links to the different online tools used and the information that using these tools has given you. 


All this does not suggest, however, that there are no problems with online evaluation.  In common with any form of online communication and online teaching and learning, issues of ‘Zoom fatigue’ or of a lack of participation and engagement with the screen are not necessarily resolved.  Notwithstanding this, tools such as those highlighted do encourage and enable active engagement – particularly if they form part of a process of participatory learning.   


Online evaluation does not require evaluators to step into a different universe: many of the existing offline evaluation approaches can be and have been adapted for online use.  What is different though is that making full use of online evaluation, requires integrating evaluation techniques into the implementation of the project or programme – not something to be done ‘after the event’.  More than with offline evaluations, obtaining online inputs from participants towards or after the end of their involvement in a project or programme is highly problematic and may not give the diversity of information required for a quality evaluation.  For organisations that have tended to do their evaluative exercises towards the end this will require a new way of planning: clarifying from the start what needs to be evaluated and integrating evaluative activities as part of the online delivery process. 


This blog is written by Harm-Jan Fricke , a Development Education/Global Citizenship Education project manager, evaluator and workshop facilitator

September 26, 2025
Date: Tuesday, 04 November, from 3.30–4.30pm Location: Online via Zoom IDEA is thrilled to invite members to the online launch of our new “Theory of Impact for Global Citizenship Education” on Tuesday, 04 November, from 3.30–4.30pm, Online via Zoom. During this session, we will present the model, share insights into the process behind its development, and explore how it will be used to strengthen impact across the sector. We will also introduce a new tool in progress, an interactive data visualisation map designed to showcase our collective impact as a network. For many years, IDEA and its members have been grappling with the concept of impact in Development Education/Global Citizenship Education (hereinafter ‘GCE’). As GCE practitioners, tracking impact helps us to identify how, where and with whom our work is creating positive change, as well as investigating areas in which our impact could be stronger. Furthermore, we can also benefit from examining the collective impact of GCE carried out by the wide-ranging work of IDEA members, and from exploring how these impacts contribute to the major social changes to which the GCE community aspires. Driven therefore by the need to understand how projects and programmes are collectively “making a difference” in IDEA we looked at models that could help us visualise and capture GCE “impact networks”. We formulated our vision of impact and then a theory of how we expect this desired impact to be achieved to allow us to map our activities and collect data to corroborate that theory. This Theory of Impact model is how we hope to illustrate this complex GCE impact network. Building on work done by IDEA over many years including building sectoral capacity in using Results Frameworks for GCE, our Quality & Impact working group, engagement with Irish Aid on their Performance Measurement Framework (PMF), and the successful roll-out of a Code of Good Practice for DE/GCE, this Theory of Impact represent the next stage of our effort to ‘develop a consistent approach to measuring impact among the sector’. We are therefore thrilled to invite you to the presentation of our ‘Theory of Impact for GCE’. At this online presentation, we will tell you about the process that led to the creation of this model, how it will be used and what we hope it could bring to the sector. We will also touch on a new tool being developed based on the model, which should allow the creation of an interactive data visualisation map of our collective impact as a network. Join us as we launch into this exciting new phase of our Impact Measurement work. Join us as we begin this exciting new phase of our Impact Measurement work. Register below!
September 26, 2025
Date: 11 November, 10.30am – 4.30pm. Location: IDEA offices, 6 Gardiner Row IDEA launched its new Advocacy Toolkit and GCE Policy Guide resource pack in early March. The advocacy toolkit and policy guide were developed for IDEA members to strengthen their capacity to effectively advocate with policymakers and to actively engage in policy processes on GCE in Ireland and the wider world. IDEA will facilitate a full-day in-person workshop on these resources in the IDEA offices on Tuesday, 11 November ,10.30am – 4.30pm. Places are limited to 20 participants and will be given on a first come, first served basis. Please note that this is a repeat of the workshop that took place in May and is aimed at members who did not have the opportunity to participate in May. A vegetarian lunch will be provided. Register below!
September 26, 2025
Date: 06 November a nd 18 November from 3.30–4.30pm Location: IDEA offices, 6 Gardiner Row, Dublin 1 Due to positive feedback following a workshop during our annual conference, we are thrilled to invite members to a full 2-part interactive workshop about “Racial Justice” on 06 November and 18 November. This event will take place in-person in Dublin. Our facilitators Bronwyn April and Mdahyelya Bassi will guide participants through a critical exploration of the interconnections between racial justice, philanthropy, migration, and decolonisation within global and Irish contexts. The workshop will delve into how historical and ongoing colonial legacies influence contemporary issues of racial equity and social justice in Ireland and beyond. The dates for this event are fast approaching, so if you have any specific accessibility requirements, please email events@ideaonline.ie as soon as possible. Places for this event are limited, and registration is mandatory. Deadline to register is Monday, 04 November. Register below!