18 February 2026
How to track learner engagement beyond completions
Natalie Holborow
Content Marketing Manager
Discover smarter ways to track learner engagement and prove impact with practical tips and tools for modern L&D teams.
Does your organisation rely on completion rates, course attendance or satisfaction scores as indicators of L&D success? While these are useful metrics to gauge participation rates and whether learners were happy with the course, finishing a course doesn’t necessarily mean someone can apply the skill (i.e. that learning transfer has occurred) or that it’s made any difference to their performance.
According to a 2024 study by the Association for Talent Development, over 90% of training programmes include learning assessments, but only 58% of L&D teams believe they measure learning effectively. So, how can L&D improve its measurement of learner engagement beyond just completion rates?
What is learner engagement, and why measure it?
In simple terms, learner engagement is the active, purposeful involvement of learners in the learning process. When learners are engaged, they are connecting, applying and valuing the learning experience (as opposed to passively consuming content; we’ve all skipped through slides of uninspiring text at some point in our working lives).
Learner engagement shows up as a combination of the following:
- ✳️ Emotional connection – does the individual see the value in learning?
- ✳️ Cognitive investment – are they thinking critically, making decisions and applying knowledge?
- ✳️ Behavioural action – are they completing modules, revisiting resources or collaborating with others?
Higher learner engagement drives better learning outcomes, which supports wider business goals and makes it easier for L&D to gain buy-in. Most importantly, increased learner engagement maximises the opportunities for people to improve both themselves and the organisation as a whole. This is why we should be continuously measuring and optimising for maximum learner engagement.
5 practical ways to measure engagement with your LMS
Your learning management system (LMS) has a wealth of data to track how well your learners engage with your training materials, but it helps to know exactly which metrics to focus on.
Modern LMS platforms like Moodle and Totara offer built-in tools and dashboards that enable you to capture deeper behavioural and cognitive engagement signals. When used effectively, these tools help you identify at-risk learners, high-performing content and prove the value of learning to your stakeholders.
Here are five practical ways to measure learner engagement directly from your LMS.
1. Time spent on training materials
Time-on-task analysis measures how much active learning time an individual spends on a module, video or activity. Unlike completions, it examines learning behaviour: how long learners engage with content, whether they move through it at a realistic pace and where they spend their time.
It’s useful to combine this metric with assessment scores. For example, has someone actually been watching a training video, or have they simply left it playing in the background? Knowledge retention will tell you whether the learner has absorbed the learning content.
When analysed at scale, time-on-task analysis can reveal:
- ✳️ Content quality issues – If most learners spend far less time than expected on a module, it may be too basic, poorly designed or easy to bypass.
- ✳️ Cognitive load problems – Spending an excessive amount of time on a short module can indicate confusion, unclear instructions or overly complex material.
- ✳️ Engagement drop-off points – Sharp drops in time spent partway through a course can often highlight where learners lose interest.
- ✳️ Risk signals for non-completion – Learners who skip through content are less likely to retain or apply what they’ve learned, which is where follow-up quizzes and assessments are useful for checking knowledge retention.
Completion doesn’t always equal learning. Analysing the time spent on a task helps move the focus from vanity metrics to evidence-based insights. Instead of reporting “X% completed this module”, you can demonstrate how learners actually engage, where learning design is working (or failing) and which interventions are most likely to improve retention.
2. Interaction tracking
Interaction tracking measures how learners engage with individual components of a course, including what they click on, how far they scroll, and how often they post in forums, attempt quizzes or participate in discussions.
This helps you analyse the depth, frequency and quality of learner behaviours throughout the learning experience.
Where time-on-task can indicate that someone was present, interaction tracking shows you what they actually did while they were there. When tracked and analysed properly, these patterns can help you:
- ✳️ Pinpoint ineffective content formats – If learners consistently skip or bounce from specific sections, it’s a sign that the content needs a rethink.
- ✳️ Identify where learners are most engaged – High levels of interaction around a discussion prompt or resource can indicate what learners find valuable and can inform future content design.
- ✳️ Identify social learning behaviours – Forum activity, peer replies or likes/shares give insight into emotional engagement and collaboration.
Interaction data helps L&D teams move beyond activity logs to evidence of engagement and effort. It helps you defend your design decisions, enables targeted interventions and helps link learning behaviour to performance outcomes (especially when integrated with HR systems or using platforms like Totara Perform).
3. Quiz engagement and retention checks (formative assessments)
Quiz engagement and retention tracking looks beyond whether a learner has passed an assessment and instead examines how learners interact with quizzes over time. This includes:
- ✳️ Number of attempts
- ✳️ Time taken per attempt
- ✳️ Score progression between attempts
- ✳️ Question-level performance
When used as formative assessments, quizzes become an important diagnostic tool for measuring learner engagement. They directly measure cognitive engagement and unlike completions, this data helps you answer critical questions:
- ✳️ Did learners actually understand the content?
- ✳️ Are they willing to make the effort to improve?
- ✳️ Is the knowledge being retained over time or disappearing as soon as the course ends?
- ✳️ Have they made multiple attempts to complete the quizzes?
- ✳️ Are the questions clear enough or do multiple people keep failing the same question?
Repeat attempts and gradual score improvement often signal deliberate practice, which is strongly associated with long-term retention and skills acquisition. This is a more effective method than one-and-done quizzes, which can mask shallow learning, particularly in compliance-driven environments. Learners who improve across attempts are actively processing and correcting mistakes.
4. Learner feedback surveys
This approach involves collecting short, structured feedback from learners throughout their learning journeys, often using quick pulse surveys, learner feedback forms or targeted reflection prompts.
These surveys often include questions such as:
- ✳️ “How confident are you in applying what you’ve learned so far?”
- ✳️ “How relevant is this content to your current role?”
- ✳️ “How engaged did you feel with the course materials today?”
- ✳️ “Would you recommend this course to others?”
While the traditional ‘happy sheet’ (learner feedback form) is often treated as a formality, it does provide value when combined with other metrics. Learner satisfaction alone doesn’t prove that learning outcomes were achieved, but when combined with behavioural and cognitive metrics, it can add powerful context. It helps to think of learner sentiment as the “why” behind the “what” you see in your LMS reports.
For example, if engagement data shows a sudden drop-off halfway through a course, sentiment feedback might reveal why (e.g. confusing content or irrelevant examples). Feedback loops from learner sentiment can help you:
- ✅ Spot disengagement early and intervene before completion rates or quiz scores suffer.
- ✅ Measure perceived relevance of the training to real-world roles or challenges.
- ✅ Identify design issues (e.g. unclear instructions, too much jargon or outdated examples).
- ✅ Refine learning delivery in real time, rather than after the course is completed.
- ✅ Track confidence and motivation trends throughout a course or programme.
They also allow you to build a culture of continuous learning feedback, which improves both learner trust and platform usability over time.
5. Project-based performance (applied learning)
Performance in project-based tasks is one of the most effective ways to assess cognitive engagement and knowledge application. Rather than simply selecting a correct answer from a list, learners must demonstrate what they’ve learned by creating something, whether that’s a written report, a case study analysis, a visual presentation or a short video.
These types of assessments ask learners to apply knowledge to practical scenarios, explain processes and integrate creativity, critical thinking and problem-solving. They move learners from passive consumption to active construction of knowledge.
While quizzes and time tracking show engagement with content, projects reveal what learners can actually do with this knowledge. This makes project-based performance a powerful indicator of the following:
- ✳️ Cognitive engagement – Are learners critically thinking and synthesising ideas?
- ✳️ Retention – Are they recalling and applying key concepts correctly?
- ✳️ Transfer of learning – Can they bridge the gap between theory and practice?
- ✳️ Effort and motivation – The quality and detail of projects often correlate with the level of thought and care learners put into their learning experience.
Projects also shift the learning experience from compliance-driven box-ticking to value-driven learning. Knowing a project is coming often leads to higher engagement throughout the course. Learners are more likely to pay attention, take notes and reflect deeply when they know they’ll need to apply the material later.
In learning management systems such as Totara and Moodle, there are several ways to track project-based performance:
- ✅ Assignment activities in Moodle allow learners to upload written projects, multimedia or external links. Use rubrics or marking guides to standardise evaluation.
- ✅ Workshop modules in Moodle support peer assessment with instructor-led criteria, ideal for reviewing and reflecting on peer projects.
- ✅ Assignment activity in Totara Learn is used for learner file submissions and is often tied into development plans or learning paths.
- ✅ Totara Perform uses skills models and observation checklists for evaluating real-world applications.
- ✅ Custom reports in both platforms help you build reports on submissions, scores, completion rates and reviewer feedback.
In a learning ecosystem where impact matters more than attendance, project performance allows you to demonstrate real learning and not just participation.
Ready to track learner engagement beyond completions?
Book a meeting to discuss how the right choice of learning technology can help you prove engagement and impact beyond completion rates.
