Pre-post texts
While pre-and post-test are very common as a training effectiveness measure, we are proposing a pre- and post-text measure.
Of course, tests are easy to implement and analyse (if statistics are used), but the improvement of say average scores may not provide the entire picture of the learning process. In addition, ‘post-post’ texts can be used as a measure implemented several months after the training to assess the retention of the competencies – this may also provide insights into the potential change in the learner’s behaviour or practices.
How to implement?
The learner would provide a text (either an essay or short reflection of a case) prior to the training, after that participates in training activities and then submits another text (can again be a short essay or discussion of a case). Optionally, another text can be produced several months after the end of the training. If the same analysis tool is used, the long-term impact can be measured.
Applicability and analysis
This measure is suitable for HE context and applicable in all disciplines. The measure is simple to implement. Common analysis tools make the work simpler and the progress levels comparable. The text can be evaluated based on the SOLO taxonomy and the reflection levels. Content criteria, like ethical principles, ethical analysis, ethical approaches can also be sought for in the texts. It may be challenging to use it in case of large groups as reading and analysis may take time. It may be difficult to find the learners months after the end of training, which decreases the large-scale feasibility of this tool, even if it has much potential of reaching assessment of learner’s behaviour or practices (generally regarded as challenging).