A multi-phase pilot study on multimodal evaluation in cognitive tests

Cognitive impairment is an increasingly prevalent issue, particularly with the ageing population. Brief cognitive screening tests play a key role in early detection, and their progressive digitisation raises new methodological challenges. One such test, the SAGE (Self-Administered Gerocognitive Exam), which assesses areas such as orientation, language, and memory, has proven useful for the early detection of cognitive impairment. This paper presents a pilot study designed to compare the traditional and digital formats of a cognitive test based on a multimodal protocol. The protocol integrates objective performance scores, subjective assessments of user experience (UX) and mental workload, and emotional response analysis conducted in two sequential phases: the first using facial expression analysis, and the second focusing exclusively on stress via electrodermal activity (EDA) sensors. The second phase was conducted in care home environments, where ethical constraints prohibited the use of cameras, highlighting the protocol's adaptability to real-world sensitive contexts. This paper contributes to understanding how test format influences not only cognitive outcomes but also UX and perceived mental workload, providing a replicable protocol for evaluating the digital transition of cognitive assessment tools.

keywords: cognitive impairment, digital SAGE test, electrodermal activity, emotional data, pilot study, UX, workload