Digital symbol-digit modalities test with modified flexible protocols in patients with CNS demyelinating diseases

Cognitive impairment (CI) is prevalent in central nervous system demyelinating diseases, such as multiple sclerosis (MS) and neuromyelitis optica spectrum disorders (NMOSD). We developed a novel tablet-based modified digital Symbol Digit Modalities Test (MD-SDMT) with adjustable protocols that feature alternating symbol-digit combinations in each trial, lasting one or two minutes. We assessed 144 patients (99 with MS and 45 with NMOSD) using both MD-SDMT protocols and the traditional paper-based SDMT. We also gathered participants’ feedback through a questionnaire regarding their preferences and perceived reliability. The results showed strong correlations between MD-SDMT and paper-based SDMT scores (Pearsons correlation: 0.88 for 2 min; 0.85 for 1 min, both p < 0.001). Among the 120 respondents, the majority preferred the digitalized SDMT (55% for the 2 min, 39% for the 1 min) over the paper-based version (6%), with the 2 min MD-SDMT reported as the most reliable test. Notably, patients with NMOSD and older individuals exhibited a preference for the paper-based test, as compared to those with MS and younger patients. In summary, even with short test durations, the digitalized SDMT effectively evaluates cognitive function in MS and NMOSD patients, and is generally preferred over the paper-based method, although preferences may vary with patient characteristics.


Survey on patients' experience
Among the participants, 120 individuals (83.3%; 86 with MS, 34 with NMOSD) provided consent and subsequently completed the questionnaire following the SDMT tests.The user experience survey primarily focused on the participants' preferences among the tested SDMTs (paper-based SDMT, MD-SDMT_1 min, and MD-SDMT_2 min).Additionally, the survey sought insights into the patients' perceived reliability of these tests.
Regarding preferences for the assessment tools, the MD-SDMT_2 min was favored by 55% of patients, followed by the MD-SDMT_1 min (39.2%), and the paper-based SDMT (5.8%) (Table 2).Overall, participants exhibited a more positive response to both MD-SDMTs compared to the paper-based SDMT.Furthermore, the MD-SDMT_2 min was identified as the most reliable test by the majority (75%) of patients, followed by the MD-SDMT_1 min (28%), and the paper-based SDMT (2%).When comparing the MS and NMOSD groups (Table 2), both groups showed a general tendency toward preferring the MD-SDMTs over the paper-based version.However, NMOSD patients exhibited a relatively higher  www.nature.com/scientificreports/preference for the paper-based SDMT compared to MS patients, and this difference was statistically significant (p = 0.009).Conversely, in terms of perceived reliability, there were no significant differences in patterns between MS and NMOSD patients (p > 0.999).
We further analyzed the results within age subgroups (Table 3).Across all age groups, more than half of the participants generally favored the MD-SDMT_2 min protocol over the other assessment tools.Notably, participants in the old-age group demonstrated a distinct preference for the paper-based SDMT, and were less inclined to favor the shorter, mobile device-based versions of the SDMT compared to the young-and middleaged groups.Conversely, the young-aged group tended to prefer the MD-SDMT_1 min, the shorter version of the digital SDMT, than the other groups.This trend was statistically significant (p for trend = 0.027).The contrast in preferences was particularly evident when the responses from the old-aged group were compared with those from a combined dataset of the young-and middle-aged groups, as presented in Supplementary Table S2.Among patients with NMOSD, those who preferred the paper-based SDMT did not have worse visual function compared to those who favored the MD-SDMT (Supplementary Table S3).Regarding reliability, the MD-SDMT_2 min was consistently identified as the most reliable test, followed by the MD-SDMT_1 min and the paper-based SDMT; this trend remained consistent across all age groups.Notably, none of the participants in the old-age group identified the paper-based SDMT as the most reliable test.
Finally, we analyzed the survey results according to the cognitive function of the patients (Table 4).Among the various cognitive function groups, the MD-SDMT_2 min consistently emerged as the most preferred and reliable assessment tool, surpassing other methods.Additionally, this preference remained consistent across all cognitive function groups, with no significant trends observed.

Discussion
This study demonstrates that MD-SDMT aligns closely with the gold-standard paper-based SDMT, providing reliable measurements across all participant groups.Patients generally favored the MD-SDMT over the paperbased SDMT.Although both the shorter (1 min) and longer (2 min) MD-SMDT durations demonstrated a significant correlation with the paper-based SDMT, there was a notable preference for the 2 min protocol.Notably, patients with NMOSD and those in the old-age group exhibited a greater preference for the paper-based SDMT, suggesting that individual preferences may vary based on patient characteristics.
The MD-SDMT demonstrated efficient assessment capabilities in clinical settings, showing a robust correlation with the paper-based SDMT across all participant groups, irrespective of patient characteristics including   24 .The varied test duration options enhance cognitive evaluation efficiency, particularly in time-constrained environments.Furthermore, the digital format offers the advantage of automated time tracking and scoring, thereby reducing the workload for examiners and providing immediate feedback to patients.This aspect of the MD-SDMT contributes to its high test-retest reliability, facilitating better periodic monitoring and more effective long-term data management.Patient preferences for cognitive testing methods appear to be influenced by individual characteristics.Notably, patients with NMOSD and older individuals were more likely to prefer the paper based SDMT, as opposed to those with MS and younger individuals.Conversely, younger patients were more inclined towards the MD-SDMT_1 min, the shorter version of the digital test.The reason for the preference of the NMOSD group for the paper-based test over the MS group remains unclear.A possible factor may be age differences, as patients with NMOSD were significantly older.Generally, older patients who are more familiar with traditional methods (paper and pencils) tend to choose the paper based SDMT, while younger patients, who are accustomed to digital environments, prefer the shorter digital SDMT.Notably, despite their inclination for the paper-based test, no participant in the old-age group considered it the most reliable.Visual dysfunction, more severe in the NMOSD than in the MS group, did not significantly influence test preferences (Supplementary Table S3).Notably, despite their inclination for the paper-based test, no participant in the old-age group considered it the most reliable.Additionally, even among older individuals and the NMOSD group, only a minority favored the paper-based test over the MD-SDMT, indicating that digital cognitive tests are generally well-received by these patients.
The current study introduces several distinct features compared to previous studies (Supplementary Table S4).First, we have implemented a modifiable protocol in the MD-SDMT, demonstrating that patient preferences for test protocols can vary at the individual level.With the rapid advancement and application of digital technologies in clinical settings [29][30][31][32][33][34][35][36] , there is a growing emphasis on personalized care 37 .By adjusting aspects like task difficulty based on individual patient characteristics such as cognitive deficit levels more sensitive monitoring of cognitive function changes at the individual level becomes feasible.Moreover, allowing patients to choose their preferred testing protocol and establishing normative MD-SDMT scores for each protocol could enable continuous, personalized cognitive evaluations in the future.
Another noteworthy point of this study is that we evaluated the feasibility of a digital cognitive assessment tool for patients with NMOSD.Cognitive dysfunction in patients with NMOSD has received comparatively less attention, as neurodegeneration in this context is understood to be linked to relapses rather than progressive processes [38][39][40] .However, recent studies, including MRI findings, have revealed that patients with NMOSD also experience silent neurodegeneration similar to that observed in patients with MS [41][42][43] .Despite this, limited studies have been undertaken to investigate cognitive dysfunction in NMOSD [44][45][46][47] .Therefore, conducting longitudinal analyses using digital cognitive assessment tools can provide deeper insights into the cognitive profiles of NMOSD patients, enhancing our understanding of the underlying mechanisms and pathophysiology of cognitive dysfunction in this condition.
Finally, we evaluated patient responses, revealing that the MD-SDMT_2 min is the most preferred and reliable test.This preference suggests potential advantages of digital over paper-based SDMT, especially for adherence in managing chronic diseases 48 .Additionally, the preference for the MD-SDMT_2 min over the 1 min version across various age and cognitive function groups suggests that patients value ample testing time to fully demonstrate their abilities, rather than shorter evaluations.
This study has several limitations.First, due to its cross-sectional design, we did not investigate how the 1 min and 2 min MD-SDMT protocols correlate with the paper-based SDMT over time.Future longitudinal studies are necessary to assess if the performance of these protocols remains consistent over time, helping to establish the MD-SDMT's effectiveness for monitoring long-term cognitive function.Second, our study focused exclusively on the written SDMT, excluding the verbal format.Consequently, patients with severe upper extremity impairments and NMOSD patients with major visual field impairments (20/200 vision or worse) were not included, www.nature.com/scientificreports/as they were considered unable to participate in either protocol.This exclusion may have introduced selection bias.Third, the MD-SDMT primarily evaluates processing speed and does not assess other cognitive domains.
While SDMT performance is associated with cognitive decline and disease progression in MS-considered the core common data element of cognition by the National Institute of Neurological Disorders and Stroke 14 -its utility in NMOSD patients is less certain 49 .Specifically, approximately 42% of NMOSD patients and 29% of MS patients identified as cognitively impaired by the brief cognitive screening test, which includes the SDMT from the Rao Brief Repeatable Neuropsychological Battery, were found to be cognitively normal when assessed with comprehensive tests such as the Wechsler Adult Intelligence Scale-III and the Wechsler Memory Scale-Revised 21 .Therefore, low performance in the MD-SDMT should not be hastily interpreted as true ' cognitive impairment, ' especially in the NMOSD group.Fourth, the identical order of tests throughout the study may have influenced the results.Additionally, administering three consecutive tests within a short period may have led to mental fatigue, although no patients explicitly complained of mental fatigue during or after the test.Finally, we did not administer the MD-SDMT to a larger, more diverse group of patients or to the general population.The study population was small and not representative of the broader MS and NMOSD population, particularly those with progressive MS.Additionally, we were unable to calculate Z-scores that would standardize MD-SDMT scores across different populations.Future studies are needed to enhance the test's applicability and generalizability.

Conclusions
The MD-SDMT, whether in its 1 min or 2 min version, effectively aligns with the paper-based SDMT for assessing cognitive function in patients with MS and NMOSD.Participants demonstrated a stronger preference and perceived greater reliability for the longer MD-SDMT compared to both its shorter counterpart and the paperbased SDMT, although these preferences may differ based on individual patient characteristics.

Participants and inclusion criteria
Patients with CNS demyelinating diseases were prospectively enrolled from the outpatient clinic at the department of Neurology, Asan Medical Center (Seoul, South Korea) between July 2021 and January 2022.The inclusion criteria were as follows: (1) age ≥ 18 years; (2) provision of informed consent; (3) according to the diagnostic criteria or diagnosis of NMOSD with the presence of autoantibodies to aquaporin-4 50,51 ; (4) being in remission for at least three months after a relapse event.In addition, the exclusion criteria were: (1) having a history of other medical illnesses that would affect neurological conditions, such as dementia and Parkinson's disease; (2) having severe visual field impairment (e.g., 20/200 or worse); (3) having significant disorganization of motor function in upper extremities (e.g., paralysis, tremors, and ataxia); (4) being in a period of relapse or acute exacerbation.This study was approved by the hospital's institutional review board (Asan Medical Center Institutional Review Board, IRB No. 2020-1038).This study was conducted in accordance with the Declaration of Helsinki.All participants provided informed consent prior to study initiation.

Modified digital symbol digit modality test (MD-SDMT)
We developed the MD-SDMT, a tablet-based version of the SDMT, with two protocols modified from the original assessment.The modified protocols involved random key changes for nine symbol-digit pairs during each test trial, with test times set at 1 and 2 min as determined by the attending investigators.The symbols utilized were Unicode characters.The top of the screen displayed ten symbol-digit pairs (Fig. 5).In the middle of the screen, 15 symbols without numbers were presented.Participants were requested to touch one of the numbers at the bottom of the screen to input the appropriate number corresponding to the symbol on the key.Each time the participant completed a row of tasks, consisting of 15 symbols, the symbol-digit pairs were randomized.This process continued until

Figure 1 .
Figure 1.Flow chart of the patient selection criteria.

Figure 2 .
Figure 2. Correlations between scores from the MD-SDMT and paper-based SDMT.Scatterplots are presented comparing the performance of the MD-SDMT (1 min and 2 min protocols) versus paper-based SDMT administrations in patients with MS and NMOSD.All correlations are highly significant (p < 0.001).MD-SDMT, Modified Digital Digit Modalities Test; SDMT, Symbol Digit Modalities Test; r = , Pearson's correlation statistic.

Figure 3 .
Figure 3. Correlations based on age groups between MD-SDMT (1 min and 2 min protocols) and paper-based SDMT performance.Age groups were classified into three categories based on participants' age terciles: Young-, middle-, and old-age groups.All correlations are highly significant (p < 0.001).MD-SDMT, Modified Digital Digit Modalities Test; SDMT, Symbol Digit Modalities Test; r = , Pearson's correlation statistic.

Figure 4 .
Figure 4. Correlations based on cognitive function groups between MD-SDMT (1 min and 2 min protocols) and paper-based SDMT performance.The degree of cognitive dysfunction was classified into four groups: standard, low, moderately low, and severe low, according to the SDMT score criteria.All correlations are highly significant (p < 0.01).MD-SDMT, Modified Digital Digit Modalities Test; SDMT, Symbol Digit Modalities Test; r = , Pearson's correlation statistic.

Figure 5 .
Figure 5. Illustration of the modified digital Symbol Digit Modalities Test (MD-SDMT).A (left): Screenshot of the tablet-based MD-SDMT during test administration.B (right): The key of nine symbol digits randomly changed during each trial.A new key is presented each time a line of response is completed.This procedure continues based on the test timeframe selected.

Table 2 .
Patient responses regarding their preference and perceived reliability according to disease groups.For the categorical variables, data are presented as numbers (percentages).MS: multiple sclerosis; NMOSD: neuromyelitis optica spectrum disorder; MD-SDMT: modified digital symbol digit modalities test; SDMT: symbol digit modalities test.p* adjusted for age with the adjusted of covariance (ANCOVA).

Table 3 .
Patientdisease type (MS and NMOSD), age, and cognitive function levels.This is noteworthy, as the digital platform emerges as a potential substitute for the traditional paper-based SDMT in real-world clinical contexts.Furthermore, the 1 min and 2 min protocols of MD-SDMT are comparable in performance, indicating that reliable evaluations can be conducted in shorter test durations.This aligns with recent studies that found that the app-based SDMT requires only 46 s for adequate performance in patients with MS responses regarding preferences and perceived reliability according to age groups.For the categorical variables, data are presented as numbers (percentages).MD-SDMT: modified digital symbol digit modalities test; SDMT: symbol digit modalities test.Vol:.(1234567890)Scientific Reports | (2024) 14:14649 | https://doi.org/10.1038/s41598-024-65486-3www.nature.com/scientificreports/

Table 4 .
Patient responses regarding preference and perceived reliability according to cognitive function groups.For the categorical variables, data are presented as numbers (percentages).MD-SDMT: modified digital symbol digit modalities test; SDMT: symbol digit modalities test.