Introduction

The Van Lieshout hand function test for tetraplegia (VLT) is an instrument to assess the quality of arm–hand skilled performance (AHSP) in persons with a cervical spinal cord injury (C-SCI) and has been demonstrated to be a valid, reliable and responsive measure.1, 2, 3 It is used not only as an assessment tool for upper extremity functioning but also as guidance for the therapy management regarding arm and hand performance (http://www.vlt-test.eu). Because the original VLT features an ordinal scale that does not satisfy the requirements of objective measurement, a Rasch analysis of the VLT has been performed.4 After recoding the response categories of the original short form VLT (VLT-SF), VLT-SF has been transformed into an interval scale (r_VLT-SF), using the Rasch analysis. It was found that the r_VLT-SF satisfied the criterion of unidimensionality. This means that the r_VLT-SF data fitted the model. This model prescribes that only the person’s ability, the item difficulty and the threshold difficulty determine the probability of endorsing a category for an item.5, 6

An interval scale enables clinicians to better quantify the individual progress, to compare the outcome of patients between each other and to derive expected items scores.4

The total score of the r_ VLT-SF is expressed in so-called logits (r_VLT-SFlogit), which are defined as the probability units that express the natural logarithm of the odds of success (that is, the pass-to-fail ratio of a subject to an item).7 However, clinicians and patients are not used to the concept of logits. They rather prefer to use scores that are more meaningful to them. The use of scores ranging from 0 to 100 instead of scores in logits (in case of r_VLT-SFlogit ranging from −4.78 to 6.32) would enhance the communication, not only amongst therapists, but also between patients and therapists. Therapists would be able to communicate with patients in terms of ‘You have nearly reached the maximal score of 100' or ‘You progressed from a score of 60 to 80’, rather than ‘You progressed from 1.81 to 3.88’. Spooren et al.4 reported that the r_VLT-SFlogit allows the derivation of the expected VLT-SF item scores and identification of the VLT-SF item at which the patient is lagging behind. However, it would also be beneficial to be able to predict the outcome of arm and hand treatment in terms of ‘What will the patient eventually be able to do with his arms and hands?’ The establishment of the reference values of the VLT-SF for different patient groups at different time points during rehabilitation may help to improve the prediction of the outcome regarding AHSP.

The aim of the present study was (1) to convert r_VLT-SFlogit into r_VLT-SF100; (2) to establish reference values of r_VLT-SF100 for different groups of patients at different moments during rehabilitation and (3) to verify whether the r_VLT-SF100 is able to detect changes over time in different subgroups.

Methods

Data of patients collected on behalf of the umbrella project ‘Physical Strain, Work Capacity and Mechanisms of Restoration of Mobility in the Rehabilitation of Persons with SCI’ (http://www.scionn.nl) across eight Dutch rehabilitation centres and of the ToCUEST project (in Adelante Rehab Centre) were used.8, 9 The inclusion criteria were (in)complete C-SCI (including lesion at the motor level T1 according to the International Standard for Neurological Classification of Spinal Cord Injury (ISNCSCI)10) and being between 18 and 70 years of age. The exclusion criteria were severe additional neurological, orthopaedic or rheumatologic diseases hampering AHSP and total inability to perform upper extremity measurements. Research assistants experienced in performing the VLT-SF assessment collected data on the best hand. The VLT-SF consists of 10 items with regard to arm positioning and stabilising, hand opening and closing, grasping and releasing and manipulating (http://www.vlt-test.eu). For the current study, data at three moments during the rehabilitation were used; that is: at the start of the active rehabilitation (t1) (when the patient is able to sit for at least 3 consecutive hours), 3 months after t1 (t2) and at the time of discharge (t3).

Because lesion completeness and lesion level mainly determine the level of arm and hand functioning,11 reference values are reported for motor lesion completeness (that is, for Grade A or B on the ASIA (American Spinal Injury Association) Impairment Scale (AIS)10 and for Grade C or D on AIS) and lesion level (that is, for high (C1–C6) or low (C7-T1) lesion level according to the ISNCSCI).10 Furthermore, as the outcome of AHSP improves across different stages of rehabilitation, reference values from different moments of time (that is, t1, t2 and t3) are reported.

Data analysis

Total r_VLT-SFlogit scores (reported by Spooren et al.4) were transformed into total r_VLT-SF100 scores for the t2 time moment (that is, 3 months after the start of the active rehabilitation). As theories on the Rasch analysis indicate that one data set should be used as the basic set on which the data sets of other measurement moments should be anchored,5 total r_VLT-SF100 scores of t1 and t3 were calculated anchored on the r_VLT-SF100 at t2 (that is, the r_VLT-SF100 scores at t1 and t3 were derived based on the r_VLT-SF100 scores at t2).

Based on the r_VLT-SF100 scores at t1, t2 and t3, reference values were established using the median and interquartiles for the different subgroups; that is, persons with motor complete and incomplete lesions followed by a division into persons with a high (C1–C6) and a low (C7-T1) lesion at the different time moments.12These subgroups were chosen based on practical considerations.

To assess whether the r_VLT-SF100 allows the detection of improvement over time in different subgroups, the r_VLT-SF100 was statistically tested as to improvement using the Wilcoxon signed rank tests with a Bonferroni correction (alpha set at 0.025) for multiple comparisons between 2 different time intervals, that is, between t1 and t2 and between t2 and t3, for the total group and for the different subgroups.

Results

Patient characteristics of the total group, the subgroups and time intervals are given in Table 1.

Table 1 Patient characteristics and time intervals

Table 2 presents the recoded VLT-SF raw scores, which were converted into r_VLT-SFlogit scores using the Rasch analysis (as described in Spooren et al.4) and the transformation towards r_VLT-SF100 scores at t2. From Table 2, it can be derived that the minimal recoded VLT-SF raw score of 0 corresponds to a r_VLT-SFlogit score of −4.784, which, in turn, matches with a r_VLT-SF100 of 0. The maximal recoded VLT-SF raw score of 26 corresponds with a r_VLT-SFlogit score of 6.317 and with a r_VLT-SF100 of 100.

Table 2 Transformation of VLT-SF scores at t2

Based on these r_VLT-SF100 scores at t2, r_VLT-SF100 scores were computed for t1 and t3 anchored on the scores at t2. Figure 1 depicts the reference values, that is, boxplots with median and interquartiles, for persons with motor complete and incomplete lesions with either high (C1–C6) or low (C7–T1) lesion level and for t1, t2 and t3.

Figure 1
figure 1

Reference values of r_VLT-SF100 in medians and interquartiles for different subgroups at t1, t2 and t3. Reference values of r_VLT-SF100 at t1, t2 and t3 for different subgroups. r_VLT-SF100 (Rasch-tranformed VLT-SF expressed in 0–100 scores). t1=start of the active rehabilitation; t2=3 months after t1; t3=discharge; (a) total group: t1 (n=61), t2 (n=73) and t3 (n=69); (b) motor complete: t1 (n=33), t2 (n=38) and t3 (n=35) and incomplete: t1 (n=28), t2 (n=35) and t3 (n=34); (c) motor complete high (C7–T1) t1 (n=21), t2 (n=25) and t3 (n=23) and low (C1–C6): t1 (n=12), t2 (n=13) and t3 (n=12) and; (d) motor incomplete high: t1 (n=21), t2 (n=26) and t3 (n=26) and low t1 (n=7), t2 (n=9) and t3 (n=8).

Example: A tetraplegic patient with a motor complete lesion at C6 (AIS B and Sensor Level C5 according to ISNCSCI)10 was admitted to rehabilitation. At the start of the rehabilitation, he obtained a score of 7 on the original VLT-SF (see Table 3). After recoding, the raw r_VLT-SF score was 6 (see Table 2 and Table 3). From Table 2, it can be derived that the r_VLT-SFraw score of 6 corresponds with a r_VLT-SFlogit score of −1.86. This score, in turn, corresponds with a r_VLT-SF100 score of 26 (see Table 2). Based on the reference values at t1 for persons with a motor complete high lesion (see Figure 1c), it can be derived that he is performing quite well (above the median), and his expected outcome at discharge is estimated to be 40.

Table 3 Example of recoding of VLT-SF towards r_VLS-SF(raw)

A significant improvement (P<0.025) was found not only between t1 and t2 and between t2 and t3 for the total group, but also for subgroups of persons with C-SCI (that is, for patients with a motor complete and incomplete lesion and for high and low lesion levels). A further analysis of subgroups revealed a significant improvement (P<0.025) between t1 and t2 and between t2 and t3 for all the different subgroups (that is, for motor complete with either high or low lesion and motor incomplete with high lesion), except for the complete low lesion group between t2 and t3 (P=0.51) and for the incomplete low lesion groups between t1 and t2 (P=0.068) and t2 and t3 (P=0.109).

Discussion

The aim of the present study was to (1) convert r_VLT-SFlogit into r_VLT-SF100, (2) establish reference values of r_VLT-SF100 for different groups of patients at different moments during rehabilitation and 3) verify whether the r_VLT-SF100 is is able to detect changes over time in different subgroups.

With regard to the conversion of scores, r_VLT-SFlogit scores ranging from −4.784 to 6.317 logits were transformed into r_VLT-SF100 scores ranging from 0 to 100. In clinical practice, this means that instead of reporting that a patient has a score of 0.87 logits on the r_VLT-SFlogit, it will be reported that he has a score of 51 on the r_VLT-SF100. Also, instead of describing that a patient has progressed from 0.87 to 3.19 logits, therapists can explain that the patient has progressed from 51 to 72 on the r_VLT-SF100. As 0–100 scores are more meaningful for clinicians and patients, the use of r_VLT-SF100 scores will enhance communication between the former and the latter. Therefore, it is advisable to use the r_VLT-SF100 scores in clinical practice.

The most important aim of the present paper was to establish reference values regarding AHSP for different subgroups of patients with tetraplegia and for different stages in rehabilitation.

First, the r_VLT-SF100 scores of t1 and t3 needed to be calculated. Theories on Rasch analysis indicate that one data set should be used as a primary set on which the data sets of other measurement moments should be anchored.5 In accordance with the former paper of Spooren et al.,4 it was decided to take the t2 data as the primary data set. The t2 data set was considered for the majority of patients to be the most representative; that is, major floor or ceiling effects in patients who were either unable to perform any task (at the start of the rehabilitation) or patients who obtained the maximum score (at the end of the rehabilitation) were omitted. By anchoring the data of t1 and t3 to the t2 data set, it is possible to illustrate the progress on AHSP of an individual person during rehabilitation.

Reference values of AHSP of the r_VLT-SF100 for different groups of tetraplegia at different stages in the rehabilitation have been established by our research. Medians and interquartiles for the total group and different subgroups, that is, for persons with motor complete and incomplete lesions with either high (C1–C6) or low (C7–T1) lesion level at the start of the rehabilitation, 3 months after the start and at discharge, are now available.

The availability of reference values allows for a more accurate prediction of the outcome of AHSP. It provides more realistic (a-priori) information to the patient and may be used by clinicians who want to cross-reference their patients’ performance regarding the therapy goals set and met. The use of reference values allows clinicians to take a more client-dedicated approach. First, it allows a more precise comparison between patients regarding AHSP at different time moments in order to answer the question ‘Does my patient perform better or worse than patient Y at this particular stage?’ Second, it enables referencing a patient’s AHSP training outcome with standards obtained from the reference database to answer the question ‘Is my patient’s performance up to the standards (s)he should meet according to the norms?’ In case the patient performs worse than required by the standards, the question rises, ‘Why does (s)he perform worse?’ Third, the clinician may relate the patient’s performance to reference values to ascertain whether (and why) a final performance level has been reached (evaluation and explanation) or will be reached (prediction). The latter is also an important aspect for novice clinicians who have not (yet) acquired much ‘hands-on’ experience.

In clinical practice, the clinician may, in communicating with the patient, more clearly present realistic expectations and therapy results/progress, and motivate and discuss any changes in therapy policy.

To verify that the r_VLT-SF is an instrument that allows the detection of improvement over time in different subgroups, the changes in the r_VLT-SF100 outcome were statistically tested as to improvement. Based on the findings in the present study, in which statistically significant improvements in different stages during the rehabilitation and in most of the subgroups were found, it can be concluded that the r_VLT-SF100 is able to detect changes over time in different subgroups. These findings corroborate earlier research findings by Spooren et al.11 on the original VLT-SF data, that is, that the VLT-SF is responsive to changes over time and that statistically significant improvements during rehabilitation were found in different subgroups. The lack of statistically significant differences in some subgroups and time intervals in the present study may be attributed to the small number of patients in, for example, the complete low lesion group (n=12) and the incomplete low lesion group (n=7).

The combination of good psychometric properties (criterion validity, the inter-rater reliability, the intra-rater reliability, the internal consistency and responsiveness),2, 3 the application of the Rasch analysis4 and the establishment of reference values all contribute to the added value of the VLT in the management of upper extremity problems in tetraplegia. The VLT assesses the actual performance of arm and hand skills at the level of basic activities in persons with C-SCI and objectifies the strategy patients use to perform specific skills. It allows not only the assessment of the outcome and the progress of upper extremity performance but also the prediction of the outcome, and allows guiding therapists to plan progress in their therapy. In this way, the VLT is different from other instruments measuring upper extremity performances like the Capability Upper Extremity measure (CUE),13 the Tetraplegia Hand Activity Questionnaire (THAQ)14 or the Graded and Redefined Assessment of Strength, Sensibility and Prehension (GRASSP). The CUE is a self-reporting questionnaire in which patients rate their abilities to perform functional tasks with their arms; the THAQ focuses on activities that are important to persons with SCI,15 but has limited clinical application being reported.14 The recently developed GRASSP is a very promising instrument, designed to track the extent of spontaneous recovery or possible outcomes of a surgical or pharmacological intervention16, 17 and combines the evaluation of the impairment level with the evaluation of prehension. In contrast to the VLT, the GRASPP does not include information on the arm performance and it cannot be used as both an assessment tool and therapy guideline. Furthermore, psychometric properties regarding responsiveness still need to be reported.

Although reference values of the VLT have been established in the present study, some considerations should be made. As the sample size of some subgroups is rather small, some caution in interpreting the reference values of these subgroups is warranted. It would be ideal to have reference values according to the completeness of the lesion for each lesion level. However, the data set is still limited. The data set is planned to be expanded in order to increase the accuracy of prediction and to be able to make more refined inferences leading to more explicit conclusions. Also, the present paper demonstrated the reference values of the best hand; that is, the VLT scores of the best hand were taken. As the performance of both hands may differ, results of both hands would give more precise information with regard to prediction and comparison.

To conclude, the r_VLT-SFlogit scores were converted into r_VLT-SF100 scores, which may facilitate communication amongst clinicians and patients. The reference values of the r_VLT-SF100 have been established for different subgroups of patients with tetraplegia at different stages of rehabilitation and r_VLT-SF100 has been proven to be able to detect improvement over time. The availability of reference values may improve the evaluation, prediction, rehabilitation management and decision making regarding AHSP.

Data archiving

There were no data to deposit.