Secondary analysis of retrospective data.
The aim of this study was to further validate the Spinal Cord Injury Pressure Ulcer Scale (SCIPUS) using Rasch analysis.
Two rehabilitation centers in Canada.
Data were collected as part of the Spinal Cord Injury Knowledge Mobilization Network (SCI KMN) initiative. The SCIPUS was completed within 72 h of inpatient admission. Persons admitted for initial rehabilitation in two inpatient spinal cord rehabilitation programs were included in the project.
Data from 886 participants were analyzed, approximately 60% of whom were males. Rasch analyses demonstrated that the SCIPUS, in its current format did not meet criteria required for true measurement. A transformed version of the SCIPUS obtained by deletion of misfitting items and modification of the response scales improved fit to the model and showed preliminary evidence of unidimensionality. The person separation index, however indicated that the scale requires further adjustments of its scoring options.
In its original form, the SCIPUS does not meet the requirements of the Rasch model and its total score should be used cautiously. However, following some adjustments to the items such as addressing DIF between sites to insure a standardized assessment across sites and adding response options to some of the items, interval-scale measurement should be possible.
A pressure injury (PI), is defined as a “localized injury to the skin and/or underlying tissue, usually over a bony prominence, resulting from pressure or a combination of pressure and shear” . PIs are one of the most frequently encountered complications in people with spinal cord injury (SCI) . A quarter of individuals with SCI will develop a PI prior to inpatient rehabilitation [3,4,5,6,7], and prevalence at rehabilitation admission has ranged from 10 to 32% [8, 9]. During inpatient SCI rehabilitation, reported incidence has ranged between 10 and 48% [4, 8,9,10,11,12], and a recent study from the United States revealed that 41% of a cohort of 169 persons with SCI had at least one PI within the first year following their discharge from rehabilitation .
PIs have well-documented consequences, including an important monetary cost, functional loss, and subsequent health problems such as depression . They have been proven to be associated with diminished quality of life among persons in the chronic phase after SCI . Because PI can be avoided, it is essential to detect individuals at risk of developing this condition and promptly implement measures to prevent them from occurring. A central component of prevention is risk assessment. A structured approach that includes the use of a risk assessment scale in combination with a skin assessment, a mobility/activity assessment as well as clinical judgment is recommended . The Canadian Best Practice Guidelines for the Prevention and the Management of Pressure Ulcers in People with SCI state that the “assessment of pressure ulcer risk is more effectively performed using an objective risk assessment tool than clinical judgment”. The Guidelines also state “numerous tools exist, not all of which have been validated for use on people with spinal cord injury”.
A review by Mortensen et al.  of seven PI risk assessment scales found that their validity following SCI ranged from poor to adequate. Reliability was not reported. Of these seven scales, only two were specifically designed for the SCI population. They are the Spinal Cord Injury Pressure Ulcer Scale (SCIPUS) and its version for the acute care setting, the SCIPUS-A . The authors of the review concluded that although the validity of these two scales was adequate, their use could not be recommended due to important methodological limitations in the validation study and the lack of information regarding reliability .
Since then, few studies have been conducted to test the metric properties of the SCIPUS. Subsequently, the authors participated in a study testing the performance of the SCIPUS in persons with SCI in a rehabilitation setting . The results indicated that inter-rater reliability was excellent for composite SCIPUS scores and very good for risk stratification . The sensitivity of the tool was found to be excellent, but on the other hand, specificity was poor. Recently, Krishnan et al.  found that the SCIPUS adequately predicted the risk of pressure injury only during a specific timeframe, which was within 2–3 days of admission to an acute care setting. The SCIPUS was unable to predict PI in a rehabilitation setting.
The aim of this study is to (1) assess additional metric properties of the SCIPUS in its current format, with a focus on validity using the partial credit Rasch measurement  and (2) propose modifications to improve performance.
The study employed a cross-sectional design and it was conducted in two Canadian rehabilitation centers, the Toronto Rehabilitation Institute-University Health Network (TRI-UHN) (Toronto, ON) and the Institut de réadaptation Gingras-Lindsay-de-Montréal (IRGLM) (Montreal, QC) of the Center intégré universitaire de santé et de services sociaux du Center-Sud-de-l’Île-de-Montréal (CCSMTL). Data were collected as part of the Spinal Cord Injury Knowledge Mobilization Network (SCI KMN) initiative . The SCI KMN is a community of practice comprised of seven rehabilitation centers across Canada. The SCI KMN has supported the implementation of best practices in SCI rehabilitation using implementation science principles, including PI prevention. As part of this initiative, the SCIPUS was selected and implemented at both sites (Toronto and Montreal).
The SCIPUS is a 15-item clinician-administered scale specifically developed and designed to assess the risk of developing a PI in persons with SCI. The majority of items are scored dichotomously as either present or absent (0/1 or 0/2). Four items have three response options that have weighted scores (1/1/4 or 0/1/3) (see Appendix 1). A summary score is calculated by adding the scores of individual items. Scoring ranges from 0 (best prognosis) to 25 (worst prognosis) with a high-risk cut off score at ≥6 .
The SCIPUS was completed within 72 h of inpatient admission. All newly admitted persons with a spinal cord injury aged 18 years or older were included in the project (traumatic and non-traumatic), regardless of time since injury. Additional socio-demographic characteristics that were collected included nature of the lesion, gender and presence of PI at admission.
Rasch analyses were performed of the SCIPUS to assess aspects of validity using RUMM 2030 software (RUMM Laboratory, Perth, Australia). The Rasch model describes the relationship between an item and a person’s response or performance on this item. The Rasch model is a way to convert ordinal measures into interval-like, meaningful measures of a single latent trait . In this study, the latent trait is defined as the risk of developing a PI.
When using Rasch analysis, the person is positioned along the continuum of latent trait. The items are also positioned along this continuum. As a result, Rasch analysis creates an interval-like measure that allows for the measurement of true differences between and within individuals of the risk of PI development. Once the items are calibrated on the continuum of the latent trait and items meet the expectations of the Rasch model, they are said to “fit” the model . Once items fit the Rasch model, we have evidence that the items composing the SCIPUS form a real measure of the risk of developing a PI and that the addition of scores for each individual yields a true quantity of risk.
Assumptions of the Rasch model must be verified to ascertain fit to the model. First, unidimensionality implies that all items comprising a scale measure one unique dimension (trait). Second, local dependency  must be verified, that is, the items should not be related to each other once the effect of the latent trait has been removed. An additional assumption that requires verification is threshold ordering; all response categories should demonstrate the highest probability of being endorsed at different levels of difficulty. Thresholds are those points along a theoretical continuum of item difficulty where the probability of a person scoring either 0-or-1, and 1-or-2, respectively, is equally likely.
The presence of differential item functioning (DIF) should also be assessed. Items with DIF demonstrate different probabilities depending on the group of persons being assessed (e.g., men vs. women) and violate the property of invariance inherent to the Rasch model. This means that for the same level of risk, scores on the items should not differ based upon differing groups such as gender or age. These items must be deleted or split (i.e., a different score is given depending on the person factor).
In Rasch analysis, fit statistics are fundamental and allow for the verification of fit of the scale and its composing items to the model and the ascertainment of the assumptions. First, the global model fit of the scale is verified by a non-significant item–trait interaction. Fit of the individual items to the model is assessed using different criteria: the fit statistics, the item characteristic curves (ICCs) (DIF analysis) and a principal component analysis of the Rasch model item residuals, which is a further test of unidimensionality and local independence. Criteria used for the fit of the items are: standardized fit residuals between +2.5 and −2.5. For the items a non-significant chi-square and F-statistic are also required.
Only when the data fit the model do the characteristics of the model hold true . If parts of the data do not fit the model, a decision to modify (e.g., rescoring items by collapsing response categories) or reject part of the data (e.g., deleting misfitting items) needs to be undertaken. These methods and their criteria are fully described elsewhere [19, 21, 23, 24].
Data from 886 participants were analyzed, approximately 60% of whom were males. Table 1 presents the clinical and socio-demographic characteristics of the study sample.
Overall fit of the SCIPUS
One-unit interval coding was utilized to analyze the data as it was not possible to “weight” the items as is prescribed by the scale (for example item 4—level of activity original coding is 0/1/4 and was entered in RUMM as 0/1/2. The fit of the data when 15 items of the SCIPUS were analyzed produced a significant item-trait interaction (chi-square = 226.82; p < 0.05; df = 112). This is an indication that not all of the items fit the Rasch model and construct validity could thus not be ascertained. Item 13 (individual in a Nursing Home or Hospital) was automatically excluded from the analysis since all study participants obtained the same score; as they were admitted to a rehabilitation center.
None of the items displayed disordered thresholds. Therefore, no re-coding or collapsing of response options were necessary.
Individual item fit
Item 7—Tobacco use/smoking did not fit the model with a standardized residual of +5.43 and significant chi-squares and F-statistics. All remaining items displayed adequate fit statistics.
Differential Item functioning
The variables that were examined for the presence of DIF were age and gender. In addition, to explore the possibility of discrepancies in scoring between the two sites (Montreal vs. Toronto), study site was also tested for DIF. The presence of DIF was deemed to be present if analyses of variance were significant (Bonferroni-corrected; p < 0.0014). Several items displayed DIF (see Table 2). Two items displayed DIF by age (automomic dysreflexia/spasticity, cardiac disease/ECG). Of importance, several items also displayed DIF by site (Montreal and Toronto). These items are pulmonary disease, cardiac disease, cognitive impairments, albumin level, and hematocrit.
Scale reliability of the SCIPUS was also examined using Rasch. In RUMM2030, the reliability index, also called the person separation index (PSI), is interpreted as a Cronbach’s alpha. Cronbach’s alpha is a measure of internal consistency, that is, how closely related a set of items is as a group. It is considered to be a measure of scale reliability. In this context, PSI indicates how well the items can discriminate persons with different levels of ability (PI risk)  with an estimate >0.8 deemed satisfactory . The PSI for the remaining 14 items of the SCIPUS was 0.44, which is considered low. Therefore, the internal consistency is inadequate, indicating that not all of the items of the SCIPUS discriminate well between persons that have different levels of risk for developing a PI.
Targeting and content validity
Content validity is achieved when items are spread evenly along the measured latent trait: “risk of developing a PI” and cover a wide range of risk from the lowest to the highest possible risk (range from −3 to +3 logits) (See Fig. 1). The 14 remaining items of the SCIPUS range from approximately −3 to +2 logits, which is a slightly narrower than an ideal range, meaning that the SCIPUS does not cover the entire range of “risk of developing a PI”. Content validity is also demonstrated through proper targeting of the items and the absence of gaps along the latent trait continuum . This type of evidence was investigated through the item-person map (Fig. 1). As depicted in Fig. 1, the items are not clustered in the same area but rather are spread out along the continuum. Spread indicates that the items are not redundant and measure different levels of risk. The items do spread further to the right than to the left, indicating some mis-targeting of the population under study. Because the item thresholds fail to spread to the left beyond −3, persons located below this value (those who are at lower risk) are not well targeted by the measure. Also, the mean location score obtained for the items is −1.165. Ideally, this should be closer to zero—the default value which should represent an “average risk”.
Unidimensionality and local independence
Unidimensionality and local independence were assessed through the principal component analysis of the residuals. The first component explained 15% of the variance, which may indicate the presence of more than one dimension. To further assess whether the scale was unidimensional, we performed a post-hoc test of unidimensionality. According to the Smith’s t-tests  24 out of 883 t-tests (2.71%) showed significant differences in the estimates generated. Unidimensionality and local independence are ascertained if no more than 5% of the t-tests have values outside ±1.96 .
Proposing modifications for improvement
Following the initial Rasch modeling of the 14-item SCIPUS, further investigation was undertaken to determine if the SCIPUS could be modified to improve the fit to the model. First, item 7—Smoking was removed. In addition, item 6—Age was removed as it is not a latent trait in itself, so it is not considered amenable to being analyzed through an item response theory model. Indeed, a latent trait, in this context, should be a construct representing “qualities” or “states” of individuals that are not directly observed but rather inferred through questionnaires or tests.
These deletions produced a non-significant item-trait interaction (chi-square = 113.82; p = 0.10; df = 96), an indication that the measure now met this particular requirement of the Rasch model. Only items 2 (Mobility) and 1 (Activity) demonstrated a slight misfit to the model with fit residuals of 2.89 and 3.11, respectively (see Individual item fit of remaining 12 items of the SCIPUS—Table 3). Further examination of the metric properties of the SCIPUS performed on the 12 remaining items demonstrated similar validity characteristics in terms of content and construct validity and slightly higher reliability (PSI = 0.48) and the same items demonstrated DIF for age, gender, and site.
The objective of this study was to assess further the metric properties of the SCIPUS in its current format, with a focus on validity using the partial credit Rasch measurement model. Results could guide modifications to potentially improve the instrument.
Rasch analysis demonstrated that the SCIPUS, in its current format does not meet the criteria required for true measurement and therefore the total score must be interpreted with caution when assessing the risk of developing a PI in a population of individuals with a SCI (non-traumatic and traumatic) during inpatient rehabilitation. First, item 13—nursing home or hospital cannot be used for persons that have been admitted to a rehabilitation center as it presents no variance and thus should not be used in this particular context.
Results indicate that the item “smoking” does not fit the Rasch model. In contrast, the remaining items display adequate fit. This may be due to the fact that it is not the smoking itself that puts a person at risk of developing a PI but rather its effect on cardiovascular and lung functions, among others, and those are assessed through other items present in the scale. The item “smoking” was therefore removed from further analyses thus improving the performance of the model considerably.
The spread of items along the measured latent trait (PI risk) indicated that the SCIPUS has a floor effect. Because the item thresholds fail to spread to the left (Fig. 1), persons with a lower risk of developing a PI are not well targeted by the measure and therefore their risk is not estimated with precision. Furthermore, DIF for the item cardiac disease differed depending on the age of the persons. This is important because it indicates that for a similar level of risk, persons should be scored differently for this item, depending on which group they belong to, and failure to do so may result in individuals being wrongly categorized. As a result, this could result in appropriate prevention measures not being put into place when required.
The DIF by site (Toronto and Montreal) also differed for several items (pulmonary disease, cardiac disease, cognitive impairments, low albumin level, and low hematocrit), which is important. This indicates that the criteria for the scoring options differs between sites or are not interpreted in the same way. For items that involve blood tests, the laboratories analyzing the results may have different guidelines and cut-offs. For more “subjective” items, which require interpretation by the assessor, there is the possibility that scoring options were interpreted differently at the two study sites. This could have implications for the generalizability of the SCIPUS in different contexts. Language may have been an additional issue as the SCIPUS was predominantly administered in French at the Montreal site. Therefore a thorough analysis of the translation of the scoring category descriptions should be considered.
Perhaps the most important aspect to consider is the low PSI and the inability of the items to distinguish between different levels of PI risk. This may be due to the fact that most of the items are dichotomous (i.e., they are scored 0 or 1) and therefore lack the precision required to differentiate between different levels of risk. This hypothesis is strengthened when one examines the frequency of response categories that were endorsed. For most items, the endorsement of response categories is highly skewed, meaning that items were scored the same for a very high percentage of the sample. In the authors’ opinion, it would be advisable to review the response options and consider increasing the number of scoring options for each item while at the same time improving the operationalization of their definitions. This conclusion is supported by a prior study from Mortensen and colleagues  that found that some items of the SCIPUS and SCIPUS-A are not operationalized well, and clearer response descriptions would aid clinicians  and potentially increase the scales’ reliability and validity.
Despite the limitation caused by not being able to consider the weights of certain items of the scale, this analysis indicates that in its original form, the SCIPUS’ total score should be used cautiously, as Rasch analysis has demonstrated that the items which comprise the SCIPUS, as currently formatted, may not accurately determine PI risk in individuals with SCI participating in inpatient rehabilitation. This is in agreement with an earlier study by the authors, which found that the SCIPUS had poor specificity . If the SCIPUS is used, we suggest clinicians emphasize the qualitative aspects of the items rather than relying on the scores as the individual items could potentially provide insight into factors contributing to PI. Furthermore, modifications to the current items or the replacement of certain items could potentially insure fit of the model and a true measurement of PI risk by the summation of the individual item scores. Addressing the DIF between sites and adding response options to some of the items could improve its performance given the low PSI. Following these changes, the scale will have to be validated by Rasch analysis as well as traditional metric standards of validity and reliability.
The datasets generated and/or analysed during the current study are available from the corresponding author on reasonable request.
National Pressure Ulcer Advisory Panel. National Pressure Ulcer Advisory Panel (NPUAP) announces a change in terminology from pressure ulcer to pressure injury and updates the stages of pressure injury. 2016; www.npuap.org.
Houghton PE, Campbell KE, CPG Panel. Canadian Best Practice Guidelines for Prevention and Management of Pressure Ulcers in People with Spinal Cord Injury. A Resource Handbook for Clinicians. 2013. Accessed at http://www.onf.org.
Richard-Denis A, Thompson C, Bourassa-Moreau E, Parent S, Mac-Thiong JM. Does the acute care spinal cord injury setting predict the occurrence of pressure ulcers at arrival to intensive rehabilitation centers? Am J Phys Med Rehabil. 2016;95:300–8.
Ash D. An exploration of the occurrence of pressure ulcers in a British spinal injuries unit. J Clin Nurs. 2002;11:470–8.
Young JS, Burns PE. Pressure sores and the spinal cord injured. In: Young JS, Burns PE, Bowen AM, McCutchen R, (eds). Spinal cord injury statistics: experience of the regional spinal cord injury systems. Phoenix, AZ: Good Samaritan Medical Center; 1982. p. 95–105.
New PW, Rawicki HB, Bailey MJ. Nontraumatic spinal cord injury rehabilitation: pressure ulcer patterns, prediction, and impact. Arch Phys Med Rehabil. 2004;85:87–93.
Verschueren JH, Post MW, de Groot S, van der Woude LH, van Asbeck FW, Rol M. Occurrence and predictors of pressure ulcers during primary in-patient spinal cord injury rehabilitation. Spinal Cord. 2011;49:106–12.
Wang H, Niewczyk P, Divita M, Camicia M, Appelman J, Mix J, et al. Impact of pressure ulcers on outcomes in inpatient rehabilitation facilities. Am J Phys Med Rehabil. 2014;93:207–16.
Iyun AO, Malomo AO, Oluwatosin OM, Ademola SA, Shokunbi MT. Pattern of presentation of pressure ulcers in traumatic spinal cord injured patients in University College Hospital, Ibadan. Int Wound J. 2012;9:206–13.
Chen D, Apple DF Jr., Hudson LM, Bode R. Medical complications during acute rehabilitation following spinal cord injury--current experience of the Model Systems. Arch Phys Med Rehabil. 1999;80:1397–401.
DeJong G, Hsieh CH, Brown P, Smout RJ, Horn SD, Ballard P, et al. Factors associated with pressure ulcer risk in spinal cord injury rehabilitation. Am J Phys Med Rehabil. 2014;93:971–86.
Salzberg CA, Byrne DW, Kabir R, van Niewerburg P, Cayten CG. Predicting pressure ulcers during initial hospitalization for acute spinal cord injury. Wounds. 1999;11:45–57.
Stillman MD, Barber J, Burns S, Williams S, Hoffman JM. Complications of spinal cord injury over the first year after discharge from inpatient rehabilitation. Arch Phys Med Rehabil. 2017; https://doi.org/10.1016/j.apmr.2016.12.011.
Adriaansen JJE, Ruijs LEM, van Koppenhagen CF, van Asbeck FWA, Snoek GJ, van Kuppevelt D, et al. Conditions and quality of life in persons living with spinal cord injury for at least ten years. J Rehabil Med. 2016;48:853–60.
National Pressure Ulcer Advisory Panel and European Pressure Ulcer Advisory Panel. Pressure Ulcer Treatment: Technical Report. Washington DC: National Pressure Ulcer Advisory Panel; 2009. Available at www.npuap.org.
Mortenson WB, Miller WC, SCIRE Research Team. A review of scales for assessing the risk of developing a pressure ulcer in individuals with SCI. Spinal Cord. 2008;46:168–75.
Delparte JJ, Scovil CY, Flett HM, Higgins J, Laramée M-T, Burns AS. Psychometric Properties of the Spinal Cord Injury Pressure Ulcer Scale (SCIPUS) for pressure ulcer risk assessment during inpatient rehabilitation. Arch Phys Med Rehabil. 2015;961:1980–5.
Krishnan S, Brick RS, Karg PE, Tzenc Y-T, Garberd SL, Sowae GA, et al. Predictive validity of the Spinal Cord Injury Pressure Ulcer Scale (SCIPUS) in acute care and inpatient rehabilitation in individuals with traumatic spinal cord injury. NeuroRehabilitation. 2016;38:401–9.
Wright B, Masters G. Rating scale analysis. (Chicago: MESA Press, 1982).
Scovil C, Flett H, McMillan L, Delparte J, Leber D, Brown J, et al. The application of implementation science for pressure ulcer prevention best practices in an inpatient spinal cord injury rehabilitation program. J Spinal Cord Med. 2014;37:589–97.
Bond T, Fox C. Applying the Rasch model: fundamental measurement in the human sciences (1st ed). (Mahwah: Lawrence Erlbaum Associates, 2001).
Smith R. Fit analysis in latent trait measurement models. J Appl Meas. 2000;1:199–218.
Forget N, Jerosch-Herold C, Shepstone L, Higgins J. Psychometric evaluation of the disabilities of the arm, shoulder and hand (DASH) with Dupuytren’s contracture: validity evidence using Rasch modeling. BMC Musculoskel Dis. 2014;15:361.
Andrich D. A rating formulation for ordered response categories. Psychometrika. 1978;43:561–73.
Bland J, Altman D. Cronbach’s alpha. BMJ. 1997;314:572.
Lim S, Rodger S, Brown T. Using Rasch analysis to establish the construct validity of rehabilitation assessment tools. Int J Ther Rehabil. 2009;16:251–60.
Smith EV Jr.. Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002;3:205–31.
Tennant A, Pallant J. Unidimensionality matters! A tale of two Smiths? Rasch Meas Trans. 2006;20:1048–51.
The authors would like to acknowledge the contribution of the Site implementation team of the Spinal cord injury program of CCSMTL, more specifically of Caroline Joly, manager of the SCI program, Manouche Casimir Nursing advisor, Isabelle Robidoux, clinical coordinator and Sonia Côté, assistant head nurse. We would also like to acknowledge the work of Marie-Ange Derival, RN for her work in data collection. We also acknowledge the contributions of the Site Implementation Team members at Toronto Rehabilitation Institute—University Health Network (in addition to the authors): Lan McMillan, MN, Clinical Nurse Educator, and Diane Leber, RN CETN(C), wound care nurse, and Trisha Domingo, BSc, for assistance with data collection.
Supported by a “Nouvelles Initiatives” grant from CRIR, a partnership of the Rick Hansen Institute and Ontario Neurotrauma Foundation (2015-RHI-BPI-1001 Montreal) and (2015-RHI-BPI-996 Toronto) and Ontario Ministry of Health and Long-Term Care Alternative Funding Plan (AFP) Innovation Funds.
JH is responsible for data analyses, interpretation of results and the drafting of the manuscript. KRH participated to the data analyses, literature review, drafting and reviewing the manuscript. MTL, as a Knowledge mobilization specialist part of the SCI KMN initiative, was the link between the Montreal and Toronto teams and contributed to the design of this project in Montreal. She helped in drafting the manuscript and its revision. ASB was the co-PI of the Toronto KMN site and along with HMF was responsible for local data collection and study performance. ASB also contributed to interpretation of study results and editing of the manuscript for publication. CYS, JJD were responsible for conducting the research and collecting the data at the Toronto site. They also provided editing of the manuscript for publication. This manuscript has not been published and is not under consideration for publication elsewhere.
Conflict of interest
The authors declare that they have no conflict of interest.
We certify that all applicable institutional regulations concerning the ethical use of human volunteers were followed during the course of this research. Research ethics approval was granted to IRGLM’S by the Montreal site research ethics board (REB). At the Toronto site, an exemption was granted by TRI-UHN’s REB as the study and accompanying data collection was deemed part of a quality improvement initiative.
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Higgins, J., Laramée, MT., Harrison, K.R. et al. The Spinal Cord Injury Pressure Ulcer Scale (SCIPUS): an assessment of validity using Rasch analysis. Spinal Cord 57, 874–880 (2019). https://doi.org/10.1038/s41393-019-0287-z