Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Analysis of four scales for global severity evaluation in Parkinson’s disease

Abstract

Global evaluations of Parkinson’s disease (PD) severity are available, but their concordance and accuracy have not been previously tested. The present international, cross-sectional study was aimed at determining the agreement level among four global scales for PD (Hoehn and Yahr, HY; Clinical Global Impression of Severity, CGIS; Clinical Impression of Severity Index, CISI-PD; and Patient Global Impression of Severity, PGIS) and identifying which of them better correlates with itemized PD assessments. Assessments included additional scales for evaluation of the movement impairment, disability, affective disorders, and quality of life. Spearman correlation coefficients, weighted and generalized kappa, and Kendall’s concordance coefficient were used. Four hundred thirty three PD patients, 66% in HY stages 2 or 3, mean disease duration 8.8 years, were analyzed. Correlation between the global scales ranged from 0.60 (HY with PGIS) to 0.91 (CGIS with CISI-PD). Kendall’s coefficient of concordance resulted 0.76 (P<0.0001). HY and CISI-PD showed the highest association with age, disease duration, and levodopa-equivalent daily dose, and CISI-PD with measures of PD manifestations, disability, and quality of life. PGIS and CISI-PD correlated similarly with anxiety and depression scores. The lowest agreement in classifying patients as mild, moderate, or severe was observed between PGIS and HY or CISI-PD (58%) and the highest between CGIS and CISI-PD (84.3%). The four PD global severity scales agree moderately to strongly among them; clinician-based ratings estimate PD severity, as established by other measures, better than PGIS; and the CISI-PD showed the highest association with measures of impairment, disability, and quality of life.

Introduction

Patient assessment integrates the data coming from health professional interview and examination, ancillary proofs (biological assays, performance measures, and imaging), self-assessment by patients and, eventually, by proxy evaluations. The combination of findings from these sources supports the diagnosis and allows determining the severity of the disorder with therapeutic and prognostic purposes. Although standardized thresholds for allocation of the severity degree can be available for some results, the assignment of a global severity level is frequently carried out in an intuitive manner based on previous experience and the observed data. To help in this purpose, some ‘global impression’ instruments have been developed and are widely applied.13

Global evaluations of severity intend providing holistic information on the severity of the disorder which is convenient, for example, for recording and sharing information, classification of patients for resources assignment, and other purposes. The main advantage of this kind of assessment is the approach to an immediate overall appraisal of the health state, whereas their main disadvantage is the lack of detailed information on the health state components.

Parkinson’s disease (PD) is a complex neurodegenerative disorder manifested through typical motor impairment and complications, a diversity of non-motor symptoms, and progressive disability. Observable signs (e.g., tremor or freezing) and performance measures are assessed by a professional rater, but the evaluation of symptoms (e.g., pain, anxiety) and other subjective aspects (e.g., quality of life, satisfaction with care) needs the input of patients. However, it is recognized that perceptions on the patients’ condition frequently differ between patients themselves and their doctors,4,5 making difficult sometimes to decide which of these evaluations is more reliable. Determining the severity level of PD is a challenge not only by these discrepancies, but also because the expression of the disorder greatly varies from case to case in components and their relative importance.

In a previous study,6 we collected information from four global scales to determine cutoff points for assignment of primary severity levels to the scores of the Movement Disorder Society sponsored version of the Unified Parkinson’s Disease Rating Scale (MDS-UPDRS). These four scales were the Hoehn and Yahr staging (HY),7 the Clinical Global Impression-Severity (CGIS),1 the Patient Global Impression-Severity (PGIS),2,8 and the Clinical Impression of Severity Index for Parkinson’s disease (CISI-PD).9,10 Two of these instruments are generic (CGIS and PGIS) and the other two are specific for PD (HY and CISI-PD). On the other hand, three are single-item scales (HY, CGIS, and PGIS) and one is multi-item scale (CISI-PD).

The objective of the present study were: (1) to determine the degree of agreement among these four global severity scales and (2) to identify which of them is more closely associated to the other variables in the study reflecting severity of PD-related aspects.

Our working hypotheses were: (1) the four scales for global assessment of PD are dissimilar in source of information and content; therefore, the agreement between scales will be only partial and different between rater-based and patient-based evaluations (objective 1), and (2) if the global scales differ among them, one of them could be more strongly associated with other markers of disease severity and, consequently, could be deemed the most accurate to estimate the global severity of PD (objective 2). No prospects on the results with any particular scale were advanced for this second hypothesis.

Results

From 452 included PD patients, 433 (95.8%), 54.5% males, were considered for analysis once 19 cases with missing values or errors (two responses for one item or values out of range) were dropped out. The distribution by HY was: stage 1, 13.9%; stage 2, 36.7%; stage 3, 30.2%; stage 4, 15.7%; and stage 5, 3.5%. The demographic characteristics and PD historical data are summarized in the Table 1, whereas the Table 2 shows the distribution of the sample as per the severity levels determined for each scale. The maximum disagreement was found for PGIS with HY and CISI-PD, which were coincident in severity level only in 58.89% of patients (sensitivity analysis: confidence interval=4.63, for a 95% confidence level).

Table 1 Descriptive data of the sample demography and assessment
Table 2 Distribution of patients by severity levels according the global scales

Table 3 displays the correlation between the global scales, which ranges from 0.60 (HY with PGIS) to 0.91 (CGIS with CISI-PD). As a whole, highest values were obtained with the CISI-PD for all correlations. CGIS and CISI-PD were highly correlated (rS=0.61–0.78) across all HY stages except stage 1 (rS=0.40), whereas PGIS showed a moderate correlation (rS=0.30–0.56, except for HY stage 5, rS=−0.02) with the CISI-PD and a weak correlation with the CGIS (except for HY stage 4, rS=0.41).

Table 3 Correlation between the global assessments and with the other variables in the study

Concerning the concordance of the four global scales to classify patients as mild, moderate or severe, the lowest percentage of agreement was observed between PGIS with HY and CISI-PD (58%) and the highest between CGIS and CISI-PD (84.3%). Weighted kappa followed a similar behavior (Table 4). Kendall’s coefficient of concordance for the severity levels of the four scales resulted 0.67 (P<0.0001) and the generalized kappa statistic was 0.52 (95% confidence interval (CI)=0.64–0.73).

Table 4 Agreement between severity levels of the four scales

The correlation coefficients between the four global scales and the other variables in the study are displayed in the Table 3. As a whole, HY and CISI-PD had the highest association with time-related variables (age and duration) and levodopa-equivalent daily dose. CISI-PD reached the highest coefficients with measures of PD manifestations severity (MDS-UPDRS), disability (SES and BI), and quality of life (EQ-5D-3L, EQ-VAS, and PDQ-8). PGIS and CISI-PD correlated similarly with HADS-A and HADS-D, at a higher level than HY and CGIS.

Discussion

This study was focused in analyzing the performance of four simultaneously applied global assessments based on the clinician (HY, CGIS and CISI-PD) and patient (PGIS). Two of these assessments are specific PD evaluations (HY and CISI-PD) and the other two are generic (CGIS and PGIS). They have different ranges of scores, running from 0 to 5 for HY and PGIS to 0 to 24 (CISI-PD). Nonetheless, the four scales can be converted to a classification in three severity levels immediately interpretable: mild; moderate; and severe. This shared ordinal scaling allowed analyses to determine the degree of agreement among scales, which is influenced not only by the differences in structure and scoring procedure, but also by the origin of the information (patient versus clinician). In this sense, it could be expected that rater-based global scales showed higher concordance with the rater-based evaluations, whereas the patient global impression would be more concordant with patient-reported outcomes.

Our results concerning the first hypothesis demonstrate that:

  1. 1

    The four scales are closely correlated between them, although with variable strength: the strongest correlation was observed between CGIS and CISI-PD, whereas the weakest was observed between clinician-based scales and patient self-evaluation (Table 3). Previous studies have reported a substantial agreement between functional evaluations performed by patients and clinicians,11,12 although patients tend to overestimate their functional disability in comparison with doctors’ evaluations.5 These relationships can be complex and depend on circumstances such as comorbidities or the availability of a caregiver.5,12,13

  2. 2

    The concordance among severity levels derived from the tested scales showed percentages of agreement from 58% (PGIS with HY and with CISI-PD) to 84.3% (CGIS with CISI-PD) and kappa values from 0.57 (moderate, PGIS with CISI-PD) to 0.86 (almost perfect, CGIS with CISI-PD)14 (Table 4), findings replicating those of the correlations commented above. Both, generalized kappa and Kendall’s concordance coefficient showed a moderate to strong agreement amongst the classification in severity levels from the four scales, indicating they are not equivalent at all.

In summary, (1) the four scales show a moderate to strong association among their scores and concordance on the severity levels classification derived from them (Tables 3 and 4); (2) the analyzed global scales are not equivalent, and (3) the patient-reported evaluation correlates at a lower degree with the rater-based scales.

Regarding the second hypothesis and once demonstrated that the tested global scales are not equivalent, is there any of them more closely associated, as a whole, to the diverse measures assessing different aspects of PD? From a logical point of view, the scale achieving the closest association with all the other detailed measures reflecting PD severity and impact (motor impairment and complications, non-motor symptoms, disability, quality of life), both from clinical evaluation and patient self-assessment could be deemed the most appropriate for the overall evaluation of PD severity. As shown in the Table 3, the CISI-PD was, as a whole, the scale most closely correlated with any other variable measuring severity of PD manifestations, functional disability, and impact on quality of life. The latter is a remarkable finding, as it would be expected that patient’s self-evaluation would be more closely correlated with the patient-reported outcomes than rater-based assessments. In fact, only the anxiety evaluation reached higher correlation values with the PGIS than with clinician-based assessments (Table 3).

When other global scale reached a higher correlation value with other variables than the CISI-PD (HY for age, PD duration, and levodopa-equivalent daily dose; PGIS for anxiety) the difference was 0.01–0.03. However, CISI-PD coefficients reached values up to 0.11 and 0.24 higher than the other rater-based global scales and PGIS, respectively (Table 3). Although these differences are not huge, the constant closer association results suggest that the CISI-PD would be the most appropriate instrument for global estimation of PD severity.

PD is a complex disease with motor and non-motor symptoms and complications. Global evaluations can provide a comprehensive appraisal of the health state in a rapid manner, but HY is based only in motor signs and functioning15 and CGIS and PGIS are overall valuations, too broad, unspecific, and with a marked subjective component difficult to control.16 The CISI-PD offers a more detailed estimation of PD-related global health from four outstanding aspects of the disorder that can be individually monitored with this pragmatic instrument. It is designed to be scored after the interview and examination have been carried out, in order to capture information enough and decrease the judgment based on the mere patient’s appearance.9,10 In addition, CISI-PD has a higher precision (range, 0 to 24 points) than the other scales (1 to 7 with the CGIS or 1 to 5 with the HY and PGIS). In spite of the CISI-PD is composed of four items, it may be considered a global evaluation because gathers the overall clinical impression on the corresponding domains and takes seconds to be completed. Previous studies found that CISI-PD explains 92% of the CGIS variance and as a whole, correlated at higher level than other global measures with a diversity of scales assessing a diversity of PD-related manifestations and consequences.9,10,17,18

Limitations of the study are: (1) most of patients in the sample were in HY stages 2 and 3, with stages 1, 4, and 5 relatively little represented, a shortage usual in clinical samples with consecutive patients from specialized settings (departments of Neurology, specialized units); nonetheless, there were 83 patients in the HY-based level with the lowest representation (‘severe’); (2) the selection of patients, as patients with dementia were excluded; the need of reliable patients’ introspection justifies this limitation, although cognitive state is of marginal importance for HY staging; (3) another potential limitation is related to variability depending on multiple sites and raters, although the group has experience in previous collaborations. On the other hand, the studied scales are used in similar conditions as they were applied for this study and, therefore, represent appropriately their use in daily practice and applied research.

The characteristics of the study, with different countries and researchers contributing, the size adjusted to acceptable levels of certainty, and a sample characteristic of the specialized background in which the field work was carried out (and where its outcomes will be applied) allow foreseeing close findings in future studies on the topic with the instruments applied here.

Conclusions are: (1) the four scales applied to estimate the global health state of PD patients are moderately to strongly related among them and agree in their estimations moderately to almost perfectly; (2) as expected, the clinician-based assessments correlate closely between them and higher than with patient self-evaluation; and (3) the CISI-PD shows, as a whole, the tightest association with other measures of PD focused on motor and non-motor impairment and complications, disability and, even, patient-reported health-related quality of life assessments.

Materials and methods

Design

Multicenter, international, observational, cross-sectional study.6 Nine centers from seven countries (Argentina, Chile, Colombia, Cuba, Ecuador, Mexico, and Spain) participated in the sample recruitment. Two centers, in Spain and United Kingdom, carried out the organization of the study and statistical analysis. Data were collected from February to September, 2013

Patients

Consecutive patients were included if they were diagnosed with PD by a neurologist competent in movement disorders, according to international criteria.19 Exclusion criteria were: (1) parkinsonian syndrome different to PD; (2) presence of any disabling condition impeding or interfering with the evaluation of PD.

Patients with more than mild cognitive deterioration were excluded from the analysis. The operational criterion to this purpose was: scoring 3 in the item 1 of the MDS-UPDRS Part I and 4 in the item Cognition of the CISI-PD. Patients with problems to answer written questionnaires (e.g., due to visual difficulties or action tremor) were assisted by a trained person.

General population in the participant countries is around 303.5 million, with around 1 million of patients suffering PD.20 Sample size for this study was calculated as a survey representative of PD population with a confidence level 95%, a s.d. 0.5, and a confidence interval=5. To this purpose, 384 fully analyzable patients must be included. An additional 10% was agreed in prevention of the missing data or mistakes. Therefore, a minimal total sample 422 was proposed.

Ethics issues

The study was approved by the local Ethics Committee or Institutional Review Board of each participant site. Patients gave their signed consent to participate in the study.

Assessments

Demographic and PD historical information were collected through interview and clinical records and the following assessments were used:

MDS-UPDRS Spanish version:21 this is a multidimensional measure for assessment of Non-Motor Experiences of Daily Living (Part I; 13 items: six rater-based and seven self-assessed by patient and/or by proxy), Motor Experiences of Daily Living (Part II; 13 patient-based items); Motor examination (Part III; 18 rater-based items with 33 scores); and Motor complications (Part IV; 6 items, rater-based). Each item scores from 0 (normal) to 4 (severe) and total scores for each of the four domains are obtained from the sum of the corresponding item scores.

HY:7 the original version of this classification (1, Unilateral involvement only usually with minimal or no functional disability; to 5, Confinement to bed or wheelchair unless aided) was used, as recommended.15

Global impression of severity: the clinician-based (CGIS), with 7 response options1 and a 6-option patient-based (PGIS),6 with the option ‘severe’ collapsing the ‘markedly ill’ and ‘severely ill’ options, were applied in the study.

CISI-PD:9,10 a clinical estimate of PD severity based on the impression of the clinician about the severity of four outstanding PD aspects: motor signs; disability; motor complications; and cognitive status. Each item-domain scores from 0 (normal) to 6 (very severe) and a total score ranging from 0 to 24 can be calculated.

Schwab and England Scale (SES):22 a rater-based measure of functional independence ranked according to eleven options (from 100%, completely independent, to 0%, completely dependent and bedridden). Scores are obtained by interview and observation.

Barthel Index (BI):23 a generic, widely used assessment of functional independence for activities of daily living. It is composed of 10 items and the total score ranges from 0 to 100.

Hospital Anxiety and Depression Scale (HADS):24 a self-rated scale for global assessment of mood disorder. It consists of 7 items for evaluation of anxiety and seven for depression. Each item scores from 0 (no problem) to 3 (severe problem). Scores of individual items can be summed to calculate separate scores for anxiety (HADS-A) and depression (HADS-D). The HADS is adequate for use in PD patients.25

EQ-5D-3L:26 a measure of health status providing a descriptive profile and a single index value (from 0 to 1) representing the global quality of life (preference) for clinical and economic evaluation. It has 5 items, each with 3 possible response levels. Higher scores represent worse perceived health. In addition, a visual analog scale (EQ-VAS) from 0 (the worst) to 100 (the best) is used to assess the global ‘health status today’. The EQ-5D is ‘recommended’ for use in PD.27

Parkinson’s Disease Questionnaire—8 items (PDQ-8):28 it includes 8 items, each representing a dimension of the mother health-related quality of life questionnaire PDQ-39. A summary index is obtained by summing the 8 items and standardizing on a scale of 0–100. Higher scores reflect worse HRQoL. It has been ‘recommended’ for use in PD.27

Data analysis

Central tendency and dispersion measures (mean, s.d., 95% CI, range), as well as proportions, were calculated for description of the variables in the study. Levodopa-equivalent daily dose was calculated as per Tomlinson et al.29

The paired correlation between the four global severity scales was determined by means of the Spearman rank correlation coefficient, as they did not meet assumptions for parametric tests.

Scores of the global severity scales were transformed to three severity levels (mild, moderate, and severe) according to previous studies10,15 or the response options wording itself, as follows: (1) HY: stages 1 and 2, mild; stage 3, moderate; and stages 4 and 5, severe;15 (2) CISI-PD: 1–7, mild; 8–14, moderate; 15, severe;10 (3) CGIS: 2–3, mild; 4, moderate; 5–7, severe; and (4) PGIS: 1–2, mild; 3, moderate; 4–5, severe. The agreement among these levels for each pair of scales was determined by percentage and weighted kappa (with quadratic weights), and for all of them simultaneously by Kendall's coefficient of concordance and generalized kappa.30

The correlation with other variables in the study (clinical ratings and patient-reported outcomes) was explored by means of the Spearman rank correlation coefficient. Correlation coefficient values <0.30 were considered weak correlation and 0.60, strong correlation.31

References

  1. 1

    Guy W. (ed.) ECDEU Assessment Manual for Psychopharmacology (US Department of Health, Education and Welfare, Public Health Service Alcohol, Drug Abuse, and Mental Health Administration, 1976).

    Google Scholar 

  2. 2

    Viktrup, L., Hayes, R. P., Wang, P. & Shen, W. Construct validation of patient global impression of severity (PGI-S) and improvement (PGI-I) questionnaires in the treatment of men with lower urinary tract symptoms secondary to benign prostatic hyperplasia. BMC Urol. 12, 30 (2012).

    Article  Google Scholar 

  3. 3

    Hughes, C. P., Berg, L., Danziger, W. L., Coben, L. A. & Martin, R. L. A new clinical scale for the staging of dementia. Br. J. Psychiatry 140, 566–572 (1982).

    CAS  Article  Google Scholar 

  4. 4

    McRae, C., Diem, G., Vo, A., O’Brien, C. & Seeberger, L. Reliability of measurements of patient health status: a comparison of physician, patient, and caregiver ratings. Parkinsonism Relat. Disord. 8, 187–192 (2002).

    Article  Google Scholar 

  5. 5

    Martínez-Martín P. et al. Patients', doctors', and caregivers' assessment of disability using the UPDRS-ADL section: are these ratings interchangeable? Mov. Disord. 18, 985–992 (2003).

    Article  Google Scholar 

  6. 6

    Martínez-Martín, P. et al. Parkinson's disease severity levels and MDS-Unified Parkinson's Disease Rating Scale. Parkinsonism Relat. Disord. 21, 50–54 (2015).

    Article  Google Scholar 

  7. 7

    Hoehn, M. M. & Yahr, M. D. Parkinsonism: onset, progression and mortality. Neurology 17, 427–442 (1967).

    CAS  Article  Google Scholar 

  8. 8

    Agüera-Ortiz, L. et al. Adaptation into Spanish of the Clinically Useful Depression Outcome Scale (CUDOS) for assessing major depressive disorder from the patient's perspective. Actas Esp. Psiquiatr. 41, 287–300 (2013).

    PubMed  Google Scholar 

  9. 9

    Martínez-Martín P. et al. Global versus factor-related impression of severity in Parkinson’s disease: a new clinimetric index (CISI-PD). Mov. Disord. 21, 208–214 (2006).

    Article  Google Scholar 

  10. 10

    Martinez-Martin, P., Rodriguez-Blazquez, C., Forjaz, M. J. & de Pedro, J. Spanish-American Longitudinal PD Patient Study Group. The Clinical Impression of Severity Index for Parkinson's Disease: international validation study. Mov. Disord. 24, 211–217 (2009).

    Article  Google Scholar 

  11. 11

    Brown, R. G., MacCarthy, B., Jahanshahi, M. & Marsden, C. D. Accuracy of self-reported disability in patients with Parkinsonism. Arch. Neurol. 46, 955–959 (1989).

    CAS  Article  Google Scholar 

  12. 12

    Louis, E. D., Lynch, T., Marder, K. & Fahn, S. Reliability of patient completion of the historical section of the Unified Parkinson's Disease Rating Scale. Mov. Disord. 11, 185–192 (1996).

    CAS  Article  Google Scholar 

  13. 13

    McRae, C., Diem, G., Vo, A., O'Brien, C. & Seeberger, L. Reliability of measurements of patient health status: a comparison of physician, patient, and caregiver ratings. Parkinsonism Relat. Disord. 8, 187–192 (2002).

    Article  Google Scholar 

  14. 14

    Landis, J. R. & Koch, G. G. The measurement of observer agreement for categorical data. Biometrics 33, 159–174 (1977).

    CAS  Article  Google Scholar 

  15. 15

    Goetz C. G. et al. Movement Disorder Society Task Force report on the Hoehn and Yahr staging scale: status and recommendations. Mov. Disord. 19, 1020–1028 (2004).

    Article  Google Scholar 

  16. 16

    Forkmann, T. et al. The Clinical Global Impression Scale and the influence of patient or staff perspective on outcome. BMC Psychiatry 11, 83 (2011).

    Article  Google Scholar 

  17. 17

    Martínez-Martín P. et al. International study on the psychometric attributes of the non-motor symptoms scale in Parkinson disease. Neurology 73, 1584–1591 (2009).

    Article  Google Scholar 

  18. 18

    Serrano-Dueñas, M., Calero, B., Serrano, S., Serrano, M. & Coronel, P. Psychometric attributes of the rating scale for gait evaluation in Parkinson's disease. Mov. Disord. 25, 2121–2127 (2010).

    Article  Google Scholar 

  19. 19

    Lees, A. J., Hardy, J. & Revesz, T. Parkinson's disease. Lancet 373, 2055–2066 (2009).

    CAS  Article  Google Scholar 

  20. 20

    Pringsheim, T., Jette, N., Frolkis, A. & Steeves, T. D. The prevalence of Parkinson's disease: a systematic review and meta-analysis. Mov. Disord. 29, 1583–1590 (2014).

    Article  Google Scholar 

  21. 21

    Martínez-Martín P. et al. Expanded and independent validation of the movement disorder society-unified Parkinson's disease rating scale (MDS-UPDRS). J. Neurol. 260, 228–236 (2013).

    Article  Google Scholar 

  22. 22

    Schwab, R. S. & England, A. C . In: Third Symposium on Parkinson’s Disease (eds Gillingham, F. J. & Donaldson I. M. L.) 152–157 (Livingstone, Edinburgh, UK, 1969).

  23. 23

    Mahoney, F. I. & Barthel, D. W. Functional evaluation: the Barthel Index. Md. State Med. J. 14, 61–65 (1965).

    CAS  PubMed  Google Scholar 

  24. 24

    Zigmond, A. S. & Snaith, R. P. The hospital anxiety and depression scale. Acta Psychiatr. Scand. 67, 361–370 (1983).

    CAS  Article  Google Scholar 

  25. 25

    Schrag A. et al. Depression rating scales in Parkinson's disease: critique and recommendations. Mov. Disord. 2007; 22: 1077–1092.

    Article  Google Scholar 

  26. 26

    EuroQol Group. EuroQol- a new facility for the measurement of health related quality of life. Health Policy 16, 199–208 (1990).

    Article  Google Scholar 

  27. 27

    Martínez-Martín P. et al. Health-related quality-of-life scales in Parkinson's disease: critique and recommendations. Mov. Disord. 26, 2371–2380 (2011).

    Article  Google Scholar 

  28. 28

    Jenkinson, C., Fitzpatrick, R., Peto, V., Greenhall, R. & Hyman, N. The PDQ-8: development and validation of a short-form Parkinson's disease questionnaire. Psychol. Health 12, 805–814 (1997).

    Article  Google Scholar 

  29. 29

    Tomlinson, C. L. et al. Systematic review of levodopa dose equivalency reporting in Parkinson's disease. Mov. Disord. 25, 2649–2653 (2010).

    Article  Google Scholar 

  30. 30

    Abraira, V. & Perez de Vargas, A. Generalization of the kappa coefficient for ordinal categorical data, multiple observers and incomplete designs. Qüestiió 23, 561–571 (1999).

    Google Scholar 

  31. 31

    Fisk, J. D. et al. A comparison of health utility measures for the evaluation of multiple sclerosis treatments. J. Neurol. Neurosurg. Psychiatry 76, 58–63 (2005).

    CAS  Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Contributions

Research project: (a) conception: P.M.-M., M.M., K.R.C.; (b) organization: P.M.-M., C.R.B., M.M.; (c) execution: M.R.-V., M.S.-D., N.G., J.C.M.-C., V.C.A., W.F., P.C., T.A., M.A., I.P.I. Statistical analysis: (a) design: P.M.-M., J.M.R.-A.; (b) execution: P.M.-M., J.M.R.-A.; (c) review and critique: all co-authors. Manuscript preparation: (a) writing of the first draft: P.M.-M.; (b) review and critique: all co-authors.

Corresponding author

Correspondence to Pablo Martínez-Martín.

Ethics declarations

Competing interests

P.M.-M. has received honorarium from AbbVie as speaker for a symposium, Editorial Viguera for a master course, UCB for lecturing in a summer course of the International University Menendez Pelayo, and honorarium from AbbVie for participating in the Advisory Board (epidemiological study). He has received Research grants from Parkinson’s UK, Parkinson’s Disease Non-Motor Group. M.R-V. has received honoraria from Boehringer-Ingelheim, Ever Neuro Pharma, UCB, Vanquish and MedLearning, and has participated in Advisory Boards for UCB Latin America. He has received grant from Boehringer Ingelheim for a workshop. J.C.M.-C. has received research support from Allergan, Lundbeck, and Abbvie, and speaking honoraria from Abbvie, Italfarmaco, Lundbeck, UCB, Allergan, Ipsen and Merz. N.G. has received honorarium from Allergan and Bago as speaker and director of a workshop. V.C.A. has received honorarium for speaking engagements at scientific meetings of Abbvie, and UCB Pharma, Allergan and Merz. W.F. is an associated editor of the IPMDS Website, Financial Committe, and Public Relationships Committee. He has received honoraria from Novartis for organizing Continued Medical Education Courses and has received research grants from Colciencias and the Universidad Nacional de Colombia. K.R.C. has received honorarium from UCB, Abbvie, Britannia, US Worldmeds, Mundipharma, Medtronic, Napp, Otsuka pharmaceuticals in the last 3 years and acted as a consultant for UCB, Abbvie, Britannia, Medtronic and Mundipharma. He has received funding from Parkinson’s UK, NIHR, European Commission, as well as educational grants from UCB, Britannia, Abbvie and Medtronic. M.M. received honoraria from speaking engagements at scientific meetings of Lundbeck and GSK. He has received grant support from Allergan and Pfizer and honoraria as consultant for Medtronic. The remaining authors declare no conflict of interest.

Rights and permissions

This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Martínez-Martín, P., Rojo-Abuin, J., Rodríguez-Violante, M. et al. Analysis of four scales for global severity evaluation in Parkinson’s disease. npj Parkinson's Disease 2, 16007 (2016). https://doi.org/10.1038/npjparkd.2016.7

Download citation

Further reading

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing