Systematic evaluation of rating scales for impairment and disability in Parkinson's disease
Claudia Ramaker MD
Department of Neurology, Leiden University Medical Center, Leiden, The Netherlands
Search for more papers by this authorJohan Marinus MSc
Department of Neurology, Leiden University Medical Center, Leiden, The Netherlands
Search for more papers by this authorAnne Margarethe Stiggelbout PhD
Department of Medical Decision Making, Leiden University Medical Center, Leiden, The Netherlands
Search for more papers by this authorCorresponding Author
Bob Johannes van Hilten PhD, MD
Department of Neurology, Leiden University Medical Center, Leiden, The Netherlands
Department of Neurology, Leiden Universit Medical Center, PO Box 9600, RC Leiden, The NetherlandsSearch for more papers by this authorClaudia Ramaker MD
Department of Neurology, Leiden University Medical Center, Leiden, The Netherlands
Search for more papers by this authorJohan Marinus MSc
Department of Neurology, Leiden University Medical Center, Leiden, The Netherlands
Search for more papers by this authorAnne Margarethe Stiggelbout PhD
Department of Medical Decision Making, Leiden University Medical Center, Leiden, The Netherlands
Search for more papers by this authorCorresponding Author
Bob Johannes van Hilten PhD, MD
Department of Neurology, Leiden University Medical Center, Leiden, The Netherlands
Department of Neurology, Leiden Universit Medical Center, PO Box 9600, RC Leiden, The NetherlandsSearch for more papers by this authorAbstract
We assessed the clinometric characteristics of rating scales used for the evaluation of motor impairment and disability of patients with Parkinson's disease (PD), conducting a systematic review of PD rating scales published from 1960 to the present. Thirty studies describing clinometrics of 11 rating scales used for PD were identified. Outcome measures included validity (including factor structure), reliability (internal consistency, inter-rater, and intrarater) and responsiveness. We traced three impairment scales (Webster, Columbia University Rating Scale [CURS] and Parkinson's Disease Impairment Scale), four disability scales (Schwab and England, Northwestern University Disability Scale [NUDS], Intermediate Scale for Assessment of PD, and Extensive Disability Scale), and four scales evaluating both impairment and disability (New York University, University of California Los Angeles, Unified Parkinson's Disease Rating Scale [UPDRS], and Short Parkinson Evaluation Scale). The scales showed large differences in the extent of representation of items related to signs considered responsive to dopaminergic treatment or to those signs that appear late in the disease course and lack responsiveness to treatment. Regardless of the scale, there was a conspicuous lack of consistency concerning inter-rater reliability of bradykinesia, tremor, and rigidity. Overall disability items displayed moderate to good inter-rater reliability. The available evidence shows that CURS, NUDS, and UPDRS have moderate to good reliability and validity. In contrast to their widespread clinical use for assessment of impairment and disability in PD, the majority of the rating scales have either not been subjected to an extensive clinometric evaluation or have demonstrated clinometric shortcomings. The CURS, NUDS, and UPDRS are the most evaluated, valid, and reliable scales currently available. © 2002 Movement Disorder Society
REFERENCES
- 1Rascol O, Brooks DJ, Korczyn AD, De Deyn PP, Clarke CE, Lang AE. A 5-year study of the incidence of dyskinesia in patients with early Parkinson's disease who were treated with ropinirole or levodopa. N Engl J Med 2000; 342: 1484–1491.
- 2 Parkinson Study Group. Pramipexole vs. levodopa as initial treatment for Parkinson disease: a randomized controlled trial. JAMA 2000; 284: 1931–1938.
- 3Lang AE. Surgery for levodopa-induced dyskinesias. Ann Neurol 2000; 47(Suppl.): S193–S199.
- 4Marsden CD, Schachter M. Assessment of extrapyramidal disorders. Br J Clin Pharmacol 1981; 11: 129–151.
- 5 Handbook of neurological rating scales. New York: Demos Vermande; 1997.
- 6Marinus J, Ramaker C, van Hilten JJB, Stiggelbout AM. Health related quality of life in Parkinson's disease: a systematic review of disease specific instruments. J Neurol Neurosurg Psychiatry 2002; 72: 241–248.
- 7 World Health Organization. International classification of impairments, disabilities, and handicaps : a manual of classification relating to the consequences of disease. Geneva: World Health Organization, 1980.
- 8Simeonsson RJ, Lollar D, Hollowell J, Adams M. Revision of the International classification of impairments, disabilities, and handicaps: developmental issues [see comments]. J Clin Epidemiol 2100; 53: 113–128.
- 9The Cochrane Controlled Trials Register. The Cochrane Library Issue 3. 2001. Oxford, UK: Update Software; http://www.update-software.com/cochranehttp://www.update-software.com/cochrane
- 10McDowell I, Newell C. Measuring health: a guide to rating scales and questionnaires, Second ed. New York: Oxford University Press; 1996.
- 11Nunnally JC. Psychometric theory. Third ed. New York: McGraw-Hill; 1994.
- 12Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159–174.
- 13Feinstein AR. Clinometrics. First ed. New Haven: Yale University Press; 1987.
- 14Fleiss JL. The measurement of inter-rater agreement. In: JL Fleiss, editor. Statistical methods for rates and proportions. New York: John Wiley; 1981. p 212–236.
- 15Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. Second ed. New York: Oxford University Press; 1995.
- 16Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 1968; 70: 233–220.
- 17Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for assessing responsiveness: a critical review and recommendations. J Clin Epidemiol 2000; 53: 459–468.
- 18Cutson TM, Sloane R, Schenkman M. Development of a clinical rating scale for persons with Parkinson's disease. J Am Geriatr Soc 1999; 47: 763–764.
- 19Henderson L, Kennard C, Crawford TJ, et al. Scales for rating motor impairment in Parkinson's disease: studies of reliability and convergent validity. J Neurol Neurosurg Psychiatry 1991; 54: 18–24.
- 20Reynolds NC, Jr., Montgomery GK. Factor analysis of Parkinson's impairment: an evaluation of the final common pathway. Arch Neurol 1987; 44: 1013–1016.
- 21Rabey JM, Bass H, Bonuccelli U, et al. Evaluation of the Short Parkinson's Evaluation Scale: a new friendly scale for the evaluation of Parkinson's disease in clinical drug trials. Clin Neuropharmacol 1997; 20: 322–337.
- 22Hely MA, Wilson A, Williamson PM, O'Sullivan DJ, Rail D, Morris JGL. Reliability of the Columbia Scale for assessing signs of Parkinson's disease. Mov Disord 1993; 8: 466–472.
- 23Geminiani G, Cesana BM, Tamma F, et al. Interobserver reliability between neurologists in training of Parkinson's disease rating scales—a multicenter study. Mov Disord 1991; 6: 330–335.
- 24Martínez-Martín P, Carrasco de la Pena JL, Ramo C, Antiguedad AR, Bermejo F. [Study of inter-observer reliability in the use of qualitative scales assessing Parkinson's disease (II)]. Arch Neurobiol (Madr) 1988; 51: 287–291.
- 25Ginanneschi A, Degl'Innocenti F, Maurello MT, Magnolfi S, Marini P, Amaducci L. Evaluation of Parkinson's disease: a new approach to disability. Neuroepidemiology 1991; 10: 282–287.
- 26Fahn S, Elton RL. Unified Parkinson's disease rating scale. In: S Fahn, M Goldstein, D Marsden, DB Calne, editors. Recent developments in Parkinson's disease, Volume II. New Jersey: MacMillan; 1987. p 153–163.
- 27Martínez-Martín P, Gil-Nagel A, Morlán Gracia L, Balseiro Gómez J, Martínez-Sarriés FJ, Bermejo F. Unified Parkinson's disease rating scale characteristic and structure. Mov Disord 1994; 9: 76–83.
- 28Martínez-Martín P, Carrasco de la Pena JL, Ramo C, Antiguedad AR, Bermejo F. [Inter-observer reproducibility of qualitative scales in Parkinson's disease (I)]. Arch Neurobiol (Madr) 1987; 50: 309–314.
- 29Ginanneschi A, Degl'Innocenti F, Magnolfi S, et al. Evaluation of Parkinson's disease: Reliability of three rating scales. Neuroepidemiology 1988; 7: 38–41.
- 30Baas H, Stecker K, Fischer PA. Value and appropriate use of rating scales and apparative measurement in quantification of disability in Parkinson's disease. J Neural Transm Park Dis Dement Sect 1993; 5: 45–61.
- 31Martínez-Martín P, Gil-Nagel A, Morlán Gracia L, et al. Intermediate scale for assessment of Parkinson's disease. Characteristic and structure. Parkinsonism Rel Disord 1995; 1: 97–102.
- 32Stebbins GT, Goetz CG. Factor structure of the Unified Parkinson's Disease Rating Scale: motor examination section. Mov Disord 1998; 13: 633–636.
- 33Canter CJ, de la Torre R, Mier M. A method of evaluating disability in patients with Parkinson's disease. J Nerv Ment Dis 1961; 133: 143–147.
- 34LaRocca MG, Scheinberg LC, Slater RJ, et al. Field testing of a minimal record of disability in multiple sclerosis: the United States and Canada. Acta Neurol Scand Suppl 1984; 101: 126–138.
- 35Slater RJ, LaRocca NG, Scheinberg LC. Development and testing of a minimal record of disability in multiple sclerosis. Ann NY Acad Sci 1984; 436: 453–468.
- 36Lieberman A, Dziatolowki M, Gopinathan G, Kopersmith M, Neophytides A, Korein J. Evaluation of Parkinson's disease. In: M Goldstein, editor. Ergot compounds and brain function: neuroendocrine and neuropsychiatric aspects. New York: Raven Press; 1980. p 277–286.
- 37Mitchell SL, Harper DW, Lau A, Bhalla R. Patterns of outcome measurement in Parkinson's disease clinical trials. Neuroepidemiology 2000; 19: 100–108.
- 38Stebbins GT, Goetz CG, Lang AE, Cubo E. Factor analysis of the motor section of the unified Parkinson's disease rating scale during the off-state. Mov Disord 1999; 14: 585–589.
- 39van Hilten JJ, van der Zwan AD, Zwinderman AH, Roos RA. Rating impairment and disability in Parkinson's disease: evaluation of the Unified Parkinson's Disease Rating Scale. Mov Disord 1994; 9: 84–88.
- 40Nouzeilles MI, Merello M. Correlation between results of motor section of UPDRS and Webster scale. Mov Disord 1997; 12: 613.
- 41Goetz CG, Stebbins GT, Chmura TA, Fahn S, Klawans HL, Marsden CD. Teaching tape for the motor section of the unified Parkinson's disease rating scale. Mov Disord 1995; 10: 263–266.
- 42Richards M, Marder K, Cote L, Mayeux R. Inter-rater reliability of the unified Parkinson's Disease Rating Scale for motor examination. Mov Disord 1994; 9: 89–91.
- 43Teravainen H, Calne D. Quantitative assessment of parkinsonian deficit. In: UK Rinne, M Linger, G Stamm, editors. Parkinson's disease: current progress, problems, and management. New York: Elsevier/North-Holland Biomedical Press; 1980.
- 44Potvin AR, Tourtellotte WW, Syndulko K, Potvin J. Quantitative methods in assessment of neurological function. CRC Crit Rev Bioeng 1981; 6: 177–224.
- 45Jankovic J. Pathophysiology and clinical assessment of motor symptoms in Parkinson's disease. In: WC Koller, editor. Handbook of Parkinson's disease. New York: Marcel Dekker; 1992. p 99–126.
- 46Ringendahl H. [Standardization of a motor performance series for measuring fine motor disorders in Parkinson disease]. Nervenarzt 1998; 69: 507–515.
- 47Lauk M, Chow CC, Lipsitz LA, Mitchell SL, Collins JJ. Assessing muscle stiffness from quiet stance in Parkinson's disease. Muscle Nerve 1999; 22: 635–639.
10.1002/(SICI)1097-4598(199905)22:5<635::AID-MUS13>3.0.CO;2-0 CASPubMedWeb of Science®Google Scholar
- 48Caligiuri MP, Galasko DR. Quantifying drug-induced changes in Parkinsonian rigidity using an instrumental measure of activated stiffness. Clin Neuropharmacol 1992; 15: 1–12.
- 49Lang AE, Fahn S. Assessment of Parkinson's disease. In: TL Munsat, editor. Quantification of neurological deficit. Boston: Butterworths; 1989. p. 285–309.
- 50Martínez-Martín P. Rating scales in Parkinson's disease. In: J Jankovic, E Tolosa, editors. Parkinson's disease and movement disorders. Baltimore: Williams and Wilkins; 1993. p 281–292.
- 51Kennard C, Munro AJ, Park DM. The reliability of clinical assessment of Parkinson's disease. J Neurol Neurosurg Psychiatry 1984; 47: 322–323.