- Research article
- Open Access
The modified functional comorbidity index performed better than the Charlson index and original functional comorbidity index in predicting functional outcome in geriatric rehabilitation: a prospective observational study
BMC Geriatrics volume 20, Article number: 114 (2020)
In the inpatient rehabilitation of older patients, estimating to what extent the patient may functionally recover (functional prognosis), is important to plan the rehabilitation programme and aid discharge planning. Comorbidity is very common in older patients. However, the role of comorbidity in making a functional prognosis is not clearly defined. The aim of this study was to investigate a modified and weighted Functional Comorbidity Index (w-FCI) in relation to functional recovery and compare its predictive performance with that of the Charlson comorbidity index (CCI) and the original Functional Comorbidity Index (FCI).
The COOPERATION study (Comorbidity and Outcomes of Older Patients Evaluated in RehabilitATION) is a prospective observational cohort study. Data of patients that were admitted in an inpatient geriatric rehabilitation facility in the UK between January and September 2017, were collected. The outcome measures were: the Elderly Mobility Scale (EMS) and Barthel index (BI) at discharge, EMS gain/day and BI gain/day. Baseline comorbidity was assessed using the CCI, the FCI and the w-FCI. Correlations, receiver operating curves (ROC), and multiple linear regression analyses were performed. The models were adjusted for age, gender and EMS or BI on admission.
In total, 98 patients (mean age 82 years; 37% male) were included. The areas under the ROC curves of the w-FCI (EMS at discharge: 0.72, EMS gain/day: 0.72, BI at discharge: 0.66 and BI gain/day: 0.60) were higher than for the CCI (0.50, 0.53, 0.49, 0.44 respectively) and FCI (0.65, 0.55, 0.60, 0.49 respectively). The w-FCI was independently associated with EMS at discharge (20.7% of variance explained (PVE), p < 0.001), EMS gain/day (11.2PVE, p < 0.001), and BI at discharge (18.3 PVE, p < 0.001). The FCI was only associated with EMS gain/day (3.9 PVE, p < 0.05). None of the comorbidity indices contributed significantly to BI gain/day (w-FCI: 2.4 PVE, p > 0.05).
The w-FCI was predictive of mobility & function at discharge and mobility gain per day, and outperformed the original FCI and the CCI. The w-FCI could be useful in assessing comorbidity in a personalised way and aid functional prognosis at the start of rehabilitation.
Making a functional prognosis - estimating to what extent a patient is able to functionally recover - at the start of rehabilitation is important for adequate planning of rehabilitation therapy and timely preparation for discharge. The degree to which recovery can be achieved varies between patients. This is particularly true for older patients after an acute and debilitating illness, for example a hip fracture, sepsis or delirium. Achieving an adequate functional level that enables the patient to perform activities of daily living (ADL), with or without aids and/or home care, is necessary prior to discharge home. Therefore, mobility and functional recovery are important outcomes in the rehabilitation of older people.
Many patient-related factors may contribute to successful or unsuccessful rehabilitation outcomes. These can be medical (multi-morbidity, disease severity), functional (premorbid ADL, baseline function) and social (access to formal care, caregiver availability) .
The role of assessing comorbidity in functional prognosis in older patients is not well understood and different co-morbidity indices exist [2,3,4]. Comorbidity can be expected to contribute to the prediction of functional outcome because it may increase the risk of intercurrent illnesses and therefore impede rehabilitation therapy [4,5,6]. The Charlson index (CCI) is one of the most widely used comorbidity indices [7, 8]. It includes 19 conditions, each assigned a weight based on their hazard ratio; the total score is the sum of these weighted scores. The index, however, was initially developed to predict mortality and not functional outcome. A number of measures have been designed that may be better associated with functional outcome. Some of these are severity weighted, such as the Cumulative Illness Rating Scale and the Index of Co-Existing Diseases, but they are complex, require specific training, and the use of a comprehensive manual [9, 10]. The Functional Comorbidity index (FCI) has been designed specifically in relation to physical function and is easier and more intuitive to use . It includes 18 diagnoses, counting their presence or absence, resulting in a cumulative sum score: the number of comorbidities. A major limitation is that it does not incorporate a severity weighting which could help improve its accuracy in predicting functional outcome . Furthermore, the index does not include dementia, which is a prevalent condition that influences functional abilities among older patients . To investigate a comorbidity index that is both brief and feasible for use in older patients, a severity-weighted rating scale was added to the original FCI and also dementia was added. As such, this modified and weighted FCI (w-FCI) assesses pre-existent comorbidity (chronic conditions) in combination with its impact on present function.
The present study aims to compare the performance of the w-FCI in an older patient population with that of the original FCI and the CCI in predicting mobility and functional recovery at discharge from geriatric rehabilitation .
Setting and design
A prospective observational cohort study was carried out as a service improvement project: COOPERATION, Comorbidity and Outcomes of Older Patients Evaluated in RehabilitATION. The setting was a community hospital-based intermediate care facility that provides inpatient rehabilitation services for older people: Lings Bar Hospital in Nottingham, UK. The multidisciplinary team consisted of an advanced nurse practitioner (ANP), nursing staff, a physician, a speech therapist, a physiotherapist, an occupational therapist, and a social worker.
Patients studied were older adults that were referred for inpatient geriatric rehabilitation. No strict age criterion was applied, but all patients had multimorbidity, complex medical problems or were ≥ 65 years old. Formal research consent was not required because this study was conducted as a service improvement project under clinical governance. A sample size of 90 was calculated based upon a minimum sample size of 50 + 8 k (where k = the number of predictors), including four predictors into a linear regression model and assuming a dropout rate of 10% . Other than the open application of these prognostic indices, which were known to the clinical team, patients received care as usual with no additional intervention.
Pre-existent comorbidity was assessed by the physician or the ANP within the first week of admission using three different indices: the CCI (Additional file 1), the FCI (Additional file 2) and the w-FCI (Fig. 1) . The sum score of the indices represented pre-existent comorbidity and not the actual disease for which the patient had been admitted to the facility.
Data from routine clinical assessments were collected on admission and at discharge from the rehabilitation facility. A physiotherapist completed the two outcome measures. These measures from routine clinical data were mobility at discharge as measured with the Elderly Mobility Scale (EMS), range 0–20 (where higher scores denote greater mobility, Additional file 3), from which EMS gain/day was calculated by subtracting EMS on admission from EMS at discharge and dividing the outcome by the total length of stay in days. The other outcome was functional dependency at discharge measured with the Barthel index (BI), range 0–20 (where higher scores denote greater independence in personal ADL, Additional file 4), from which BI gain/day was calculated [16, 17]. The EMS measures mobility and the ability to carry out transfers that are necessary for ADL activities while the patient performs 7 different tasks. The total score depends on the level of help the patient requires to succeed in the tasks. The BI determines the degree of (physical or verbal) help that a person needs to perform ADL activities. Gain/day is a measure that takes account of the fact that the length of stay of each patient varied, leading to a variable time of recovery to which the patient is ‘exposed’.
Besides comorbidity, the ANP collected the following data from routine clinical records in the first week after admission: age, gender, admission domicile, premorbid BI, primary diagnosis, cognition measured using the Montreal Cognitive Assessment (MoCA; range 0–30 where higher scores denote greater cognitive function) . At discharge, the ANP noted the discharge date (length of stay), intercurrent diseases and discharge destination.
The outcomes were used as continuous variables, except for ROC analysis. Correlations (Spearman’s rho) were calculated to test the relation between comorbidity indices and the functional outcome measures. Correlations of 0.1–0.3, 0.3–0.5 and > 0.5 were considered small, medium and large effect sizes respectively . Receiver operating characteristic curve (ROC) analyses were performed in order to create a plot to visualize the differences of predictive performance of the co-morbidity indices. To create the ROC plot, the outcomes were dichotomized: the cut off point for the BI was set at 15 and for the EMS at 13 on the base of literature [20,21,22]. The clinical interpretation of a BI = 15 is mildly disabled to independent, and EMS = 13 is mildly ADL dependent to independent. For “gain/day” no clinical interpretation of a cut off score is available and therefore was set at their median. Additional ROC curves with different thresholds (cut-off values at 25th, 50th, and 75th percentiles) were created to analyse the robustness of these results. These were performed because AUC’s may vary when different cut-off scores are used. Finally, three multiple linear regression models per outcome were created to compare the R-squared value and percentage of variance explained (PVE) of the w-FCI with that of the other indices. At first, simple models were created (comorbidity index only), age and gender were then added to the second models and function on admission was added to the full models. The areas under the ROC curves (AUCs), R squared values and PVEs were used to compare the performance of the comorbidity indices in relation to the four outcome measures.
Characteristics of patients
Ninety-eight patients were included in the study, between January and September 2017. Two patients were admitted directly from home but the remainder was admitted after acute hospitalisation. Fifty-five (56%) patients were admitted following presentation with a fall - with a fracture (n = 38) or without fracture (n = 17). Patients’ ages ranged from 57 to 99 years and 38 (39%) were male. The median functional level on admission was 5.5 (EMS) and 9 (BI) and this improved to 11 (EMS) and 14 (BI). The median length of stay in the rehabilitation facility was 24 days and functional gain/day was 0.19 (EMS) and 0.18 (BI). In total, 68 (69%) were discharged home. All characteristics are presented in Table 1.
Comorbidity and functional outcome
The most prevalent comorbidities were arthritis (47%) and osteoporosis (41%). The median scores were 1 for the CCI index (range: 0–8), 3 for the FCI (range: 0–9) and 2 for the w-FCI (range: 0–7). The FCI correlated with both the CCI (ρ: 0.376, p < 0.001) and the w-FCI (ρ: 0.497, p < 0.001), but the CCI and the w-FCI were not significantly correlated (ρ: 0.180, p: 0.076). The FCI correlated only with EMS at discharge (ρ: − 0.245, p: 0.023). The w-FCI correlated with EMS at discharge (ρ: − 0.469, p < 0.001), EMS gain/day (ρ: − 0.385, p < 0.001) and BI at discharge (ρ: − 0.415, p < 0.001), but did not significantly correlate with BI gain/day (ρ: − 0.125, p: 0.250). The CCI did not correlate significantly (p > 0.10) with any of the outcomes.
The ROC curves and corresponding AUCs - with their 95% confidence intervals - are presented in Fig. 2.The AUCs of the w-FCI were larger than those of the CCI and the FCI, which applied to all functional outcomes. This remained true for different cut-off scores, except for BI gain/day (Additional file 5). In the linear regression analyses, the CCI did not significantly contribute to the simple or to the full models (p > 0.05), the FCI only contributed to EMS gain/day (p = 0.037) but was not independently associated in the full models. The w-FCI independently contributed to the prediction of EMS & BI at discharge (p < 0.01) and EMS gain/day (p < 0.001) but not to BI gain/day (p = 0.082). These associations were also statistical significant in the full models. The PVE’s of included variables - with their 95% confidence intervals - are presented in Table 2.
Our key finding was that the modified FCI had a better predictive performance than the CCI and the original FCI with regard to EMS and BI at discharge and EMS gain/day in older patients that underwent geriatric rehabilitation. The w-FCI had a larger AUC and stronger correlation with these three outcomes (medium effect size) than the CCI and FCI. Results were not significant for BI gain/day. Furthermore, the w-FCI was independently associated with EMS and BI at discharge and EMS gain/day, whereas the CCI and FCI were not.
Strengths and limitations
This study has several strengths: we did not apply any restrictions or exclusion criteria except that all patients had to be referred for rehabilitation. The study cohort was characterised by a high age, prevalent comorbidity and a large drop in mobility and functional capacity after acute illness: it was a typical population and the study was conducted in a normal clinical setting . However, no stroke patients were admitted in the facility: stroke rehabilitation usually is provided in specific post-acute stroke rehabilitation facilities.
Furthermore, the design of the w-FCI and its rating scale is function-based and involves the clinical judgement of the clinician. This is in contrast to many studies that used an administration-based method of assessing comorbidity. Therefore, this prospective study gives insight in the clinical assessment of severity-weighted comorbidity and its potency in making a functional prognosis. Finally, we used two different rehabilitation impact indices per outcome measure: function/mobility at discharge and function/mobility gain/day . Function at discharge is an important rehabilitation outcome that indicates the functional independence of a patient, which is necessary for discharge planning. However, other factors than functional status alone may influence discharge planning such as availability of informal caregivers and home situation (stairs or ground floor). That is why EMS and BI gain/day - which is a measure of rehabilitation efficiency - are also important outcomes with regard to the functional prognosis and duration of stay.
There were also several limitations. The study cohort was relatively small and the study was carried out in one facility where the clinicians that completed the measurements were not blinded to clinical practice and the course of a patient. To minimize potential bias, the therapists that performed the EMS and BI were not aware of the comorbidity indices and its scores. Therefore, we think it is unlikely that it has affected our results to any major degree. We also did not take therapy type, duration and intensity into account. Patients likely received customized therapy, on the basis of their capacity and general condition. A larger multicentre study that takes account of therapy differences across patients would be needed to investigate whether the predictive validity of the w-FCI can be confirmed. It is also important to realise that our findings apply to vulnerable older patients but may not be generalizable to younger patients with less comorbidity. One last limitation concerning the study design: our study did not investigate outcomes like quality of life or other indicators of wellbeing, which are also important outcomes of rehabilitation.
Furthermore, a limitation of the w-FCI may relate to what we have stated above as one of its strengths: the w-FCI assesses comorbidity on the base of the clinician’s opinion and quantifies this into a rating scale. This may reduce the reliability and reproducibility due to variability of opinions about the impact of a comorbid condition. Lastly, for the ROC analyses of BI or EMS gain/day we have used the medians as the cut-off. A clinical interpretation of these cut off values is lacking in literature, therefore these results have to be interpreted with caution. However, to give a better insight in all the results from the ROC analyses plots and AUC’s with different thresholds are presented in the additional files (Additional file 5).
Findings in context
With regard to mobility, the w-FCI showed higher AUCs than the other indices and independently contributed to the prediction of mobility and function at discharge and mobility gain/day. This finding supports the conclusion of other studies that severity of disease should be included in comorbidity assessment [12, 25,26,27,28,29]. The w-FCI contains information on the impact of disease in the patient’s individual situation and therefore quantifies severity of comorbidity: a clinical severity weight. This is in contrast to the method of the design studies of the CCI and FCI [8, 11]. In these studies a statistical weight (relative risk and/or beta coefficient) was used and no clinical severity was added to the index. The statistical weighted count in the original FCI study did not perform much better, but the authors discuss the issue that de FCI does not take the severity of diagnoses into consideration. They agree that severity ratings are likely to provide a better performance, but discuss the practical problems of severity rating. We believe that it is an important part of assessing comorbidity in older patients.
In our study, the w-FCI explained almost half of the variance in three out of the four models (not in BI gain/day). For research purposes in older patients, the w-FCI seems to be preferable compared to the CCI and the FCI when functional outcomes are of interest. The CCI has proven to be a sufficient predictor of mortality and we think that the use of it should be restricted to studies that investigate mortality and survival. The FCI has been designed in relation to function, but has not yet been validated in older patients (e.g. absence of dementia), which may explain the lower predictive performance in our study .
Regarding the BI, the w-FCI performed sufficiently (AUC > 0.60) and the other indices were poor. An explanation for the overall stronger associations with mobility (EMS) than with the BI (Table 2) could be that the EMS is sensitive in detecting change (improvement), which was found to be stronger compared to that of the BI . In addition, our study cohort was specifically characterized by reduced mobility (Table 1).
Interpretation of findings
The present study demonstrated that clinicians were able to estimate functional impact of comorbid conditions in such a way that it proved to be an independent factor in predicting mobility and function at discharge and EMS gain/day. Assessing functionally weighted comorbidity using the rating scale distinguishes the w-FCI from the CCI and the FCI. It resembles usual clinical rehabilitation practice, in which a clinician evaluates disease severity, functional impairments and the potential for successful functional recovery. Using the w-FCI, this could be carried out in a brief and structured way, for example as part of comprehensive geriatric assessment. Finally, the w-FCI seems to fit well into the concept of the International Classification of Functioning, Disability and Health, the ICF framework . This framework defines health by the interactions between conditions, body functions and structures, activities and participation, including environmental and personal factors (Additional file 6).
The w-FCI had higher predictive performance in relation to functional recovery and efficiency of recovery than the CCI and the original FCI, especially when measured using the EMS. The w-FCI may aid in assessing comorbidity in a personalised way and could be incorporated into routine triaging and discharge planning in the rehabilitation practice of older patients. However, further research is required to investigate whether the predictive validity of the w-FCI can be confirmed.
Availability of data and materials
The authors confirm that all relevant data are included in the article or its supplementary information files.
Activities of daily living
Advanced nurse practitioner
Area under the curve
Charlson Comorbidity Index
Elderly mobility scale
Functional comorbidity index
International Classification of Functioning, Disability and Health
Montreal Cognitive Assessment
Percentage of Variance Explained
Receiver operating characteristic
Weighted functional comorbidity index
Gladman JR. The international classification of functioning, disability and health and its value to rehabilitation and geriatric medicine. J Chin Med Assoc. 2008;71(6):275–8.
Spruit-van Eijk EM, Zuidema SU, Buijck BI, Koopmans RT, Geurts AC. To what extent can multimorbidity be viewed as a determinant of postural control in stroke patients? Arch Phys Med. 2012;93(6):1021–6.
Spruit-van Eijk EM, Zuidema SU, Buijck BI, Koopmans RT, Geurts AC. Determinants of rehabilitation outcome in geriatric patients admitted to skilled nursing facilities after stroke: a Dutch multi-Centre cohort study. Age Ageing. 2012;41(6):746–52.
Lew HL, Lee E, Date ES, Zeiner H. Influence of medical comorbidities and complications on FIM change and length of stay during inpatient rehabilitation. Am J Phys Med Rehabil. 2002;81(11):830–7.
Siegler EL, Stineman MG, Maislin G. Development of complications during rehabilitation. Arch Intern Med. 1994;154(19):2185–90.
Kabboord AD, Van Eijk M, Buijck BI, Koopmans R, van Balen R, Achterberg WP. Comorbidity and intercurrent diseases in geriatric stroke rehabilitation: a multicentre observational study in skilled nursing facilities. Eur Geriatr Med. 2018;9(3):347–53.
Yurkovich M, Avina-Zubieta JA, Thomas J, Gorenchtein M, Lacaille D. A systematic review identifies valid comorbidity indices derived from administrative health data. J Clin Epidemiol. 2015;68(1):3–14.
Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83.
Salvi F, Miller MD, Grilli A, Giorgi R, Towers AL, Morichi V, et al. A manual of guidelines to score the modified cumulative illness rating scale and its validation in acute hospitalized elderly patients. J Am Geriatr Soc. 2008;56(10):1926–31.
Imamura K, McKinnon M, Middleton R, Black N. Reliability of a comorbidity measure: the index of co-existent disease (ICED). J Clin Epidemiol. 1997;50(9):1011–6.
Groll DL, To T, Bombardier C, Wright JG. The development of a comorbidity index with physical function as the outcome. J Clin Epidemiol. 2005;58(6):595–602.
Kabboord AD, van Eijk M, Fiocco M, van Balen R, Achterberg WP. Assessment of comorbidity burden and its association with functional rehabilitation outcome after stroke or hip fracture: a systematic review and meta-analysis. J Am Med Dir Assoc. 2016;20(16):30306–1.
Hoang-Kim A, Busse JW, Groll D, Karanicolas PJ, Schemitsch E. Co-morbidities in elderly patients with hip fracture: recommendations of the ISFR-IOF hip fracture outcomes working group. Arch Orthop Trauma Surg. 2014;134(2):189–95.
Green SB. How many subjects does it take to do a regression analysis. Multivariate Behav Res. 1991;26(3):499–510.
Kabboord AD, van Eijk M, van Dingenen L, Wouters M, Koet M, van Balen R, et al. Reliability and usability of a weighted version of the functional comorbidity index. Clin Interv Aging. 2019;11(14):289–99.
Prosser L, Canby A. Further validation of the elderly mobility scale for measurement of mobility of hospitalized elderly people. Clin Rehabil. 1997;11(4):338–43.
Collin C, Wade DT, Davies S, Horne V. The Barthel ADL index: a reliability study. Int Disabil Stud. 1988;10(2):61–3.
Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695–9.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. New York: Lawrence Erlbaum Associates; 1988.
Wade DT, Hewr RL. Functional abilities after stroke: measurement, natural history and prognosis. J Neurol Neurosurg Psychiatry. 1987;50:177–82.
Smith R. Validation and reliability of the elderly mobility scale. Physiotherapy. 1994;80(11):744–7.
Simundic AM. Measures of diagnostic accuracy: basic definitions. EJIFCC. 2009;19(4):203–11.
National Audit of Intermediate Care (NAIC). Summary Report – England 2017. https://s3.eu-west-2.amazonaws.com/nhsbn-static/NAIC+(Providers)/2017/NAIC+England+Summary+Report+−+upload+2.pdf. Accessed 20 Aug 2018.
Koh GC, Chen CH, Petrella R, Thind A. Rehabilitation impact indices and their independent predictors: a systematic review. BMJ Open. 2013;3(9):e003483.
Ferriero G, Franchignoni F, Benevolo E, Ottonello M, Scocchi M, Xanthi M. The influence of comorbidities and complications on discharge function in stroke rehabilitation inpatients. Eura Medicophys. 2006;42(2):91–6.
Rozzini R, Frisoni GB, Ferrucci L, Barbisoni P, Sabatini T, Ranieri P, et al. Geriatric index of comorbidity: validation and comparison with other measures of comorbidity. Age Ageing. 2002;31(4):277–85.
de Groot V, Beckerman H, Lankhorst GJ, Bouter LM. How to measure comorbidity: a critical review of available methods. J Clin Epidemiol. 2003;56(3):221–9.
Bayliss EA, Ellis JL, Steiner JF. Subjective assessments of comorbidity correlate with quality of life health outcomes: initial validation of a comorbidity assessment instrument. Health Qual Life Outcomes. 2005;3:51.
Liu M, Domen K, Chino N. Comorbidity measures for stroke outcome research: a preliminary study. Arch Phys Med Rehabil. 1997;78(2):166–72.
Spilg EG, Martin BJ, Mitchell SL, Aitchison TC. A comparison of mobility assessments in a geriatric day hospital. Clin Rehabil. 2001;15(3):296–300.
The authors thank Nan van Geloven for statistical consultation.
No formal funding or grants were received. The work was supported by Laurens, a Dutch care organization in Rotterdam, the Netherlands. Laurens did not play any role in the design of the study, data collection, analysis, interpretation of the data, and in writing the manuscript.
Ethics approval and consent to participate
After consultation with the NHS Health Research Authority, this study was approved by the responsible NHS Trust (Nottinghamshire Healthcare NHS Trust) as a service improvement project conducted under clinical governance. No formal ethics approval was required and the Nottinghamshire Healthcare NHS Trust waived the need for consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The Charlson comorbidity index: lay out of the Charlson comorbidity index.
The original functional comorbidity index: lay out of the original functional comorbidity index.
The Elderly Mobility Scale: content of the Elderly Mobility Scale.
The Barthel index: content of the Barthel index.
Robustness ofd ROC curves: ROC curves of the four different outcome measures with different thresholds (25th, 50th and 75th percentiles as cut-off scores) to present the robustness of the results.
The ICF framework: the w-FCI embedded in the ICF framework.
About this article
Cite this article
Kabboord, A.D., Godfrey, D., Gordon, A.L. et al. The modified functional comorbidity index performed better than the Charlson index and original functional comorbidity index in predicting functional outcome in geriatric rehabilitation: a prospective observational study. BMC Geriatr 20, 114 (2020). https://doi.org/10.1186/s12877-020-1498-z