Comparison of self-reported and performance-based measures of functional ability in elderly patients in an emergency department: implications for selection of clinical outcome measures
BMC Geriatrics volume 16, Article number: 199 (2016)
Assessment of functional ability in elderly patients is often based on self-reported rather than performance-based measures. This study aims to compare self-reported and performance-based measures of functional ability in a population of elderly patients at an emergency department (ED).
Participants were 61 patients aged 65 years and above admitted to an ED. The self-reported measure used was the Barthel-20; the performance-based measures were Timed Up and Go (TUG); 30s-Chair Stand Test (30s-CST) and Assessment of Motor and Process Skills (AMPS) with the two scales; motor and process. Correlation analyses were conducted to examine the relationships between the self-reported and performance-based measures of functional ability.
The correlation between the Barthel-20 and the TUG was moderate (r = −0.64). The correlation between the Barthel-20 and the AMPS motor was also moderate (r = 0.53). The correlation between the Barthel-20 and the 30s-CST was fair (r = 0.45). The correlation between Barthel-20 and the AMPS process was non-significant. The results were affected by high ceiling effect (Barthel-20).
Self-reported and performance-based measures seem to assess different aspects of functional ability. Thus, the two methods provide different information, and this highlight the importance of supplementing self-reported measures with performance-based measures when assessing functional ability in elderly patients.
Elderly patients often experience limitations in their functional ability related to daily activities and mobilization [1–4]. Limited functional ability in elderly is associated with increased risk of readmission and may be a predictor of prolonged hospitalisation and increased mortality [5–7]. According to a systematic review by Wales et al., assessment of functional ability is the first step in identifying rehabilitation needs in elderly patients and to determine effectiveness of treatment . Assessment of functional ability is also an important element in the multidimensional Comprehensive Geriatric Assessment (CGA) approach aiming at providing care and treatment for geriatric patients. The CGA assesses the patient's level of independence in performing daily activities using measures as Barthel Index, the Katz Index of independence in Daily Activities and the Function Activity Questionnaire . However, there is currently no consensus on the use of a “gold-standard” for assessment of functional ability in elderly [10–13].
There are different approaches to assessing functional ability and several outcome measures related to different aspects of functional ability are used [10, 11]. Self-reported measures are frequently used to assess functional ability in elderly patients [10, 12, 14]. Self-reporting may be less time-consuming than performance-based assessment but the two approaches vary considerably . Two studies have compared self-reported and performance-based assessment of functional ability in elderly patients and they found little overlap between the two methods [15, 16]. A study of Roedersheimer et al. , found discrepancies between self-reported ability and performance-based ability in simple mobility tasks. In general, both approaches to data collection have advantages as well as limitations. One important feature of the self-reported approach is that it represents the patient perspective. However, the use of self-reported data in emergency departments poses several limitations. Patients hospitalised for medical problems may experience a sudden, but unrecognised decline in functional ability and their self-reporting of current functional ability may consequently not be accurate. Furthermore, self-reporting in elderly patients can be problematic due to cognitive impairment or affective responses to acute illness . On the other hand, performance-based measures can be used to evaluate discrete and specific components of the performance on specific tasks, including how the task was approached. This can point to specific disabilities which can be targeted during treatment and rehabilitation [18–20]. Although performance-based measures seems to have some advantages, evidence indicate they are not routinely performed in ED [12, 21].
The aim of the present study was to compare self-reported and performance-based measures of functional ability in elderly patients at an ED.
Design and setting
The study used a cross sectional design and was conducted at a university hospital in Denmark.
Patients were recruited from the ED at a university hospital. Patients aged 65 years or older with planned discharge directly from the ED, who were able to sit on a chair were included. Exclusion criteria: Orthopaedic patients, patients admitted from a nursing home, patients requiring palliative care, patients not speaking Danish and patients unable to follow instructions due to cognitive impairment. Patients were tested after acute medical treatment and close to discharge. The assessments were performed for the purpose of this study and were thus not a part of the daily routine.
Written informed consent was obtained to perform the assessments and use the data for the purpose of this study. The study was approved by the Central Denmark Region Committees on Biomedical and Research Ethics (J. nr.1-10-72-108-14), and by the Danish Data Protection Agency (J.nr. 2012-41-0763).
One of the most commonly used functional outcome measures in elderly patients both in research and in clinical settings is the Barthel Index [22–26]. The index measures a person’s level of independence in the performance of daily activities. It is an ordinal scale comprising ten activities including grooming, bathing, feeding, getting on and off the toilet, ascending and descending stairs, getting dressed bladder continence, bowel continence, walking, and transferring. Although it is widely used, a study by de Morton  found that the index was not unidimensional and that the scale consists of different constructs.
A widely adopted modification by Collin and Wade  uses a score range from 0 (high dependence on assistance) to 20 (independent of assistance). The Barthel-20 can be used as self-reporting, by proxy and as an observation-based measurement .
To identify performance-based outcome measures for functional ability in elderly patients, we searched the literature. Selection criteria were: Generic outcome measures validated for the elderly population and simple to administer without the use of special equipment.
Based on the literature, Timed Up and Go (TUG) and 30s-Chair Stand Test (30s-CST) were chosen to assess disability in relation to basic mobility [29, 30]. Both measures are widely used at medical and geriatric departments and they are validated and feasible for use in elderly hospitalised patients [31–33]. To get a broader perspective on functional ability , we supplemented measures of mobility with measures of quality in performance of daily activities. Here the Assessment of Motor and Process Skills (AMPS) is the only performance-based instrument that measures a person’s quality of performing daily activities [18, 19, 35].
The TUG test assesses basic mobility and reflects a person’s ability to get up from a chair, walk three metres and turn around. Wearing regular footwear and using his/her customary walking aid, participants were asked to complete the following as fast and safely as possible: Get up from an armchair (46 cm high), walk three metres (marked by tape), turn, return and sit down. Timing begins at the instruction “go” and stops when the person is seated. The faster a person is, the better and a score < 20 s reflects independence in basic transfers . When possible, the best result in seconds of three attempts was recorded and used for analysis .
The 30s-CST assesses lower body strength and area of functional mobility. It uses a chair with a seat height of 43 cm and no arm rest. At the signal “go”, the participant rose to a full stand and was instructed to complete as many full stands as possible within the 30-s time limit .
The AMPS measures the quality of a person’s performance of daily activities in natural, task-relevant environments . It is an observational assessment instrument used by occupational therapists (OT) with an AMPS license. The AMPS consists of two scales, one measuring motor skills and one measuring process skills. Computer scoring of the AMPS provides logit values from −4 to +4. AMPS indicate whether the patient is able to live independently in the community or whether minimal, moderate or maximal assistance is needed .
Data on diagnosis and age was collected from the patient’s medical record. A research physiotherapist (PT) used the Barthel-20 as self-report during a face-to-face interview. The time frame used in the Barthel-20 was one week. Afterwards, the patient was tested using the TUG and the 30s-CST administered by a PT and AMPS administered by a OT. The Barthel-20 was always administered first so that the Barthel-20 score was not affected by the patient’s test performance. All tests were performed in accordance with a standard protocol. None of the performance-based measures was part of routinely praxis and the two OT’s was licensed to administer AMPS in relation to the study.
The following a priori hypotheses tested were based on the assumption that measures that conceptually converge should be strongly correlated and measures with less in common should have a weaker correlation. As the measures represent different constructs of functional ability, we hypothesised the following:
The correlation between Barthel-20 and TUG would be fair.
The correlation between Barthel-20 and 30s-CST would be fair.
The correlation between Barthel-20 and AMPS motor skills would be fair.
The correlation between Barthel-20 and AMPS process skills would be fair.
Descriptive statistics were used to report frequency and proportions for categorical variables, medians were reported with 5 and 95 percentiles for data on ordinal scales and means and standard deviations for continuous variables with normal distribution. Floor and ceiling effects were examined and described for Barthel-20, TUG and 30s-CST. Such effects occur if more than 15% of the patients achieve the lowest or highest possible score .
The relationship between self-reporting and performance-based measures was examined with Spearman’s correlations between TUG, 30s-CST, AMPS and Barthel-20, respectively. Coefficients were stated as poor (<0.25), fair (0.25-0.49), moderate (0.50-0.74) and excellent (≥0.75) . Analyses were conducted using Stata-13.0.
Sixty-six patients were enrolled in this study; five patients were transferred to another department instead of being discharged and were excluded. The final study population thus comprised 61 participants all completed Barthel-20; 77.1% completed the TUG, 80.3% the AMPS and 93.4% the 30s-CST. Reasons for not completing the tests are described in Fig. 1. There was no difference between completers and non-completers in relation to gender, age or Barthel-20 score (Fig. 1).
The mean age of participants was 80.4 years (SD 7.7) and 57% were women. A large proportion (20%) had no specific diagnosis (Table 1). The median scores were 19 (11–20) for the Bathel-20, 13.7 (6.4-39.6) for the TUG, 4 (0–14) for the 30s-CST, 0.97 (SD 0.76) for the AMPS motor skills and 0.73 (SD 0.67) for AMPS process skills (Table 1).
As shown in Fig. 2, the Barthel-20 had a ceiling effect as 43% of the patients scored the highest possible score. Both TUG and 30s-CST had floor effect; 23% of the patients scored 0 in TUG and 44% of the patients scored 0 in 30s-CST.
The correlation between Barthel-20 (level of independence) and TUG (basic mobility) was moderate (r = −0.64). The correlation between Barthel-20 (level of independence) and AMPS motor skills (quality of performance of daily activities – motor skills) was moderate (r = 0.53), while the correlation between Barthel-20 (level of independence) and 30s-CST (lower body strength) was fair (r = 0.45). The correlation between Barthel-20 and AMPS process skills (quality of performance of daily activities – process skills) was poor (r = 0.06) (Table 2).
Barthel-20 comprises two different constructs: mobility and daily activities. Thus, we divided Barthel-20 into two sub-scores related to daily activities (items 1, 3, 4, 5 and 8) and mobility (items 2, 6 and 7) to test if the correlations became stronger. None of the correlations changed significantly (Table 2).
This study compared self-reported and performance-based measures of functional ability in elderly patients at an ED. The correlation between Barthel-20 and TUG and between Barthel-20 and AMPS motor skills was moderate (r: 0.50 - 0.74). It was hypothesised that the correlation would be only fair because the measurements represent different constructs. The correlation between Barthel-20 and 30s-CST was fair and the correlation between Barthel-20 and the AMPS process skills was poor. This may either indicate a difference between the different underlying constructs (mobility and performance of daily activities) of the Barthel-20 and the three performance-based measures or confirm our hypothesis that self-reporting compared with performance-based measurements provides distinct information about functional ability [15, 16].
The three performance- based measures revealed a higher prevalence of patients with functional limitations compared to the self-reported measure (Barthel-20). One explanation could be that the patients were not yet aware of their ability to mobilize or to perform daily activities due to their state of sudden acute illness and admission to hospital. Our results are in accordance with results from other studies. A study by Wæhrens et al.  found that measures of self-reported daily activities had limited correlation to observed performance of daily activities in a population of women with rheumatoid arthritis, knee osteoarthritis or fibromyalgia. Sager et al.  found significant differences between elderly patients’ self-reported performance of daily activities and performance-based assessments of daily activities at the time of discharge. The same tendency was reported by Roedersheimer et al.  who found a discrepancy between elderly patients’ self-reported ability to perform simple mobility tasks and results of their performance-based abilities. In the present study we compared measures of functional ability with different underlying constructs and our results are thus not directly comparable. We could have compared the Barthel-20 used as a self-reported measure with the Barthel-20 used as a performance-based measure, but to the best of our knowledge assessment of functional ability encompasses more than level of independence in performing daily activities.
The difference between self-reported and performance-based measures could have implications for the patient’s discharge and further rehabilitation process. Self-reported measures of functional ability may be inadequate in the planning of rehabilitation, especially as some patients are unable to report their performance realistic and accurately.
Assessing functional ability during hospitalisation may prevent the patient from undergoing further testing and the assessments can be used by other professionals during the course of rehabilitation, thus potentially improving the quality of overall pathway. Investing time and resources in obtaining comprehensive knowledge of older patients is an important part of the Comprehensive Geriatric Assessment (CGA) [40, 41]. Including performance-based measures in this assessment may not only ensure that patients receive the right care, training, and rehabilitation; such efforts may also be instrumental in reducing mortality and readmission rates seen among elderly disabled patients [2, 6].
The high ceiling effect of the Barthel-20 in our study indicates the challenges of using this test. Moreover, it also suggests that self-reported measurements of functional ability in general may be problematic in elderly patients in an acute care setting [14, 15].
Both the TUG and the 30s-CST showed floor effects. This indicates that the tests are not sufficiently sensitive for use in all older patients . A large part of patients (44%) were not able to follow the protocol of the 30s-CST and rise without the use of armrest. Perhaps we should have categorized these data differently to get a broader picture of the patients’ physical performance. A study by Bodilsen et al.,  describe three categories 1) ability to rise without using the armrest, 2) ability to rise using the armrest and 3) inability to rise independently from the chair. In our study, 17 patients completed the TUG, but scored 0 in the 30s-CST. This indicates that at least these 17 patients would score 2 using the scale presented by Bodilsen .
Our study is limited by a relatively small sample size. Nevertheless, an important strength of the study is that several measures are examined in the same sample, which mitigates the potential risk of comparing measures across different samples. This strengthens our result that self-reported and performance-based measures seem to assess different aspects of functional ability. About 20% of the study population was unable to complete either the TUG or the AMPS. This suggests that the measures may not be suitable in the entire population, or perhaps that the use of all three measures was too cumbersome for some of the patients in the ED. The use of AMPS can reveal some limitations, as the measure requires license of the OT.
Another limitation is that we included only patients able to sit on a chair and who were able to follow instructions. The findings may therefore not be generalizable to all elderly patients at an ED.
Our findings add to the growing evidence that self-report and performance-based measures of functional ability provide distinct and different information. These differences are relevant to both clinicians and researchers. It should be recognized that the Barthel-20 does not provide nearly as broad and compressive a view of functional ability as the three performance-based measures. The underlying construct of the Barthel-20 is different from the constructs of the performance-based measures. Thus, direct comparisons might be challenging. However, both self-reported and performance-based measures describe aspects of functional ability and both are advocated outcomes of this domain within clinical research [16, 39]. A priority for further research should be to examine if or how the use of both performance-based and self-reported measures of functional ability leads to improved discharge planning, rehabilitation, and thus better patient outcome.
In conclusion we found that patients reported higher functional ability than observed by using the performance-based measures. This indicates that the two methods provide different information about functional ability. Thus, it is important to supplement self-reported measures with performance-based measures as both methods provide important and complementary information about the elderly patients’ functional ability.
30s- chair stand test
Assessment of motor and process skills
Comprehensive geriatric assessment
Timed up and go
Caplan GA, Brown A, Croker WD, Doolan J. Risk of admission within 4 weeks of discharge of elderly patients from the emergency department--the DEED study. Discharge of elderly from emergency department. Age Ageing. 1998;27(6):697–702.
Comette P, D’Hoore W, Malhomme B, Van Pee D, Meert P, Swine C. Differential risk factors for early and later hospital readmission of older patients. Aging Clin Exp Res. 2005;17(4):322–8.
Counsell SR, Holder CM, Liebenhauer LL, Palmer RM, Fortinsky RH, Krevic DM, et al. Effects of a multicomponent intervention on functional outcomes and process of care in hospitalized older patients: A randomized controlled trial of acute care for elders in a community hospital. J Am Geriatr Soc. 2000;48(12):1572–81.
Boyd CM, Landefeld CS, Counsell SR, Palmer RM, Fortinsky RH, et al. Recovery of activities of daily living in older adults after hospitalization for acute medical illness. J Am Geriatr Soc. 2008;56:2171–9.
Friedmann PD, Jin L, Karrison TG, Hayley DC, Mulliken R, Walter J, et al. Early revisit, hospitalization, or death among older persons discharged from the ED. Am J Emerg Med. 2001;19(2):125–9.
Chu LW, Pei CK. Risk factors for early emergency hospital readmission in elderly medical patients. Gerontology. 1999;45(4):220–6.
Campbell SE, Seymour DG, Primrose WR, ACMEPLUS Project. A systematic literature review of factors affecting outcome in older medical patients admitted to hospital. Age Ageing. 2004;33(2):110–5.
Wales K, Clemson L, Lannin N, Cameron I. Functional assessments used by occupational therapists with older adults at risk of activity and participation limitations: a systematic review. PLoS One. 2016;11(2), e0147980.
Jiang S, Li P. Current development in elderly comprehensive assessment and research methods. Biomed Res Int. 2016;2016:3528248.
Wells JL, Seabrook JA, Stolee P, Borrie MJ, Knoefel F. State of the art in geriatric rehabilitation. Part I: review of frailty and comprehensive geriatric assessment. Arch Phys Med Rehabil. 2003;84(6):890–7.
Buurman BM, van Munster BC, Korevaar JC, de Haan RJ, de Rooij SE. Variability in measuring (instrumental) activities of daily living functioning and functional decline in hospitalized older medical patients: a systematic review. J Clin Epidemiol. 2011;64(6):619–27.
Ellis G, Marshall T, Ritchie C. Comprehensive geriatric assessment in the emergency department. Clin Interv Aging. 2014;9:2033–43.
Freiberger E, de Vreede P, Schoene D, Rydwik E, Mueller V, Frandin K, et al. Performance-based physical function in older community-dwelling persons: a systematic review of instruments. Age Ageing. 2012;41(6):712–21.
Gill TM. Assessment of function and disability in longitudinal studies. J Am Geriatr Soc. 2010;58 Suppl 2:S308–12.
Bean JF, Olveczky DD, Kiely DK, LaRose SI, Jette AM. Performance-based versus patient-reported physical function: what are the underlying predictors? Phys Ther. 2011;91(12):1804–11.
Sager MA, Dunham NC, Schwantes A, Mecum L, Halverson K, Harlowe D. Measurement of activities of daily living in hospitalized elderly: a comparison of self-report and performance-based methods. J Am Geriatr Soc. 1992;40(5):457–62.
Roedersheimer KM, Pereira GF, Jones CW, Braz VA, Mangipudi SA, Platts-Mills TF. Self-reported versus performance-based assessments of a simple mobility task among older adults in the emergency department. Ann Emerg Med. 2016;67(2):151–6.
Fisher AG, Bray K. Assessment of motor and process skills. Development, standardization, and administration manual. 7th ed. Colorado: Fort Collins Three Star Press; 2007.
Doble SE, Fisk JD, Lewis N, Rockwood K. Test-retest reliability of the assessment of motor and process skills in elderly adults The Occupational Therapy Journal of Research. 1999;19:203-15.
Fioravanti AM, Bordignon CM, Pettit SM, Woodhouse LJ, Ansley BJ. Comparing the responsiveness of the assessment of motor and process skills and the functional independence measure. Can J Occup Ther. 2012;79(3):167–74.
Rodriguez-Molinero A, Lopez-Dieguez M, Tabuenca AI, de la Cruz JJ, Banegas JR. Functional assessment of older patients in the emergency department: comparison between standard instruments, medical records and physicians’ perceptions. BMC Geriatr. 2006;6:13.
Crocker T, Young J, Forster A, Brown L, Ozer S, Greenwood DC. The effect of physical rehabilitation on activities of daily living in older residents of long-term care facilities: systematic review with meta-analysis. Age Ageing. 2013;42(6):682–8.
Mercante O, Gagliardi C, Spazzafumo L, Gaspari A, David S, Cingolani D, et al. Loss of autonomy of hospitalized elderly patients: does hospitalization increase disability? Eur J Phys Rehabil Med. 2014;50:703-08.
Seematter-Bagnoud L, Lecureux E, Rochat S, Monod S, Lenoble-Hoskovec C, Bula CJ. Predictors of functional recovery in patients admitted to geriatric postacute rehabilitation. Arch Phys Med Rehabil. 2013;94(12):2373–80.
MAHONEY FI, BARTHEL DW. Functional Evaluation: the Barthel Index. Md State Med J. 1965;14:61–5.
Collin C, Wade DT, Davies S, Horne V. The Barthel ADL Index: a reliability study. Int Disabil Stud. 1988;10(2):61–3.
de Morton NA, Keating JL, Davidson M. Rasch analysis of the barthel index in the assessment of hospitalized older patients after admission for an acute medical condition. Arch Phys Med Rehabil. 2008;89(4):641–7.
Sainsbury A, Seebass G, Bansal A, Young JB. Reliability of the Barthel Index when used with older people. Age Ageing. 2005;34(3):228–32.
Podsiadlo D, Richardson S. The timed “Up & Go”: a test of basic functional mobility for frail elderly persons. J Am Geriatr Soc. 1991;39(2):142–8.
Jones CJ, Rikli RE, Beam WC. A 30-s chair-stand test as a measure of lower body strength in community-residing older adults. Res Q Exerc Sport. 1999;70(2):113–9.
Hesseberg K, Bentzen H, Bergland A. Reliability of the Senior Fitness Test in Community-dwelling Older People with Cognitive Impairment. Physiother Res Int. 2015;20(1):37-44.
Brooks D, Davis AM, Naglie G. Validity of 3 physical performance measures in inpatient geriatric rehabilitation. Arch Phys Med Rehabil. 2006;87(1):105–10.
Rydwik E, Bergland A, Forsen L, Frändin K. Psychometrics properties of the timed up and go in elderly people: a systematic review. Physical & Occupational Therapy in Geriatrics. 2011;29(2):102.
Gladman JRF. The international classification of functioning, disability and health and its value to rehabilitation and geriatric medicine. J Chin Med Assoc. 2008;71(6):275–8.
Fisher AG. The assessment of IADL motor skills: an application of many-faceted Rasch analysis. Am J Occup Ther. 1993;47(4):319–29.
Merritt BK. Validity of using the assessment of motor and process skills to determine the need for assistance. Am J Occup Ther. 2011;65(6):643–50.
De Vet HC, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine. 1st ed. New York: Cambridge University Press; 2011.
Portney LG WM. Foundations of clinical research - applications to practice. 3rd ed. New Jersey: Pearsons Education; 2007.
Waehrens EE, Bliddal H, Danneskiold-Samsoe B, Lund H, Fisher AG. Differences between questionnaire- and interview-based measures of activities of daily living (ADL) ability and their association with observed ADL ability in women with rheumatoid arthritis, knee osteoarthritis, and fibromyalgia. Scand J Rheumatol. 2012;41(2):95–102.
Mion LC, Palmer RM, Meldon SW, Bass DM, Singer ME, Payne SM, et al. Case finding and referral model for emergency department elders: a randomized clinical trial. Ann Emerg Med. 2003;41(1):57–68.
Caplan GA, Williams AJ, Daly B, Abraham K. A randomized, controlled trial of comprehensive geriatric assessment and multidisciplinary intervention after discharge of elderly from the emergency department--the DEED II study. J Am Geriatr Soc. 2004;52(9):1417–23.
Bodilsen AC, Juul-Larsen HG, Petersen J, Beyer N, Andersen O, Bandholm T. Feasibility and Inter-Rater Reliability of Physical Performance Measures in Acutely Admitted Older Medical Patients. Plos One 2015;23(10):1-15
We acknowledge the Department of Emergency Medicine at Aarhus University Hospital for facilitating recruitment and enabling staff to take part in this study.
This work was supported by the Danish Occupational Therapy Foundation (FF 1 13–2) and by the Tryg Foundation (IDnr 107632). The foundations played no role in the design, execution, analysis and interpretation of data, or writing of the study.
Availability of data and materials
All data generated and analysed during this study are included in this published article in supplementary information files. Please see Additional file 1.
Study conception and design: LMN, HK, TM. Acquisition of data: LMN, KBO, KBR. Analysis and interpretation of data: LMN, TM. Drafting of manuscript: LMN, TM. Critical revision: LMN, HK, LØ, TM. All authors have approved the version to be published.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The study was approved the Central Denmark Region Committees on Biomedical and Research Ethics (J. nr.1-10-72-108-14), and by the Danish Data Protection Agency (J.nr. 2012-41-0763). All participants gave consent to participate.
About this article
Cite this article
Nielsen, L.M., Kirkegaard, H., Østergaard, L.G. et al. Comparison of self-reported and performance-based measures of functional ability in elderly patients in an emergency department: implications for selection of clinical outcome measures. BMC Geriatr 16, 199 (2016). https://doi.org/10.1186/s12877-016-0376-1