Feasibility of performance-based and self-reported outcomes in self-managed falls prevention exercise interventions for independent older adults living in the community
BMC Geriatrics volume 22, Article number: 147 (2022)
Little is known about associations between performance-based measurements and self-reported scales, nor about ceiling effects or sensitivity to change to evaluate effects in the target population for self-managed exercise interventions. This study aimed to explore the feasibility of using performance-based outcomes for gait speed, functional leg strength and balance, and self-reported outcomes of falls-efficacy and functional ability in two self-managed falls prevention exercise interventions for community dwelling older adults.
Independent living, community-dwelling older adults (n = 67) exercised with one of two self-managed falls prevention exercise programmes, a digital programme (DP) or a paper booklet (PB) in a 4-month participant preference trial. Pre- and post-assessments, by blinded assessors, included Short Physical Performance Battery (SPPB) and 30s Chair stand test (30s CST). Participants completed self-reported questionnaires: Activities-specific and Balance Confidence scale (ABC), Iconographical Falls Efficacy Scale (Icon-FES), Late-Life Function and Disability Instrument Function Component (LLFDI-FC). In addition, improvement in balance and leg strength was also self-rated at post-assessment. Participants’ mean age was 76 ± 4 years and 72% were women.
Ceiling effects were evident for the balance sub-component of the SPPB, and also indicated for ABC and Icon-FES in this high functioning population. In SPPB, gait speed, 30s CST, and LLFDI-FC, 21–56% of participants did not change their scores beyond the Minimal Clinically Important Difference (MCID). At pre-assessment all performance-based tests correlated significantly with the self-reported scales, however, no such significant correlations were seen with change-scores. Improvement of performance-based functional leg strength with substantial effect sizes and significant correlations with self-reported exercise time was shown. There were no differences in outcomes between the exercise programmes except that DP users reported improved change of leg strength to a higher degree than PB users.
The LLFDI-FC and sit-to-stand tests were feasible and sensitive to change in this specific population. The balance sub-component of SPPB and self-reported measures ABC and Icon-FES indicated ceiling effects and might not be suitable as outcome measures for use in a high functioning older population. Development and evaluation of new outcome measures are needed for self-managed fall-preventive interventions with high functioning community-dwelling older adults.
Falls prevention is important as the ageing population increases, and the occurrence of falls rise . Exercise based falls prevention programmes can significantly reduce the risk of falls and rate of falls in community-dwelling older adults , and may also reduce fall related psychological concerns like fear of falling . The fall preventive effect is dependent on the amount of exercise time, or dose . Unfortunately, previous studies for home-based falls prevention have shown generally poor adherence , and engagement is known to decrease over time . One suggestion to increase adherence has been to support older adults’ active involvement in their own exercise routines . Through self-management older adults can be supported to take responsibility for their falls prevention, which could impact their daily lives and also reduce the need for health care services. Traditionally self-managed exercise has been introduced with demonstration and verbal instructions, reinforced by written text and illustrations. Today, however, the support for self-management can also be provided by digital technology. Digital technology seems to provide more support in self-management of exercise than a paper booklet  and can also support adherence, provide feedback, facilitate documentation and registration of adherence. In the future, smartphone technology may also enable self-assessed outcome measurements [9,10,11] to motivate self-management of exercise and falls, and objectively monitor change in function.
Outcome measures that are sensitive enough to detect important differences in physical capacity are crucial to evaluate the effects of exercise interventions. Older adults are a heterogenous group and it is therefore important to evaluate psychometric properties for the intended target group. For high functioning community-dwelling older adults, commonly used outcome measures might have ceiling effects, which can limit evaluations of exercise effects [12,13,14]. When it comes to self-managed exercise interventions, it would be preferable to use self-reported outcomes as they can be used when occasions for performance-based measures are limited. Previous studies have shown performance-based and self-reported measures to be comparable for physical function, for example in measurements after hip fracture . Further investigation of these relationships, between performance-based measurements and self-reported outcomes, may increase our understanding and ability to interpret the results from outcomes used in a self-managed intervention.
The overall aim of this study was to explore the feasibility of using performance-based outcomes of gait speed, functional leg strength and balance, and self-reported outcomes of falls-efficacy and functional ability in two self-managed falls prevention exercise interventions. More specifically to investigate the feasibility of the outcome measures regarding ceiling effects and sensitivity to change, and to explore associations between performance-based measurements and self-reported scales. We also explored measured effects and differences depending on format of the programme (digital vs. paper).
The intervention was a participant preference trial in which the participants choose to self-manage their exercise with either a digital programme (DP) or a paper booklet (PB). Each participant started the intervention by attending an introduction meeting, including individual pre-assessments and a short presentation of the exercise programme of their choice. The intervention included four months of fully self-managed exercise, guided by the chosen programme, and the intervention ended with a post-assessment meeting. The study complies with the Declaration of Helsinki and received approval from The Regional Ethical Review Board in Umeå (Dnr 2016/106–31). All participants were given written and verbal information and gave written informed consent. The study was registered on ClinTrials.gov 28/09/2016, with ID: NCT02916849.
Recruitment was performed in senior citizen organizations and at one health care centre. At the senior organizations the participants were recruited by members of the research team and at the health care centre by health care professionals. Inclusion criteria were: ≥70 years old, living independently in the community, able to rise from a chair and stand without support, experiences of deterioration in balance and/or need to be more careful not to lose balance and/or have experienced a fall the past year. Exclusion criteria were: doing physical exercise more than three hours per week, self-reported progressive disease that was likely to influence mobility and cognitive difficulties. Status of cognitive condition was judged during the screening interview, if the person was able to answer questions satisfactorily and able to converse about matters regarding the study, they were considered suitable to take part in the study. The study participants were 72% women and the mean age was 76 years.
Both programmes were fully self-managed, meaning the programme was used without professional guidance and it could be tailored and progressed by the participant as often as desired. The PB was based on the Otago Exercise Programme , the DP exercises were similar but expanded with both easier and more challenging exercises inspired by the Falls Management Exercise Programme (FaME) . The digital programme (Safe Step v1 web-based or mobile application) was accessed by computer, smartphone or tablet [8, 18, 19]. The exercises were presented in short video clips with verbal instructions and organized into ten predetermined groups of balance, strength, and step/gait exercises, all including several exercise alternatives of various difficulty to choose from. In the PB the exercises were organized into strength or balance exercises, each with three different levels of difficulty. All participants were instructed to choose a set of ten exercises that they felt would be challenging but not too demanding. Balance exercises should give sensation of unsteadiness but without losing the balance with risk of a fall. For strength exercises, an exertion should be noticed but still be able to complete the stipulated number of repetitions. Participants were recommended to exercise for at least 30 min three days per week, and to adjust the programme by selecting new exercises whenever the current ones became too easy or too difficult to perform.
All participants attended an introduction meeting for approximately two hours including a short lecture on falls and falls prevention followed by physical assessments, completion of self-administered questionnaires, and an introduction of either the DP or PB. As self-management was the focus of the intervention, interactions with participants were limited during the study. A contact number was provided in case of any emerging technical problems during the intervention and all participants received a telephone call a few weeks after study start to identify any potential problems with the programmes. For some of the participants in the DP group more interaction was scheduled, six participants had an observation in their own home midway in the intervention, and twelve participants were in a sub-group who were offered monthly peer-mentor meetings. Further detailed description of the interventions can be found in the Supplementary Table (S1), Template for Intervention Description and Replication (TIDieR) checklist. In a previously published paper on adherence  more details about this feasibility study is reported.
Data collection and outcome measures
At the introduction meeting, sociodemographic characteristics, access to technology, self-reported health, function, and mobility, as well as history of falls in the past year, was collected through a self-report questionnaire. One of the researchers was present in the room to answer questions when participants filled in the questionnaires. A physiotherapist blinded to group allocation, and previous results, performed all measurements of physical functioning at the pre- and post-assessment.
Performance-based outcome measurements
Functional performance was measured using the Short Physical Performance Battery (SPPB) . The SPPB is a valid, reliable and responsive instrument  that comprises standing balance, gait speed over four meters, and Five times sit-to-stand test. A total score of 0–12 is formed from the sub-components, higher score indicate a better functional performance. Standing balance was assessed in three positions: feet together, semi tandem, and full tandem. Gait speed was timed at preferred gait speed over four meters. The test was repeated twice, and the fastest time was registered as test result. Preferred walking speed is a reliable and valid measurements to use for older adults . The 4-m gait speed has been found to predict disability almost as well as the total SPPB . The Five times sit-to-stand (5TSTS) is a timed performance of the participants’ ability to sit and stand five times as quickly as possible from a chair with arms folded over the chest. The 5TSTS can be used to assess functional leg strength , and identify older adults with impaired balance  and fall risk . The test showed good test-retest reliability ICC 0.89; 95% CI = 0.79–0.95 .
The 30s Chair stand test (30s CST) was used to assess functional leg strength and endurance . During the assessment, the participant’s ability to perform a maximum number of sit-to-stands with arms folded over the chest, in 30 s was counted. The number of correct stands was noted, if the last stand was more than halfway up it was also counted. The 30s CST has been found to have good test-retest reliability (intra-class coefficient R = 0.89; 95% CI = 0.79–0.93) and concurrent validity with 1 RM leg-press among community-dwelling older adults (r = 0.77, 95% CI = 0.64–0.85 .
Self-reported outcome measures
Different definitions and tests have been used to describe and report fear of falling, where loss of confidence in balance abilities to function safely may cause fear and avoidance of activities .
Self-reported balance confidence was measured using a Swedish version of the Activities-specific Balance Confidence Scale (ABC) showing internal consistency Cronbach’s α = 0,95–0,97, and test-retest ICC 0.82, 95% CI = 0.72–0.88 . Verbal instructions were provided individually for this questionnaire. Confidence in performance of a task without losing balance or becoming unsteady is rated on a scale from 0 to 100% in 16 ambulatory activities , higher scores indicate more confidence. The ABC scale has been found both valid and reliable for assessing balance confidence in community-dwelling older adults , as well as excellent correlation with performance-based measures such as the Timed Up and Go Test (TUG) and the SPPB .
Fear of falling was measured by the 30-item Iconographical Falls Efficacy Scale (Icon-FES) a picture-based questionnaire , translated to Swedish for the purpose of this study. The translation procedure included some clarifications of items, i.e., three items concerning reaching for something above your head was clarified regarding if one stood on the floor, a stool, or a ladder when reaching. Additionally, some linguistic adaptations were made, e.g., “Walking around in the neighbourhood” was changed to “Take a short walk”. The process of translation followed established guidelines  and was approved by the developers. Fall related concern is rated on a 4-point scale, ranging from not at all concerned to very concerned, by looking at pictures including a short descriptive text of a variety of activities and situations. Higher scores reflect a greater fall related concern. The Icon-FES has excellent psychometric properties and has been recommended for use among high functioning older adults living in the community showing internal consistency Cronbach’s α = 0,96, and test-retest ICC 0.90, 95% CI = 0.83–0.94 .
The Late-Life Function and Disability Instrument (LLFDI) measures functional limitations and disability in community-dwelling older adults [34, 35]. In this study the Swedish translation was used  as a questionnaire , with the permission from the developers. Verbal instructions were provided individually. The function component (LLFDI-FC) is assessed through 32 different physical activities and comprise a general scale of function and three sub-scales: upper extremity, basic lower extremity and advanced lower extremity. The raw scores of the scale are transformed to a standardized score of 0–100, where a higher score indicates better levels of functioning. The LLFDI-FC is frequently used in research with community-dwelling older adults and has been shown to have high construct validity, high test-retest reliability and to be sensitive to change [38, 39]. The Swedish cross-cultural translation showed internal consistency Cronbach’s α = 0,96, and test-retest ICC 0.91 . The function component has also been shown to predict falls and functional decline in older community-dwelling adults with mobility limitations .
Self-rated improvements in leg strength and balance were assessed by two single-item questions with a 5-point Likert scale (“My leg strength/balance has improved by training with the program”, 1 = disagree strongly and 5 = agree strongly). The questions were developed by the research group for the purpose of this study.
Participant characteristics are reported using means with standard deviations or as proportions when applicable. In this feasibility study both groups received an exercise intervention (DP and PB). To improve power in analyses of the outcome measures data were pooled from both groups. Differences in effects between groups were explored although the study was not powered for this purpose. Pre-post values are summarized using non-parametric measures of central tendency and dispersion (median and interquartile range). Eventual occurrence of ceiling effects were explored by examining pre-assessment median values and the scores for the third or first quartile depending on whether a high or low score was considered superior. For outcomes with no ceiling effects, and available limit values for Minimal Clinically Important Difference (MCID), the proportions of participants who improved or deteriorated were calculated. For SPPB the MCID applied was 1 point , for gait speed 0,1 m/s , for 30s CST 2 repetitions  and for LLFDI-FC 2 standard scores . Changes after the intervention for the whole group were analysed using Wilcoxon signed-rank test and effect sizes calculated as Rank biserial correlations meaning the difference between the proportion with improved scores and the proportion with decreased scores . For comparisons of changes between groups (DP or PB) the Mann-Whitney U-test was used. To explore associations between effects and exercise time and associations between performance-based and self-reported outcomes, Spearman’s rank correlations were calculated. Results were interpreted according to the following levels; very high correlation (0.90 to 1.00), high correlation (0.70 to 0.90), moderate correlation (0.50 to 0.70), low correlation (0.30 to 0.50) or poor (less than 0.30) . Alpha was set to 0.05. All analyses were performed in the software Jamovi version 1.6.3. Retrieved from https://www.jamovi.org, The jamovi project (2020).
In total, 67 participants were enrolled in the study (Table 1). Over 90% experienced that their balance had been reduced, and 58% reported at least one fall the past year. Nearly 60% reported having a good or very good health, however among men only 37% reported good or very good health. In the whole group 60% had access to a smartphone/tablet and 82% to a computer, more women had a smartphone/tablet and more men a computer. Regarding choice of programme 43% preferred to exercise with the DP and the rest preferred the PB, almost 2/3 of participants who chose the DP were women and for the PB more than 3/4 were women. During the 16 weeks of exercise, five participants (17%) in the DP group and 14 (37%) in the PB group withdrew from the study, resulting in 48 participants completing the study. The only significant difference for pre-assessment variables for participants who withdrew was slower gait speed (p = 0.009). A few participants who withdrew still filled in self-reported scales at the end of the study. More information on attrition and adherence from this feasibility study has been reported elsewhere . The mean exercise time per week for the whole sample was 53 min; 63 min for DP and 46 min for PB group. Two non-injurious falls during exercise were reported by one individual in the PB group. No other adverse events were reported.
Feasibility of the outcome measures
Median values, interquartile ranges and effect sizes are presented in Table 2. In the balance test, from the SPPB, 70% of the participants managed the highest possible score (level 4) indicating an evident ceiling effect. The falls-efficacy questionnaires ABC and Icon-FES also indicated ceiling effects. The median value for ABC total score was 84 out of a maximum of 100 points and 25% reached scores over 89.5 points. For Icon-FES the median score at pre-assessment was 47 and 25% scored below 40.5 points with 30 being the best score out of 120 possible. The SPPB total score was in the higher range with a median score of 9 and 25% scoring above 10 points of 12 at pre-assessment. No ceiling or floor effects were indicated for the LLFDI-FC. For gait speed and chair stands, ceiling effects are not obtainable as they are a timed measure.
In terms of sensitivity to change, about half of the participants improved according to limits of MCID (Table 3) for the SPPB  and 30s CST , while nearly a third deteriorated in gait speed . For LLFDI-FC  about one third each improved, deteriorated or did not change. Between 21 and 56% of participants did not improve nor deteriorate between pre- and post-assessment according to established limits of MCID these four outcomes.
Associations between performance-based measurements and self-reported scales
At pre-assessment, the performance-based tests SPPB, gait speed, balance, and 30s CST all had significant low to moderate correlations with self-reported scales, with the exception of poorer correlations between balance and Icon-FES (Table 4). For the 5TSTS significant poor correlations with all the self-reported scales ABC, Icon-FES, and LLFDI-FC was shown.
Change scores, between pre- and post-assessment, showed no significant correlations between performance-based measurements and self-reported scales (Table 5). There were also no significant associations between self-rated perceived improvements in balance or leg strength and changes in gait speed, balance, leg strength, self-reported falls-efficacy and functional ability. However, the change in self-reported scales ABC, Icon-FES, and LLFDI-FC all correlated significantly with each other as did the performance-based measurements gait speed, balance, 5TSTS, and 30s CST with the total SPPB score.
Measured effects of the intervention
Outcome measures at pre- and post-assessments for the whole sample and per group are presented in Table 2. Functional leg strength was significantly improved with substantial effect sizes (5TSTS rrb = − 0.65, 30s CST rrb = 0.76) following four months of either self-managed exercise intervention. The effect size for total SPPB score was smaller (rrb = 0.34). Small effect sizes were seen for gait speed, balance, fall-efficacy and self-reported functional ability (rrb < 0.21). Participants in both groups self-reported improved balance (in median 4, on a scale of 1–5) post intervention. Participants in the DP group were significantly more inclined than participants in the PB to agree that their leg strength had increased. No other significant differences between the two programmes were found.
For the whole sample, improvements in functional leg strength correlated significantly with self-reported exercise time, 30s CST (rho 0.393; p = 0.006) and 5TSTS (rho − 0.415; p = 0.003). Although total SPPB did not improve significantly, the outcome was correlated to reported exercise time (rho 0.462; p < .001). No significant associations were seen between exercise time and outcomes for gait speed (rho − 0.063), balance (rho 0.159), ABC (rho 0.078), Icon-FES (rho − 0.079) LLFDI-FC (rho 0.04), or with self-rated improvements in leg strength (rho 0.202) or balance (rho 0.264).
In this sample of independent high functioning community dwelling older adults there was limited room to measure improvement, in the performance-based balance test within the SPPB, self-reported balance confidence (ABC) or fear of falling (Icon-FES). In these tests, a large proportion of the participants obtained either close to the best or the best scores at pre-assessment. These ceiling effects were not seen in the self-reported functional ability according to LLFDI-FC. The measurements of functional leg strength according to time for 5TSTS or number of 30s CST, have in themselves no maximum score, and are thus not subject to ceiling effects. Using these outcome measures, substantial effect sizes were seen for functional leg strength, which also correlated with exercise time (minutes accomplished). Associations between performance-based measurements and self-report scales were seen at pre-assessment but not for change over time.
The ABC scale demonstrated ceiling effects, which is in accordance with previous studies [46,47,48]. Myers et al.  have shown that ABC scores above 80 are indicative of high functioning, usually physically active older adults who are unlikely to show further improvement in balance confidence. Ceiling effects were also found in Icon-FES. This scale includes a wider range of activities and situations than the original Falls Efficacy Scale (FES) , as well as pictures to clarify the context of the activity . A score of 30–40 on the 30-item Icon-FES has been suggested to demonstrate a low concern of falling . The large proportion of participants in our study within the categories of high balance confidence in the ABC scale and low concerns regarding falls in the Icon-FES indicates that these scales might not be suitable for detecting changes in relatively high functioning older adults as in our study, and the target population for fully self-managed falls prevention interventions. Ceiling effects have not previously been demonstrated for Icon-FES [32, 50, 51]. This scale was translated into Swedish for use in our study and included some linguistic adaptations, so there may be a further need for evaluation of the psychometric properties of this Swedish version. A short intervention period can also have an impact on the limited effect on fear of falling, according to a previous meta-analysis . LLFDI-FC did not show a ceiling effect in our study, which is in line with results from previous studies [36, 53]. The instrument cover several functions on different levels which reduces the risk of reaching a ceiling effect.
The SPPB was used to measure lower-extremity function. The psychometric properties of this assessment battery have previously been extensively evaluated and SPPB is strongly recommended as the first choice of outcome measure in older community-dwelling persons . The participants in our study increased their total score slightly and more than half of the participants showed an improvement larger than the previously published MCID . Thus, our results support the use of SPPB when the purpose is to get a measurement of overall lower-extremity function. However, the balance sub-component showed strong ceiling effects, which is important to take in consideration. The sub-component gait speed intriguingly deteriorated in 29% of participants. This might be explained by that the intervention took part during winter months when conditions are challenging to take outdoor walks, or, that the programme focuses on strength and balance exercises and did not include taking walks. Some sub-components of the SPPB showed large effect sizes, in particular the 5TSTS. Hence the difference in total score hid an important improvement in an outcome measure with a strong predictive risk of falls. We also assessed functional leg strength and endurance using the 30s CST which confirmed the improvement. Almost half of the participants improved by at least 2 stands, which represents the MCID. Consequently, both of these tests are suitable to use in evaluations of intervention effectiveness, in groups similar to our. In contrast, 70% of the participants reached the maximum balance score of SPPB at pre-assessment, so there was an evident ceiling effect. This has previously been noted by others [12,13,14], and the test battery was modified to be more demanding in one study . In fall-preventive interventions for community-dwelling older adults, in which balance exercise tasks are a major focus, objective balance measurements with higher sensitivity to change are needed. In the near future we may have reliable and valid measurement tools based on digital technology with built-in sensors in smartphones that are easy to use at a low cost . Such sensor-tests may also provide opportunities for self-assessments [9,10,11], which could be used in self-management of exercise interventions.
In contrast to performance-based measurements of balance the self-rated change in balance, with questions made for this study , indicated improvements. This type of scale, which is used to rate perceived changes, like the Patient Global Impression of Change, has been criticized for participants’ recall bias . Nevertheless, it allows the individual participant to express a change that is relevant or noticeable for them in their daily life, which may reflect a more real-life situation than a static balance test in the performance-based measurements. In addition, self-rated measures of change are sensitive to change and have been shown to correlate with changes in well-established instruments, at least concerning for example experiences of pain , quality of life  and physical function . However, in our study the perceived change in balance and leg strength did not correlate with other measures of change. Most participants experienced that balance had improved while their perceived leg strength remained unchanged, which is in contrast to the performance-based assessments. This might be a result of that the performance-based balance assessment had a ceiling effect, and functional leg strength tests were sensitive to detect minor changes that the participant may not have noticed. To our knowledge, self-rated change in balance and strength has not previously been evaluated. Perhaps an improvement in balance is more easily noticed. Or maybe the two constructs, balance and muscle strength, are excessively intertwined to notice a difference between the two. To further develop and evaluate assessments of perceived change in balance and muscle strength more research is needed.
At pre-assessment significant associations were seen between performance-based measurements and self-reported scales. Previous cross-sectional studies have also shown associations between balance confidence (ABC) and self-reported function (LLFDI-FC), with various balance, physical performance measurements and self-rated health [38, 46]. However, looking at change scores, no correlations were found. This was not surprising given that both assessed balance and questionnaires for balance confidence and falls concern showed signs of ceiling effects, and thus small effect sizes in most outcomes which limits the conclusions that can be drawn from this correlation analysis. The exercise interventions were relatively short (4 months) and a small change in performance measures such as leg strength may not automatically and directly be reflected in falls efficacy or functional ability, as such process may take longer time . There is a need for future longitudinal studies to further investigate associations between change scores in performance-based measurements and self-reported scales. However, changes in ABC, Icon-FES, and LLFDI-FC did correlate with each other, which supports the construct validity of these scales.
No differences were seen in the additional analyses between groups using the DP and the PB, except that DP participants were more inclined to agree that their leg strength improved post intervention. This is in line with our previous reported results showing that adherence to the programme were similar in both groups among participants who completed the intervention . The results in the present study also showed that improvements in performance-based functional leg strength, the only significant improvement seen, were related to the amount of exercise, which implies a dose response relationship that could be further explored in a larger study.
The majority of study participants were women (72%), a distribution normally seen in studies concerning falls prevention . The inclusion and exclusion criteria allowed older adults with a broad range of characteristics to enrol in this study. We selected measurements and scales that have been used in falls prevention studies that included community-dwelling older adults, except for the self-rated perceived change in balance and strength questions made for this study. Despite the broad inclusion criteria in our study, ceiling effects were seen particularly in the performance-based assessments of balance and the self-reported balance confidence and falls concern scales, as most participants were high functioning. Despite the ceiling effects in these measures, more than 90% reported perceived decreased balance and almost 2/3 reported a fall the previous year, suggesting they are an important population to focus primary falls prevention. Consequently, there was limited room for evaluation of improvements, which needs to be considered in interpretation of effect sizes and for future evaluations of similar interventions. The results of this study put emphasis on the heterogeneity of older adults and that measurements to assess a wide range of physical function are needed. They also highlight the importance of measures that will be useful for evaluating self-managed interventions, as for example digital self-assessments and self-reported outcome measurements.
The use of MCID is based on previous studies where both length of the intervention and study population have to be considered. The reference values used in this study were obtained from studies that varied in length from nine weeks to one year follow-ups [40,41,42,43]. All MCID papers included a general older adult population, except for 30s CST where participants had hip osteoarthritis . Thus, the results on proportion reaching a MCID in this study have to be interpreted with some caution although MCIDs are valuable to use as reference for important change.
A limitation with the present study was that it was a feasibility study with a relatively short intervention, and was not powered to evaluate exercise effects between the two programmes. Although, the four-month self-managed falls prevention exercise study showed some positive effects on self-reported balance and measured leg strength in both groups combined. We also created new questions on self-reported change in functional ability as no evaluations of such questions were found in the literature. The PB was used as a comparative group to the new DP and the aim was explore the feasibility of the outcome measures.
We did not apply any strict limits for what was considered a ceiling affect. Commonly ceiling effects are described when the majority of values obtained for a variable approach the upper limit of the scale. A criterion often applied is that ceiling effects are considered if more than 15% of respondents achieve the highest possible score . Such guidelines are however difficult to apply in scales with high maximal scores, as in this study the ABC with a maximal score of 100%. In these situations, it is more complex to set definite limits for when the majority of values is considered to approach the upper limit of the scale. We decided to make these judgements based on the distribution of the scores described by median values and the third or first quartile in combination with results of previous studies indicating limits for meaningful effects [46, 50].
A strength of this study was that data was collected before and after the intervention by the same small group of assessors. Experienced physiotherapists assessed performance-based measurements blinded to results of self-rated scales and to group allocation. For ABC, individual verbal instruction was provided as the original scales have extensive written instructions. The participants answered all self-report questionnaires independently, with a researcher close by in case of any questions. The LLFDI-FC also had individual verbal instructions, yet many participants found the parted page for function unclear, which required some explanation. Several participants had questions regarding some illustrations in Icon-FES. For example: How concerned are you about crossing the street on a pedestrian crossing against the lights? How concerned are you when cleaning the gutter? These were all things that many participants were warned to do and never did. Consequently, they had objections to answering these questions, resulting in a few contradicting answers in this questionnaire.
The outcome measures used to assess participants changes following two self-managed falls prevention interventions showed limitations. The balance sub-component of the SPPB and the self-reported measures ABC and Icon-FES might not be suitable for assessments in all community-dwelling older adults due to risk of ceiling effects. The LLFDI-FC did not show any ceiling effects, and could be used as a self-administered instrument. The 5TSTS and 30s CST were feasible in this study including high-functioning older adults. Both leg strength assessments were able to detect improvements and also showed correlation with exercise time, suggesting adequate level of challenge to reflect the capacity/function of relatively high-functioning older adults. Associations were seen at pre-assessment for performance-based and self-reported scales, considering change-scores no significant correlations were seen. More research is needed to identify suitable instruments for assessment of balance performance, and balance confidence in self-managed fall-preventive interventions in this group of older adults. Additionally, it is desirable to explore the participants’ own experiences of improvements in balance and strength in further studies.
Availability of data and materials
The dataset used to support the findings of this study is not publicly available due to lack of consent for sharing individual data but are available from the corresponding author on reasonable request.
Five times sit to stand
- 30s CST:
30 s chair stand test
Activities-specific Balance Confidence scale
Iconographical Falls Efficacy Scale
Late Life Function and Disability Instrument - function component
Minimal Clinically Important Difference
Short Physical Performance Battery
World Health Organization. World report on ageing and health. Geneva: WHO; 2015.
Sherrington C, Fairhall NJ, Wallbank GK, Tiedemann A, Michaleff ZA, Howard K, et al. Exercise for preventing falls in older people living in the community. Cochrane Database Syst Rev. 2019:CD012424. https://doi.org/10.1002/14651858.CD012424.pub2.
Kendrick D, Kumar A, Carpenter H, Zijlstra GAR, Skelton DA, Cook JR, et al. Exercise for reducing fear of falling in older people living in the community. Cochrane Database Syst Rev. 2014:CD009848. https://doi.org/10.1002/14651858.CD009848.pub2.
Sherrington C, Michaleff ZA, Fairhall N, Paul SS, Tiedemann A, Whitney J, et al. Exercise to prevent falls in older adults: an updated systematic review and meta-analysis. Br J Sports Med. 2017;51:1749–57. https://doi.org/10.1136/bjsports-2016-096547.
Simek EM, McPhate L, Haines TP. Adherence to and efficacy of home exercise programs to prevent falls: a systematic review and meta-analysis of the impact of exercise program characteristics. Prev Med. 2012;55:262–75. https://doi.org/10.1016/j.ypmed.2012.07.007.
Nyman SR, Victor CR. Older people’s participation in and engagement with falls prevention interventions in community settings: an augment to the cochrane systematic review. Age Ageing. 2012;41:16–23. https://doi.org/10.1093/ageing/afr103.
Yardley L, Beyer N, Hauer K, McKee K, Ballinger C, Todd C. Recommendations for promoting the engagement of older people in activities to prevent falls. Qual Saf Health Care. 2007;16:230–4. https://doi.org/10.1136/qshc.2006.019802.
Pettersson B, Wiklund M, Janols R, Lindgren H, Lundin-Olsson L, Skelton DA, et al. ‘Managing pieces of a personal puzzle’ — older people’s experiences of self-management falls prevention exercise guided by a digital program or a booklet. BMC Geriatr. 2019;19:43. https://doi.org/10.1186/s12877-019-1063-9.
Bergquist R, Vereijken B, Mellone S, Corzani M, Helbostad JL, Taraldsen K. App-based self-administrable clinical tests of physical function: development and usability study. JMIR MHealth UHealth. 2020;8:e16507. https://doi.org/10.2196/16507.
Mansson L, Wiklund M, Öhberg F, Danielsson K, Sandlund M. Co-creation with older adults to improve user-experience of a smartphone self-test application to assess balance function. Int J Environ Res Public Health. 2020;17:3768. https://doi.org/10.3390/ijerph17113768.
Mansson L, Bäckman P, Öhberg F, Sandlund J, Selling J, Sandlund M. Evaluation of concurrent validity between a smartphone self-test prototype and clinical instruments for balance and leg strength. Sensors. 2021;21:1765. https://doi.org/10.3390/s21051765.
Tangen GG, Robinson HS. Measuring physical performance in highly active older adults: associations with age and gender? Aging Clin Exp Res. 2020;32:229–37. https://doi.org/10.1007/s40520-019-01190-x.
Bergland A, Strand BH. Norwegian reference values for the short physical performance battery (SPPB): the Tromsø study. BMC Geriatr. 2019;19:216. https://doi.org/10.1186/s12877-019-1234-8.
Simonsick EM, Newman AB, Nevitt MC, Kritchevsky SB, Ferrucci L, Guralnik JM, et al. Measuring higher level physical function in well-functioning older adults: expanding familiar approaches in the health ABC study. J Gerontol Ser Biomed Sci Med Sci. 2001;56A:M644–9.
Latham NK, Mehta V, Nguyen AM, Jette AM, Olarsch S, Papanicolaou D, et al. Performance-based or self-report measures of physical function: which should be used in clinical trials of hip fracture patients? Arch Phys Med Rehabil. 2008;89:2146–55. https://doi.org/10.1016/j.apmr.2008.04.016.
Gardner MM, Buchner DM, Robertson MC, Campbell AJ. Practical implementation of an exercise-based falls prevention programme. Age Ageing. 2001;30:77–83.
Skelton DA, Dinan SM. Exercise for falls management: rationale for an exercise programme aimed at reducing postural instability. Physiother Theory Pract. 1999;15:105–20.
Sandlund M, Lindgren H, Pohl P, Melander-Wikman A, Bergvall-Kåreborn B, Lundin-Olsson L. Towards a mobile exercise application to prevent falls: a participatory design process. In: 10th Intl Conf. Disability, Virtual Reality & Associated Technologies. Gothenburg, Sweden; 2014. p. 8.
Mansson L, Lundin-Olsson L, Skelton DA, Janols R, Lindgren H, Rosendahl E, et al. Older adults’ preferences for, adherence to and experiences of two self-management falls prevention home exercise programmes: a comparison between a digital programme and a paper booklet. BMC Geriatr. 2020;20:209. https://doi.org/10.1186/s12877-020-01592-x.
Guralnik JM, Simonsick EM, Ferrucci L, Glynn RJ, Berkman LF, Blazer DG, et al. A short physical performance battery assessing lower extremity function: association with self-reported disability and prediction of mortality and nursing home admission. J Gerontol. 1994;49:M85–94.
Freiberger E, de Vreede P, Schoene D, Rydwik E, Mueller V, Frändin K, et al. Performance-based physical function in older community-dwelling persons: a systematic review of instruments. Age Ageing. 2012;41:712–21. https://doi.org/10.1093/ageing/afs099.
Rydwik E, Bergland A, Forsén L, Frändin K. Investigation into the reliability and validity of the measurement of elderly people’s clinical walking speed: a systematic review. Physiother Theory Pract. 2012;28:238–56. https://doi.org/10.3109/09593985.2011.601804.
Guralnik JM, Ferrucci L, Pieper CF, Leveille SG, Markides KS, Ostir GV, et al. Lower extremity function and subsequent disability: consistency across studies, predictive models, and value of gait speed alone compared with the short physical performance battery. J Gerontol Ser A. 2000;55:M221–31. https://doi.org/10.1093/gerona/55.4.M221.
Csuka M, McCarty DJ. Simple method for measurement of lower extremity muscle strength. Am J Med. 1985;78:77–81. https://doi.org/10.1016/0002-9343(85)90465-6.
Whitney SL, Wrisley DM, Marchetti GF, Gee MA, Redfern MS, Furman JM. Clinical measurement of sit-to-stand performance in people with balance disorders: validity of data for the five-times-sit-to-stand test. Phys Ther. 2005;85:1034–45. https://doi.org/10.1093/ptj/85.10.1034.
Tiedemann A, Shimada H, Sherrington C, Murray S, Lord S. The comparative ability of eight functional mobility tests for predicting falls in community-dwelling older people. Age Ageing. 2008;37:430–5. https://doi.org/10.1093/ageing/afn100.
Jones CJ, Rikli R, Beam W. A 30- s chair- stand test as a measure of lower Body strength in community-residing older adults. Res Q Exerc Sport. 1999;70:113–9.
Jung D. Fear of falling in older adults: comprehensive review. Asian Nurs Res. 2008;2:214–22. https://doi.org/10.1016/S1976-1317(09)60003-7.
Forsberg A, Nilsagård Y. Validity and reliability of the Swedish version of the activities-specific balance confidence scale in people with chronic stroke. Physiother Can. 2013;65:141–7. https://doi.org/10.3138/ptc.2011-54.
Powell LE, Myers AM. The activities-specific balance confidence (ABC) scale. J Gerontol A Biol Sci Med Sci. 1995;50:M28–34.
Hatch J, Gill-Body KM, Portney LG. Determinants of balance confidence in community-dwelling elderly people. Phys Ther. 2003;83:1072–9. https://doi.org/10.1093/ptj/83.12.1072.
Delbaere K, T. Smith S, Lord SR. Development and initial validation of the iconographical falls efficacy scale. J Gerontol Ser Biomed Sci Med Sci. 2011;66:674–80.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8:94–104. https://doi.org/10.1111/j.1524-4733.2005.04054.x.
Haley SM, Jette AM, Coster WJ, Kooyoomjian JT, Levenson S, Heeren T, et al. Late life function and disability instrument: II. Development and evaluation of the function component. J Gerontol A Biol Sci Med Sci. 2002;57:M217–22.
Jette AM, Haley SM, Coster WJ, Kooyoomjian JT, Levenson S, Heeren T, et al. Late life function and disability instrument: I. development and evaluation of the disability component. J Gerontol A Biol Sci Med Sci. 2002;57:M209–16.
Roaldsen KS, Halvarsson A, Sarlija B, Franzen E, Ståhle A. Self-reported function and disability in late life – cross-cultural adaptation and validation of the Swedish version of the late-life function and disability instrument. Disabil Rehabil. 2014;36:813–7. https://doi.org/10.3109/09638288.2013.819387.
LaPier TK. Utility of the late life function and disability instrument as an outcome measure in patients participating in outpatient cardiac rehabilitation: a preliminary study. Physiother Can. 2012;64:53–62. https://doi.org/10.3138/ptc.2010-30.
Beauchamp MK, Schmidt CT, Pedersen MM, Bean JF, Jette AM. Psychometric properties of the late-life function and disability instrument: a systematic review. BMC Geriatr. 2014;14:12. https://doi.org/10.1186/1471-2318-14-12.
Beauchamp MK, Jette AM, Ward RE, Kurlinski LA, Kiely D, Latham NK, et al. Predictive validity and responsiveness of patient-reported and performance-based measures of function in the Boston RISE study. J Gerontol A Biol Sci Med Sci. 2015;70:616–22. https://doi.org/10.1093/gerona/glu227.
Perera S, Mody SH, Woodman RC, Studenski SA. Meaningful change and responsiveness in common physical performance measures in older adults. J Am Geriatr Soc. 2006;54:743–9.
Chui K, Hood E, Klima D. Meaningful change in walking speed. Top Geriatr Rehabil. 2012;28:97–103. https://doi.org/10.1097/TGR.0b013e3182510195.
Wright AA, Cook CE, Baxter GD, Dockerty JD, Abbott JH. A comparison of 3 methodological approaches to defining major clinically important improvement of 4 performance measures in patients with hip osteoarthritis. J Orthop Sports Phys Ther. 2011;41:319–27. https://doi.org/10.2519/jospt.2011.3515.
Beauchamp MK, Ward RE, Jette AM, Bean JF. Meaningful change estimates for the late-life function and disability instrument in older adults. J Gerontol Ser A. 2019;74:556–9. https://doi.org/10.1093/gerona/gly230.
Kerby DS. The simple difference formula: an approach to teaching nonparametric correlation. Compr Psychol. 2014;3:11.IT.3.1. https://doi.org/10.2466/11.IT.3.1.
Mukaka M. A guide to appropriate use of correlation coefficient in medical research. Malawi Med J J Med Assoc Malawi. 2012;24:69–71 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3576830/. Accessed 20 May 2020.
Myers AM, Fletcher PC, Myers AH, Sherk W. Discriminative and evaluative properties of the activities-specific balance confidence (ABC) scale. J Gerontol Ser A. 1998;53A:M287–94. https://doi.org/10.1093/gerona/53A.4.M287.
Talley KMC, Wyman JF, Gross CR. Psychometric properties of the activities-specific balance confidence scale and the survey of activities and fear of falling in older women. J Am Geriatr Soc. 2008;56:328–33. https://doi.org/10.1111/j.1532-5415.2007.01550.x.
Huang T-T, Wang W-S. Comparison of three established measures of fear of falling in community-dwelling older adults: psychometric testing. Int J Nurs Stud. 2009;46:1313–9. https://doi.org/10.1016/j.ijnurstu.2009.03.010.
Tinetti ME, Richman D, Powell L. Falls efficacy as a measure of fear of falling. J Gerontol. 1990;45:P239–43. https://doi.org/10.1093/geronj/45.6.P239.
Lim ML, van Schooten KS, Radford KA, Menant J, Lord SR, Sachdev PS, et al. The iconographical falls efficacy scale (IconFES) in community-dwelling older people—a longitudinal validation study. Age Ageing. 2020;00:1–8. https://doi.org/10.1093/ageing/afaa213.
Franco MR, Pinto RZ, Delbaere K, Eto BY, Faria MS, Aoyagi GA, et al. Cross-cultural adaptation and measurement properties testing of the iconographical falls efficacy scale (icon-FES). Braz J Phys Ther. 2018;22:291–303. https://doi.org/10.1016/j.bjpt.2018.01.003.
Kumar A, Delbaere K, Zijlstra GAR, Carpenter H, Iliffe S, Masud T, et al. Exercise for reducing fear of falling in older people living in the community: Cochrane systematic review and meta-analysis. Age Ageing. 2016;45:345–52. https://doi.org/10.1093/ageing/afw036.
Gignac MAM, Cao X, Mcalpine J, Badley EM. Measures of disability: arthritis impact measurement scales 2 (AIMS2), arthritis impact measurement scales 2-short form (AIMS2-SF), the Organization for Economic Cooperation and Development (OECD) long-term disability (LTD) questionnaire, EQ-5D, World Health Organization disability assessment schedule II (WHODASII), late-life function and disability instrument (LLFDI), and late-life function and disability instrument-abbreviated version (LLFDI-abbreviated). Arthritis Care Res. 2011;63:S308–24. https://doi.org/10.1002/acr.20640.
Ghislieri M, Gastaldi L, Pastorelli S, Tadano S, Agostini V. Wearable inertial sensors to assess standing balance: a systematic review. Sensors. 2019;19:4075. https://doi.org/10.3390/s19194075.
Rampakakis E, Ste-Marie PA, Sampalis JS, Karellis A, Shir Y, Fitzcharles M-A. Real-life assessment of the validity of patient global impression of change in fibromyalgia. RMD Open. 2015;1:e000146. https://doi.org/10.1136/rmdopen-2015-000146.
Perrot S, Lantéri-Minet M. Patients’ global impression of change in the management of peripheral neuropathic pain: clinical relevance and correlations in daily practice. Eur J Pain. 2019;23:1117–28. https://doi.org/10.1002/ejp.1378.
Fischer D, Stewart AL, Bloch DA, Lorig K, Laurent D, Holman H. Capturing the Patient’s view of change as a clinical outcome measure. JAMA. 1999;282:1157–62. https://doi.org/10.1001/jama.282.12.1157.
Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012.
We thank the registered physiotherapists Dr. Britta Lindström and Dr. Christina Ahlgren for their contribution as blinded assessors. And also, all the participants for their time and interest in the study.
Open access funding provided by Umea University. This work was financially supported by the Swedish Research Council (grant number 521–2011-3250 and grant number 2015–03481); the Strategic Research Programme in Care Sciences (SFO-V), Umeå University and Karolinska Institutet, Sweden; the Swedish Research Council for Health, Working Life and Welfare (FORTE); and King Gustav V and Queen Victoria’s Freemasons’ Foundation. The research was made possible using the funding but funders were not involved in the design of the study, data collection, analysis, interpretation, writing of the manuscript or decision to submit for publication.
Ethics approval and consent to participate
The project was approved by The Regional Ethical Review Board in Umeå (Dnr 2016/106–31). The participants were aware that their anonymised data would be used and all gave written informed consent prior to data collection.
Consent for publication
All participants gave written permission to use their anonymised data for publication purposes.
D.S. is Director of Later Life Training, a non-profit making organisation who provide the Otago Home Exercise Booklet free online. All other authors declare that they have no competing interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Mansson, L., Pettersson, B., Rosendahl, E. et al. Feasibility of performance-based and self-reported outcomes in self-managed falls prevention exercise interventions for independent older adults living in the community. BMC Geriatr 22, 147 (2022). https://doi.org/10.1186/s12877-022-02851-9