Skip to main content
  • Research article
  • Open access
  • Published:

Feasibility of a multicomponent cognitive behavioral intervention for fear of falling after hip fracture: process evaluation of the FIT-HIP intervention

Abstract

Background

This study describes the process evaluation of an intervention developed to reduce fear of falling (FoF) after hip fracture, within an inpatient geriatric rehabilitation setting. This ‘FIT-HIP intervention’ is a multicomponent cognitive behavioral intervention, conducted by physiotherapists and embedded in usual care in geriatric rehabilitation in the Netherlands. A previous study (cluster randomized controlled trial) showed no beneficial effects of this intervention when compared to usual care. The aim of this study was to gain insight into factors related to the intervention process that may have influenced the effectiveness of the intervention.

Methods

This process evaluation was conducted using an observational prospective study design. Based on quantitative and qualitative data derived from session logs, evaluation questionnaires and interviews, we addressed: 1] recruitment and reach; 2] performance according to protocol; 3] patients’ adherence; and 4] opinions of patients and facilitators on the intervention. Participants in this study were: a) patients from 6 geriatric rehabilitation units, who were invited to participate in the intervention (39 adults aged ≥65 years with hip fracture and FoF) and; b) intervention facilitators (14 physiotherapists and 8 psychologists who provide coaching to the physiotherapists).

Results

Thirty-six patients completed the intervention during inpatient geriatric rehabilitation. Apart from cognitive restructuring and telephonic booster (which was not provided to all patients), the intervention was performed to a fair degree in accordance with protocol. Patients’ adherence to the intervention was very good, and patients rated the intervention positively (average 8.1 on a scale 0–10). Although most facilitators considered the intervention feasible, a limited level of FoF (possibly related to timing of intervention), and physiotherapists’ limited experience with cognitive restructuring were identified as important barriers to performing the intervention according to protocol.

Conclusions

The FIT-HIP intervention was only partly feasible, which may explain the lack of effectiveness in reducing FoF. To improve the intervention’s feasibility, we recommend selecting patients with maladaptive FoF (i.e. leading to activity restriction), being more flexible in the timing of the intervention, and providing more support to the physiotherapists in conducting cognitive restructuring.

Trial registration

Netherlands Trial Register: NTR5695 (7 March 2016).

Peer Review reports

Background

Many older adults who have sustained a hip fracture will go through an extensive and generally challenging process of rehabilitation [1, 2]. During this recovery process, a substantial number of patients will experience concerns about falling (once) again [3, 4]. This fear of falling (FoF), is defined as ‘a lasting concern about falling that leads to an individual avoiding activities that he/she remains capable of performing’. [5] Prevalence rates of up to 63% have been reported for FoF in inpatient geriatric rehabilitation after hip fracture [4]. As a consequence of the activity restriction associated with FoF, deterioration in physical functioning and a decline in social participation and quality of life can occur [3, 6]. FoF may even have more effect on functional recovery after fracture than pain and depression [7]. Hence, FoF appears to be an important risk factor for impaired recovery [3, 8, 9], which could possibly be addressed by treatment.

Patients with a recent hip fracture differ from the general population of community-dwelling older adults in that they experience a sudden impairment of their gait function and consequently become dependent in (basic) activities of daily living [2]. In the Netherlands, approximately half of all older patients with a hip fracture follow an inpatient multidisciplinary rehabilitation program after surgical repair of the fracture. These ‘geriatric rehabilitation’ services are specialized in the medical care for frail older adults [10]. Therapy is aimed at optimizing the patient’s physical condition and restoring (gait) function [11]. Physical therapy focuses on training balance and muscle strength, and practicing activities of daily living [12]. At present there are no treatment programs aimed specifically at reducing FoF after a recent hip fracture. However, for community-dwelling older adults, various evidence-based interventions have been developed to reduce FoF [13,14,15,16,17,18]. Particularly the treatment programs that combine exercise with cognitive behavioral approaches have been found to be effective in reducing FoF [16,17,18]. In the Netherlands, two of these evidence-based programs using cognitive behavioral approaches have been nationally implemented (based on ‘A Matter of Balance’) [15, 19, 20]. However, in their current format (community- or home-based), these established programs are not suitable for the therapeutic setting of inpatient geriatric rehabilitation. The cognitive behavioral approaches used in these programs were therefore adjusted to an individualized treatment program that fits the (physio) therapeutic setting within rehabilitation services. This Fear of falling InTervention in HIP fracture geriatric rehabilitation (FIT-HIP intervention) was designed to reduce FoF and consequently to improve functional outcome in inpatient geriatric rehabilitation after hip fracture [21]. However, a recent cluster randomized controlled trial evaluating the effects of the FIT-HIP intervention showed the program was not effective in reducing FoF or improving functional outcome after hip fracture [12].

The aim of this process evaluation therefore is to gain insight into factors that may have influenced the effectiveness of the intervention. Subsequently, findings from this study can provide insight into opportunities to improve both the intervention itself and its implementation in clinical practice. In this study we assessed the feasibility of the FIT-HIP intervention in clinical practice based on the following aspects of the intervention process: 1] recruitment and reach; 2] performance according to protocol (dose delivered and fidelity); 3] adherence (dose received exposure); and 4] opinion on the intervention provided by patients and facilitators (dose received satisfaction and context). These items are based on the framework of Saunders and colleagues [22, 23]. This model for process evaluation is frequently used within health care innovations and is based on the widely acknowledged principles of Steckler et al. (2002) [24].

Methods

Study design

This process evaluation has an observational prospective design, combining qualitative and quantitative research methods. It was conducted in conjunction with the cluster randomized controlled trial that evaluated effectiveness of the FIT-HIP intervention [12]. Ethical approval was provided by the Ethics Committee of the Leiden University Medical Center (LUMC) and the study was registered in the Netherlands Trial Register (NTR5695). Patients were recruited between March 2016 and January 2017 from 11 post-acute geriatric rehabilitation units in the Netherlands. For the present study we focused on the patients and intervention facilitators from the six units that were allocated to the FIT-HIP intervention.

Intervention

The FIT-HIP intervention is an individualized, multicomponent intervention based on cognitive behavioral approaches. It aims to reduce FoF in inpatient geriatric rehabilitation after hip fracture. The intervention is conducted by physiotherapists from the participating units and is integrated in usual care in geriatric rehabilitation (i.e. physical therapy sessions). The following cognitive behavioral elements are embedded in the intervention: 1] guided exposure to feared activities; 2] cognitive restructuring; 3] psychoeducation; 4] relapse prevention (Staying Active Plan and telephonic booster); and 5] motivational interviewing. These elements are combined with regular exercise training in rehabilitation. The physiotherapists are counseled by psychologists (from participating units) during daily practice. This coaching is organized as (on-site) monthly meetings and interim consultation at the request of the physiotherapists.

The study protocol published previously [21] and Table 1 provide detailed information on the rationale and schedule of the various items within intervention. The intervention, which is integrated in the regular geriatric rehabilitation treatment, starts directly after admission and lasts for the duration of the inpatient rehabilitation (in general six to 7 weeks) [10]. First, patients have an intake interview with the physiotherapist, to assess which circumstances cause concerns of falling, and to determine treatment goals. Next, based on this information, the physiotherapist puts together a tailor-made treatment plan for the application of the guided exposure (i.e. the FIT-HIP fear ladders). Guided exposure is considered the core element of the FIT-HIP intervention and is applied within the regular physical therapy sessions as long as the FoF persists. Guided exposure may not be necessary in all sessions (in the event the FoF has subsided). Cognitive restructuring is also tailored to the patient’s needs. The frequency will depend on whether the patient has unrealistic thoughts and on the patient’s receptiveness to such an approach. Cognitive restructuring is practiced at least twice during the inpatient rehabilitation treatment (including a homework assignment) and can be repeated as needed. Psychoeducation is provided in the initial stage of rehabilitation (first 3 weeks) and in the final stage when discharge is being planned. In both stages the information is provided during at least one session. The psychoeducation in the final stage is integrated in the relapse prevention plan (i.e. Staying Active Plan), a reference book given to the patient at discharge. A topic list of the psychoeducation is provided in Additional file 1. The telephonic booster 6 weeks after discharge (one session) is the final element of the intervention. Motivational interviewing does not have a fixed schedule in the intervention, as it is applied by the physiotherapists during the entire FIT-HIP program, in order to assess and relate to the patient’s intrinsic and extrinsic motivation for rehabilitation.

Table 1 Overview of the FIT-HIP intervention

Participants

Patients were older adults (≥ 65 years) with fear of falling, admitted to inpatient geriatric rehabilitation following hip fracture. FoF was assessed using the following one-item question with a 5-point Likert scale, ‘Are you concerned to fall?’ (answer options: never - almost never - sometimes - often - very often). Eligible for participation were patients who reported concerns about falling at least ‘sometimes’. Exclusion criteria included conditions interfering with learnability [dementia; a score > 1 on the Hetero-anamnesis List Cognition (HAC) [25] (suggestive for premorbid cognitive disabilities); or major psychiatric disease]; furthermore, a pre-fracture Barthel index score < 15; pathologic hip fracture; life expectancy < 3 months; and insufficient mastery of the Dutch language. All patients provided written informed consent for participation in the study. Thirty-nine patients were included in the present study.

The intervention providers, from here forward entitled facilitators, were physiotherapists working in the participating intervention units (two per unit), and psychologists. The physiotherapists were actively engaged in the multidisciplinary geriatric rehabilitation team and had experience in the field of (orthopedic) rehabilitation for frail older adults. One psychologist from each unit was involved for the on-site coaching of physiotherapists. Most participating units were specialized in orthopedic rehabilitation and the patient volume of these units varied from 19 to 34. Initially facilitators from six units were trained, but due to a limited inclusion rate after 4 months, we included an additional unit (affiliated to one of the participating units). In total, 14 physiotherapists (12 female) and eight psychologists (all female) were involved in the FIT-HIP program, and all were trained to perform the FIT-HIP intervention. For training details: see Table 1.

Data collection

Table 2 presents an overview of the measurement instruments used to assess information for this process evaluation. Patients received a self-administered evaluation questionnaire at discharge from geriatric rehabilitation; and again at three and 6 months after discharge. We applied purposive sampling for the qualitative interviews with patients [26], and aimed to conduct interviews with a selection of patients from all participating units and representing both sexes, until data saturation occurred. Patients were approached by telephone for the interviews. Physiotherapists were asked to fill in session logs for all therapy sessions, providing information on attendance, therapy content (which FIT-HIP elements were performed), reasons to deviate from protocol and the duration of therapy. Adherence was assessed using the Pittsburg Rehabilitation Participation Scale (PPRS) to score participants’ active engagement during therapy. The PPRS is a 6-point Likert scale ranging from ‘none’ (patient refused therapy) to ‘excellent’. The physiotherapists were approached for a semi-structured site-specific group interview, and psychologists for a telephone interview. They also received an evaluation questionnaire. As physicians and nursing staff are also involved in the general rehabilitation process, they were approached to fill in a short evaluation questionnaire (five questions), to assess the extent to which they had been informed of or involved in the patients’ FIT-HIP treatment.

Table 2 Outcome measures and associated measurement instruments used for the FIT-HIP process evaluation

Interviews were conducted after the six-month follow-up. They were performed by the author MSB and recorded on audiotape (with the exception of the telephone interviews).

Data analysis

Quantitative data from the questionnaires and the session logs was analyzed by means of descriptive statistics using IBM SPSS Statistics version 23. The qualitative data from open-end questions in the questionnaires, session logs and the interviews, were transcribed and categorized based on content by author MS. Telephone interviews were summarized and categorized.

Results

Recruitment, reach and response

Enrollment of patients per unit varied from 1 to 11 (Additional file 2). Thirty-nine patients were assigned to the FIT-HIP intervention, 34 of whom were female (87.2%). Age varied from 65 to 98 years (mean: 83.7 ± 7.3) and the majority lived alone prior to the fracture (n = 27; 69.2%). At baseline one-third of the patients experienced concerns to fall (very) often, and the mean FES-I score (Falls Efficacy Scale-International) was 33.9 (SD:9.9); see also Additional file 3. The flow chart presented in Fig. 1 shows recruitment, reach and response for both patients and facilitators. The timing of enrollment for the study (first week of rehabilitation) was regularly experienced as inconvenient by patients, as it was difficult for them to anticipate and oversee both the rehabilitation (treatment program) and participation in the study. The main challenge for maintaining patient engagement in the study was poor health. Thirty-six of the 39 patients completed the intervention during inpatient rehabilitation. Two patients did not receive the intervention and one withdrew from treatment in the final stage of rehabilitation due to health problems.

Fig. 1
figure 1

Flow diagram of the FIT-HIP process-evaluation

Based on patients that were actively enrolled in the study at the various assessments, the response rate for the patients’ evaluation questionnaires was 58.8% (n = 20) at discharge; and 92% (n = 23) and 95.8% (n = 23) at three and 6 months follow-up. We conducted interviews with nine patients; three patients declined to be interviewed. All units were represented within the interviews, with the exception of unit 4 (n = 1 patient enrolled; Additional file 2). We excluded one session log from data analysis, as data were largely missing.

Two physiotherapists and one psychologist discontinued participation (Fig. 1). One of these physiotherapists had treated one patient according to the FIT-HIP intervention, the other had no FIT-HIP patients. Ten of the 14 physiotherapists and six of the seven psychologists participated in the interviews. Response rates for health care professionals’ evaluation questionnaires were: N = 6 for physiotherapists (42.9%; representing four units); N = 4 for psychologists (50.0%; representing three units); N = 4 for physicians (44.4%; representing three units) and N = 4 for nursing staff (representing two units).

Performance according to protocol

The FIT-HIP intervention was conducted during inpatient geriatric rehabilitation and in our study the length of stay varied from 21 to 98 days (median: 42). From study inclusion until discharge, patients on average received 30.7 physiotherapy sessions (range: 8–105), accounting for 15.7 h of physiotherapy (range: 3.9–52.5).

Table 3 provides an overview of the dose delivered per FIT-HIP intervention element. The FIT-HIP intake was carried out for all patients. Guided exposure, the key element of the intervention, was delivered to 97.2% of the patients (n = 35). Lack of FoF after enrollment was the reason for not using guided exposure (n = 1). On average, guided exposure was incorporated in 56.6% of all physiotherapy sessions (ranging from 5 to 100%; tailored to patient’s needs and response to treatment). Cognitive restructuring was performed according to protocol less frequently; 26 patients (72.2%) had this element within their treatment program. On average cognitive restructuring was incorporated in 3.5 ± 1.9 sessions. Eighteen patients (50.0%) received homework assignment(s) for cognitive restructuring. With regard to reasons for deviating from protocol for cognitive restructuring, lack of FoF was mentioned for three patients, and for the remaining seven patients the reason was unknown. The telephonic booster was carried out for 38.9% of the patients (n = 14; of which n = 9 were registered in booster log), resulting in this being the intervention element that was most frequently not performed according to protocol. Facilitators from unit 3 forgot to perform the booster (n = 11 patients), one patient was repeatedly not available, and for the remaining patients who did not receive the booster, the reason was unknown.

Table 3 Performance according to protocol

Regarding the coaching of physiotherapists provided by psychologists, interviews revealed that the frequency of meetings decreased over time. At the start of the study, meetings were initiated and the intervention protocol was reviewed again within the team. However, during the course of the study there were few consultation requests from the physiotherapists and consequently the meetings did not take place each month.

Adherence

Based on the PRPS, active participation during the intervention sessions was very good to excellent for the majority of patients (56%; n = 20). One patient’s participation was rated as ‘fair’, the remaining 15 (41.2%) as ‘good’. Patients reported their adherence to homework (including physical exercises) as follows: during rehabilitation they performed their homework ‘sometimes’ (11.1%; n = 2), ‘most of the time’ (55.6%; n = 10) or ‘always’ (33.3%; n = 6). Time spent on homework varied from 30 to 420 min per week. Three months post-discharge eight patients (42.1%) had ‘never’ used the Staying Active Plan; three patients (15.8%) ‘seldom or sometimes’ and eight patients ‘most of the time’. The reported adherence for the Staying Active Plan at 6 months was comparable.

Opinion on the intervention

Patient opinions

In general, patients had a positive opinion about the treatment provided by physiotherapists and rated this with a mean of 8.1 (scale 0–10 with higher scores indicating a more favorable opinion) (range 6–10; n = 19). Ninety percent of the patients (n = 18) evaluated quality of the facilitators as being (very) good. A large majority of the patients would recommend this treatment for fear of falling to other patients (88.2%; n = 15). In general, the perceived burden of the physical effort during physiotherapy was rated as being ‘just right’ (65.0%; n = 13), yet 25.0% experienced it as ‘too much’. Using a 5-point Likert scale we assessed the perceived benefit of the intervention. At discharge from rehabilitation, half of the patients reported that the intervention was (very) helpful to reduce fear of falling and none reported having experienced no benefit from the intervention. The reported benefit after discharge decreased to 39.1% (n = 9) at 3 months, and 33.4% (n = 6) at 6 months. Patients reported most benefit from the Staying Active Plan (75.1%), guided exposure (62.5%) and psychoeducation (55.6%) (Table 4). After discharge, the reported benefit of the Staying Active Plan decreased to 35.7 and 36.4% after three and 6 months. The telephonic booster was considered least beneficial.

Table 4 Patients’ perceived benefit of the FIT-HIP interventionb

Interviews showed the patients were positive about the physiotherapists. The patient-therapist relationship was mentioned as an important facilitator for recovery. Patients specified the following key factors within this patient-therapist relationship: 1] trust in the competence of the therapist; 2] calm and supportive personality of the therapist; 3] personal attention for the patient during therapy; and 4] the continuity in treatment - provided by that specific therapist. The fact that therapy was provided on a daily basis - sometimes multiple sessions - was helpful to (re) gain self-confidence. Additionally, patients experienced that having other patients as a reference during group sessions was supportive for recovery.

Care professionals’ opinions

The majority of the physiotherapists (70%, n = 7, representing four units) had a favorable opinion of the intervention and stated it was a good intervention for the treatment of FoF. These seven physiotherapists mentioned that intervention items such as psychoeducation, guided exposure and to some extent cognitive restructuring are already part of their (physiotherapy) treatment, but receive more attention and are offered in a more structured manner because of the intervention. Preferences for type of cognitive behavioral approach did, however, differ among these physiotherapists (guided exposure n = 4; cognitive restructuring n = 1; use of guided exposure or cognitive restructuring tailored to patient’s response to these approaches n = 2). Both physiotherapists and psychologists mentioned that this cognitive restructuring can be challenging for physiotherapists, depending on prior experience with psychosocial interventions. All facilitators questioned to what extent patients would use the Staying Active Plan after discharge.

For the physiotherapists with a less favorable opinion of the intervention, time constraints were an important barrier to performing the intervention according to protocol. They felt that treatment of fear (of falling) was more appropriate for psychologists and doubted the added value of the guided exposure principles over current usual care. Physiotherapists with positive attitudes toward the intervention (n = 7), on the other hand, did not perceive time as a barrier to implementing the intervention (for future purposes). Although (mild) cognitive impairment was regularly observed in the study population, this was usually not perceived to be a barrier to applying treatment principles. Additional file 4 presents an overview of all challenges, barriers and suggestions for improvement that were mentioned in this process evaluation; the main suggestions are highlighted below.

Suggestions for improvement

First, physiotherapists observed that after enrollment, the level of FoF among patients appeared to be limited, which consequently hindered the execution of the intervention according to protocol. To improve the efficiency and feasibility of the intervention on that account, it may be helpful to reconsider the selection of the target group (i.e. screening), and initiate treatment at a later stage of geriatric rehabilitation (i.e. if the FoF persists). Second, physiotherapists indicated that having more flexibility to tailor the treatment protocol to the individual patient would be helpful. In their experience, some patients were more receptive to guided exposure and others to cognitive restructuring. Hence, it would be useful to choose the most appropriate element for each individual patient, for example based on their treatment response and anxiety trait(s).

The third suggestion was to intensify the collaboration (and coaching function) between psychologists and physiotherapists, specifically with regard to cognitive restructuring. Although most physiotherapists felt they were capable of (partly) performing cognitive restructuring (as appropriate, with additional training and experience), they suggested it would be helpful if the psychologist routinely observed a physiotherapy session (for example once every week or 2 weeks). This would provide the opportunity to give additional advice to the physiotherapist, but also to monitor whether additional (psychological) treatment is required. To promote an interdisciplinary approach to addressing FoF, it was also recommended to train nursing staff in early recognition of FoF.

Discussion

This study assessed the feasibility of a multicomponent cognitive behavioral intervention for FoF after hip fracture, integrated in usual care in inpatient rehabilitation. To a fair degree the intervention was performed according to protocol, but cognitive restructuring and the telephonic booster were not provided to all patients. Patients rated the intervention positively and half of them reported that the intervention was (very) helpful in reducing FoF. Most facilitators were positive about the intervention and considered it feasible. However, this study also identified barriers that may have affected this feasibility, and these should be addressed to improve the intervention. Two important barriers were the limited level of FoF after enrollment (possibly related to timing of the intervention), and the fact that physiotherapists, having limited experience with such approaches, perceived cognitive restructuring as challenging.

A considerable body of evidence demonstrates that programs based on cognitive behavioral approaches (preferably combined with physical exercise) are effective to reduce FoF in older adults with fall risk [16,17,18, 27]. However, despite the benefit perceived by patients, the FIT-HIP intervention was not effective in reducing FoF when compared to usual care [12]. It is therefore crucial to reflect on the intervention process, in particular cognitive restructuring as this was not administered to all patients and was considered the most challenging element for facilitators. First, the dose of cognitive restructuring within the intervention does not differ significantly from other programs [14, 28, 29], and this does not explain the absence of effect. However, in our study fewer patients received cognitive restructuring according to protocol (72.2% in the FIT-HIP study versus 83.4% in the home-based program for FoF in community-dwelling older adults) [30]. This may have contributed to the lack of effectiveness.

The fact that cognitive restructuring is perceived as challenging does not by definition imply it is not feasible in practice or not suitable for frail older adults. Literature on nurse-led programs for FoF in community-dwelling older adults confirms the finding that cognitive restructuring can be challenging for facilitators and participants, yet these programs - despite the perceived difficulties - proved to be effective [14, 15, 20]. Regarding the appropriateness of cognitive restructuring for frail older adults, facilitators in our study acknowledged that even in cases of mild cognitive impairment, this approach still had potential short-term effects (during the therapy session), enhancing the rehabilitation process.

In a broader perspective, we could question whether it is appropriate for physiotherapists to apply cognitive restructuring. In the past years, interest in incorporating a biopsychosocial approach to physiotherapy practice to enhance the rehabilitation process has increased [31]. Research illustrates that overall, physiotherapists have positive attitudes and beliefs regarding psychosocial interventions [31]. Common barriers to implementation of psychosocial interventions in clinical practice include lack of knowledge, time constraints (including the perceived need to prioritize physical care) and the scope of practice (role clarity and public perceptions of traditional physiotherapist role) [31, 32]. These factors were also identified in our study, but rather than the lack of knowledge, the facilitators mentioned a desire for more experience. The current literature concerning psychosocial interventions with physiotherapists as facilitators recommends that, in order to ensure treatment fidelity, psychologists should provide comprehensive training and mentoring to the physiotherapists, including performance feedback [32, 33]. Effectiveness of such an approach is supported by a recent study that showed positive effects of a physiotherapist-led in-home intervention to reduce FoF and activity avoidance, including cognitive restructuring and exposure therapy, in community-dwelling older adults [18]. The physiotherapists received weekly supervision by a psychologist, based on video tapes of the therapy sessions. Likewise, the ‘Step by Step intervention’ aimed at reducing FoF after hip- or pelvic fracture, performed by physiotherapists who received weekly supervision by clinical psychologists, also had favorable effects on reducing FoF [27]. In our intervention protocol the supervision by psychologists was limited to monthly team meetings and individual coaching on request. In practice this supervision occurred less frequently. This is therefore an area of attention for the future.

Reflecting on the therapy intensity in our intervention, thus comparing the individual intervention items to various effective multi-component interventions for FoF, is not straightforward, as this is not always described in detail in the available literature. Also, tailoring of the intervention to the specific needs of the patients can complicate insight in the therapy intensity. The core element of the FIT-HIP intervention is guided exposure to feared activities, which is integrated in most of the therapy sessions. In other intervention programs this element was generally limited to one or two therapy sessions [28, 33]. Only the ABLE intervention, an in-home intervention for community dwelling older adults with excessive FoF, incorporated the exposure as a more elementary part of the program [29]. To the best of our knowledge, based on the intervention protocols, all programs had comparable frequency of delivery for psychoeducation on home safety and relapse prevention. Comparable to our program, the ABLE program included psychoeducation on the background on anxiety consequences and rationale for treatment [28, 29, 33]. The only other treatment program for FoF in this specific target group, the ‘Step by Step intervention’ includes problem-solving and relaxation techniques as additional items as compared to the FIT-HIP intervention [33]. The intended therapy intensity of cognitive therapy in this program was similar to our intervention. Hence, the therapy intensity of the individual FIT-HIP intervention items, in the form of therapy frequency, does in itself not clearly explain the lack of effectivity of the FIT-HIP intervention.

Regarding the feasibility of the telephonic booster (6 weeks after discharge): this element proved to be easily forgotten, as the physiotherapist was no longer involved in the patient’s treatment after discharge. We incorporated the booster in the intervention based on lessons learned from the programs based on a ‘Matter of Balance ‘ [30, 34], and the insight that (increase in) FoF is common after discharge from geriatric rehabilitation [35]. We can, however, question whether a telephonic booster is useful for our target group, as patients who received the booster reported no benefit from this intervention element. Perhaps it would be more appropriate to extend the treatment for FoF to an ambulatory rehabilitation setting (in-home) [27, 36].

An important barrier to acknowledge is the limited level of the FoF reported after enrollment in the study (i.e. selection of the target population). Facilitators pointed out that during screening (first week of rehabilitation), patients were mainly sedentary. Once patients started the process of mobilization (i.e. walking during therapy), in clinical practice the FoF appeared to decrease. The timing of the intervention in relation to the timeline after fracture may be a relevant factor to consider in the selection of the target group. Current literature illustrates that FoF present 2–4 weeks after fracture is not associated with negative effects on long-term functional outcomes, contrary to FoF present 6–12 weeks post-fracture [7, 8]. Provided that the fear is not disproportionate and does not lead to significant avoidance behavior (activity restriction), this could imply that FoF shortly after fracture can in some cases be a normal or adaptive process which does not require treatment. Unfortunately, for this specific group of patients, it is currently unknown what a disproportionate level of FoF is as measured with established instruments such as the FES-I. We can question whether the standard cut-off values are appropriate for this target group, especially because the FES-I appears to be more closely related to functional performance than to psychological concepts such as anxiety [37]. Patients with hip fracture experience a sudden impairment of the lower body function, and a certain level of ‘caution’ in relation to an increased fall risk in the early stage of recovery after fracture, may be an appropriate response. For clinical practice it seems relevant to monitor the course of FoF. Findings from a cohort study of hip fracture patients show three distinct patterns of FoF evolving from 4 to 12 weeks after fracture; i] patients with consistently low levels of FoF; ii] patients with high levels of FoF at 4 weeks that continue to increase; iii] patients with high levels of FoF at 4 weeks which decrease at 12 weeks post-fracture [38]. It is currently unknown how these distinct trajectories relate to avoidance behavior. However, it is plausible that especially those patients that have increasing levels of FoF are more susceptible to develop activity restriction as a consequence of FoF. Accordingly this may be an important group to address by means of intervention.

Another factor to consider when screening for FoF, is the (mediating) role of anxiety (traits) in the development of maladaptive or dysfunctional fear of falling [18, 39, 40]. Findings from Bower et al. show that patients with higher scores for neuroticism were more likely to have high levels of FoF [38]. Also, the previously mentioned in-home cognitive behavioral program for FoF that was conducted by physiotherapists and showed positive effects on reducing FoF and activity restriction, was aimed at patients with disproportionate FoF; as defined as high fear and low to moderate objective fall risk and functional impairment because of FoF [29]. The majority of participants had a psychiatric disorder, most frequently a pre-existing anxiety disorder [18]. In contrast, the FIT-HIP study population reported low scores for anxiety, had a lower level of FoF at baseline (Falls Efficacy Score-International); and we excluded patients with generalized anxiety [12, 21]. It may therefore be useful to incorporate screening for more generalized anxiety symptoms and also specifically include patients with anxiety for treatment.

Limitations

This process evaluation has several limitations. First, we cannot rule out the possibility of socially desirable answers given by patients and facilitators. To reduce the risk of such bias, we informed patients that data would be handled confidentially by the research team (not involved in treatment). For facilitators, we emphasized that their input was essential to improve the intervention for future purposes. Second, the timing of the interviews may have led to recall bias among facilitators and patients. However, facilitators had no trouble recalling the intervention and were able to identify barriers and suggest improvements. Additionally, we collected information on barriers from the regular informal contact with physiotherapists (researcher log) during the course of the study. We therefore have extensive information concerning the intervention’s feasibility, especially from the facilitator’s perspective. A third limitation is the relatively low response for the evaluation questionnaires from patients at discharge from rehabilitation. Physiotherapists coordinated this assessment, as the date of discharge could occasionally be brought forward. They sometimes forgot to hand out the questionnaires. Despite additional postal ‘follow-up’ in these cases, the response rate remained limited. Finally, data on performance according to protocol (including fidelity), was limited to self-report measures (session logs and interviews), which can lead to more favorable responses in comparison to more objective measures. However, video recording of the physiotherapy sessions was considered to be too intrusive for the patients. The strength of this process evaluation is that the results are based on extensive quantitative and qualitative information obtained from patients and facilitators (both physiotherapists and psychologists). This was analyzed within a well-established framework for process evaluations (Saunders) [22] and provided a good insight into the feasibility of the FIT-HIP intervention, possible barriers to implementation and suggestions for improving the intervention.

Recommendations for improvement

First, in order to select an appropriate target population that can benefit from treatment, it is crucial to select patients with maladaptive FoF. Currently we do not know how to accurately quantify disproportionate levels of fear of falling for this specific target group. However, factors such as anxiety and avoidance behavior may contribute to the development of maladaptive FoF, and may aid the process of determining which patients require treatment. We therefore recommend screening patients for FoF, related activity restriction and comorbid anxiety at the start of the rehabilitation, and every time the rehabilitation treatment is evaluated. To assess activity restriction related to FoF, an instrument such as SAFE (Survey of Activities and Fear of Falling in the Elderly) could prove to be useful [41]. Treatment of FoF does not by definition have to be initiated directly at the start of rehabilitation, but treatment is advised when avoidance behavior for physical activities is observed. We also recommend treatment for FoF in the event the FoF is progressive or persists, which implies treatment in later stages of rehabilitation.

Second, to improve the feasibility of the FIT-HIP intervention we recommend the following adjustments regarding the content and organization of the intervention. 1] Intensify collaboration between physiotherapists and psychologists to (a form of) collective treatment, in order to support performance feedback for the physiotherapists and to enable timely identification when treatment is required from a psychologist. We advise that psychologists observe the patient during a physiotherapy session once a week. Furthermore, within each individual team, there should be clear agreements regarding the extent to which cognitive restructuring is provided by the physiotherapist (based on prior experience and the preferences of the physiotherapist), and which indications require referral to the psychologist. 2] We support the idea of a more tailored approach to applying guided exposure and cognitive restructuring. Based in part on the presence of anxiety traits, facilitators observed that some patients were more receptive to guided exposure and others to cognitive restructuring. We propose that physiotherapists continue to initiate treatment with both approaches and that the (most) appropriate treatment is determined during the joint treatment with psychologists. 3] More attention to cognitive restructuring in the training of facilitators may also be beneficial, as this element was perceived as most challenging. 4] Last, the telephonic booster can be eliminated from the intervention, due to lack of both feasibility for the facilitators and perceived benefit of the patients.

Conclusion

This process evaluation shows that the FIT-HIP intervention was only partly feasible, which may have contributed to the lack of effectiveness of the intervention. To improve feasibility and effectiveness, we recommend a number of adjustments to the intervention. These include selecting patients with maladaptive FoF (specifically in the context of avoidance behavior for physical activities), being more flexible with regard to the timing of the intervention (initiating treatment at a later stage of rehabilitation), and providing more support to the physiotherapists with regard to the cognitive restructuring. Although the FIT-HIP intervention in its current form was not effective, and only partly feasible, there is sufficient evidence that cognitive behavioral therapy is a feasible and effective approach to reduce FoF in older adults. We therefore expect that, with the proposed improvements, the FIT-HIP intervention has the potential to effectively reduce FoF. However, further research is needed to prove whether the suggested adjustments result in improved feasibility and effectiveness of the intervention.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

FES-I:

Falls Efficacy Scale-International

FoF:

Fear of Falling

FIT-HIP:

Fear of falling InTervention in HIP fracture geriatric rehabilitation

LUMC:

Leiden University Medical Center

References

  1. Handoll HH, Cameron ID, Mak JC, Finnegan TP. Multidisciplinary rehabilitation for older people with hip fractures. Cochrane Database Syst Rev. 2009;4:Cd007125.

    Google Scholar 

  2. Magaziner J, Chiles N, Orwig D. Recovery after hip fracture: interventions and their timing to address deficits and desired outcomes--evidence from the Baltimore hip studies. Nestle Nutr Institute Workshop Series. 2015;83:71–81. https://doi.org/10.1159/000382064.

    Article  Google Scholar 

  3. Visschedijk J, Achterberg W, Van Balen R, Hertogh C. Fear of falling after hip fracture: a systematic review of measurement instruments, prevalence, interventions, and related factors. J Am Geriatr Soc. 2010;58(9):1739–48. https://doi.org/10.1111/j.1532-5415.2010.03036.x.

    Article  PubMed  Google Scholar 

  4. Visschedijk J, van Balen R, Hertogh C, Achterberg W. Fear of falling in patients with hip fractures: prevalence and related psychological factors. J Am Med Dir Assoc. 2013;14(3):218–20. https://doi.org/10.1016/j.jamda.2012.10.013.

    Article  PubMed  Google Scholar 

  5. Tinetti ME, Powell L. Fear of falling and low self-efficacy: a case of dependence in elderly persons. J Gerontol. 1993;48:35–8.

    Article  Google Scholar 

  6. Scheffer AC, Schuurmans MJ, van Dijk N, van der Hooft T, de Rooij SE. Fear of falling: measurement strategy, prevalence, risk factors and consequences among older persons. Age Ageing. 2008;37(1):19–24. https://doi.org/10.1093/ageing/afm169.

    Article  PubMed  Google Scholar 

  7. Oude Voshaar RC, Banerjee S, Horan M, et al. Fear of falling more important than pain and depression for functional recovery after surgery for hip fracture in older people. Psychol Med. 2006;36(11):1635–45. https://doi.org/10.1017/S0033291706008270.

    Article  PubMed  Google Scholar 

  8. Bower ES, Wetherell JL, Petkus AJ, Rawson KS, Lenze EJ. Fear of falling after hip fracture: prevalence, course, and relationship with one-year functional recovery. Am J Geriatr Psychiatry. 2016;24(12):1228–36. https://doi.org/10.1016/j.jagp.2016.08.006.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Ko Y, Lee J, Kim SY, Baek SH. Identification of factors related to functional decline of Korean older adults after hip fracture surgery: a cross-sectional study. Res Gerontol Nurs. 2019;12:1–9.

    Article  Google Scholar 

  10. Holstege MS, Caljouw MAA, Zekveld IG, van Balen R, de Groot AJ, van Haastregt JCM, et al. Successful geriatric rehabilitation: effects on Patients’ outcome of a National Program to improve quality of care, the SINGER study. J Am Med Dir Assoc. 2017;18(5):383–7. https://doi.org/10.1016/j.jamda.2016.10.011.

    Article  PubMed  Google Scholar 

  11. Achterberg WP, Cameron ID, Bauer JM, Schols JM. Geriatric rehabilitation-state of the art and future priorities. J Am Med Dir Assoc. 2019;20(4):396–8. https://doi.org/10.1016/j.jamda.2019.02.014.

    Article  PubMed  Google Scholar 

  12. Scheffers-Barnhoorn MN, van Eijk M, van Haastregt JCM, et al. Effects of the FIT-HIP Intervention for Fear of Falling After Hip Fracture: a Cluster-Randomized Controlled Trial in Geriatric Rehabilitation. J Am Med Dir Assoc. 2019;20(7):857–865.e852.

    Article  Google Scholar 

  13. Zijlstra GA, Tennstedt SL, van Haastregt JC, van Eijk JT, Kempen GI. Reducing fear of falling and avoidance of activity in elderly persons: the development of a Dutch version of an American intervention. Patient Educ Couns. 2006;62(2):220–7. https://doi.org/10.1016/j.pec.2005.07.005.

    Article  PubMed  Google Scholar 

  14. Zijlstra GA, van Haastregt JC, Ambergen T, et al. Effects of a multicomponent cognitive behavioral group intervention on fear of falling and activity avoidance in community-dwelling older adults: results of a randomized controlled trial. J Am Geriatr Soc. 2009;57(11):2020–8. https://doi.org/10.1111/j.1532-5415.2009.02489.x.

    Article  PubMed  Google Scholar 

  15. Dorresteijn TA, Zijlstra GA, Ambergen AW, Delbaere K, Vlaeyen JW, Kempen GI. Effectiveness of a home-based cognitive behavioral program to manage concerns about falls in community-dwelling, frail older people: results of a randomized controlled trial. BMC Geriatr. 2016;16(1):2. https://doi.org/10.1186/s12877-015-0177-y.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Liu TW, Ng GYF, Chung RCK, Ng SSM. Cognitive behavioural therapy for fear of falling and balance among older people: a systematic review and meta-analysis. Age Ageing. 2018;47(4):520–7. https://doi.org/10.1093/ageing/afy010.

    Article  PubMed  Google Scholar 

  17. Chua CHM, Jiang Y, Lim S, Wu VX, Wang W. Effectiveness of cognitive behaviour therapy-based multicomponent interventions on fear of falling among community-dwelling older adults: a systematic review and meta-analysis. J Adv Nurs. 2019;75(12):3299–315. https://doi.org/10.1111/jan.14150.

    Article  PubMed  Google Scholar 

  18. Wetherell JL, Bower ES, Johnson K, Chang DG, Ward SR, Petkus AJ. Integrated exposure therapy and exercise reduces fear of falling and avoidance in older adults: a randomized pilot study. Am J Geriatr Psychiatry. 2018;26(8):849–59. https://doi.org/10.1016/j.jagp.2018.04.001.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Tennstedt S, Howland J, Lachman M, Peterson E, Kasten L, Jette A. A randomized, controlled trial of a group intervention to reduce fear of falling and associated activity restriction in older adults. J Gerontol Ser B Psychol Sci Soc Sci. 1998;53(6):P384–92.

    CAS  Google Scholar 

  20. Zijlstra GA, van Haastregt JC, Du Moulin MF, de Jonge MC, van der Poel A, Kempen GI. Effects of the implementation of an evidence-based program to manage concerns about falls in older adults. The Gerontologist. 2013;53(5):839–49. https://doi.org/10.1093/geront/gns142.

    Article  PubMed  Google Scholar 

  21. Scheffers-Barnhoorn MN, van Haastregt JC, Schols JM, et al. A multi-component cognitive behavioural intervention for the treatment of fear of falling after HIP fracture (FIT-HIP): protocol of a randomised controlled trial. BMC Geriatr. 2017;17(1):71. https://doi.org/10.1186/s12877-017-0465-9.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Saunders RP, Evans MH, Joshi P. Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005;6(2):134–47. https://doi.org/10.1177/1524839904273387.

    Article  PubMed  Google Scholar 

  23. Wilson DK, Griffin S, Saunders RP, Kitzman-Ulrich H, Meyers DC, Mansard L. Using process evaluation for program improvement in dose, fidelity and reach: the ACT trial experience. Int J Behav Nutr Phys Act. 2009;6(1):79. https://doi.org/10.1186/1479-5868-6-79.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Steckler ALL, Israel B. Process evaluation for public health interventions and research: Wiley; 2002.

  25. Meijer R, van Limbeek J, de Haan R. Development of the stroke-unit discharge guideline: choice of assessment instruments for prediction in the subacute phase post-stroke. Int J Rehabil Res. 2006;29(1):1–8. https://doi.org/10.1097/01.mrr.0000175269.59788.41.

    Article  PubMed  Google Scholar 

  26. Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Admin Pol Ment Health. 2015;42(5):533–44. https://doi.org/10.1007/s10488-013-0528-y.

    Article  Google Scholar 

  27. Pfeiffer K, Kampe K, Klenk J, Rapp K, Kohler M, Albrecht D, et al. Effects of an intervention to reduce fear of falling and increase physical activity during hip and pelvic fracture rehabilitation. Age Ageing. 2020;49(5):771–8. https://doi.org/10.1093/ageing/afaa050.

    Article  PubMed  Google Scholar 

  28. Dorresteijn TA, Zijlstra GA, Delbaere K, van Rossum E, Vlaeyen JW, Kempen GI. Evaluating an in-home multicomponent cognitive behavioural programme to manage concerns about falls and associated activity avoidance in frail community-dwelling older people: design of a randomised control trial [NCT01358032]. BMC Health Serv Res. 2011;11(1):228. https://doi.org/10.1186/1472-6963-11-228.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Wetherell JL, Johnson K, Chang D, Ward SR, Bower ES, Merz C, et al. Activity, balance, learning, and exposure (ABLE): a new intervention for fear of falling. Int J Geriatric Psychiatry. 2016;31(7):791–8. https://doi.org/10.1002/gps.4393.

    Article  Google Scholar 

  30. Dorresteijn TA, Rixt Zijlstra GA, Van Haastregt JC, Vlaeyen JW, Kempen GI. Feasibility of a nurse-led in-home cognitive behavioral program to manage concerns about falls in frail older people: a process evaluation. Res Nurs Health. 2013;36(3):257–70. https://doi.org/10.1002/nur.21534.

    Article  PubMed  Google Scholar 

  31. Driver C, Kean B, Oprescu F, Lovell GP. Knowledge, behaviors, attitudes and beliefs of physiotherapists towards the use of psychological interventions in physiotherapy practice: a systematic review. Disabil Rehabil. 2017;39(22):2237–49. https://doi.org/10.1080/09638288.2016.1223176.

    Article  PubMed  Google Scholar 

  32. Nielsen M, Keefe FJ, Bennell K, Jull GA. Physical therapist-delivered cognitive-behavioral therapy: a qualitative study of physical therapists’ perceptions and experiences. Phys Ther. 2014;94(2):197–209. https://doi.org/10.2522/ptj.20130047.

    Article  PubMed  Google Scholar 

  33. Kampe K, Kohler M, Albrecht D, Becker C, Hautzinger M, Lindemann U, et al. Hip and pelvic fracture patients with fear of falling: development and description of the “step by step” treatment protocol. Clin Rehabil. 2017;31(5):571–81. https://doi.org/10.1177/0269215517691584.

    Article  PubMed  Google Scholar 

  34. van Haastregt JC, Zijlstra GA, van Rossum E, van Eijk JT, de Witte LP, Kempen GI. Feasibility of a cognitive behavioural group intervention to reduce fear of falling and associated avoidance of activity in community-living older people: a process evaluation. BMC Health Serv Res. 2007;7(1):156. https://doi.org/10.1186/1472-6963-7-156.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Visschedijk JH, Caljouw MA, Bakkers E, van Balen R, Achterberg WP. Longitudinal follow-up study on fear of falling during and after rehabilitation in skilled nursing facilities. BMC Geriatr. 2015;15(1):161. https://doi.org/10.1186/s12877-015-0158-1.

    Article  PubMed  PubMed Central  Google Scholar 

  36. van Balen R, Gordon AL, Schols JMGA, Drewes YM, Achterberg WP. What is geriatric rehabilitation and how should it be organized? A Delphi study aimed at reaching European consensus. Eur Geriatric Med. 2019;10(6):977.

    Article  Google Scholar 

  37. Visschedijk JH, Terwee CB, Caljouw MA, Spruit-van Eijk M, van Balen R, Achterberg WP. Reliability and validity of the falls efficacy scale-international after hip fracture in patients aged >/= 65 years. Disabil Rehabil. 2015;37(23):2225–32. https://doi.org/10.3109/09638288.2014.1002573.

    Article  PubMed  Google Scholar 

  38. Bower ES, Wetherell JL, Petkus AJ, Lenze EJ. Neuroticism predicts fear of falling after hip fracture. Int J Geriatr Psychiatry. 2020;35(5):498.

    Article  Google Scholar 

  39. Adamczewska N, Nyman SR. A new approach to fear of falls from connections with the posttraumatic stress disorder literature. Gerontol Geriatric Med. 2018;4:2333721418796238.

    Article  Google Scholar 

  40. Young WR, Mark WA. How fear of falling can increase fall-risk in older adults: applying psychological theory to practical observations. Gait Posture. 2015;41(1):7–12. https://doi.org/10.1016/j.gaitpost.2014.09.006.

    Article  PubMed  Google Scholar 

  41. Allison LK, Painter JA, Emory A, Whitehurst P, Raby A. Participation restriction, not fear of falling, predicts actual balance and mobility abilities in rural community-dwelling older adults. J Geriatr Phys Ther. 2013;36(1):13–23. https://doi.org/10.1519/JPT.0b013e3182493d20.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors thank all participants and facilitators for their participation in the FIT-HIP trial, and specifically for their participation in this process evaluation. We thank the physiotherapists for their role in the data acquisition (session logs). This study was performed within the University Network for the Care Sector South Holland in the Netherlands (UNC-ZH), and we are grateful that this study was facilitated within this network.

Funding

This work was supported by ZonMw (The Netherlands Organization for Health Research and Development); research grant number 839120004. This study has been conducted independently of the funding body. SBOH (employer of elderly care medicine trainees), and the Leiden University Medical Centre (training centre for Elderly Care Physicians) additionally supported this study.

Author information

Authors and Affiliations

Authors

Contributions

All authors were involved in the design of the study. MS was responsible for the data acquisition. MS and JvH performed the data analysis. All authors were involved in the interpretations of the findings. MS drafted the manuscript; all authors contributed to the manuscript and provided approval for the final submitted version of the manuscript.

Corresponding author

Correspondence to Maaike N. Scheffers-Barnhoorn.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was provided by the Ethics Committee of the Leiden University Medical Center (LUMC); reference number P15.212 (09-09-2015). All participants provided written informed consent to participate in the FIT-HIP study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Topic list for psycho-education within the FIT-HIP intervention. This table provides an overview of the topics handled within the psycho-education of the FIT-HIP intervention.

Additional file 2.

Enrollment of and data from patients and facilitators per GR unit. This table provides an overview of the enrollment and data available for each individual participating GR unit.

Additional file 3.

Fear of falling and associated activity restriction. Table in word document (.doc). The table contains data on the course of fear of falling in the study population.

Additional file 4.

Feedback and suggestions for improvement of the intervention provided by facilitators. This table provides an overview of additional (minor) suggestions for improvement of the intervention.

Additional file 5.

Evaluation questionnaires. Summary of the evaluation questionnaires used in the process evaluation.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Scheffers-Barnhoorn, M.N., van Eijk, M., Schols, J.M.G.A. et al. Feasibility of a multicomponent cognitive behavioral intervention for fear of falling after hip fracture: process evaluation of the FIT-HIP intervention. BMC Geriatr 21, 224 (2021). https://doi.org/10.1186/s12877-021-02170-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12877-021-02170-5

Keywords