Measured outcomes of chronic care programs for older adults: a systematic review
BMC Geriatrics volume 15, Article number: 139 (2015)
Wagner’s Chronic Care Model (CCM), as well as the expanded version (ECCM) developed by Barr and colleagues, have been widely adopted as frameworks for prevention and management of chronic disease. Given the high prevalence of chronic illness in older persons, these frameworks can play a valuable role in reorienting the health care system to better serve the needs of seniors. We aimed to identify and assess the measured goals of E/CCM interventions in older populations. In particular, our objective was to determine the extent to which published E/CCM initiatives were evaluated based on population, community, system and individual-level outcomes (including clinical, functional and quality of life measures).
We conducted a systematic search of the Science Citation Index Web of Knowledge search tool to gather articles published between January 2003 and July 2014. We included published CCM interventions that cited at least one of the fundamental papers that introduced and described the CCM and ECCM. Studies retained for review reported evaluations of senior-focused E/CCM initiatives in community-based settings, with the topic of “older adults” OR senior* OR elder* OR geriatric OR aged. The resulting 619 published articles were independently reviewed for inclusion by two researchers. We excluded the following: systematic reviews, meta-analyses, descriptions of proposed programs, and studies whose populations did not focus on seniors.
We identified 14 articles that met inclusion criteria. Studies used a wide range of measures, with little consensus between studies. All of the included studies used the original CCM. While a range of system-level and individual patient outcomes have been used to evaluate CCM interventions, no studies employed measures of population or community health outcomes.
Future efforts to test E/CCM interventions with seniors would be aided by more consistent outcome measures, greater attention to outcomes for the caregivers of older persons with chronic illness, and a greater focus on population and community impacts.
Health care systems are frequently challenged by issues of access, continuity, fragmentation and quality of care in addressing the needs of older persons with chronic illness . Wagner and colleagues  developed the Chronic Care Model (CCM) as a framework for the development of more comprehensive and integrated chronic care. The CCM framework includes six components: Community Resources and Policies; Health system organization; Self-Management Support; Decision Support; Delivery System Design; and Clinical Information Systems . In this model, the community resources and health system components are designed to support engaged patients and proactive health care teams, which interact to improve functional and clinical outcomes for patients. Barr and colleagues  proposed an Expanded Chronic Care Model (ECCM) to support greater emphasis on population and community health outcomes.
The original and expanded versions of the Chronic Care Model (E/CCM) have been widely adopted . We were interested in understanding the outcomes and indicators used to evaluate E/CCM interventions that focus on older adults with chronic illness. The objective of this paper was to determine the extent to which published E/CCM initiatives were evaluated based on population, community, system and individual-level outcomes (including clinical, functional and quality of life measures).
We reviewed published studies of explicitly identified E/CCM interventions that included elements of the CCM model: self-management support, decision support, delivery system design, clinical information systems, health care organization, and community resources.
As described by Coleman and colleagues , the variation in nomenclature used by authors, and imprecisions in descriptions of interventions, can make it difficult to identify E/CCM interventions through usual database search strategies. In order to facilitate the identification of CCM-based interventions, Coleman and colleagues developed a strategy utilizing the Science Citation Index Web of Knowledge to limit their search to published interventions that cited at least one of the fundamental CCM papers [2, 6–9]. We utilized a similar strategy, but also identified interventions that cited the more recent paper by Barr and colleagues , which introduced the ECCM. We included articles published between January 2003 and July 2014, in English, with the topic of “older adults” OR senior* OR elder* OR geriatric OR aged. The search process is outlined in Fig. 1.
To be included, articles had to report an evaluation or observational study of an E/CCM intervention, and needed to examine the relationship between the intervention and clearly identified outcomes. We excluded the following: systematic reviews, meta-analyses, descriptions of proposed programs that lacked outcomes, and studies whose populations did not focus on seniors. The articles were independently reviewed for inclusion by two researchers; disagreements were resolved by consensus of the two reviewers or, if necessary, through group discussion among the authors.
As of July 2014, the search yielded 3630 articles that cited at least one of the six articles [2, 3, 6–9]; of these, 827 had a focus on older adults – 619 once duplicates were removed. After abstract and full text review, twelve articles were included in the final set. Of four literature reviews, one , was helpful in identifying two further articles for inclusion.
The resulting 14 included articles were reviewed to determine the level of reporting for each of the reported outcomes (population, community, health system, or individual) and the type of measure for each outcome (system impact, quality of care, or patient/caregiver outcome).
The included studies are summarized in Table 1. Most included studies focused on populations aged 65 (or 66 ) and older, except two which focused on persons aged 75+ [12, 13] and one with a wider age range (20–98) but an average age of 65.5 . None of the papers in the final sample, even those published recently, used the ECCM as the basis of their intervention. Therefore, we did not anticipate that outcomes would be reported at the population level. However, consistent with the original CCM, we expected community level outcomes.
Health system impacts
Health system impacts were considered in 12 of the 14 articles. Organization impacts were collected with three measures: employee satisfaction, staff turnover rates , and “teamness” . Health service use, with seven distinct measures, was measured fairly uniformly through costs (direct/indirect) , emergency department visits [16, 18–20], hospitalizations and re-hospitalizations [16–20], hospital bed days , nursing home admission [12, 16, 18, 19], prescribed medications , and utilization of services (community, home care, specialist, etc.) [13, 15, 19, 20].
Quality of care measures were the most diverse (eighteen distinct measures) and were collected through three methods: provider perspectives of quality, patient perspectives of quality, and patient-related care processes. Professional caregiver measures of quality of care were assessed through perceptions of collaboration , quality of medical management  and impact of programs on health behaviour , as well as by using tools such as the Primary Care Assessment Survey , and the Assessment of Chronic Illness Care tool . Quality of care from the patient’s perspective was more common, including measures of satisfaction [12, 15, 16, 18, 21], access to care , coordination of care , patient involvement in decision-making [18, 22], client-centred care , and provider performance . Observed patient-related care processes included symptom/pain management [15, 18, 22], completion of advanced directives , appropriateness of tests performed (e.g., HbA1c, lipid panel, LDL cholesterol, pharmacist review, foot exam) [15, 23], appropriateness of biomedical test results [15, 22], and self-management knowledge/behaviour [13, 16, 18, 24].
Individual patient or caregiver outcomes were defined in 10 of the 14 articles. Patient outcomes were assessed using a wide range of measures. Biomedical measures were used in four studies [15, 18, 21, 23], and included blood pressure, HbA1c levels, LDL cholesterol level and nutritional status.
Functional status was assessed in seven studies [11–13, 15, 17, 18, 21] with measures of physical function, activities of daily living (ADL), instrumental ADL (IADL), cognitive function, and incontinence. Physical and functional (ADL/IADL) outcomes were collected using seven different methods, including the Groningen Activity Restriction Scale (by mail), Katz ADL index, Avlund Scale (self-assessment of physical function), Shuttle-walk test, chair stand test, 2.45 meter up and go, and a telephone administered physical function survey. Only one study included a personal indicator of frailty, in the form of the Groningen Frailty Index (GFI) self-report version.
Psychological wellbeing and mental health of patients was measured in four studies [13, 17, 18, 22] using measures of anxiety and depression, relationships, social functioning, and the Groningen Well-being Indicator (GWI). Seven studies [11–13, 17, 18, 21, 22] examined health-related quality of life through health status, quality of death, and level of pain. At least six instruments were used to measure quality of life: EQ-5D, SF-12, RAND-36, SF-36, 24 item HRQL from SF-36, and QUAL-E.
Five studies [12, 13, 16, 18, 22] measured patients’ knowledge, attitudes and abilities through various indicators, including attitudes towards aging, level of communication, decision-making capacity, knowledge of disease management and risk factors, and self-management ability. Two studies [14, 18] focused on health behaviours such as nutrition, smoking, exercise, and organization of medication. Patient care needs were measured in three studies [13, 18, 24] examining complexity of care needs, and medications. Adverse outcomes, specifically falls and mortality, were measured in two studies [12, 18].
Only four studies looked at the impact of CCM implementation on informal caregiver outcomes [13, 16–18]. These studies used a combination of measures of quality of life, burden of care, mental wellbeing and caregiver strain.
None of the 14 papers reported outcomes measured at the population or community level. The level of analysis remained almost exclusively at the individual level (all articles included at least one measure collected at the individual level), while a minority (five articles) [14–17, 20], examined measures at the health system level.
Many published studies of E/CCM interventions lack detailed descriptions of the interventions evaluated and the study context, making it difficult to determine how closely the interventions correspond with the E/CCM frameworks. To ensure we included only studies specifically aimed at implementing elements of the E/CCM, we restricted our search to papers that cited one of the six foundational papers. The advantage of this is that we could appropriately examine the extent to which the outcomes reflected the E/CCM framework. However, this method may have excluded E/CCM interventions that did not include references to the original papers.
This paper provides a review of how CCM interventions in older populations are being evaluated for success and impact. As the CCM emphasizes the involvement of all levels of care to improve outcomes, it follows that outcomes would be measured at each of these levels. Several papers included measures of system impact, and all included measures of individual patient outcomes. Overall, there was a noticeable heterogeneity of outcomes measured in the studies, as well as in the associated methods and measurement instruments used. This lack of consistency in outcome measures is a common issue in evaluation of geriatric interventions and limits our ability to compare results across studies or to discern whether negative study results are due to an ineffective intervention or an inadequate measure . Standardized health assessment and reporting systems could help to alleviate these concerns [25, 26].
We found a focus on patient outcomes, with very little focus on the supportive role of provider and informal caregivers, despite the importance of interactions and relationships between patients and their community partners . There is an opportunity for future E/CCM based interventions to provide greater attention to quality of life and other outcomes for the caregivers of older persons with chronic conditions.
In the evaluations of CCM programs included in this review, no population or community outcomes were measured directly. The lack of studies using the newer ECCM was an interesting finding. The ECCM supports the design of services based on the needs and health characteristics of a population in order to improve an equitable distribution of health . This is especially important for groups of patients with higher burdens of morbidity, such as older persons-with chronic illness. Our review suggests that while the ECCM may represent a significant conceptual advance, it has not yet guided empirical research that has resulted in peer-reviewed studies. This finding also highlights the need for greater integration of clinical programs with public and population health strategies. Others have also reflected on a lack of attention to the population and community-oriented elements of the E/CCM . The impacts of some of the elements that may greatly affect disease, health, and quality of life (including patient support, system design, clinical decision support and clinical information systems) can be difficult to evaluate or measure, but may be of considerable importance to the overall success of E/CCM programs . A recent scoping review on public health and primary care collaboration identified many potential barriers to collaboration, but also significant benefits for improved chronic care and disease prevention .
The current literature on E/CCM interventions with older adults indicates that evaluation of these programs is often limited to health system performance indicators and clinical or functional outcomes for patients, all at the level of the individual. Outcomes are rarely measured at the health system level, and not at all at the population or community level. This review has identified a need for development of chronic care programs and related research that focus on population health or community impacts. An additional gap was found in the measurement of outcomes for caregivers, which is particularly relevant for programs that care for older persons with chronic illness, who frequently require support of family members or friends.
The CCM was developed to guide comprehensive system change [8, 29]; the ECCM  suggested an even broader scope. The World Health Organization’s adaptation of the CCM placed increased emphasis on its community and policy aspects . Using the robust methods of a systematic review , we wished to explore whether the comprehensive aims of these models have been realized in their application and evaluation.
This and other recent reviews  have found that few studies of chronic care programs have addressed the community or policy components of these models. We believe this paper points to the need for more comprehensive chronic care prevention and management efforts. Similarly, there is a need for future efforts to support greater collaboration and integration across community and health system sectors, recognizing that this will come with significant challenges .
With more comprehensive approaches to intervention comes a need for more comprehensive approaches to evaluation and outcome measurement, which is another important implication of this paper. Advancement of chronic care research would benefit from more consistent frameworks and methods for outcome assessment. Work in other contexts may provide useful models to guide these efforts. Examples include the TOPICS-MDS initiative in the Netherlands to support consistent collection and sharing of data for research on health care of older persons , work of the OMERACT group related to rheumatology clinical trials , and efforts to identify consistent health outcome measures for older persons with multiple chronic conditions . The monitoring and evaluation of coordinated, cross-system efforts would also benefit from consistent clinical information systems . A consistent set of measures that could address outcomes at the health system, community and population levels would be of great value for future research.
Given the growing global burden of chronic disease, especially among a growing population of older persons [29, 38], we hope that our review will provide added impetus for more comprehensive prevention and management efforts, and more consistent approaches to their evaluation.
Chronic care model
Expanded chronic care model
Activities of daily living
Instrumental activities of daily living
van der Vlegel-Brouwer W. Integrated healthcare for chronically ill. Reflections on the gap between science and practice and how to bridge the gap. Int J Integr Care. 2013;13:e019.
Wagner EH, Austin BT, Von Korff M. Organizing care for patients with chronic illness. Milbank Q. 1996;74(4):511–44.
Barr VJ, Robinson S, Marin-Link B, Underhill L, Dotts A, Ravensdale D, et al. The expanded chronic care model: an integration of concepts and strategies from population health promotion and the chronic care model. Hosp Q. 2003;7(1):73–82.
Zwar N, Harris M, Griffiths R, Roland M, Dennis S, Powell Davies G, et al. A systematic review of chronic disease management. Sydney, AU: Research Centre for Primary Health Care and Equity, School of Public Health and Community Medicine, University of New South Wale; 2006.
Coleman K, Austin BT, Brach C, Wagner EH. Evidence on the chronic care model in the new millennium. Health Affair. 2009;28(1):75–85.
Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness: The Chronic Care Model, part 2. JAMA-J Am Med Assoc. 2002;288(15):1909–14.
Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA-J Am Med Assoc. 2002;288(14):1775–9.
Wagner EH. Chronic disease management:What will it take to improve care for chronic illness? Eff Clin Pract. 1998;1(1):2–4.
Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: Translating evidence into action. Health Affair. 2001;20(6):64–78.
De Bruin SR, Versnel N, Lemmens LC, Molema CCM, Schellevis FG, Nijpels G, et al. Comprehensive care programs for patients with multiple chronic conditions: A systematic literature review. Health Policy. 2012;107(2–3):108–45.
Stock R, Mahoney ER, Reece D, Cesario L. Developing a senior healthcare practice using the chronic care model: Effect on physical function and health-related quality of life. J Am Geriatr Soc. 2008;56(7):1342–8.
Stijnen MMN, Duimel-Peeters IGP, Jansen MWJ, Vrijhoef HJM. Early detection of health problems in potentially frail community-dwelling older people by general practices--project [G]OLD: Design of a longitudinal, quasi-experimental study. BMC Geriatr. 2013;13:7.
Spoorenberg SLW, Uittenbroek RJ, Middel B, Kremer BPH, Reijneveld SA, Wynia K. Embrace, a model for integrated elderly care: Study protocol of a randomized controlled trial on the effectiveness regarding patient outcomes, service use, costs, and quality of care. BMC Geriatr. 2013;13:62.
Cramm JM, Adams SA, Walters BH, Tsiachristas A, Bal R, Huijsman R, et al. The role of disease management programs in the health behavior of chronically ill patients. Patient Educ Couns. 2014;95(1):137–42.
Stock R, Reece D, Cesario L. Developing a comprehensive interdisciplinary senior healthcare practice. J Am Geriatr Soc. 2004;52(12):2128–33.
Boult C, Reider L, Frey K, Leff B, Boyd CM, Wolff JL, et al. Early effects of “Guided Care” on the quality of health care for multimorbid older persons : A cluster randomized controlled trial. J Gerontol A Biol Sci Med Sci. 2008;63A(3):321–7.
Muntinga ME, Hoogendijk EO, van Leeuwen KM, van Hout HPJ, Twisk JWR, van der Horst HE, et al. Implementing the Chronic Care Model for frail older adults in the Netherlands: Study protocol of ACT (frail older adults: care in transition). BMC Geriatr. 2012;12:19.
Allen KR, Hazelett DOSE, Jarjoura MSD, Wright K, Fosnight SM, Kropp BDJ, et al. The after discharge care management of low income theoretical framework and study design. Popul Health Manag. 2011;14(3):137–42.
Béland F, Bergman H, Lebel P, Dallaire L, Fletcher J, Tousignant P, et al. Integrated services for frail elders (SIPA): A trial of a model for Canada. Can J Aging. 2006;25(01):25–42.
Schraeder C, Fraser CW, Clark I, Long B, Shelton P, Waldschmidt V, et al. Evaluation of a primary care nurse case management intervention for chronically ill community dwelling older people. J Clin Nurs. 2008;17(11c):407–17.
Frølich A, Host D, Schnor H, Norgaard A, Ravn-Jensen C, Borg E, et al. Integration of healthcare rehabilitation in chronic conditions. Int J Integr Care. 2010;10:e033.
Allen KR, Hazelett SE, Radwany S, Ertle D, Fosnight SM, Moore PS. The Promoting Effective Advance Care for Elders (PEACE) randomized pilot study: Theoretical framework and study design. Popul Health Manag. 2012;15(2):71–7.
Caruso LB, Clough-Gorr KM, Silliman RA. Improving quality of care for urban older people with diabetes mellitus and cardiovascular disease. J Am Geriatr Soc. 2007;55(10):1656–62.
Boyd CM, Shadmi E, Conwell LJ, Griswold M, Leff B, Brager R, et al. A pilot test of the effect of guided care on the quality of primary care experiences for multimorbid older adults. J Gen Intern Med. 2008;23(5):536–42.
Stolee P. Measuring outcomes of multidimensional interventions. In: Fillit HM, Rockwood K, Woodhouse K, editors. Brocklehurst’s Textbook of Geriatric Medicine and Gerontology. 7th ed. Philadelphia, PA: Saunders Elsevier; 2010. p. 245–71.
Hirdes JP. Addressing the health needs of frail elderly people: Ontario’s experience with an integrated health information system. Age Ageing. 2006;35(4):329–31.
Valentijn PP, Schepman SM, Opheij W, Bruijnzeels MA. Understanding integrated care: A comprehensive conceptual framework based on the integrative functions of primary care. Int J Integr Care. 2013;13:e010.
Martin-Misener R, Valaitis R, Wong ST, Macdonald M, Meagher-Stewart D, Kaczorowski J, et al. A scoping review of collaboration between primary care and public health. Prim Health Care Res Dev. 2012;13:327–46.
Nolte E, McKee M. Integration and chronic care: A review. In: Nolte E, McKee M, editors. Caring for People with Chronic Conditions: A Health System Perspective. Berkshire, England: McGraw-Hill Open University Press; 2008. p. 64–91.
Epping-Jordan J, Pruitt S, Bengoa R, Wagner E. Improving the quality of health care for chronic conditions. Qual Saf Health Care. 2004;13(4):299–305.
Mulrow C. Rationale for systematic reviews. BMJ. 1994;309:597–9.
Stellefson M, Dipnarine K, Stopka C. The Chronic Care Model and diabetes management in US primary care settings: A systematic review. Prev Chronic Dis. 2013;10:120180.
Ciliska D, Ehrlich A, DeGuzman A. Public health and primary care: Challenges and strategies for collaboration. 2005. http://www.health.gov.on.ca/en/common/ministry/publications/reports/capacity_review06/phealth_pcare.pdf. Accessed 28 July 2015.
Lutomski JE, Baars MAE, Schalk BWM, Boter H, Buurman BM, den Elzen WPJ, et al. The development of the Older Persons and Informal Caregivers Survey Minimum Dataset (TOPICS-MDS): A large-scale data sharing initiative. PLoS One. 2013. doi:10.1371/journal.pone.0081673.
Boers M, Idserda L, Kirwan JR, Beaton D, Escorpizo R, Boonen A, et al. Toward a generalized framework of core measurement areas in clinical trials: A position paper for OMERACT II. J Rheumatol. 2014;41:978–85.
Working group on health outcomes for older persons with multiple chronic conditions. Universal health outcomes measures for older persons with multiple chronic conditions. J Am Geriatr Soc. 2013;60:2333–41.
Gray LC, Berg K, Fries BE, Henrard J, Hirdes JP, Steel K, et al. Sharing clinical information across care settings: The birth of an integrated assessment system. BMC Health Serv Res. 2009;9:71.
World Health Organization. Innovative care for chronic conditions: building blocks for action, global report. 2002. http://www.who.int/chp/knowledge/publications/icccglobalreport.pdf. Accessed 28 July 2015.
This work was supported in part by an Emerging Team Grant (ETG 92249) from the Canadian Institutes of Health Research. We are grateful to Jackie Stapleton, Health Sciences Librarian at the University of Waterloo, for her assistance with the search strategy, and to Mudathira Kadu, for her assistance in the article selection and abstraction process.
The authors declare that they have no competing interests.
Conception and study design: PS, JW, HM, JE; literature search and data abstraction: HD, HM, JW; analysis: HD, JW, HM, JE; interpretation and drafting of paper: HD, JW, HM, JE, PS. All authors reviewed and approved the final manuscript.
About this article
Cite this article
Drouin, H., Walker, J., McNeil, H. et al. Measured outcomes of chronic care programs for older adults: a systematic review. BMC Geriatr 15, 139 (2015). https://doi.org/10.1186/s12877-015-0136-7
- Chronic care model
- Expanded chronic care model
- Chronic illness