This article has Open Peer Review reports available.
A comparative analysis of vaccine administration in urban and non-urban skilled nursing facilities
© The Author(s). 2016
Received: 28 January 2016
Accepted: 21 July 2016
Published: 29 July 2016
The U.S. population is aging at an unprecedented rate, resulting in an increased demand for skilled nursing facilities (SNFs) and long-term care. Residents of these facilities are at a high risk for pneumococcal disease or severe influenza-related illnesses and death. For these reasons, the Centers for Medicare and Medicaid Services use influenza and pneumococcal vaccination rates as a quality measure in the assessment of SNFs, as complications related to these infections increase morbidity and mortality rates.
Disparities have been reported amongst vaccination with increased rates in urban areas as compared to their non-urban counterparts. Statistical analyses were performed to compare influenza and pneumococcal vaccination in urban and non-urban SNFs to determine variables that may influence vaccination status.
Of the 15,639 nursing homes included in the study, 10,107 were in urban areas, while 5532 were considered non-urban. We found the percent of eligible and willing residents with up-to-date influenza and pneumococcal vaccinations increased with overall five-star ratings of SNFs. Somewhat paradoxically, although urban SNFs had higher mean overall five-star ratings, they showed lower rates of influenza and pneumococcal vaccination compared to non-urban SNFs. Ordinary least squares regression analysis comparing overall ratings, type of ownership, and geographic location by region yielded statistically significant results in which the overall rating, ownership-type and certificate-type favored urban SNFs (p < 0.001).
This is the first systematic and comparative analysis to use the Nursing Home Compare database to assess vaccine administration of urban and non-urban SNFs. The findings of this study may be used to encourage the development of programs to improve vaccination rates and the quality of care in these facilities.
Skilled nursing facilities (SNFs) provide continuous monitoring and medical assistance for individuals with long term healthcare needs. It is estimated that those aged 65 years and older are expected to comprise nearly 20 % of U.S. residents by 2050 . This expansion will undoubtedly result in a concurrent increase in the demand for SNFs and long-term care to satisfy the needs of the aging population.
Since November 2002, consumers have been able to access information regarding SNFs from the Centers for Medicare and Medicaid Services (CMS). This database is updated periodically, and is available via the Nursing Home Compare website . An overall Five-star Quality Rating System, determined by CMS, provides assessments of SNFs based on comprehensive ratings derived from health inspections ratings and adjusted staffing and quality measure ratings, offering a simplified way to assist consumers in making informed decisions . It remains unclear as to whether this public database provides consumers with a better understanding of the facilities they are considering . It has been found that consumers are more likely to consider matters of convenience rather than quality of clinical care received in SNFs . In addition, a recent study found very little evidence to suggest that the introduction of the Nursing Home Quality Initiative (NHQI) report card measures led to increased consumer demand or better quality for long-stay stay residents . Others have contradicted this, indicating that public reporting of these assessments resulted in little increase in consumers preferring higher-scoring facilities . Nonetheless, these are good signs that consumers are beginning to use the information provided by CMS to choose the appropriate SNF for their care.
More than 15,000 SNFs are monitored by the CMS. Among them, over 60 % are located in urban areas. For reasons related to practices and costs, one would expect there to be some differences between urban and non-urban SNFs. It has previously been found that that rurality may be associated with poorer quality care . When controlling for state and adjusting for SNF size and ownership, non-urban SNFs were less likely to earn a 4-star or higher quality rating. Additionally, not-for-profit and government-owned facilities usually earn higher ratings and provide a higher quality of care than for-profit SNFs on average . SNF size and ownership are also important factors, and are relevant to non-urban SNFs health outcomes. Other studies have suggested that differences may exist also at access, quality, and cost in urban and non-urban SNFs [10, 11]. For these reasons, it has been suggested that efforts to enhance Medicare payment approaches, training programs for staff, facility accreditation status, as well as offering special care programs could likely reduce health disparities in non-urban SNFs .
Acute respiratory illnesses due to influenza or pneumococcal pneumonia are common in individuals residing in SNFs. Among Americans aged 65 years and older, influenza accounts for more than 190,000 hospitalizations and 33,000 deaths annually, and close to 3400 deaths due to pneumonia [13, 14]. The World Health Organization (WHO) has classified pneumococcal infections, caused by Streptococcus pneumonia, as a leading cause of morbidity and mortality worldwide . It is approximated that 1.6 million people die every year from pneumococcal infections globally. Additionally, coinfection with S. pneumoniae and influenza has been observed to have a synergistic effect and increased mortality rates [16, 17]. Because individuals residing in SNFs are considered at high risk of developing complications, these diseases pose a major health concern as they are associated with increased morbidity, mortality and cost .
The Centers for Disease Control and Prevention (CDC) has recommended vaccine administration for adults aged 65 years of age and older, as well as for residents of SNFs and other long-term care facilities in an effort to reduce influenza- and pneumonia-related morbidity and mortality . Although there has been some contention regarding the effectiveness of these vaccines particularly in the elderly, there is also evidence that vaccination is an important prevention strategy and significantly reduces hospitalization and related complications [20, 21]. Despite this debate, efforts are being made by some countries to increase vaccination rates. An example of this is in the United Kingdom, where clinical governance programs have successfully increased vaccinations through audits . Canada has also suggested expanding its current vaccination program, and has recommended that it should include both residents and staff of SNFs reasoning that preventing transmission of influenza and other infectious agents within these facilities is relevant to quality of life .
The percent of long-stay residents assessed and appropriately given the seasonal influenza and pneumococcal vaccine are quality measures used in evaluating SNFs . It is important to note that it is possible for this percentage to reach as high as 100 %. This is because the vaccination status of residents reported by SNFs do not represent vaccine administration rates, but rather include the total number of residents who had an up-to-date vaccine, those who were offered and declined the vaccine, as well as residents who were ineligible due to medical contraindications. A study investigating the actual proportion of residents vaccinated with either the influenza or pneumococcal vaccine were as low as 58.5 and 34.6 %, respectively . Although an important quality indicator, vaccination rates are currently not included in the determination of the overall five-star ratings of SNFs .
Differences between urban and non-urban vaccination rates have previously been reported with lower rates in non-urban residents [27, 28]. It has been found that a multitude of factors affect administration of the seasonal influenza vaccine including healthcare-related social determinants such as knowledge and attitudes about vaccination and guidance from clinicians [27, 29]. Furthermore, individuals in non-urban locations are more dependent upon clinical settings for their influenza vaccinations . The purpose of this study was to determine if a disparity exists in vaccine administration in SNFs located in urban versus non-urban areas and to investigate the relationship between vaccination rates and independent contributors.
A researchable database was created from two sources: 2013 CMS Nursing Home Compare datasets and 2010 Census Urban and Rural Classification and Urban Area Criteria for U.S. counties by state. These were the most recently updated reports at the time of this study.
All U.S. Medicaid and Medicare SNFs were manually matched by geographic locale (urban, non-urban). The Census Bureau identifies Urbanized Areas (UAs) as 50,000 or more people and were used to determine categorize SNFs. “Rural” (non-urban), encompassed all population, housing, and territories not included within an urban area. The two databases used in this study did not report locales in the same format, spellings or abbreviations of county names. Therefore, facilities located in urban counties were determined and the remaining facilities were categorized as non-urban SNFs. There were 15,639 SNFs in the CMS Nursing Home Compare dataset; however, some had missing values so we were left with 15,509, of which 10,107 (65.2 %) were urban and 5532 (35.7 %) were non-urban.
SNFs were further separated by U.S. Regions: Northeast, Midwest, South, and West according to U.S. Census Bureau Regions and Divisions with State. Region 1 were the Northeast, New England and Middle Atlantic regions, which included 2640 (16.9 %) SNFs. Region 2 comprised the Midwest East, North Central and West North Central areas and included 5150 (32.9 %) SNFs. Region 3 was South, and included the South Atlantic, East South Central and West South Central regions with 5429 (34.7 %) SNFs. Region 4 was West and included the Mountain and Pacific regions and 2420 (15.5 %) SNFs.
All other classifications were based on provider information obtained from the CMS Nursing Home Compare dataset. Our customized database (Additional file 1) also classified SNFs by ownership-type and certificate-type. There were three types of ownership: for-profit, not-for-profit, and government-owned. Of the two certificate types, Medicare and Medicaid, SNFs qualified for either both Medicare and Medicaid (Category 0), Medicaid (Category 1) and Medicare (Category 2).
We used non-parametric Wilcoxon rank-sum test (ranksum), also known as Mann-Whitney two-sample statistics, in order to compare mean overall rating of SNFs and rates of influenza and pneumococcal vaccination. A number of preliminary tests were performed in order to test for normality and equality of populations. Skewness and kurtosis test (sktest) and Shapiro-Wilk test (swilk) rejected the null hypothesis of normally distributed data samples. In addition, Kruskal-Wallis non parametric equality of population rank test (kwallis) for testing whether samples originate from the same distribution led us to reject the hypothesis that the populations are the same. As a result independent t-tests were deemed inappropriate.
Ordinary least squares (OLS) regression models were also performed using either influenza vaccination or pneumococcal vaccination as the dependent variable and urban locales as independent variables. In addition, OLS models controlled for overall rating, as well as for geographic locale, ownership type, and certificate type, since these covariates were all associated with vaccination.
All classifications were based on provider information sections of CMS nursing home data. For all statistical analyses, alpha was set at a p value less than 0.05. Microsoft® Office Excel was used to create customized database in this study (Additional file 1). STATA/SE 13.1 was used to complete all statistical analyses performed for cases.
Ordinary least squares (OLS) regression results estimating the effect of location, ownership-type and certificate-type on vaccination rates
In this regression, the urban locale was again statistically significant and a negative sign in front of the coefficients (−2.25 for influenza and −1.45 for pneumococcal vaccination), suggesting that the rate of influenza vaccination were 2.25 percentage points lower for urban SNFs and 1.45 percentage points lower for pneumococcal vaccinations. These results hold even as we controlled for overall rating, geographic locale, type of ownership, and certificate type – variables that were all independently statistically significant in the regression. Moreover, this regression found that SNFs with only one certificate favored vaccination with the seasonal influenza vaccine compared to dual-eligible facilities. Using the Mann-Whitney test, there was a statistically significant difference (p < 0.05) between facilities with Medicaid or Medicare only; however, certificate type did not influence pneumococcal vaccination rates.
As quality measurements, vaccination rates are rarely studied. In this analysis, we showed that seasonal influenza and pneumococcal assessment and vaccination should be considered in the assessment of quality of care received in SNFs. Both urban and non-urban SNF influenza and pneumococcal vaccination rates increased relative to the overall five-star ratings. In addition, we found that overall ratings favored urban SNFs. Because urban SNFs were higher rated, one would assume they would in turn have higher vaccination rates; however, our data suggests the opposite. With access to vaccinations no longer a barrier within this clinical setting, it is possible the proportion of those vaccinated in SNFs is increased in comparison to the general public in non-urban areas .
Next, we wanted to explore factors that could potentially explain these results. We analyzed possible contributors to quality of SNFs as well as factors that could potentially influence vaccination rates using data provided by CMS. Ordinary least squares regression analysis considered the relationship between vaccinations with ownership-type, geographic location, and certificates in urban and non-urban settings. We found that ownership seemed to play an important role in this process. Government and non-profit SNFs favored vaccination. One possible explanation for this finding is that government-owned facilities may have stricter policies for vaccination assessment and administration processes. Because non-urban SNFs had more government-owned SNFs, this also may have impacted our finding that non-urban SNFs had higher influenza and pneumococcal vaccination rates but lower overall five-star ratings.
Another factor we controlled for was geographic locations. The Northeast SNFs had significantly higher vaccine rates while the South and the West seemed less likely to vaccinate their residents (data not shown). Weather conditions in the North may facilitate respiratory illnesses related to influenza and pneumococcal pneumonia. Population density may be another reason, as people living outside the Northern region may have fewer vaccinations. It is possible that racial issues may also interfere with our findings, as it has been found that individuals living in the South and West typically do not want to share their vaccination history .
Certificate-type plays a role in the financing of SNFs. Dual-eligible SNFs with certifications for both Medicare and Medicaid showed they qualify for services, perhaps even for some special procedures, which may directly reflect on their overall ratings. A study using a detailed national database of hospitalized patients discharged to SNFs found that dual-eligible patients from the same hospital were discharged to SNFs with worse quality of care compared to their Medicare-only counterparts . Our analysis showed that SNFs with only one certificate had higher rates of the seasonal influenza but not the pneumococcal vaccine. Interestingly, we also found the Medicaid-only SNFs had higher rates (p < 0.05), Medicaid is a social health care program for families and individuals with low incomes. Because vaccines are recommended for individuals aged 65 and older, SNFs with a Medicare certificate would be expected to have higher rates.
We also found that non-urban SNFs were more often owned by the government compared to urban SNFs, which also typically vaccinate more often. In addition, urban facilities were more often for-profit and are also less likely to vaccinate. One could claim that better SNFs would vaccinate more as indicated more; however, the for-profit owned facilities may not have enough incentive to vaccinate. Likewise, if the overall rating system typically and accurately corresponds to better quality SNFs, then the current rating system does not seem to be adequately rewarding non-urban SNFs for their efforts. Alternatively, it would be interesting to investigate differences in vaccination practice and conventions between urban and non-urban facilities. It has been shown that publicly reported quality measures can affect performance, and that SNFs with objectives that required considerable improvement of quality measures resulted in more favorable outcomes .
It should be noted that there were several limitations to this study. First, overall quality of SNFs is determined from many different measures. The Nursing Home Compare database includes only some of the possible factors that could be considered when assessing a characteristic such as quality of clinical care. Patient and family satisfaction and participation should also be considered and included in the data analyzed for a study such as this.
A second limitation was that the data used in this study depends to a certain extent on how well SNFs complete the minimum data set that is used to construct the Nursing Home Compare quality measures. These measures are self-reported and it is possible that some variation in ratings may be attributable to how a SNF reports data rather than actual performance. Without confirmation of these data, self-reported assessments may not be entirely accurate because they are directly related to the overall ratings of these facilities.
Finally, we used the 2010 Census Urban and Rural Classification database in this study. There is also the U.S. Department of Agriculture County Continuum Codes, which we did not use to define as urban and non-urban locations in this study. Thus, urban and non-urban definitions may slightly differ based on function and population. The data used in this study may not accurately represent urban and non-urban locations in 2013.
This is the first systematic and comparative analysis to use the Nursing Home Compare database to assess differences in vaccine administration in urban and non-urban SNFs. Ordinary least squares analysis indicated urban SNFs had a lower percent of eligible and willing residents with an up-to-date influenza and pneumococcal vaccination despite having higher overall star ratings. Our results suggest that among all variables investigated, vaccination rates were dependent on ownership-type in non-urban SNFs. In non-urban areas, there were more government-owned SNFs. It has previously been reported that consumers are most likely to make decisions regarding SNFs due to matters of convenience rather than the quality of clinical care. The results of this study can be used to encourage the development of programs to improve vaccination rates and the quality of care in these SNFs. Further research is needed to fully understand the process of vaccine administration in SNFs and how they influence the decision making process of consumers.
CDC, Centers for Disease Control and Prevention; CMS, Centers for Medicare and Medicaid Services; NHQI, Nursing Home Quality Initiative; SNF, skilled nursing facilities; WHO, World Health Organization
Availability of data and materials
• The 2013 CMS Nursing Home Compare Dataset is archived and can be found via the following link: https://data.medicare.gov/data/archives/nursing-home-compare.
• The 2010 Census Urban and Rural Classification and Urban Area Criteria for U.S. can be found via the following link: https://www.census.gov/geo/reference/ua/urban-rural-2010.html.
• The customized database used in this study is available as an XLS file as a Additional file 1.
YP conceived the study. VD and ALG participated in the design of the study. YP and VD performed the statistical analysis. YP and ALG drafted the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The data used in this study were within the public domain and available via CMS. As stated in the privacy protection act “CMS is obligated by the federal Privacy Act, 5 U.s.C. Section. 552a and the HIPAA Privacy Rule, 45 C.F.R Parts 160 and 164, to protect the privacy of individual beneficiaries and other persons. Public data files consist of aggregated data that do not permit direct identification of individuals.” Thus, this study was performed using non-identifiable data files and excluded person-specific information and was not considered research using human participants. Works of the U.S. Government are in the public domain and permission is not required to reuse them. For more information please see the following link: https://data.medicare.gov/about.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Ortman JM, Velkoff VA, Hogan H. An Aging Nation: The Older Population in the United States. 2014. Retrieved November 10, 2015 from http://www.census.gov/content/dam/Census/library/publications/2014/demo/p25-1140.pdf
- Medicare.gov Nursing Home Compare. Retrieved January 15, 2016. n.d.; from https://www.medicare.gov/nursinghomecompare/search.html.
- Parenteau MA. Informing consumers through simplified nursing home evaluations. J Leg Med. 2009;30:545–62.View ArticlePubMedGoogle Scholar
- Werner RM, Norton EC, Konetzka RT, Polsky D. Do consumers respond to publicly reported quality information? Evidence from nursing homes. J Health Econ. 2012;31:50–61.View ArticlePubMedGoogle Scholar
- Pesis-Katz I, Phelps CE, Temkin-Greener H, Spector WD, Veazie P, Mukamel DB. Making difficult decisions: the role of quality of care in choosing a nursing home. Am J Public Health. 2013;103(5):pe31.View ArticleGoogle Scholar
- Mukamel DB, Weimer DL, Spector WD, Ladd H, Zinn JS. Publication of quality report cards and trends in reported quality measures in nursing homes. Health Serv Res. 2008;43:1244–62.View ArticlePubMedPubMed CentralGoogle Scholar
- Williams A, Straker JK, Applebaum R. The nursing home five star rating: how does it compare to resident and family views of care? Gerontologist. 2014;2:234–42.Google Scholar
- Lutfiyya MN, Gessert CE, Lipsky MS. Nursing home quality: a comparative analysis using CMS Nursing Home Compare data to examine differences between rural and nonrural facilities. J Am Med Dir Assoc. 2013;14:593–8.View ArticlePubMedGoogle Scholar
- Hillmer MP, Wodchis WP, Gill SS, Anderson GM, Rochon PA. Nursing home profit status and quality of care: Is there any evidence of an association? Med Care Res Rev. 2005;62:139–66.View ArticlePubMedGoogle Scholar
- Troyer JL, Sause W. Association between traditional nursing home quality measures and two sources of nursing home complaints. Health Serv Res. 2013;48:1256–78.View ArticlePubMedGoogle Scholar
- Werner RM, Konetzka RT, Polsky D. The effect of pay for performance in nursing homes: evidence from state medicaid programs. Health Serv Res. 2013;48:1393–414.View ArticlePubMedPubMed CentralGoogle Scholar
- Kang Y, Meng H, Miller NA. Rurality and nursing home quality: evidence from the 2004 National nursing home survey. Gerontologist. 2011;6:761–73.View ArticleGoogle Scholar
- Thompson WW, Shay DK, Weintraub E, Brammer L, Bridges CB, Cox NJ, Fukuda K. Influenza-associated hospitalizations in the United States. J Am Med Assoc. 2004;292:1333–40.View ArticleGoogle Scholar
- Thompson WW, Shay DK, Weintraub E, Brammer L, Cox N, Anderson LJ, Fukuda K. Mortality associated with influenza and respiratory syncytial virus in the United States. J Am Med Assoc. 2003;289:179–86.View ArticleGoogle Scholar
- Robinson KA, Baughman W, Rothrock G, Barrett NL, Pass M, Lexau C, Damaske B, Stefonek K, Barnes B, Patterson J, Zell ER, Schuchat A, Whitney CG. Epidemiology of invasive Streptococcus pneumoniae infections in the United States, 1995–1998: opportunities for prevention in the conjugate vaccine era. J Am Med Assoc. 2001;285:1729–35.View ArticleGoogle Scholar
- Palacios G, Hornig M, Cisterna D, Savji N, Bussetti AV, Kapoor V, Hui J, Tokarz R, Briese T, Baumeister E, Lipkin WI. Streptococcus pneumoniae coinfection is correlated with the severity of H1N1 pandemic influenza. PLoS One. 2009;4(12):e8540.View ArticlePubMedPubMed CentralGoogle Scholar
- Morens DM, Taubenberger JK, Fauci AS. Predominant role of bacterial pneumonia as a cause of death in pandemic influenza: implications for pandemic influenza preparedness. J Infect Dis. 2008;198:962–70.View ArticlePubMedPubMed CentralGoogle Scholar
- Pop-Vicas A, Rahman M, Gozalo PL, Gravenstein S, Mor V. Estimating the effect of influenza vaccination on nursing Home Residents’ Morbidity and Mortality. J Am Geriatr Soc. 2015;63:1798–804.View ArticlePubMedPubMed CentralGoogle Scholar
- Vaccination: who should do it, who should not and who should take precautions. 2015; Retrieved December 25, 2015 from http://www.cdc.gov/flu/protect/whoshouldvax.htm#annual-vaccination
- Lee BY, Ercius AK, Smith KJ. A predictive model of the economic effects of an influenza vaccine adjuvant for the older adult (age 65 and over) population. Vaccine. 2009;27:2251–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Pitsiou GG, Kioumis IP. Pneumococcal vaccination in adults: does it really work? Respir Med. 2011;105:1776–83.View ArticlePubMedGoogle Scholar
- Siriwardena AN, Wilburn T, Hazelwood L. Increasing influenza and pneumococcal vaccination rates in high risk groups in one primary care trust as part of a clinical governance programme. Clin Governance. 2003;8:200–7.View ArticleGoogle Scholar
- Stevenson CG, McArthur MA, Naus M, Abraham E, McGeer AJ. Prevention of influenza and pneumococcal pneumonia in Canadian long-term care facilities: How are we doing? Can Med Assoc J. 2001;164:1413–9.Google Scholar
- MDS 3.0 Quality Measures User’s Manual. 2016; Retrieved October 5, 2015 from https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-instruments/NursingHomeQualityInits/NHQIQualityMeasures.html
- Looijmans-Van Den Akker I, Van Delden JJM, Verheij TJ, Van Essen GA, Van der Sande MAB, Hulscher ME, Hak E. Which determinants should be targeted to increase influenza vaccination uptake among health care workers in nursing homes? Vaccine. 2009;27:4724–30.View ArticlePubMedGoogle Scholar
- Design for Nursing Home Compare Five-Star Quality Rating System: Technical Users’ Guide. 2015; Retrieved September 28, 2015 from https://www.cms.gov/Medicare/Provider-Enrollment-and-Certification/CertificationandComplianc/Downloads/usersguide.pdf.
- Li Y, Mukamel DB. Racial disparities in receipt of influenza and pneumococcus vaccinations among US nursing-home residents. Am J Public Health. 2010;100:S256–62.View ArticlePubMedPubMed CentralGoogle Scholar
- Bennett KJ, Pumkam C, Probst JC. Rural–urban differences in the location of influenza vaccine administration. Vaccine. 2011;29:5970–7.View ArticlePubMedGoogle Scholar
- Mieczkowski TA, Wilson SA. Adult pneumococcal vaccination: a review of physician and patient barriers. Vaccine. 2002;20:1383–92.View ArticlePubMedGoogle Scholar
- Rahman M, Grabowski DC, Gozalo PL, Thomas KS, Mor V. Are dual eligibles admitted to poorer quality skilled nursing facilities? Health Serv Res. 2014;49:798–817.View ArticlePubMedGoogle Scholar
- Baier R, Butterfield K, Patry G, Harris Y, Gravenstein S. Identifying star performers: the relationship between ambitious targets and nursing home quality improvement. J Am Geriatr Soc. 2009;57:1498–503.View ArticlePubMedGoogle Scholar