- Open Access
Assessing equity and quality indicators for older people – Adaptation and validation of the Assessing Care of Vulnerable Elders (ACOVE) checklist for the Portuguese care context
BMC Geriatrics volume 22, Article number: 561 (2022)
Development has promoted longer and healthier lives, but the rise in the proportion of older adults poses new challenges to health systems. Susceptibilities of older persons resulting from lower knowledge about services availability, health illiteracy, lower income, higher mental decline, or physical limitations need to be identified and monitored to assure the equity and quality of health care. The aim of this study was to develop equity indicators for the Assessing Care of Vulnerable Elders (ACOVE)-3 checklist and perform the first cross-cultural adaptation and validation of this checklist into Portuguese.
A scoping literature review of determinants or indicators of health (in)equity in the care of older people was performed. A total of 5 language experts and 18 health professionals were involved in the development and validation of the equity and quality indicators through expert opinion and focus groups. Data collected from focus groups was analyzed through directed or conventional content analysis. The usefulness of the indicators was assessed by analyzing the clinical records of 30 patients.
The literature review revealed that there was a worldwide gap concerning equity indicators for older people primary health care. A structured and complete checklist composed of equity and quality indicators was obtained, validated and assessed. A significant number of non-screened quality or equity related potential occurrences that could have been avoided if the proposed indicators were implemented were detected. The percentage of non-registered indicators was 76.6% for quality and 96.7% for equity.
Applying the proposed checklist will contribute to improve the monitoring of the clinical situation of vulnerable older people and the planning of medical and social actions directed at this group.
Further gains in average population health require that health equity is improved [1, 2]. The quality of care provided in an equitable health care system is independent of personal characteristics such as gender, ethnicity, geographic location or socio-economic status . Health care equity entails equal access to and utilization of available care for equal need, and equal quality of care for all . Since health inequalities are potentially avoidable , they should be a priority for policy makers and health managers.
A vulnerable older person (i.e., an older adult who is at risk of functional decline or death in a period of two years ) may be exposed to situations of inequity due to ageism [6, 7], social isolation and loneliness , higher mental decline, or physical limitations. Frequently, older adults accumulate other conditions that may be factors of inequity (such as, lower education levels, lower health literacy, and lower income) or increase the complexity of care (namely, multimorbidity and the associated polymedication, and geriatric syndromes). As the population structure changes and, especially in developed countries, the proportion of adults aged 65 or over rises [9, 10], the equity and quality of health services provided to vulnerable older adults should be monitored and assured. In a primary health care (PHC) standard consultation, managing the care of vulnerable older adults can be challenging, given their care needs and the limited time for each visit. Health care workers are often unprepared to effectively manage the health care needs of older adults; thus, concerted and sustained efforts of academic leaders and health professional groups directed at improving education and training are needed . The availability of equity and quality indicators (EQI) focused on vulnerable older people that can guide health professionals is of special importance in this context.
The existence of quality indicators (QI) is an essential prerequisite to monitor, compare and improve the level of effectiveness and efficiency of health systems . Several studies have addressed QI for specific issues related with vulnerable older persons: falls and mobility problems , hearing loss , pain management , medication , and undernutrition . QI are already well established in national health systems [12, 18], but those related to vulnerable older adults are relatively new and require more time to be widely adopted. E.g., in Portugal, the 365 existing quality indicators for PHC  only include four indicators concerning the quality of health care for older adults. In 2000, RAND Health Care researchers released the first set of quality measures specifically developed for vulnerable older persons, the Assessing Care of Vulnerable Elders (ACOVE) project . The initial ACOVE quality indicators covered 22 specific conditions of continuity and coordination of care for older people and were developed based on the literature and its authors’ expertise . In ACOVE-3 , more clinical conditions were included. Several studies  have highlighted ACOVE  for its broad set of quality indicators. Its structure comprises an extensive variety of clinical conditions, suitable to measure the quality of care provided to vulnerable older adults [12, 24]. This instrument has been recognized by the scientific and health communities (namely, by WHO) for its reliability in the evaluation and definition of practical interventions.
On the other hand, monitoring of equity in health care is in its infancy and remains isolated from mainstream quality assurance . In a literature review, Burkett et al.  compared quality indicators for older people care in emergency departments and concluded that ACOVE-3  was one of the few quality instruments that comprehensively considered five of the six Health Care Quality dimensions proposed by the American Institute of Medicine : aiming at safe, effective, patient-centered, timely, efficient health care. The sixth – equitable health care – had not been considered in any quality instrument . To our best knowledge, until this study, this lack had not been fulfilled.
The objectives of the research were: a) to develop a set of equity indicators (EI) for ACOVE-3 to be used by PHC providers, contributing to the improvement of health care to vulnerable older adults; b) to undertake the first cross-cultural adaptation and validation of ACOVE-3 into Portuguese; c) to assess the validity of the developed EQI and if they would be well accepted by health professionals. The study focused in PHC, the most cost-effective way of providing accessible care to chronic conditions and multimorbidity [28, 29].
The research followed a sequential research design that included: Phase 1) a literature review to understand the state-of-the art concerning the development of equity indicators for PHC of vulnerable older persons; Phase 2) a cross-cultural adaptation of ACOVE-3 to Portuguese, and Phase 3) the assessment of the validity and acceptance of the proposed EQI using expert opinions and focus groups. Table 1 presents an overview of the activities performed to develop the EQI checklist (detailed in the next subsections), and Additional file 1 describes the experts and focus groups participants, and the research tasks they were involved in.
A scoping review of the literature published from 2016 to 2020 following PRISMA  and JBI’s Population (or participants), Concept, Context (PCC)  guidelines aimed at answering the question What equity indicators are available for health care of older adults? was performed in order to identify indicators suited for primary health care settings. The concept of interest was equity indicators or determinants, and the context was health care of older adults . (Studies that did not concern PHC were eligible because excluding them would be too limitative.) Then, the inclusion criteria were: focusing on health equity; in the care older people; and identifying determinants or indicators of health (in)equity. Only original research was considered.
PubMed, Medline, and Web of Science were searched for ("healthcare" OR “health care” OR "primary health care") AND ("older people" OR "older person*" OR "older adult*" OR "elder*") AND "equity" AND "indicators" in titles or abstracts. Only documents written in English were considered. After duplicates were removed, the abstracts of the remaining studies were read and their full texts were skimmed in order to select a final set of studies that were fully and carefully read.
The purpose of the scoping review was merely descriptive and the analysis consisted on registering, for each article in the dataset, the equity dimensions and the equity determinants or indicators identified and if they were related to PHC or older adults in data extraction table.
A cross-cultural adaptation of an assessment instrument involves the development of versions that are equivalent to the original but simultaneously linguistically and culturally adapted to the new specific context. ACOVE-3 instrument has twenty-six clinical conditions, but only twelve (identified as conditions of vulnerability of older adults) were considered in the adapted and translated instrument, since they: a) were not included in the National Health Program for the older people already implemented in the Portugal ; and b) can be used in PHC . The clinical conditions considered were: continuity and coordination of care, dementia, depression, falls and mobility problems, hearing loss, medication use, pressure ulcers, screening and prevention, sleep disorders, malnutrition, urinary incontinence, and vision.
The ACOVE-3 checklist was translated into Portuguese following the Guidelines for Cross-Cultural Adaptation Process of Beaton et al. , a widely recognized and validated iterative method (Table 1). This process requires a review by an expert committee (that assures semantic, idiomatic, experiential, and conceptual equivalences). In this study, the committee was composed by six experts (Additional file 1): a) one specialized in the translation of data collection instruments in the clinical area, native in Portuguese (P1) that translated the English version into Portuguese; b) three experts in health care (P2, P3, P4); and c) two experts in applied language (P5, P6) that independently performed the backward translation (in a first moment, blinded to the original English version). The EI (in Portuguese) were incorporated into the ACOVE-3 checklist after expert P1 translated it from English to Portuguese. The experts were invited to make comments about their understanding of each item and its relevance, both on a personal and a cultural level, and made suggestions about items or terms they considered difficult to understand, offensive, redundant, or inappropriate.
The health care experts (P2, P3 and P4) assessed each of the 170 EQI (139 ACOVE-3 QI and 31 EI) by scoring it in terms of language understandability, syntax, and semantics using the 4-point Likert scale: 1—Unclear, 2—Slightly unclear, 3—Quite clear, 4—Extremely clear; and in terms of content relevance, using the scale: 1 – Not relevant, 2—Slightly relevant, 3—Quite relevant, 4—Extremely relevant. These scales are similar to those proposed by Hambleton et al.  and frequently used in healthcare. The index of content validity (CVI), the most widely reported measure of content validity, specifically the Average Scale-level-CVI (S-CVI/Ave) and the Universal Agreement Scale-level-CVI (S-CVI/UA) , were calculated using the responses. Face and content validity  were confirmed at this stage. It was considered that a S-CVI/Ave ≥ 0.9 and S-CVI/UA ≥ 0.8 meant excellent content validity.
The health care experts were asked to suggest changes that would improve language understandability or EQI content relevance whenever they assigned a score lower than 3 to an indicator. For an indicator to be accepted and become part of the EQI instrument, at a first stage, it was required that at least two of the three experts gave it a score of 3 or 4. In case of a rejection, a detailed analysis of the indicator was performed and, after considering the experts’ feedback, a second round took place to see if consensus concerning its relevance, understandability and meaning was reached. In that case, the indicator was included; otherwise, it was definitely excluded. At the end of the process, the definitive list of EQI in Portuguese was obtained.
Next, expert P5 translated the 139 QI from the ACOVE-3 checklist back into English. The applied languages experts (P6, P7) were asked to assess these QI (in English) concerning their semantics, using a 4-point concordance scale: 1 – Strongly disagree, 2—Disagree, 3—Agree, 4 – Strongly agree to state if they agreed that the retranslated version corresponded to the original one. Whenever the concordance score given to a QI was 1 or 2, the expert was asked to explain why. Experts were also asked to report issues related to the similarity between the versions.
EQI validity, acceptance and usefulness assessment
The validity of the EQI instrument—i.e., its ability to measure what it is supposed to measure  was assessed in terms of its face validity (ability to be understandable and relevant for the targeted population [36, 38]), content validity (ability to reflect the domain of interest and the conceptual definition of the involved constructs [36, 37, 39]), and responsiveness (ability to detect change when a patient health status improves or deteriorates [36, 37]). This validation was performed during and after the cross-cultural adaptation (phases 2 and 3, Table 1).
Health care experts P2, P3, and P4 analyzed the understandability (syntax and semantics), the conceptual validity and relevance of the Portuguese version of the EQI (face and content validity). Applied languages experts P6, and P7 analyzed the semantic equivalence (detection of translation errors related with meaning) of the of the retranslated ACOVE-3 (in English) by comparing it to the original version of the instrument.
The focus groups were used to gain a deeper understanding of the fundamentals, processes and contexts that shape patients' interactions with health care professionals . These meetings were hosted to elicit and analyze past experiences and views of the health care professionals in order to: a) discuss, identify, and validate EI that uncover inequities in the access of vulnerable older people to health care; b) determine a comprehensive list of standard terms to register inequities during health care consultations; and c) obtain health care professionals’ perceptions about the usefulness of the EQI checklist.
The focus groups qualitative content analysis comprised the phases of preparation, organization, and reporting . Preparation involved defining the samples; deciding on the type of content analysis—directed for FG1 and FG2, and conventional for FG3 and FG4 ; preparing the discussion guides; and deciding how to collect data and the unit of analysis. The fifteen participants in the four focus groups (Additional file 1) were selected through purposeful sampling aimed at gathering PHC professionals that provided care to vulnerable older people. All the participants were from Minho, a region in the North of Portugal. The discussion guide of FG2 was composed of targeted questions, the guides for FG1, FG3, and FG4 of open-ended questions.
The discussions lasted around one hour, occurred in the PHC center, and were audio-recorded with the formal consent of all participants; records were then transcribed. Each meeting started with the moderator presenting the purpose of the focus group. Following, the participants interacted by departing from previous opinions, which resulted in a gradual co-construction of a consensual narrative. The topics of discussion were gradually introduced by the moderator that recalled to prior findings as needed. The moderator also intervened to: a) refocus the discussion on the theme; and b) reinforce and synthetize the contributions of the participants. Participants’ views were grounded in the context of everyday situations and reflected their lived experiences.
FG1 discussed the importance of EI complementary to QI. The discussion evolved around the equity concept, the dimensions considered to identify situations of inequity, and eventual difficulties in the application of the EI. FG2 started with the presentation of a list of descriptors to be used in the context of a consultation to identify situations of inequity in every equity dimension (derived from findings of the literature review). Next, there was a debate to confirm (refute) each descriptor and complete the list. Data collected in these two focus groups was explored through directed content analysis (that uses prior research to identify key concepts or variables as initial coding categories)  because equity is a topic that can be prone to biased or emotional opinions. The categories used for the equity concept, the dimensions of access equity, and the implications for health resulting from key variables were obtained in recent studies [5, 25, 43]
Looking at ACOVE-3 as the reference, FG3 and FG4 discussed the following topics: what are the clinical conditions of vulnerability; and what are the limitations of the QI used in older people health care management at the time of the study (PNSPIFootnote 1); are the EQI understandable and relevant; what are the (dis)advantages of the proposed EQI; and what will be the difficulties of applying the instrument in practice. To analyze the information generated in these focus groups, since the participants were experienced in quality indicators, conventional content analysis (that lets categories flow from the data)  was used so that a wide variety of opinions around the discussed themes was obtained. These two focus groups also discussed EQI responsiveness and acceptance (i.e., the extent to which people delivering or receiving a health care intervention consider it to be appropriate, based on anticipated or experienced cognitive and emotional responses to the intervention ).
In the organization phase, a set of rules for coding was developed (e.g., for the Equity category, all phrases related with defining or difficulties in defining equity should be coded under the subcategory concept). The unit of analysis was the record transcription. Given the low abstraction levels required to: 1) link raw data to predetermined categories, in the case of FG1 and FG2, or 2) group and categorize phrases according to their meanings, similarities and differences, in the case of FG3 and FG4, these processes were relatively simple. The discussion of the equity concept was the exception. In the analysis of transcripts of FG1 and FG2, doubtful categorizations were discussed among the research team. In the case of FG3 and FG4, categories emerged well differentiated from the transcripts and situations of doubt were rare. Coding was double checked.
To explore the usefulness of the EQI—i.e., the ability of the instrument to help the health professional(s) during the consultation, a set of 30 past clinical records was analyzed. Clinical records that fulfilled the following inclusion criteria were randomly selected: a) age of patient > 65 years, b) vulnerable patient (at risk of functional decline or death in two years) according to the frailty criteria of , and c) regular and current user of the PHC center. Around 60% of the selected patients were women; patients were, on average, 73 years old; around 93% did not comply with active life (good nutrition, exercise) recommendations; only around 7% had low risk of falls, 80% understood medication prescriptions (doses and purpose); around 17% consumed alcohol occasionally, one third of the men were alcohol dependent. The clinical record of each patient was analyzed back until when the patient completed 65 years relatively to each EQI, using a verification table built for the purpose. The analysis was made by the first author, who holds a Bachelor of Science in Nursing, a Master of Science in Management and has worked in PHC for several years, and involved looking for registries concerning the sequential follow-up of occurrences as recommended in the EQI and their dichotomous classification as registered or not registered (e.g., if at given moment a patient was diagnosed with a medical condition that needed subsequent actions, and the medical record did not contain information about such actions in the appropriate period of time, the EQI at stake was considered as non-registered). The comparison between real past health care actions and the desirable actions guided by the EQI provided some hints about the potential health gains that could have been obtained by using the EQI, i.e., the usefulness of the instrument.
Knowledge about inequities in health care use of specific groups remains scarce . Following the database search, after duplicates were removed, the abstracts of 118 retrieved studies were read and their full text was skimmed. Four papers were added to the retrieved studies due to their relevance for the study (these documents were identified in the references’ list of read articles). Nineteen studies met the inclusion criteria. A flow-chart of the study selection process is available in Additional file 2.
In Table 2, a summary of the 19 reviewed studies is presented. Most of the studies have been directed at only one dimension of equity and considered a limited number of determinants of health (in)equity. Wong et al.  was an exception: the study developed a set of EI for the Canadian PHC services considering four dimensions (Inequity-responsive care; Culturally-safe care; Trauma/violence-informed care; and Contextually-tailored care) and 17 indicators.
Based on the determinants or indicators of health (in)equity identified in the literature (Table 2) and on Equity-Oriented Health Care (EOHC) orientations , a list of equity standard descriptors for PHC of older adults organized into domains was discussed in FG2 and, as a result, 27 standard descriptors for the 5 equity dimensions (Table 3) were obtained.
Since no comprehensive set of EI that could be incorporated into the ACOVE-3 structure was identified, the five equity dimensions considered to develop the EI (Additional file 3)—Availability, Accessibility, Cost (Affordability), Quality, and Acceptability—were based on the work of Furtado and Pereira  and Obrist et al. . Acceptability assesses whether the provision of health care suits the users' needs and expectations [65, 66]. Quality refers to the patient’s or caregiver’s judgment about the quality of care, which may possibly be influenced by past experiences or the reputation of the health care organization, being more related to the user’s perceptions about adequacy, safety, trust, outcomes, and experience (that is, user satisfaction) than to the technical aspects of health care quality (e.g., diagnosis accuracy) [65, 66]. Affordability (costs) considers if the prices of services for the users fit their income and ability to pay and includes directs cost of purchasing the care, such as the non-reimbursed part of a drug, but also the cost of transport to the health care site or costs of waiting for care appointments [65, 66]. Availability is the existence of an adequate portfolio of health care services [65, 66].
EQI validity and acceptance assessment
The final EQI instrument is composed by QI for twelve clinical conditions and EI for the five equity dimensions aimed at ten of the clinical conditions (in the EQI assessment phase – FG3, it was determined that, for urinary incontinence and screening and prevention, no EI should be included because the intention was to monitor access equity and all care related to these conditions would take place at the PHC center not involving referrals). Additional file 3 shows the complete set of EI; the definitive version of the instrument, in Portuguese, is available hereFootnote 2. An example of an EI is:
“IF pharmacological therapy is prescribed to the Vulnerable Elder and the patient has not started it, THEN the health professional must choose the cause from the following:
unavailability of the drug (specify the reason);
geographical /physical inaccessibility;
unaffordable costs to be incurred (specify which);
lack of quality associated with the process (professional service, schedules);
refusal of the user /caregiver (therapy does not correspond to her/his expectations)”.
In Table 3, a list of suggested standard descriptors for most usual inequity situations is provided. These descriptors were derived from the EOHC  and validated and completed by FG2.
Relatively to the EQI, the analysis by the health care experts (P2, P3, P4) led to a total consensus in terms of face validity (score average of 4). In terms of content validity of the QI, there was an initial rejection of 12% of the QI by expert P2 (score average of 3.61), 1% by P3 (score average of 3.96) and 4% by P4 (score average of 3.91). Concerning the content validity of the EI, there was an initial rejection of 11% of the indicators by P2 (score average of 3.57), and of 5% by P4 (score average of 3,89) occurs. P3 did not reject any indicator (score average of 4). Following the suggestions of these experts, the text of the problematic EQI was changed and, in a new round, only 2% of the indicators were rejected: 4 QI of the clinical condition Depression, and 2 EI related with Medication Use. The results relative to the EI were S-CVI/Ave of 0.89 for P2, 1.00 for P3, and 0.95 for P4. In relation to the QI, the S-CVI/Ave was 0.88 for P2, 0.99 for P3, and 0.96 for P4. In terms of S-CVI/UA, the results were 0.83 (23 of 139 indicators were rejected) for QI, and 0.84 (5 of 31 indicators were rejected) for EI. Twenty-three out of 139 QI were rejected (20 due to item CVI of 0.67, and 3 with item CVI of 0.33); the same happened to 5 out of 31 EI (4 with item CVI of 0.67 and 1 with item CVI 0.33).
When the language experts (P6, P7) analyzed the QI concerning possible meaning variability in the back-translated version, all QI were accepted without need for further adjustments (score average = 4).
The categories used for or derived from the qualitative data analysis of the information collected through focus groups are depicted in Fig. 1.
In the Equity category, discussed in FG1, the following points were evident:
Concept: There was no comprehensive and consensual notion of equity; therefore, the participants concluded that an effort should be made to communicate to health care professionals what equity in health care access means.
Dimensions: Only three out of the five dimensions of equity in health care access were mentioned, namely: accessibility, affordability and acceptability, further emphasizing the need for an instrument like the one developed in this study. E.g., a participant stated “(…) the indicators we currently have expose the undervaluation of equity in health care access” (P12);
Implications to quality in health: The EI that were available at the moment of the data collection were generic—“(…) the current indicators to evaluate access are general, for everyone; the older people, who are a vulnerable group, as well as children or pregnant women, should be given more attention.” (P11); the suggested EI are much better directed at older people.
According to the participants, the monitoring of health care equity (currently undervalued or fragmented) is directly proportional to the quality of the service and the satisfaction of the users:
“If there is no equity, there is no quality, they compromise each other.” (P8).
“If we monitor the equity levels that the population faces, we will also have better levels of health and population satisfaction, essentially, best quality of care” (P12).
In the ACOVE-3 category, the following points emerged (from FG3 and FG4):
The clinical conditions of vulnerability considered in the PNSPI were described as generic (i.e., only related with the physiological decline associated with aging, and processes of co-morbidity) and it was stated that the proposed EQI checklist “(…) addresses several aspects still undervalued by health professionals.” (P10). A consensus about the understandability and relevance of the Portuguese version of the QI emerged, and no one suggested changes to the checklist.
The quality indicators directed at older people implemented in PHC at the moment of the meetings were limitative (only four indicators for the purpose were identified), did not raise awareness or provided guidance to the health care teams about the need for an integral assessment of the older person: “(…) it’s only when we see the [proposed] checklist that we become aware that there are many conditions that we do not value, because we focus on very specific complaints from the older adults” (P22). In terms of clinical governance, the participants emphasized the importance of obtaining lessons regarding the quality of the care processes that, in the future, can result in an improvement of health care service. At this level, the participants highlighted the need for more suitable performance metrics.
Relatively to the Advantages, the participants considered that, once integrated in the work activities of the health care teams, the proposed EQI instrument would fulfil the previously identified needs by:
considering a set of clinical conditions specifically directed at the vulnerable older adults: “(…) [the proposed checklist] presents a complete and adequate notion of the most prevalent needs of the older patients” (P18);
fitting into the Portuguese PHC;
promoting health, preventing/ screening disease, and supporting disease management: “(…) through the application of ACOVE-3, a group of specific interventions that, if implemented in the clinical practice, can result in health gains, emerges (…). (P14)”; there was consensus about the responsiveness of the EQI checklist.
favoring the obtention of information about the quality of health care, the adoption of good practices, and the occurrence of inequity situations.
Concerning the Operational limitations, the most problematic issue pointed out by the participants was the length of the instrument that, given the constrains imposed by tight consultation times, can create some resistance to implementation: “(…) as [the proposed EQI checklist] is extensive, there will be resistance from the health professionals.” (P13); “(…) something that takes up time in the consultation is something that the health professionals always try to avoid (…)” (P19); “Since [the proposed EQI checklist] requires a possible change in practice, there are professionals who will probably not adhere.” (P22).
In terms of Suggestions, the participants highlighted that the advantages of the EQI should be communicated to health professionals in order to motivate effective use and the integration of the EQI in the information systems used by the teams. They also suggested that a pilot implementation of a reduced version of the instrument in a PHC center was conducted in order to show the advantages of the EQI implementation.
In summary, given the near-absence of specific indicators for vulnerable older adults, the health professionals expressed positive perceptions concerning the intention to use the developed EQI.
The usefulness of the EQI instrument was further assessed through the analysis of 30 patient clinical records. Table 4 contains the percentage of classifications as non-registered EQI that resulted from that analysis (i.e., situations when a quality or equity issue should have been registered and it was not). It was found that a significant part of the issues addressed by the proposed EQI had not been registered by the health professionals that interacted with the older patients (on average, 76.6% of the QI-related situations that should have been registered, and 96.7% of the EI-related situations that should have been registered were not written in the clinical records), which was expectable because the EQI were not implemented at the time of the health care provision analyzed, but highlights that some important quality or equity questions may had been overlooked. From the 24.4% of QI-related situations that had been registered in the clinical records, 55% concerned problematic situations (i.e., quality problems) that could have been avoided if the EQI were already at place. In the case of the EI, the registrations were rare.
The EQI proposed are a structured and complete set to track health care quality and equity conditions that are relevant for vulnerable older adults, thus helping health professionals to provide a better-quality service, for example, by avoiding misdiagnosis that, when this population is involved, can result in severe health consequences. The various phases of the design played different roles in development of the EQI: the EI were identified through a scoping review; a cross-cultural adaptation of ACOVE-3 provided the appropriate structure to incorporate the EI; and the focus groups and the retrospective analysis of patient clinical records enabled an overall appraisal of the benefits and acceptance of the EQI checklist.
This work contributes to the effort of improving quality indicators in PHC through the transfer of ACOVE from the USA to other countries: other researchers have performed cross-cultural adaptations of this instrument to The Netherlands —8 conditions and 72 indicators adapted); Switzerland —56 indicators; and the UK —16 conditions and 102 indicators. As in these studies, we have not adapted all clinical conditions and indicators of the original ACOVE instrument, and differences occur due to the specific needs of each country's PHC system.
The categorization of equity in Availability, Accessibility, Cost (Affordability), Quality, and Acceptability [65, 66] is not unanimous but includes the most common equity concerns. For example, Goddard and Smith  studied inequities in access to some types of health care (such as general practitioner consultations or preventive medicine) in the UK, considering four dimensions: availability, quality, costs and information. The information dimension is somehow related with accessibility and acceptability because the availability of certain services is not equally known by all population groups. Accessibility includes the physical or geographical accessibility of care [65, 66], a common dimension in equity studies [49, 54].
The choice of standard descriptors for the EI followed the orientations of EOHC  that aims to mitigate the power imbalances, systemic barriers, and dismissive attitudes that people living in marginalizing conditions often encounter when interacting with the health care sector. Providing care tailored to patients’ social circumstances may help create a sense of mutual respect and trust necessary for the patient to engage with health care over time . From a practical perspective, the report of inequity situations should be as standardized as possible in order to facilitate description and subsequent analysis: if a count of a standard reported situation is high, decision makers can rapidly identify the problem and act to solve it; if, on the other hand, each health professional can write a non-standard description, the analysis will probably be difficult, eventually leading to inconclusive results and lack of action.
The few health equity studies that have addressed older people typically used non-systematic surveys  or generic data from NHS information systems  to analyze the equity status (e.g., by comparing admissions of older adults with those of other population groups). There has been a gap concerning the systematic collection of dedicated information that can support health care and policy decision making and ultimately contribute to improve care provided to older adults. This study was directed at favoring the collection of such information.
The acceptance of the EQI instrument by health care professionals seems evident. However, it would be essential to incorporate it into existing information systems – e.g., electronic medical record systems, as it was done for ACOVE-3 in the Netherlands , and to explain the advantages of its use to primary health care general practitioners and nurses. Also, the application of the proposed list of standard terms to describe the causes of situations of inequity can expedite the use of the instrument.
It would be interesting to further explore the automatic evaluation of at least some of the EQI, thus answering the concerns of health care professionals about the length of the instrument given the normal time of a consultation. The analysis of a sample of patient clinical records pointed towards the usefulness of the instrument. Also, starting to use the instrument to collect and analyze data about the quality and equity of the primary health care to vulnerable older adults and disclose the results of that assessment will contribute to the acceptance of the instrument and spread it as a benchmark tool, hopefully, improving health care.
The use of the proposed EQI instrument will likely improve the health care service provided to a fragile population in Portuguese speaking countries and communities. The developed EI can be incorporated into ACOVE-3 based instruments also in other countries, improving the screening of inequity in the access to health care services by vulnerable older adults. It must be noted that, in the future, the proposed EI should be further developed by adding inequity mitigation actions to be taken when an occurrence of inequity is detected. These actions should be determined after EI implementation and some period of information gathering, and must be contextually adapted.
In Portugal, there were no systematized EI for the vulnerable older adults. The incorporation of the EI in the structured ACOVE checklist favors the registration of detailed information by health professionals. That detail enhances data analysis and contributes to more accurate information about the reality. In practice, by filling the form about one of the five equity dimensions, health professionals are invited to register why some clinical conditions were not satisfied. In each one of them, they also have the possibility to detail the causes of the observed inequity.
Because of the Covid-19 pandemic situation, the main limitation of this study was the overwork of the health care professionals that limited their availability to participate in the research. A wider participation would have strengthened the validation of the study. As the clinical records can only be consulted by health professionals, it was not possible to double check the analysis of these data.
Health organizations and authorities will have a source of information that can support decision making if data concerning situations of lack of quality and inequity in primary health care of older adults start to be systematically collected and analyzed. Contributing to that effort, this study developed equity indicators for ACOVE-3, and undertook the first cross-cultural adaptation and validation of ACOVE-3 into Portuguese. The EQI instrument was validated and assessed by general practitioners and nurses through expert opinion and focus groups, and was well accepted by these health care professionals.
The developed equity and adapted quality indicators were tailored to PHC in the Portuguese national health system, but they can easily be adapted to secondary care or to the health care systems of other countries.
Availability of data and materials
The expert opinion and focus groups data collected and analysed during the current study are available from the corresponding author on reasonable request.
The clinical records data that support some findings of this study are available from ARS Norte but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available.
Plano Nacional de Saúde da Pessoa Idosa (Older People National Health Plan).
Assessing Care of Vulnerable Elders
World Health Organization
Primary health care
Equity and quality indicators
Equity-Oriented Health Care
Wilkinson RD, Pickett K. The spirit level: Why more equal societies almost always do better. New York, NY, US: Bloomsbury Publishing; 2009. p. xvii-331– xvii.
Lee JH, Sadana R. The Comission on Social Determinants of Health Knowledge Networks. Improving equity in health by addressing social determinants. Geneva: World Health Organization; 2011.
Institute of Medicine Committee on Quality of Health Care in A. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington (DC): National Academies Press (US). Copyright 2001 by the National Academy of Sciences. All rights reserved.; 2001.
Whitehead M. The concepts and principles of equity and health. Int J Health Serv. 1992;22(3):429–45.
Braveman P. Health disparities and health equity: concepts and measurement. Annu Rev Public Health. 2006;27:167–94.
Wenger NS, Roth CP, Shekelle P, the AI. Introduction to the assessing care of vulnerable elders-3 quality indicator measurement set. J Am Geriatr Soc. 2007;55(s2):S247–52.
Cohn-Schwartz E, Ayalon L. Societal views of older adults as vulnerable and a burden to society during the COVID-19 outbreak: results from an Israeli nationally representative sample. J Gerontol B Psychol Sci Soc Sci. 2021;76(7):e313–7.
Corbett CF, Wright PJ, Jones K, Parmer M. Voice-Activated Virtual Home Assistant Use and Social Isolation and Loneliness Among Older Adults: Mini Review. Front Public Health. 2021;9: 742012.
Eurostat. Population by Age Group. Luxembourg: European Commission; 2019.
European Commission. The 2015 Ageing Report. Brussels, Belgium Publications Office of the European Union, European Economy series; 2015. Report No.: 978–92–79–44747–1.
World Health Organization. Integrated care for older people: realigning primary health care to respond to population ageing. Geneva: World Health Organization; 2018.
Joling KJ, van Eenoo L, Vetrano DL, Smaardijk VR, Declercq A, Onder G, et al. Quality indicators for community care for older people: a systematic review. PLoS One. 2018;13(1):e0190298.
Chang JT, Ganz DA. Quality indicators for falls and mobility problems in vulnerable elders. J Am Geriatr Soc. 2007;55(SUPPL. 2):S327–34.
Yueh B, Shekelle P. Quality indicators for the care of hearing loss in vulnerable elders. J Am Geriatr Soc. 2007;55(Suppl 2):S335–9.
Etzioni S, Chodosh J, Ferrell BA, MacLean CH. Quality indicators for pain management in vulnerable elders. J Am Geriatr Soc. 2007;55(SUPPL. 2):S403–8.
Polinski JM, Barker T, Gagliano N, Sussman A, Brennan TA, Shrank WH. Patients’ Satisfaction with and Preference for Telehealth Visits. J Gen Intern Med. 2016;31(3):269–75.
Reuben DB. Quality indicators for the care of undernutrition in vulnerable elders. J Am Geriatr Soc. 2007;55(SUPPL. 2):S438–42.
Rotar AM, van den Berg MJ, Kringos DS, Klazinga NS. Reporting and use of the OECD Health Care Quality Indicators at national and regional level in 15 countries. Int J Qual Health Care. 2016;28(3):398–404.
ACSS. Bilhete de Identidade dos Indicadores dos Cuidados de Saúde Primários para o ano de 2017. Lisboa: ACSS, Ministério da Saude; 2017.
Wenger NS, Shekelle PG. Assessing care of vulnerable elders: ACOVE project overview. Ann Intern Med. 2001;135(8 Pt 2):642–6.
Chodosh J, Solomon D, Roth CP, Chang JT, MacLean C, Ferrell B, et al. Improving the Quality of Health Care for Older Adults. Santa Monica, CA: RAND Corporation; 2008.
Wenger NS, Solomon D. Appendix to Application of ACOVE-3 Quality Indicators to Patients with Advanced Dementia and Poor Prognosis (Appendices 1 & 2 and Figures 1 & 2). Santa Monica, CA: RAND Corporation; 2007.
Sinvani L, Kozikowski A, Smilios C, Patel V, Qiu G, Akerman M, et al. Implementing ACOVE quality indicators as an intervention checklist to improve care for hospitalized older adults. J Hosp Med. 2017;12(7):517–22.
Reuben DB, Roth C, Kamberg C, Wenger NS. Restructuring primary care practices to manage geriatric syndromes: the ACOVE-2 intervention. J Am Geriatr Soc. 2003;51(12):1787–93.
Cookson R, Asaria M, Ali S, Ferguson B, Fleetcroft R, Goddard M, Goldblatt P, Laudicella M, Raine R. Health Equity Indicators for the English NHS: a longitudinal whole-population study at the small-area level. Health Serv Deliv Res. 2016;4(26).
Burkett E, Martin-Khan MG, Gray LC. Quality indicators in the care of older persons in the emergency department: a systematic review of the literature. Australas J Ageing. 2017;36(4):286–98.
Wenger NS, Roth CP, Shekelle P. Introduction to the assessing care of vulnerable elders-3 quality indicator measurement set. J Am Geriatr Soc. 2007;55(Suppl 2):S247–52.
Shi L. The impact of primary care: a focused review. Scientifica (Cairo). 2012;2012: 432892.
Nord M, Lyth J, Alwin J, Marcusson J. Costs and effects of comprehensive geriatric assessment in primary care for older adults with high risk for hospitalisation. BMC Geriatr. 2021;21(1):263.
Beaton D, Bombardier C, Guillemin F, Ferraz MB. Recommendations for the cross-cultural adaptation of the DASH & QuickDASH outcome measures. Inst Work Health. 2007;1(1):1–45.
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Annals Internal Med. 2018;169(7):467–73.
Peters MDJ, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evidence Synthesis. 2020;18(10):2119–26.
DGS. Programa nacional para a saúde das pessoas idosas. Lisboa, 2008: Direcção-Geral da Saúde; 2006.
Hambleton RK, Swaminathan H, Algina J, Coulson DB. Criterion-Referenced Testing and Measurement: A Review of Technical Issues and Developments. Rev Educ Res. 1978;48(1):1–47.
Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382–5.
Arafat S, Chowdhury H, Qusar M, Hafez M. Cross cultural adaptation and psychometric validation of research instruments: A methodological review. J Behav Health. 2016;5(3):129–36.
Monticone M, Ferrante S, Maggioni S, Grenat G, Checchia GA, Testa M, et al. Reliability, validity and responsiveness of the cross-culturally adapted Italian version of the core outcome measures index (COMI) for the neck. Eur Spine J. 2014;23(4):863–72.
Anthoine E, Moret L, Regnault A, Sébille V, Hardouin JB. Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures. Health Qual Life Outcomes. 2014;12:176.
Shi J, Mo X, Sun Z. Content validity index in scale development. Zhong Nan Da Xue Xue Bao Yi Xue Ban. 2012;37(2):152–5.
Lehoux P, Poland B, Daudelin G. Focus group research and “the patient’s view.” Soc Sci Med. 2006;63(8):2091–104.
Assarroudi A, HeshmatiNabavi F, Armat MR, Ebadi A, Vaismoradi M. Directed qualitative content analysis: the description and elaboration of its underpinning methods and data analysis process. J Res Nurs. 2018;23(1):42–55.
Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.
Ford-Gilboe M, Wathen CN, Varcoe C, Herbert C, Jackson BE, Lavoie JG, et al. How equity-oriented health care affects health: key mechanisms and implications for primary health care practice and policy. Milbank Q. 2018;96(4):635–71.
Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88.
Winograd CH, Gerety MB, Chung M, Goldstein MK, Dominguez F Jr, Vallone R. Screening for frailty: criteria and predictors of outcomes. J Am Geriatr Soc. 1991;39(8):778–84.
Nyamande FN, Mosquera PA, San Sebastián M, Gustafsson PE. Intersectional equity in health care: assessing complex inequities in primary and secondary care utilization by gender and education in northern Sweden. Int J Equity Health. 2020;19(1):159.
Docherty AB, Anderson NH, Walsh TS, Lone NI. Equity of access to critical care among elderly patients in Scotland: a national cohort study. Crit Care Med. 2016;44(1):3–13.
Zhong C, Kuang L, Li L, Liang Y, Mei J. Equity in patient experiences of primary care in community health centers using primary care assessment tool: a comparison of rural-to-urban migrants and urban locals in Guangdong, China. Int J Equity Health. 2018;17(1):51.
Mohan G, Nolan A, Lyons S. An investigation of the effect of accessibility to general practitioner services on healthcare utilisation among older people. Soc Sci Med. 2019;220:254–63.
Sorkin DH, Pham E, Ngo-Metzger Q. Racial and ethnic differences in the mental health needs and access to care of older adults in California. J Am Geriatr Soc. 2009;57(12):2311–7.
Gahagan J, Subirana-Malaret M. Improving pathways to primary health care among LGBTQ populations and health care providers: key findings from Nova Scotia, Canada. Int J Equity Health. 2018;17(1):76.
Jones AL, Hausmann LRM, Haas GL, Mor MK, Cashy JP, Schaefer JH, et al. A national evaluation of homeless and nonhomeless veterans’ experiences with primary care. Psychol Serv. 2017;14(2):174–83.
Cheraghi-Sohi S, Panagioti M, Daker-White G, Giles S, Riste L, Kirk S, et al. Patient safety in marginalised groups: a narrative scoping review. Int J Equity Health. 2020;19(1):26.
Cheng L, Yang M, De Vos J, Witlox F. Examining geographical accessibility to multi-tier hospital care services for the elderly: A focus on spatial equity. J Transp Health. 2020;19:100926.
Jatrana S, Crampton P. Do financial barriers to access to primary health care increase the risk of poor health? Longitudinal evidence from New Zealand. Social Science and Medicine. 2020.
Agerholm J, Bruce D, Ponce de Leon A, Burström B. Equity impact of a choice reform and change in reimbursement system in primary care in Stockholm County Council. BMC Health Serv Res. 2015;15:420.
Garcia-Ramirez J, Nikoloski Z, Mossialos E. Inequality in healthcare use among older people in Colombia. Int J Equity Health. 2020;19(1):168.
Wallerstedt S, Belfrage B, Koldestam A, Sjöberg C. Many patients with suboptimal drug treatment are missed. Sensitivity, specificity and prediction value of drug-specific quality indicators for the elderly. Läkartidningen. 2016;113:1-4.
Brinda EM, Attermann J, Gerdtham UG, Enemark U. Socio-economic inequalities in health and health service use among older adults in India: results from the WHO Study on Global AGEing and adult health survey. Public Health. 2016;141:32–41.
Page J, Comino E, Burgess M, Cullen J, Harris E. Participation in Hospital in the Home for patients in inner metropolitan Sydney: implications for access and equity. Aust Health Rev. 2018;42(5):557–62.
Villalobos Dintrans P. Health Systems, Aging, and Inequity: An Example from Chile. Int J Environ Res Public Health. 2020;17(18):1-9.
Salway SM, Payne N, Rimmer M, Buckner S, Jordan H, Adams J, et al. Identifying inequitable healthcare in older people: systematic review of current research practice. Int J Equity Health. 2017;16(1):123.
Fakoya OA, McCorry NK, Donnelly M. Loneliness and social isolation interventions for older adults: a scoping review of reviews. BMC Public Health. 2020;20(1):129.
Wong ST, Browne AJ, Varcoe C, Lavoie J, Fridkin A, Smye V, et al. Development of health equity indicators in primary health care organizations using a modified Delphi. PLoS One. 2014;9(12): e114563.
Furtado C, Pereira J. Equidade e Acesso aos Cuidados de Saúde. Plano Nacional de Saúde 2011–16. 2010.
Obrist B, Iteba N, Lengeler C, Makemba A, Mshana C, Nathan R, et al. Access to health care in contexts of livelihood insecurity: a framework for analysis and action. PLoS Med. 2007;4(10):1584–8.
van der Ploeg E, Depla MF, Shekelle P, Rigter H, Mackenbach JP. Developing quality indicators for general practice care for vulnerable elders; transfer from US to The Netherlands. Qual Saf Health Care. 2008;17(4):291–5.
Ebert ST, Pittet V, Cornuz J, Senn N. Development of a monitoring instrument to assess the performance of the Swiss primary care system. BMC Health Serv Res. 2017;17(1):789.
Steel N, Melzer D, Shekelle PG, Wenger NS, Forsyth D, McWilliams BC. Developing quality indicators for older adults: transfer from the USA to the UK is feasible. Qual Saf Health Care. 2004;13(4):260–4.
Goddard M, Smith P. Equity of access to health care services: Theory and evidence from the UK. Soc Sci Med. 2001;53(9):1149–62.
Dang BN, Westbrook RA, Njue SM, Giordano TP. Building trust and rapport early in the new doctor-patient relationship: a longitudinal qualitative study. BMC Med Educ. 2017;17(1):32.
Ranjan A, Muraleedharan VR. Equity and elderly health in India: reflections from 75th round National Sample Survey, 2017–18, amidst the COVID-19 pandemic. 2020.
Opondo D, Visscher S, Eslami S, Medlock S, Verheij R, Korevaar JC, et al. Feasibility of automatic evaluation of clinical rules in general practice. Int J Med Informatics. 2017;100:90–4.
JC is funded by National Funds of the FCT – Portuguese Foundation for Science and Technology within the project No. UIDB/03182/2020.
Ethics approval and consent to participate
The study was approved by the Ethics Committee of ARS Norte on 15 March 2019, complying with the ethical requirements of this entity. A proposal of the research project was sent along with the invitation letter to the participants in advance of their participation. A written informed consent for participation was obtained. The authors assert that all methods contributing to this work were performed in accordance with the ethical standards of the Declaration of Helsinki.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1.
Experts and focus groups participants involvement.
Additional file 2.
Literature review flow chart.
Additional file 3.
List of the equity indicators.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Taveira, A., Macedo, A.P., Rego, N. et al. Assessing equity and quality indicators for older people – Adaptation and validation of the Assessing Care of Vulnerable Elders (ACOVE) checklist for the Portuguese care context. BMC Geriatr 22, 561 (2022). https://doi.org/10.1186/s12877-022-03104-5
- Cross-cultural adaptation
- Healthcare access equity
- Healthcare quality
- Instrument validity
- Vulnerable older people