Identifying common impairments in frail and dependent older people: validation of the COPE assessment for non-specialised health workers in low resource primary health care settings
BMC Geriatrics volume 15, Article number: 123 (2015)
Frail and dependent older people in resource-poor settings are poorly served by health systems that lack outreach capacity. The COPE (Caring for Older PEople) multidimensional assessment tool is designed to help community health workers (CHWs) identify clinically significant impairments and deliver evidence-based interventions
Older people (n = 150) identified by CHWs as frail or dependent, were assessed at home by the CHW using the structured COPE assessment tool, generating information on impairments in nutrition, mobility, vision, hearing, continence, cognition, mood and behaviour. The older people were reassessed by local physicians who reached a clinical judgment regarding the presence or absence of the same impairments based upon clinical examination guided by the EASY-Care assessment tool.
The COPE tool was considered easy to administer, and gave CHWs a sense of empowerment to understand and act upon the needs of older people. Agreement between COPE assessment by CHW and clinician assessors was modest (ranged from 45.8 to 91.3 %) for most impairments. However, the prevalence of impairments was generally higher according to clinicians, particularly for visual impairment (98.7 vs 45.8 %), cognitive impairment (78.4 vs. 38.2 %) and depression (82.0 vs. 59.9 %). Most cases identified by WHO-COPE were clinician confirmed (positive predictive values - 72.2 to 98.5 %), and levels of disability and needs for care among those identified by COPE were higher than those additionally identified by the clinician alone.
The COPE is a feasible tool for the identification of specific impairments in frail dependent older people in the community. Those identified are likely to be confirmed as having clinically relevant problems by clinicians working in the same service, and the COPE may be particularly effective at targeting attention upon those with the most substantial unmet needs.
Among older people, impairments in mobility, nutrition, vision, hearing, cognition, mood, and behaviour make an important contribution to years lived with disability, and dependence, and mortality [1–4]. A recent systematic review concluded that, in primary care and community settings, interventions targeting risk factors and functional impairments may be more effective than disease specific interventions at alleviating burden in older people with complex multimorbidity . Such an approach may be particularly salient to low and middle-income countries with few physicians, where non-specialist community health workers could be used to improve the coverage of and access to health and social care. However, identifying impairments that limit older people’s functional capacity, and selecting and implementing evidence-based interventions will be a significant challenge in such settings.
In India, as with many other low and middle-income countries (LAMIC), the primary health care system is the core of the government’s provision for basic health care needs. However, studies conducted in LAMIC indicate highly variable levels of utilization of government primary health care services among older people, with a preference for private doctor and hospital outpatient services in India and some Latin American countries . The public health care system is acknowledged to be limited, in that it is mostly clinic-based with little or no outreach, focuses upon the detection and treatment of acute illnesses, and fails to provide coordinated continuing care to those with chronic conditions [7, 8]. In India, it is not considered part of the primary health care physician’s role to make home visits to assess and treat those who cannot access health facilities . A cadre of Auxiliary Nurse Midwives (ANM), often referred to as community health workers (CHWs) was introduced 50 years ago to increase the coverage of basic health care at the community level, and improve equity . CHWs undergo nine or 24 months training focused mainly upon midwifery and maternal and child health. Their role is to supplement that of doctors and other higher trained personnel by promoting preventive and curative health activities. CHWs have become key workers at the interface of primary health care services and the community, and their effectiveness is reflected in secular reductions in maternal and child mortality . Only recently has interest shifted to the potential to engage CHWs in the task of controlling chronic non-communicable diseases . As the only branch of primary care offering outreach into the community, and with a family and household orientation to their work, CHWs are in principle ideally situated to implement age-appropriate care for older people; case-finding (identifying frail or dependent older people in the community, who have not sought help at the health facility), and home-based assessment and intervention to treat or mitigate the effects of impairments arising from chronic disease.
We have already demonstrated that, after 3 h training, CHWs working in the Goa State health service could accurately identify frail, dependent, or frail and dependent older people . The next step was to develop and evaluate a simple structured assessment that would enable CHWs to identify specific impairments at the level that could inform targeted evidence-based intervention. In support of this approach, a review of studies conducted in high income countries concluded that home visits based on comprehensive geriatric assessment can reduce functional decline in older people . Little research has been undertaken to validate the assessments that could be used by non-specialised community health workers in resource-poor settings [15, 16].
The scope of the assessment was determined by a concurrent World Health Organization program (WHO-COPE) to develop evidence-based guidelines for the prevention and management of dependence by non-specialist health workers; covering nutrition, mobility, falls, cognition, mood and behaviour, sensory impairment, and incontinence . It was assumed that CHWs would lack prior experience in assessing older people, and hence structured assessments with objective tests would be required, rather than the exercise of clinical judgment. Scoping the literature failed to identify any comprehensive multi-dimensional assessment that was simple, fully structured and capable of identifying and distinguishing between specific impairments. Existing comprehensive assessment tools recommended for use in older people [18–21] were either too generic, or required specialised clinical knowledge for administration and interpretation.
The aims of the current study were therefore to develop a comprehensive assessment tool for CHWs working in the primary health care system, to assess the feasibility and acceptability of this approach, and to explore concurrent validity against clinical assessments carried out by physicians working in the same local public health system. It would not be appropriate to consider such assessments as a ‘gold standard’ criterion, since these doctors were non-specialists, and lacked the time or equipment for a rigorous comprehensive clinical examination. The approach was, rather, to assess pragmatically whether those identified by the CHWs would be likely to be confirmed as requiring intervention by local clinicians
Older people identified by CHWs as frail or dependent, were assessed at home by the CHW using the COPE assessment tool (see below for details), generating information on impairments in nutrition, mobility, vision, hearing, continence, cognition, mood and behaviour. After an interval of up to 3 weeks, they were re-assessed by local physicians who reached a clinical judgment regarding the presence or absence of the same impairments based upon clinical examination guided by the EASY-Care assessment tool . This study was conducted between 2013 and 2014. King’s College Research Ethics Committee and Institutional Ethics Committee of Public Health Foundation of India approved the study.
Development and structure of COPE assessment
Rapid review was conducted to select appropriate assessments for undernutrition, mobility and strength impairments, visual and hearing impairments, and cognition, mood and behavioural impairments. The selection of measurements was based on the following criteria: a) they should be simple, quick, and easy to administer in a primary health care facility, or the older person’s own home, b) they should be capable of being administered by non-specialist health workers with suitable training, c) they should have good sensitivity, specificity and positive predictive value for identification of the target impairment. The full COPE assessment tool comprises; Section 1 - demographic information; Section 2 - assessments for specific impairments; Section 3 - a brief interview with co-resident or primary caregiver; Section 4 - a summary of findings and action plans for management or referral. The time taken to administer the full COPE assessment ranges from 30 to 45 min. The following description focuses upon Section 2, the assessment of impairments.
Assessments of mobility: A 10 m walk test, and the chair stand test were used to identify mobility impairment. Both are well-suited to standardised evaluation of older people at community level by non-specialist health workers, being quick to administer, inexpensive, and a reliable measure of frailty with respect to physical functioning [23–26]. The walking test, used successfully in the 10/66 Dementia Research Group population-based studies in LAMICs, involves the participant being timed walking 5 m (indicated by a piece of string), turning and returning to the starting point; with time taken to turn taken into account, a cut off of more than 15 s to complete the test was considered to reflect limited mobility (<1.2 m per second) [27, 28]. Although often considered to be a good proxy measure of sarcopaenia (loss of muscle mass and strength) gait speed will also reflect impairments in the function of joints, central and peripheral nervous system. The ‘30 s chair stand’ test assesses proximal lower limb strength, and has also been used in LAMICs . The person being assessed is asked to stand upright from a chair with their arms folded across their chest, then to sit down again and then to repeat the action at their own pace. The test score is the number of times they rise to a full stand from the seated position within 30 s. A cut-off of fewer than seven stands in 30 s was recommended for detecting older people with, or at risk of, lower limb strength impairment . Fewer than 14 stands predicted falls in a study conducted among community-dwelling older people in Japan . Performance may be influenced by the height of the chair, leading to problems with standardisation when used in the community. Also, a high proportion of frail participants may be unable to perform the task, leading to floor effects.
Assessment of nutritional status: The mini-nutritional assessment (MNA-SF®) is a short form version of the original 18 item MNA full version, comprising six items that best discriminated between malnourished, at risk, and normal older people [32, 33]; decline in food intake; weight loss in the last three months; mobility limitation; psychological stress or acute diseases in the past three months; neurological problems (dementia and depression); and body mass index (BMI). BMI, requiring accurate assessment of height and weight is difficult to measure in the community, particularly in bed- or chair-bound older people. In the revised MNA, calf-circumference was substituted for BMI, with good criterion  and predictive validity . MNA-SF has a maximum score of 14 points, with risk of malnutrition increasing with lower scores. Respondents are classified as well-nourished (a score of 12–14), at-risk for malnutrition (8–11), or malnourished (0–7).
Visual impairment: The Snellen ‘tumbling E’ chart has been used in population-based studies to identify visual impairment in older people in India . Although developed for use in children, it has a general application for low literacy groups, and has been used and validated in many developing countries, including among older people [37–39]. According to the World Health Organisation, visual impairment is defined as a best-corrected visual acuity of less than 6/18 in the better-seeing eye .
Hearing impairment: The whisper voice test [41, 42] was administered to identify hearing impairment. The examiner stands behind the seated older person and enunciates three random numbers (for example, 2-6-9) at four decreasing levels of loudness: a conversational voice at 6 inches and 2 ft from the ear and then a whispered voice at the same distances. Tests were presented to each ear, masking the other by rubbing the tragus. If correct, the examiner proceeds to the next level of difficulty, if incorrect, the test is repeated using different numbers. A pass at each level is achieved if the three numbers are repeated correctly or if at least three out of six numbers are repeated correctly over two sets . Failing the whisper voice test at 2 ft implies a 30 dB hearing loss, likely to have a significant impact on communication. Sensitivity and specificity against audiometry ranges from 90 to 100 % and 80 to 87 % respectively , with little difference when administered by experienced and inexperienced examiners . However, studies validating the whisper voice test were conducted in hospital or institutional settings, exclusively in high income countries .
Cognitive impairment: The Community Screening Instrument for Dementia (CSI-D) was extensively validated against clinician dementia diagnosis (DSM-IV dementia) in 26 centres in Latin America, India and SE Asia . It combines culture and education-fair cognitive testing of the participant and an informant interview enquiring after the participant’s daily functioning and general health, into a single predictive algorithm. The Brief version of CSI-D (administered in around 5 min) was developed using item response theory for item reduction, the intention being to make the assessment brief enough to be used as a screening assessment by non-specialist health workers in low resource primary care settings . The brief version comprises seven cognitive test items for the older person and six informant report items for a co-resident or primary caregiver. Lower scores in the cognitive test and higher scores in the informant reports indicate cognitive impairment. To calculate the total score, the informant score is subtracted from the cognitive score, giving a possible range of −6 to +9 with a cut-off of less than five reported to have 97.3 % sensitivity and 90.5 % specificity in detecting older people with dementia, based on data from community surveys . It has not previously been used by non-specialist health workers in low resource settings.
Mood: The Geriatric Depression Scale (GDS) was originally devised with 30 items specifically for use in older populations , and has been used successfully in an illiterate older Indian population . A 15 item short version is more widely used, but is still time-consuming to administer. An eight-item version, the GDS-8 has been developed in the Netherlands for brevity and ease of use in nursing home residents. The GDS-8 is internally consistent (alpha = 0.80) and against clinician interviews yielded a sensitivity of 96.3 % for major depression and 83 % for minor depression with specificity of 71.7 % at a cut-off point of 2/3 . The GDS-8 item short version has not been validated in community settings.
Behaviour: The brief form of the Neuropsychiatric Inventory (NPI-Q) comprises 12 questions administered to an informant, covering common behavioural and psychological symptoms: delusions, hallucinations, agitation/aggression, depression, anxiety, elation/euphoria, apathy, disinhibition, irritability/lability, aberrant motor activity, sleep and night time behaviours, appetite change and eating behaviour . Each behaviour or symptom is rated by the informant on a six point scale (0–5) for the distress it occasions them. The total NPI-Q distress score is the sum of the 12 individual domain scores, with a maximum possible score of 60. NPI-Q has adequate test-retest and inter-rater reliability as well as good concurrent validity . A behavioural problem was considered as significant, only if it was rated by the caregiver as causing distress.
Dependence: Care dependency (whether the participant needed no care, some care or much care) was ascertained through a series of open-ended questions administered to the informant.
Training CHWs to use the COPE assessment
Training was conducted by two facilitators for ten CHWs currently working in Sub-Health Centres of Corlim Primary Health Centre, Goa, India. Training involved a) brief introduction to common problems associated with ageing, age-dependent chronic diseases, and the origins and types of needs for care arising in frail and/or dependent older people, b) a detailed description of each impairment and the relevant COPE assessment methods, and c) general rules for identifying impairments, emphasizing the use of the specified test cutpoints, but also recommending procedures for exercising judgment when the relevant test was difficult or impossible to administer. Facilitators demonstrated the correct method of performing the assessment in an older person’s home. Safety precautions were clearly flagged. After each demonstration, the facilitators invited CHWs to demonstrate how they would perform the assessment with the facilitator acting as the older person. Other trainees observed the role-play and commented on their colleague’s performance. The facilitator summarised the background knowledge and required competencies, and health workers were given the opportunity to clarify doubts. Facilitators asked questions to check that trainees had understood the assessment procedure and general rules for identifying impairments. Finally, each CHW was requested to identify an older person for whom they believed a COPE assessment would be indicated. These assessments were observed by the facilitator who noted any deviations from assessment protocol, which were then fed back to the CHW. Any doubts or questions raised by the CHW were also clarified at this stage.
Clinician assessments were guided by the EASY-Care Standard (2010) assessment  comprising scales and single items derived from established instruments, including the Barthel index , the Duke OARS IADL scale , the SF-36 , questions on cognitive function , the four-item geriatric depression scale , and questions from the World Health Organisation 11 countries social and medical survey instrument . The EASY-Care assessment, as a package, had shown content, discriminant, and cross-cultural validity [59–61]. Forty-nine checklist items are clustered into seven groups; seeing, hearing and communicating; looking after yourself; getting around; your safety; your accommodation and finance; staying healthy; and your mental health and wellbeing. The assessment can be used by a suitably trained clinician to identify and prioritise management of unmet needs. Based on 18 ADL and IADL items, EASY-Care also generates summary scores for ‘independence’ (higher scores indicating needs for care and support), risk of breakdown in care, and risk of falls. We have demonstrated that the independence score scale has excellent core psychometric properties, with high internal consistency, and strong hierarchical scale properties . Although the 49 checklist items are structured and quite well operationalised, identification of unmet needs and development of management plans requires the exercise of clinical judgment, hence the choice of this assessment for the clinician validation rather than the CHW assessment. EASY-Care assessment was supplemented by clinical assessments routinely used by primary care doctors (see Table 1). Three doctors with minimum ten years of primary care experience were included. Two of the medical doctors had completed their clinical training in psychiatry and neurology. Clinical judgment was then applied, based upon the entirety of available evidence to identify impairments in nutrition, mobility, vision, hearing, continence, cognition, mood and behaviour.
Qualitative interview with CHWs
The purpose of the qualitative study was to elicit information regarding CHW’s experiences and opinions about the administration of the COPE structured assessment, to clarify its potential for routine primary health care practice in the community. A research assistant trained in qualitative interviewing conducted individual in-depth interviews with ten CHWs who had administered the COPE assessment for frail dependent older people, and had provided informed consent to participate in the qualitative study. All qualitative interviews were conducted in sub-health centres, and the duration of each interview ranged between 45 and 90 mins. Interviews were mainly conducted in Konkani (Goan local language). All interviews were recorded, transcribed and translated in to English before thematic analysis was carried out.
The proportion of older people considered, according to the CHW COPE assessments, to have impairments in nutrition, mobility, vision, hearing, continence, cognition, mood and behaviour, was described, and the independent effects of age (per year) and gender (male versus female) assessed using Poisson regression to generate prevalence ratios. The prevalence of each impairment according to CHW COPE assessment was compared with that from clinician judgment. The agreement between CHW assessment and clinician judgment was assessed using the % of overall agreement, and Cohen’s kappa. The sensitivity, specificity, positive and negative predictive values of the CHW assessment were estimated using clinician judgment as the external reference criterion.
The construct (concurrent) validity of the CHW COPE assessments was assessed by:
1) comparing mean EASY-Care independence scores for those identified as impaired in the CHW COPE assessment (‘true positives’ and ‘false positives’ combined) with those who were identified as impaired only according to clinician judgment (‘false negatives’) and those identified as impaired according to neither criteria (‘true negatives’), using one way ANOVA and Scheffe tests for statistical significance accounting for multiple sub-group comparisons; 2) assessing the correlations between number of impairments identified by CHW COPE assessment, needs for care assessed by CHW, numbers of impairments identified by clinician judgment, and EASY-Care independence scores; and 3) using multiple linear regression to assess the independent individual and collective contribution of a) CHW identified impairments and b) clinician identified impairments to the percentage of variance in EASY-Care independence scores, having controlled for age and gender.
Two researchers independently analysed the interview transcripts. A grounded theory method was used for content coding and identification of themes. Data analysis was performed at three stages. First, two researchers independently marked the key text with a series of codes emerging from the transcripts. Secondly, codes were grouped together as representing similar concepts. Third, identified codes reflecting similar concepts were classified under broad themes for better understanding and description of findings. NVivo software version 8 was used for data analysis.
The ten trained community health workers (CHWs) referred the sub-health centre case registry to identify people aged 60 years and over, and reviewed the family record, and their own recollections of family visits to identify those who, on the basis of their training, could be considered to be frail and/or dependent. The 159 so identified were approached by the CHWs for informed consent. Seven refused to participate and two others completed the COPE assessment but could not participate in the clinician assessment due to hospitalisation. The COPE assessment was administered by CHWs at the older person’s home. Subsequently, the clinician made a home visit to conduct the clinical examination; however, for three frail dependent older people the clinical examination was performed at the primary health care facility. The mean age of the participants was 73.6 years (SD 7.6). Most were women (72 %), and 118 (78 %) had no education. Forty-eight (31 %) were still married and 102 (67 %) widowed. Only four (3 %) were living alone, while 121 (80 %) lived with children and/or children-in-law. Nine (6 %) were in paid full- or part-time employment. The very large majority, 141 (94 %), indicated that they did receive care and support, 12 of whom also reported providing care for someone else.
Distribution of impairments as assessed by the CHW using the COPE assessment
Valid data was obtained for most participants for most of the assessments. However, mainly because of severe mobility impairment, 27 (17.8 %) could not attempt the chair-stand test, and 21 (13.8 %) could not attempt the walking test. Mainly because of cognitive impairment, 19 (12.7 %) could not be tested for visual acuity, eight (5.3 %) could not be assessed for hearing, and 12 (7.9 %) could not provide meaningful responses for the Geriatric Depression Scale. According to data collected by the CHWs in their structured assessments, the most common impairment was mobility (n = 124, 81.6 %), followed by hearing (104, 68.4 %), mood (91, 60.7 %), nutrition (82, 53.9 %), behaviour (73, 48.0 %), vision (66, 45.8 %), cognition (58, 38.2 %) and continence (34, 22.4 %). Of the 56 identified by CHWs as having visual impairment, 16 were considered to have refractable errors (corrected by pinhole) and 40 unrefractable errors. Among those identified with incontinence, 21 had occasional urinary incontinence, six frequent urinary incontinence, and seven faecal incontinence. The commonest behavioural disturbances reported to be distressing by the carer were appetite and eating problems (n = 29), agitation or aggression (n = 25), sleep disturbance (n = 23), depression (n = 23), irritability (n = 20), and apathy (n = 19).
Only two older people were rated as having no impairments; 28 (18.4 %) had one or two impairments, 55 (38.2 %) had three or four impairments, and 67 (44.1 %) had five or more. Most (82.8 %) were assessed as having needs for care; 72 (47.4 %) were identified as needing occasional care, and 54 (35.5 %) as needing care much of the time. The independent effects of age and gender on the prevalence of the impairments are described in Table 2 and (age only) in Fig. 1. While the prevalence of all impairments other than depression, mobility and undernutrition increased monotonically with increasing age, only the effect of age on the prevalence of cognitive impairment was statistically significant in this group of older people identified as having frailty and/or needs for care. There were no differences in the prevalence of any impairments with gender.
Agreement between CHWs COPE assessment and clinician diagnosis
The agreement between the CHW identification of impairment, and the rating of the clinician assessor is summarised in Table 3. The agreement (kappa) was generally modest; between 0.20 and 0.41 for undernutrition, incontinence, depression and impairments in hearing and behaviour, 0.14 for mobility, 0.12 for cognitive impairment, and −0.02 for vision impairment. Other than hearing impairment, the prevalence of each impairment was always higher according to the judgment of the clinician. While overall agreement proportions were generally high, ‘false negatives’ (clinician +/ CHW -) were more numerous than ‘false positives’ (clinician -/ CHW +). This was particularly striking for visual impairment, where according to the clinicians 98.7 % were impaired but according to the CHW assessment only 45.8 %, cognitive impairment (78.4 versus 38.2 %) and depression (82.0 versus 59.9 %). The overall pattern comparing CHW assessment with the assumed ‘gold standard’ of clinician assessment was therefore one of moderate sensitivity and specificity for each of the assessments, with a generally high positive predictive value (exceeding 78.0 % for all assessments), and low negative predictive value. For those CHW administered COPE assessments that generated continuously distributed scores, the area under the ROC curve (AUROC) suggested only moderate discriminability with respect to the relevant impairment according to clinician judgment with AUROC close to 0.70 for most tests, but somewhat lower for mobility (walking test, AUROC 0.63; chair stand test, AUROC 0.65).
Concurrent validity of COPE assessment
The continuously distributed COPE assessments for impairment in cognition, nutrition, mobility and behaviour correlated statistically significantly, but moderately (correlation coefficient 0.21 to 0.47) with the EASY-Care independence score (Table 4). Correlations of the GDS-8 depression score and the number of hearing tests passed (from 0 to 4) in the best or worst ear with EASY-Care independence score, were negligible or low, and not statistically significant. The numbers of impairments identified by the CHW-administered COPE assessment and by clinician judgment correlated moderately (Kendall’s Tau-B +0.38, p < 0.001). The Kendall’s Tau-B correlation between numbers of impairments according to CHW/COPE and the Easy-Care independence score was +0.31 (p < 0.001), and with intervals of care assessed by the CHW was +0.25 (p < 0.001).
Post hoc analysis
Given the under-identification of impairments by the COPE tool as administered by the CHWs (or, alternatively, the over-identification of impairments by the clinician unstructured assessment), we carried out a post-hoc analysis to compare the EASY-CARE independence scale score among three groups;
those who screened positive using the COPE (true positives and false positives),
those who were identified with impairment by the clinician, but not by COPE (false negatives),
those identified as negative by CHW and clinician (true negatives).
For all impairments other than hearing impairment and depression, those identified by the COPE as impaired (Group 1) had higher independence scale scores (suggesting greater needs for care) than did those identified by the clinician but not confirmed by COPE (Group 2) (Table 5). For nutrition, vision, incontinence and cognitive impairment the difference in mean dependence score between these sub-groups was statistically significant. Finally, in a multivariable model, controlling for age and gender, neither vision nor depression made a statistically significant contribution to EASY-Care independence scores, whether assessed by CHW-administered COPE, or clinician judgment (Table 6). The contribution to the variance made by nutrition, mobility and cognition impairment was greater for CHW/COPE assessed impairment than for clinician judgment, while the reverse was true for impairment in hearing and behaviour.
Qualitative data on COPE assessment: community health workers (CHWs)
The COPE assessment package was generally perceived as easy to administer, with CHWs reporting that they gained knowledge, experience and confidence through training. The CHWs felt empowered to conduct assessments of older people, and discriminate between different impairments that might require intervention. In their view this could increase the efficiency of the care provided, both in improving identification and generating more accurate referrals. However, several of the CHWs thought that the involvement of doctors was crucial, to validate their findings, to recommend and implement treatment, and ensure adherence. The assessment was generally perceived as acceptable to the older people and their family members, in part because this showed that the service was interested in their problems. Benefit might come simply from improved knowledge and understanding. However, some CHWs did find it difficult to convince some older people of the benefits of assessment, given their fatalistic view of their health status. Opinion was divided among CHWs as to whether the COPE assessment could be routinely incorporated in their daily work. Some felt that it was both feasible and necessary. Others expressed concern about the time to administer the COPE assessment, and the impact that this might have on their other work. However, four CHWs volunteered that they had already begun to, or intended to use the COPE in their clinical practice.
The main difficulties experienced in using the COPE tool were that planning was required to carry out the caregiver assessment, and sometimes a second visit was required for that purpose. Some tests, particularly the 5 m walk test and the visual acuity test were difficult to perform in some households because of cramped space and/or poor lighting. The visual acuity test was difficult to explain to participants with cognitive impairment, and some health workers expressed a need for additional training to identify vision problems in older people with dementia. Some CHWs commented that a second assistant might be required with very frail older people when no family caregiver was at hand (for detail information see the Additional file 1).
The first objective of this study was to examine the acceptability and utility of comprehensive COPE assessment developed for non-specialist community health workers in identifying specific impairments in frail older people at primary health care level. Our second objective was to explore the concurrent validity of COPE assessment against clinical assessments carried out by physicians working in the same local public health system.
The strengths of this study included, first, a clear objective to develop a comprehensive geriatric assessment tool for use in resource poor settings by suitably trained CHWs, with little or no assumed relevant clinical experience or knowledge. The pragmatic study design assessed how the structured assessment might work in real-world primary care settings, and how the results of the assessment might converge with those of clinicians working in the same settings. The clinicians conducted an independent assessment and were completely masked from the CHW COPE assessment results. The clinician assessment may have been adversely affected by the doctors’ non-specialist background, the short time available for the assessment, and the lack of equipment (for, for example audiometry or visual acuity testing). For all these reasons, the clinician judgment certainly cannot be considered to represent a ‘gold standard’. We have carried out a construct validation rather than a criterion validation of the COPE assessment. It would be possible, perhaps desirable, to carry out a more detailed criterion validation of the COPE in the future. However, evidence, mainly from high income countries, already supports criterion validity for most of the components. Arguably, the convergence with local clinician opinion may be most relevant to considering its utility and acceptability within the local health system.
There was only a moderate agreement between the CHW COPE assessment and the clinician judgment for some of the impairments; nutrition, continence, mood, hearing and behaviour; and low agreement for mobility, cognition and vision impairments. On closer inspection of the data, this was mainly accounted for by the generally higher prevalence of all of the impairments other than hearing impairment, according to clinician judgment compared with the findings from the structured COPE assessment. Impairments identified by COPE were generally confirmed by the clinicians, reflected in the high positive predictive values for the COPE assessment (72.2 to 98.5 %). However, particularly for vision, cognition and mood impairment, many more participants were considered by the clinician to have the impairment, reflected in the large discrepancy in prevalence, the low sensitivity of the COPE assessment, and the low levels of agreement. Since we lack an independent gold standard assessment, it is impossible to be sure whether this represents under-recognition by the COPE, or over-diagnosis by the clinician assessor, or both. In the 10/66 Dementia Research Group’s population-based surveys in Latin America, India and China, the prevalence of dementia among care dependent participants was around 50 % in most sites . This is closer to the COPE estimate of 38 % with cognitive impairment than the clinician estimate of 78 %. There are no suitable external comparators for the prevalence of low mood and visual impairment among care dependent older people. The level of disability/ needs for care among those identified by COPE was generally higher than that for those additionally identified by the clinicians but not confirmed by COPE. This difference was both particularly striking and statistically significant for nutrition, cognition and vision impairments, suggesting that COPE might be more conservative than clinician judgment and more effective at targeting those with more severe impairment. This may be because the CHW COPE assessment comprised objective tests with clear operationalisation, whereas the clinicians relied upon global clinical impression.
Reassuringly, COPE assessed impairments were generally associated with EASY-Care independence scores. The lack of any crude or adjusted association between mood impairment and disability, whether mood was assessed by COPE or clinician judgment, is surprising. It may be that in this sample of older people with extensive multimorbidity and intensive needs for care, the impact of other conditions and impairments predominates. Whether assessed by COPE or clinician judgment, impairments in nutrition, mobility, hearing, vision, mood, behaviour and cognition collectively accounted for just under 20 % of the variance in the independence score, with the largest contributions coming from cognition/behaviour, consistent with other reports of the dominant effect of disorders of the brain and mind on disability and dependence [63, 64].
Most CHWs reported that the COPE assessment was relatively easy to administer, and appreciated the empowerment that the training and tool gave them to conduct competent assessments of older people and identify specific problems. Benefits cited included the potential to increase the coverage of care for older people, improve the efficiency of services, and optimise family care arrangements. Some CHWs talked of this as a necessary service development and expressed willingness to use the COPE assessment in the future. However, there were concerns regarding the time taken to administer the assessment, and its impact on their current workload. These views are likely coloured by the fact that attending to the needs of older people is currently neither part of their role, nor on the priority healthcare agenda of the primary health care or sub-centre system . Therefore, spending time with older people is considered to be an additional responsibility.
Some needs for refinement were noted. A portable light source and a mirror could facilitate the administration of the Snellen chart vision test, where space is cramped and lighting inadequate. Vision testing should be extended to include near vision (reading), since unlike refraction errors (which would require optometry and a prescription for glasses or cataract surgery), hyperopia can be corrected by low cost magnifying lens glasses, which could be dispensed by the CHW. Pain is a common and burdensome impairment,  which is not yet assessed as part of COPE, and may be a relevant co-factor in other impairments. Pain management may be challenging unless prescribing restrictions that pertain in many health systems, including the Goan system, are eased. More information would be required to plan interventions; for example a dietary assessment for nutritional intervention, and assessment of pain, recent fractures, and safety aspects prior to exercise interventions to improve mobility. However, such additional assessments could be conducted as part of the intervention, after screening using COPE.
The evidence presented here suggests that the COPE assessment is a useful tool for identifying specific impairments linked to needs for home care and support. In low-resourced primary health care, it is rare for clinicians to visit patients in the community, and this is even considered undesirable . Mobility impairment and lack of transportation limits the scope for frail dependent older people to visit the primary health care facilities for assessment and treatment. Community health workers (who are currently the interface between the community and primary health care facility) could bridge this gap. The high positive predictive value of the CHW identification using the COPE assessment tool suggests that local physicians could have confidence in the accuracy of the CHW assessments, whether in authorising them to initiate home-based interventions, or in accepting referrals arising from these assessments. This collaborative working model is already used to improve maternal and child health, but its potential is rarely considered for managing dependent older people.
The next step would be to evaluate the COPE for cost–effectiveness, in the context of a cluster randomised controlled trial of a complex intervention comprising screening and intervention with evidence-based packages of care. Such multidimensional community-based assessments have been shown to be effective in maintaining physical function, reducing falls and hospitalization in high income countries, although their incremental benefit was less apparent in trials conducted in more recent years, when these approaches became more widespread, and access to basic healthcare was more assure .
Community Health Worker
Low And Middle Income Countries
World Health Organization
Mini Nutritional Assessment
Body Mass Index
Community Screening Instrument for Dementia
Diagnostic and Statistical Manual of Mental Disorders, 4th edition
Geriatric Depression Scale
Instrumental Activities of Daily Living
Activities of Daily Living
Vos T, Flaxman AD, Naghavi M, Lozano R, Michaud C, Ezzati M, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2163–96.
Wea H. Age-specific and sex-specific mortality in 187 countries, 1970–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2013;380(9859):2071–94.
Spiers NA, Matthews RJ, Jagger C, Matthews FE, Boult C, Robinson TG, et al. Diseases and Impairments as Risk Factors for Onset of Disability in the Older Population in England and Wales: Findings From the Medical Research Council Cognitive Function and Ageing Study. J Gerontol A Biol Sci Med Sci. 2005;60(2):248–54.
Stuck AE, Walthert JM, Nikolaus T, Bula CJ, Hohmann C, Beck JC. Risk factors for functional status decline in community-living elderly people: a systematic literature review. Soc Sci Med. 1999;48(4):445–69.
Smith SM, Soubhi H, Fortin M, Hudon C, O'Dowd T. Interventions for improving outcomes in patients with multimorbidity in primary care and community settings. Cochrane Database Systematic Review. 2012;4:CD006560. doi:10.1002/14651858.CD14006560.pub14651852.
Albanese E, Liu Z, Acosta D, Guerra M, Huang Y, Jacob KS, et al. Equity in the delivery of community healthcare to older people: findings from 10/66 Dementia Research Group cross-sectional surveys in Latin America, China, India and Nigeria. BMC Health Serv Res. 2011;11:153.
Beaglehole R, Epping-Jordan J, Patel V, Chopra M, Ebrahim S, Kidd M, et al. Improving the prevention and management of chronic disease in low-income and middle-income countries: a priority for primary health care. Lancet. 2008;372(9642):940–9.
Samb B, Desai N, Nishtar S, Mendis S, Bekedam H, Wright A, et al. Prevention and management of chronic disease: a litmus test for health-systems strengthening in low-income and middle-income countries. Lancet. 2010;376(9754):1785–97.
IPHS. Indian Public Health Standards(IPHS) Guidelines for Primary Health Centres In. Ministry of Health and Family Welfare: New Delhi Directorate General of Health Services; 2012.
Roy S. Primary Health Care in India. Health and Population-Perspectives & Issues. 1985;8(3):135–67.
Malik G. Role of auxiliary nurse midwives in National Rural Health Mission. Nurs J India. 2009;100(4):88–90.
GoI. Indian Public Health Standards(IPHS), Guidelines for Sub-Centres Revised In. Edited by Directorate General of Health Services MoHFW. New Delhi, India: Government of India(GoI); 2012.
Jotheeswaran AT. Identification, Prevention, and Management of Dependency Among Frail Dependent Older People in Low Resourced Primary Health Care Settings. London, UK: University of London; 2014.
Huss A, Stuck AE, Rubenstein LZ, Egger M, Clough-Gorr KM. Multidimensional preventive home visit programs for community-dwelling older adults: a systematic review and meta-analysis of randomized controlled trials. J Gerontol A Biol Sci Med Sci. 2008;63(3):298–307.
Stuck AE, Siu AL, Wieland GD, Rubenstein LZ, Adams J. Comprehensive geriatric assessment: a meta-analysis of controlled trials. Lancet. 1993;342(8878):1032–6.
Li C-M, Chen C-Y, Li C-Y, Wang W-D, Wu S-C. The effectiveness of a comprehensive geriatric assessment intervention program for frailty in community-dwelling older people: a randomized, controlled trial. Arch Gerontol Geriatr. 2010;50(Supplement 1):S39–42.
Guidance on Frailty [http://www.who.int/ageing/health-systems/integrated-care/en/] Accessed 11 Oct 2015.
Philp I, Lowles RV, Armstrong GK, Whitehead C. Repeatability of standardized tests of functional impairment and well-being in older people in a rehabilitation setting. Disabil Rehabil. 2002;24(5):243–9.
Fillenbaum GG, Smyer MA. The development, validity, and reliability of the OARS multidimensional functional assessment questionnaire. J Gerontol. 1981;36(4):428–34.
Lennon OC, Carey A, Creed A, Durcan S, Blake C. Reliability and validity of COOP/WONCA functional health status charts for stroke patients in primary care. J Stroke Cerebrovasc Dis. 2011;20(5):465–73.
Mann E, Koller M, Mann C, van der Cammen T, Steurer J. Comprehensive Geriatric Assessment (CGA) in general practice: results from a pilot study in Vorarlberg. Austria BMC Geriatrics. 2004;4:4.
EASY-Care Standard [http://www.easycareproject.org/the-easycare-instruments.html] Accessed 10 Oct 2015.
AbellanvanKan G, Rolland Y, Andrieu S, Bauer J, Beauchet O, Bonnefoy M, et al. Gait speed at usual pace as a predictor of adverse outcomes in community-dwelling older people an International Academy on Nutrition and Aging (IANA) Task Force. The Journal of Nutrition, Health & Aging. 2009;13(10):881–9.
Gobbens RJ, Luijkx KG, Wijnen-Sponselee MT, Schols JM. Towards an integral conceptual model of frailty. J Nutr Health Aging. 2010;14(3):175–81.
Peel NM, Kuys SS, Klein K. Gait speed as a measure in geriatric assessment in clinical settings: a systematic review. J Gerontol A Biol Sci Med Sci. 2013;68(1):39–46.
Mijnarends DM, Meijers JM, Halfens RJ, ter Borg S, Luiking YC, Verlaan S, et al. Validity and reliability of tools to measure muscle mass, strength, and physical performance in community-dwelling older people: a systematic review. J Am Med Dir Assoc. 2013;14(3):170–8.
Prince M, Ferri C, Acosta D, Albanese E, Arizaga R, Dewey M, et al. The protocols for the 10/66 dementia research group population-based research programme. BMC Public Health. 2007;7(1):165.
Prince M, Acosta D, Ferri CP, Guerra M, Huang Y, Jacob KS, et al. The association between common physical impairments and dementia in low and middle income countries, and among people with dementia, their association with cognitive function and disability. A 10/66 Dementia Research Group population-based study. Int J Geriatr Psychiatry. 2011;26(5):511–9.
Barbosa AR, Souza JM, Lebrao ML, Laurenti R, Marucci Mde F. Functional limitations of Brazilian elderly by age and gender differences: data from SABE Survey. Cadernos De Saude Publica. 2005;21(4):1177–85.
Jones CJRR. Functional fitness normative scores for community residing older adults ages 60–94. J Aging Phys Act. 1999;7:160–79.
Kawabata Y, Hiura M. The CS-30 test is a useful assessment tool for predicting falls in commuity-dwelling elderly people. Rigakuryoho Kagaku. 2008;23:441–5.
Rubenstein LZ, Harker JO, Salva A, Guigoz Y, Vellas B. Screening for undernutrition in geriatric practice: developing the short-form mini-nutritional assessment (MNA-SF). J Gerontol A Biol Sci Med Sci. 2001;56(6):M366–372.
Cai-hua ZHANG. Malnutrition screening by Mini-Nutritional Assessment and Short-Form Mini-Nutritional Assessment in patients with Alzheimer's disease. Chinese Journal of Clinical Nutrition. 2010;18(3):141–4.
Kaiser MJ, Bauer JM, Ramsch C, Uter W, Guigoz Y, Cederholm T, et al. Validation of the Mini Nutritional Assessment short-form (MNA-SF): a practical tool for identification of nutritional status. J Nutr Health Aging. 2009;13(9):782–8.
Tsai AC, Chang T-L, Wang Y-C, Liao C-Y. Population-Specific Short-Form Mini Nutritional Assessment with Body Mass Index or Calf Circumference Can Predict Risk of Malnutrition in Community-Living or Institutionalized Elderly People in Taiwan. J Am Diet Assoc. 2010;110(9):1328–34.
Marmamula S, Narsaiah S, Shekhar K, Khanna RC, Rao GN. Visual Impairment in the South Indian State of Andhra Pradesh: Andhra Pradesh - Rapid Assessment of Visual Impairment (AP-RAVI) Project. PLoS One. 2013;8(7):e70120.
Keeffe JE, Lovie-Kitchin JE, Maclean H, Taylor HR. A simplified screening test for identifying people with low vision in developing countries. Bull World Health Organ. 1996;74(5):525–32.
Hsu W-M, Cheng C-Y, Liu J-H, Tsai S-Y, Chou P. Prevalence and causes of visual impairment in an elderly Chinese population in Taiwan: The Shihpai Eye Study. Ophthalmology. 2004;111(1):62–9.
Mbulaiteye SM, Reeves BC, Karabalinde A, Ruberantwari A, Mulwanyi F, Whitworth JA, et al. Evaluation of E-optotypes as a screening test and the prevalence and causes of visual loss in a rural population in SW Uganda. Ophthalmic Epidemiol. 2002;9(4):251–62.
WHO. International Statistical Classification of Diseases and Related Health Problems. Vol. 1. 10th. rev. Geneva: World Health Organisation; 2010.
Bagai A, Thavendiranathan P, Detsky AS. Does this patient have hearing impairment? The Journal of American Medical Association. 2006;295(4):416–28.
Swan IR. The whispered voice as a screening test for hearing impairment. J R Coll Gen Pract. 1985;35(273):197.
Macphee GJ, Crowther JA, McAlpine CH. A simple screening test for hearing impairment in elderly patients. Age Ageing. 1988;17(5):347–51.
Pirozzo S, Papinczak T, Glasziou P. Whispered voice test for screening for hearing impairment in adults and children: systematic review. Br Med J. 2003;327(7421):967.
McShefferty D, Whitmer WM, Swan IR, Akeroyd MA: The effect of experience on the sensitivity and specificity of the whispered voice test: a diagnostic accuracy study. British Medical Journal Open 2013, 3(4): doi:10.1136/bmjopen-2012-002394.
Prince M, Acosta D, Chiu H, Scazufca M, Varghese M. Dementia diagnosis in developing countries: a cross-cultural validation study. Lancet. 2003;361(9361):909–17.
Prince M, Acosta D, Ferri CP, Guerra M, Huang Y, Jacob KS, et al. A brief dementia screener suitable for use by non-specialists in resource poor settings the cross-cultural derivation and validation of the brief Community Screening Instrument for Dementia. International Journal of Geriatric Psychiatry 2011;26(9):899–907.
Yesavage JA, Brink TL, Rose TL, Lum O, Huang V, Adey M, et al. Development and validation of a geriatric depression screening scale: a preliminary report. J Psychiatr Res. 1982;17(1):37–49.
Kohli A, Banerjee ST, Verma SK. Adaptation of a Geriatric Depression Scale in simple Hindi. Indian Journal of Clinical Psychology. 1991;18:63–4.
Jongenelis K, Gerritsen DL, Pot AM, Beekman AT, Eisses AM, Kluiter H, et al. Construction and validation of a patient- and user-friendly nursing home version of the Geriatric Depression Scale. Int J Geriatr Psychiatry. 2007;22(9):837–42.
Kaufer DI, Cummings JL, Ketchel P, Smith V, MacMillan A, Shelley T, et al. Validation of the NPI-Q, a brief clinical form of the Neuropsychiatric Inventory. J Neuropsychiatry Clin Neurosci. 2000;12(2):233–9.
Boada M, Cejudo JC, Tarraga L, Lopez OL, Kaufer D. [Neuropsychiatric inventory questionnaire (NPI-Q): Spanish validation of an abridged form of the Neuropsychiatric Inventory (NPI)]. Neurologia. 2002;17(6):317–23.
Philp I. Can a medical and social assessment be combined? J R Soc Med. 1997;90(Suppl-32):11–3.
Mahoney FI, Barthel DW. Functional Evaluation: The Barthel Index. Md State Med J. 1965;14:61–5.
Brazier JE, Harper R, Jones NM, O'Cathain A, Thomas KJ, Usherwood T, et al. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. Br Med J. 1992;305(6846):160–4.
Katzman R, Brown T, Fuld P, Peck A, Schechter R, Schimmel H. Validation of a short Orientation-Memory-Concentration Test of cognitive impairment. Am J Psychiatry. 1983;140(6):734–9.
D'Ath P, Katona P, Mullan E, Evans S, Katona C. Screening, detection and management of depression in elderly primary care attenders. Fam Pract. 1994;11:260–6.
Heikinnen E, Waters WE, Brzeziński ZJ. The Elderly in eleven countries: a sociomedical survey. Copenhagen: Albany, N.Y: World Health Organization, Regional Office for Europe; WHO Publications Centre U.S.A; 1983 [distributor].
Bath P, Philp I, Boydell L, McCormick W, Bray J, Roberts H. Standardized health check data from community-dwelling elderly people: the potential for comparing populations and estimating need. Health Soc Care Community. 2000;8(1):17–21.
Döhner HKC, Philp I. Health outcome instrumente in der primärversonrgung älterer menschen erste ergebnisse einer konzertierten action de Europe (SCOPE). Geriatrie Forschung. 1999;9(3):103–9.
Wojszel ZBBB, Politynska B. Ocena stanur funkcjonowania ludzi w podeslym wieku przez lekarza rodzinnego za pomoca kwestionariusza EasyCare. Polski Merkuriusz. 1999;33:167–70.
WAR. World Alzheimer Report 2013, Journey of Caring: An analysis of long-term care for dementia. London: World Alzheimer Association; 2013.
Sousa RM, Ferri CP, Acosta D, Albanese E, Guerra M, Huang Y, et al. Contribution of chronic diseases to disability in elderly people in countries with low and middle incomes: a 10/66 Dementia Research Group population-based survey. Lancet. 2009;374(9704):1821–30.
Sousa RM, Ferri CP, Acosta D, Guerra M, Huang Y, Jacob K, et al. The contribution of chronic diseases to the prevalence of dependence among older people in Latin America, China and India: a 10/66 Dementia Research Group population-based survey. BMC Geriatr. 2010;10:53.
Beswick AD, Rees K, Dieppe P, Ayis S, Gooberman-Hill R, Horwood J, et al. Complex interventions to improve physical function and maintain independent living in elderly people: a systematic review and meta-analysis. Lancet. 2008;371(9614):725–35.
Authors acknowledge the PHFI-UKC Wellcome Trust Capacity Building Programme for the financial support for this research. We are also thankful to our research team members, Dr. Kedar Raikar, Dr. Sandesh Madkaikar, Dr. Sadanand N.S. Kerkar, Dr. Vanita Kutumbale, Dr. Vivek Vajaratkar, Ms. Shezmin Jasani, Mr. Robert Tele, and Community Health Workers from sub-health centers of Corlim Primary Health Care Centre, Goa, India.
The authors declare that they have no competing interests.
All of the authors worked collectively to develop the protocols and methods described in this paper. ATJ led the research study as part of his doctoral study under the supervision of MP and VP. AD acted as co-investigator responsible for the fieldwork in Primary Health Care settings, Goa, India. JB and IP made considerable intellectual contribution for design of the study and preparation of the manuscript. ATJ conducted the analyses and wrote the first draft under the supervision of MP. Other authors reviewed the manuscript, provided further contributions and suggestions. All authors read and approved the final manuscript.
About this article
Cite this article
AT, J., Dias, A., Philp, I. et al. Identifying common impairments in frail and dependent older people: validation of the COPE assessment for non-specialised health workers in low resource primary health care settings. BMC Geriatr 15, 123 (2015). https://doi.org/10.1186/s12877-015-0121-1
- Geriatric assessment
- Frailty assessment
- Frail older people
- Primary health care settings