- Research article
- Open Access
Agreement between self-reported morbidity and pharmacy claims data for prescribed medications in an older community based population
BMC Geriatrics volume 20, Article number: 283 (2020)
Studies have indicated variability around prevalence estimates of multimorbidity due to poor consensus regarding its definition and measurement. Medication-based measures of morbidity may be valuable resources in the primary-care setting where access to medical data can be limited. We compare the agreement between patient self-reported and medication-based morbidity; and examine potential patient-level predictors of discordance between these two measures of morbidity in an older (≥ 50 years) community-based population.
A retrospective cohort study was performed using national pharmacy claims data linked to The Irish LongituDinal study on Ageing (TILDA). Morbidity was measured by patient self-report (TILDA) and two medication-based measures, the Rx-Risk (< 65 years) and Rx-Risk-V (≥65 years), which classify drug claims into chronic disease classes. The kappa statistic measured agreement between self-reported and medication-based morbidity at the individual patient-level. Multivariate logistic regression was used to examine patient-level characteristics associated with discordance between measures of morbidity.
Two thousand nine hundred twenty-five patients were included (< 65 years: N = 1095, 37.44%; and ≥ 65 years: N = 1830 62.56%). Hypertension and high cholesterol were the most prevalent self-reported morbidities in both age cohorts. Agreement was good or very good (κ = 0.61–0.81) for diabetes, osteoporosis and glaucoma; and moderate for high cholesterol, asthma, Parkinson’s and angina (κ = 0.44–0.56). All other conditions had fair or poor agreement. Age, gender, marital status, education, poor-delayed recall, depression and polypharmacy were significantly associated with discordance between morbidity measures.
Most conditions achieved only moderate or fair agreement between self-reported and medication-based morbidity. In order to improve the accuracy in prevalence estimates of multimorbidity, multiple measures of multimorbidity may be necessary. Future research should update the current Rx-Risk algorithms in-line with current treatment guidelines, and re-assess the feasibility of using these indices alone, or in combination with other methods, to yield more accurate estimates of multimorbidity.
Key findings and implications
Agreement between patient self-reported morbidity and medication-based measures of morbidity (Rx-Risk and Rx-Risk-V) was mainly moderate or fair. Diabetes was the only condition for which the level of agreement was found to be very good.
The results of our study indicate that neither measure of morbidity is completely reliable, and we suggest that researchers may require multiple measures (self-report and medication-based measures of morbidity) to fully capture accurate prevalence estimates of multimorbidity.
Our study identified several limitations of the current versions of the Rx-Risk indices, which require updating if medication-based measures of morbidity are to be used to assess the epidemiology of chronic conditions and multimorbidity.
Multimorbidity is commonly defined as the presence of two or more chronic medical conditions and its prevalence has been shown to increase with age . As the world’s older population continues to grow, multimorbidity has become an important public health issue capturing the attention of researchers, healthcare professionals, as well as policy makers. Indeed, for healthcare systems to effectively adapt and manage the delivery of healthcare to our growing older population, an accurate description of the epidemiology of chronic conditions is required. However, to date, studies in the literature reveal wide disparities in prevalence estimates of multimorbidity, ranging from 3.5 to 95.1% [2, 3]. This large variability is thought to be due to the lack of standards defining multimorbidity and validated methods for how it should be measured . A recent systematic review reported 132 definitions of multimorbidity involving 1631 different criteria . In addition, the appropriateness of different measures of multimorbidity is also variable depending on both the outcome of interest as well as the type of data that is available .
Measures of multimorbidity include diagnosis-based measures (e.g. Charlson Index) based on hospital diagnosis codes (ICD codes),  medication-based measures (e.g. Rx-Risk, and Rx-Risk-V for those aged ≥65 years) based on pharmacy data,  and patient self-report. Diagnosis-based measures of multimorbidity are the most common measures and are generally based on hospital or physician records . Medication-based measures of multimorbidity include the Rx-Risk and Rx-Risk-V – two algorithms which determine an individual’s current comorbidities based on their dispensed medication. The Rx-Risk indexes only include morbidities for which a medicine could be prescribed and include 42 categories of morbidities based on the World Health Organisation (WHO) Anatomical Therapeutic Classification (ATC) system [9,10,11]. The Rx-Risk and Rx-Risk-V have good reliability and criterion validity against ICD-9 diagnoses and have been shown to predict costs of care, mortality, and health care utilisation . Previous studies have reported medication-based measures of morbidity (such as the Medicines Disease Burden Index (MDBI) and Rx-Risk-V) to be useful in epidemiological studies when adjusting for comorbidity . However, there are few studies describing the use of these indices to directly measure chronic conditions. Patient self-report is also a valid method of identifying disease categories. A study of older patients with multimorbidity reported good agreement between patient self-report and general practitioner (GP) report for a wide range of diseases .
A number of studies have compared the different measures of multimorbidity with differing results [6, 15, 16]. A study of older primary care patients in Ireland found that medication-based measures of multimorbidity such as Rx-Risk-V performed better than diagnosis-based measures of multimorbidity in predicting emergency and ambulatory care sensitive (ACS) admissions . Studies comparing patient self-report and diagnosis-based measures of multimorbidity have reported a stronger association between self-report measures of multimorbidity and quality of life and functional outcomes than diagnosis-based measures [18, 19]. However, no previous research has compared self-reported morbidity in the primary care or community setting with the Rx-Risk measures of morbidity. Comparison between self-reported morbidity data and pharmacy records is important in order to understand the relative merits of each measure of morbidity and the potential for misclassification, particularly in the community setting where access to medical or clinical data can be limited.
Studies have also indicated that agreement between self-report measures and other measures of morbidity might be influenced by patient recall bias . Patient recall has been reported to be influenced by age, marital status and education . There is also some evidence that cognition and memory influence patient recall . The impact of these factors needs to be explored further when assessing and comparing measures of morbidity. The aim of this study was to: (1) compare the agreement between patient self-reported morbidity and medication-based morbidity (Rx-Risk and Rx-Risk-V); and (2) examine potential patient-level predictors of discordance between the two measures of morbidity; including demographic, cognitive, and mental health factors in an older community based population.
The STrengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines were used in the reporting of this study .
This was a retrospective cohort study using data from a national pharmacy claims database, the Health Service Executive-Primary Care Reimbursement Service (HSE-PCRS) General Medical Services (GMS) scheme, linked to the first wave of The Irish LongituDinal study on Ageing (TILDA). TILDA is a nationally representative sample of community dwelling individuals aged ≥50 years in Ireland. The sampling framework is based on the Irish Geodirectory, a comprehensive and up-to-date listing and mapping of residential addresses in Ireland compiled by the Ordinance Survey Office; and participants aged ≥50 years were randomly selected using the RANSAM sampling procedure. This meant that each residential address in Ireland had an equal probability of selection, and thus ensured that the TILDA sample was representative of the Irish population aged ≥50 years. The first wave of data collection began in October 2009 through to February 2011 (N = 8175 participants aged ≥50 years), where participants completed a computer-aided personal interview (CAPI) and a health assessment measuring their health, economic and social circumstances. Further information on TILDA’s study design and sampling framework is described in detail elsewhere .
The HSE-PCRS GMS scheme is the largest pharmacy claims dataset in Ireland, covering more than 40% of the general Irish population . It is means tested and provides free health services, including medications, to eligible persons in Ireland. Qualification for the GMS scheme is on the basis of income related means-testing. Automatic entitlement for those aged ≥70 years occurred between July 2001 and December 2008; however, since January 2009 (current study period), means-testing was introduced, but with a higher income threshold than the general population. As of 2013, 90% of men and 94% of women in the general population aged ≥70 years were eligible . The HSE-PCRS GMS pharmacy claims data were available for consenting TILDA participants aged ≥50 years with GMS eligibility (N = 2925).
Within the HSE-PCRS-GMS pharmacy claims data, prescriptions are coded using the WHO ATC classification system; and prescriber information, defined daily doses, strength, quantity, method and unit of administration of each drug dispensed are all available. Pharmacy claims data was extracted for 1 year prior to each participant’s TILDA interview. GMS patients typically receive their medications on a monthly basis .
As part of the TILDA interview, participants were asked to report if they had any of the following doctor-diagnosed chronic diseases: high blood pressure or hypertension; high cholesterol; angina; congestive heart failure; heart attack; diabetes; stroke or mini-stroke; abnormal heart rhythm; arthritis; osteoporosis; cancer; Parkinson’s disease; emotional nervous or psychiatric problems; alcohol or substance abuse; dementia; serious memory impairment; stomach ulcers; glaucoma; incontinence; or chronic pain. Participants were also asked to self-report urinary incontinence in the past 12 months, as well as pain (moderate or severe), and if they were taking medication for pain management. If participants reported that they had arthritis, they were asked to clarify the type of arthritis (e.g. osteoarthritis, rheumatoid arthritis, some other kind of arthritis). Similarly, if participants reported emotional, nervous or psychiatric problems, they were asked to clarify from a list of conditions (e.g., anxiety, depression, emotional problems, psychosis, manic depression).
Medication-based measures of morbidity – Rx-risk and Rx-risk-V
The Rx-Risk and Rx-Risk-V indices were applied to the HSE-PCRS pharmacy claims data. The Rx-Risk index was applied to the population aged < 65 years, while the Rx-Risk-V was applied to the population aged ≥65 years. The Rx-Risk and Rx-Risk-V are algorithms that classify prescription drug fills into chronic disease classes for older populations based on the WHO ATC classification system [9,10,11]. Within the Rx-Risk-V, cardiac disease is separated into a number of categories: anticoagulation; antiplatelet agents; arrhythmias; congestive heart failure (CHF)/hypertension; hypertension; ischaemic heart disease (IHD)/angina; and ischaemic heart disease (IHD)/hypertension . For a medication to be eligible as a measure of morbidity per Rx-Risk and Rx-Risk-V chronic disease classes, a patient was required to have been dispensed two or more consecutive prescriptions of the medication in question (e.g., ‘donepezil’ was required to be dispensed on ≥2 consecutive prescriptions to link this medication with the Rx-Risk-V condition ‘dementia’). This definition has previously been used by other pharmacoepidemiological studies .
Comparison of self-reported morbidity with Rx-risk and Rx-risk-V
Each self-reported condition in TILDA was matched to the equivalent Rx-Risk and Rx-Risk-V condition at the individual patient level for those aged < 65 years and ≥ 65 years, respectively. This was performed by consensus between two pharmacists (FM & CM). For some self-reported conditions, the ATC classes of medications were not specific to these conditions – e.g. anti-thrombotic agents (B01AC04 – B01AC30) were matched to the self-reported condition of a heart attack and also to stroke. There were four self-reported TILDA conditions which could not be matched to an Rx-Risk or Rx-Risk-V condition, but the prevalence was low (Appendix 1 in Tables 5, 6 and 7). The Rx-Risk and Rx-Risk-V also reported conditions which patients had not been asked about during their TILDA interview. (Appendix 1 in Tables 5, 6 and 7).
Patient-level characteristics associated with discordance between the two measures of morbidity
Patient characteristics were assessed to determine discordance (patient recall bias) between self-reported morbidity (TILDA) and the Rx-Risk (< 65 years) and Rx-Risk-V (≥ 65 years) medication-based measures of morbidity. These characteristics were age, gender, marital status, education, poor delayed recall, depression and polypharmacy. Marital status was sub-categorised into married, never married, separated or divorced. Education was categorised into primary/none, secondary or third/higher level education. Delayed recall, based on participants being presented with 10 words during the interview and being later asked to recall as many as possible, was defined as poor where 3 or fewer words were recalled. Depression was defined as scoring 16 or greater on the Centre for Epidemiologic Studies Depression Scale (CES-D) . Polypharmacy was defined as reporting regular use of five or more prescription medications .
Agreement between self-reported morbidity (TILDA) and the Rx-Risk and Rx-Risk-V measures of morbidity (pharmacy claims) was assessed using Cohen’s Kappa statistic, as neither source was considered to be a gold standard for reporting morbidity. Interpretation of the value of Kappa was as follows: poor (< 0.20), fair (0.20–0.40), moderate (0.41–0.60), good (0.61–0.80), and very good (0.81–1.00) .
Multivariate logistic regression was used to examine the association between the patient-level characteristics and discordance between the two measures of morbidity. Adjusted odds ratios (OR) and 95% confidence intervals (CI) are presented. Discordance was defined as participants reporting to have the condition in the absence of any dispensed medication for the condition, per Rx-Risk (< 65 years) or per Rx-Risk-V (≥ 65 years), and participants reporting to not have the condition, but medication was found to be dispensed for the condition, per Rx-Risk (< 65 years) or Rx-Risk-V (≥ 65 years). All significance tests were two-tailed. Statistical significance was set at P < 0.05, after adjustment for a false discovery rate of 5% . Analyses were performed using Stata SE Version 14.0 statistical package (StataCorp, College Station, TX).
In total, 2925 patients were included in this cohort study: 1095 (37.44%) patients were aged < 65 years and 1830 (62.56%) were aged ≥65 years. Characteristics of the study participants are presented in Table 1. On average patients aged < 65 years had 3 (SD 2.17) conditions per the Rx-Risk and patients aged ≥65 years had 6 (SD 3.27) conditions per the Rx-Risk-V. The proportion of patients with third/higher level education was relatively low across both age groups (< 65 years: N = 175 (15.98%), ≥ 65 years: N = 317 (17.32%)). Poor delayed recall (< 65 years: N = 177 (16.16%), ≥ 65 years: N = 560 (30.60%)) and polypharmacy (< 65 years: N = 301 (27.49%), ≥ 65 years: N = 733 (40.05%)) were significantly more prevalent in the older cohort compared to the younger cohort (p < 0.05).
Agreement between self-reported morbidity and medication-based measures of morbidity (Rx-risk and Rx-risk-V)
Tables 2 and 3 present a comparison between the number and percentage of patients’ self-reported morbidities compared to the Rx-Risk (Table 2: aged < 65 years) and Rx-Risk-V (Table 3: aged ≥65 years) measures of morbidity. High blood pressure or hypertension (< 65 years: N = 438 (40.00%), ≥ 65 years: N = 964 (52.68%)) and high cholesterol (< 65 years: N = 458 (41.83%), ≥ 65 years: N = 733 (40.05%)) were the most prevalent self-reported morbidities in both age cohorts in the TILDA dataset. High cholesterol was also found to be highly prevalent in the Rx-Risk (N = 454, 41.46%) and Rx-Risk-V (N = 1002, 54.75%) measures of morbidity. Other prevalent Rx-Risk and Rx-Risk-V conditions included arthritis (Rx-Risk: N = 688 (62.83%)), stomach ulcers (Rx-Risk: N = 518 (47.31%), Rx-Risk-V: N = 947 (51.75%)), stroke (Rx-Risk-V: N = 952 (52.02%)), heart attack (Rx-Risk-V: N = 952 (52.02%)) and other heart trouble (Rx-Risk-V: N = 884 (48.31%)).
There was very good agreement between the self-reported TILDA measure of diabetes and the Rx-Risk and Rx-Risk-V measures (κ = 0.81). There was also good agreement between self-reported measures of osteoporosis (κ = 0.61) and glaucoma (κ = 0.69) and the Rx-Risk-V measure of these morbidities in the older cohort. Despite the high prevalence of high cholesterol in both measures of morbidity, there was only moderate agreement (κ = 0.52 Rx-Risk, κ = 0.44 Rx-Risk-V) between the two measures. There was moderate agreement also for asthma (κ = 0.47 Rx-Risk), Parkinson’s (κ = 0.56 Rx-Risk-V) and angina (κ = 0.51 Rx-Risk V). Agreement was fair for self-reported high blood pressure or hypertension (Rx-Risk and Rx-Risk-V), heart attack (Rx-Risk), stroke (Rx-Risk), abnormal heart rhythm (Rx-Risk-V), cancer (Rx-Risk), depression (Rx-Risk and Rx-Risk-V) and pain (Rx-Risk-V) and Rx-Risk measures of these conditions (κ = 0.21–0.40). All other conditions had poor agreement (κ = 0.02–0.19); including arthritis (Rx-Risk), chronic lung disease and incontinence (Rx-Risk-V) and emotional, nervous psychiatric problems, anxiety and stomach ulcers (Rx-Risk and Rx-Risk-V) (Tables 2 & 3).
Patient-level characteristics associated with discordance between the two measures of morbidity
Age, gender, marital status, education, poor delayed recall, depression, and polypharmacy were all associated with discordance between the two measures of morbidity (Table 4). Females were five times more likely to have discordance in reporting osteoporosis (OR = 5.20, 95% Confidence Intervals (CI) 3.33, 8.09, P < 0.05). Females were also more likely to have discordance in reporting anxiety (OR = 1.66; 95% CI 1.35, 2.04), emotional problems (OR = 1.57; 95% CI 1.29, 1.92) and depression (OR = 1.46; 95% CI 1.19, 1.79) as well as use of pain medication (OR = 1.43; 95% CI 0.13, 1.80) and incontinence (OR = 2.13; 95% CI 1.59, 2.85). They were less likely to have discordance in reporting stroke and high cholesterol (Table 4).
Patients who were never married were less likely to have discordance in reporting a heart attack (OR = 0.69; 95% CI 0.52, 0.92) and stroke (OR = 0.69; 95% CI 0.52, 0.92). Patients with third level education were less likely to have discordance in reporting hypertension (OR = 0.75; 95% CI 0.59, 0.96), compared to those with primary level education (Table 4). Patients with poor delayed recall and depression were more likely to have discordance in reporting anxiety and depression. In general, discordance was higher in patients with polypharmacy (Table 4).
Within a population based study of ageing in Ireland we found that agreement between patient self-reported morbidity and medication-based measures of morbidity (Rx-Risk and Rx-Risk-V), was generally not good; with most conditions achieving only moderate or fair agreement. There was ‘very good’ agreement (κ = 0.81) between self-reported diabetes and pharmacy dispensing records, across both age cohorts. This was the only morbidity common to both age cohorts for which the level of agreement was found to be ‘very good’. Many research studies confirm this same level of agreement for diabetes [22, 34, 35]. This was expected, given that previous research has demonstrated the reliability of reporting to be better in morbidities for which there are clear diagnostic criteria (e.g. diabetes) . Furthermore, with many educational resources promoting self-management of this condition, patients with diabetes are more likely to play an active role in managing their condition (e.g. regular self-monitoring of blood glucose levels; dietary management; recognising and dealing with symptoms, such as hypo- and hyper-glycaemia; and/or medication taking) and are therefore more likely to self-report accurately .
There was ‘good’ agreement between both measures of morbidity for osteoporosis and for glaucoma in the older age group. A Multi-Care cohort study of primary care patients in Germany found only moderate agreement between patient-reported and GP-reported osteoporosis . A retrospective cohort study of older patients in a secondary-care setting in Canada, also found moderate agreement for glaucoma between physician and patient reports . Similar to diabetes, patients are required to play an active role in the management of osteoporosis, while glaucoma is very often a comorbidity of diabetes .
There was ‘moderate’ agreement between the measures of morbidity for asthma in the younger age cohort (< 65 years). Similar results have been reported for agreement between self-reported asthma and medical record data in older hospitalised patients . There was also ‘moderate’ agreement for high cholesterol in both age cohorts and for angina and Parkinson’s disease in the older age cohort. Other studies have reported lower agreement for high cholesterol and higher agreement for angina and Parkinson’s diseases [14, 41]. Discordance here may be explained by patients managing their cholesterol using non-pharmacological means (e.g., lifestyle modifications, including cardioprotective diet) . Interestingly the prevalence of self-reported angina in TILDA was higher than the prevalence reported by Rx-Risk-V. This may reflect poor patient adherence if prescribed medications were not dispensed.
There was only ‘fair’ agreement between both measures of morbidity for hypertension despite hypertension being the most prevalent self-reported morbidity across both age cohorts. Higher agreement between self-reported anti-hypertensive drug use and pharmacy records, has been reported in a population-based study and a cohort study of older people in the Netherlands [43, 44]. The discordance observed here is likely attributable to the omission of a major group of anti-hypertensives, calcium-channel-blockers (CCBs), in the current version of the Rx-Risk and Rx-Risk-V algorithms [9, 10]. This is significant given that CCBs are recommended as first-line therapy in patients aged > 55 years . Equally, since hypertension is considered to be a condition without symptoms,  this may influence patient adherence to anti-hypertensive medications, and their proclivity to fill a prescription for these medications. There was also ‘fair’ agreement for pain in the older age group, with agreement increasing somewhat when self-reported pain specified ‘taking pain medication’. The prevalence of self-reported pain was higher than the medication-based (Rx-Risk-V) prevalence and this may be due to patients managing their pain through non-pharmacological or lifestyle interventions such as physiotherapy and cognitive behavioural therapy .
In both age cohorts, there was “poor to fair” agreement between self-reporting of emotional problems (e.g. depression, anxiety) and medication-based measures. These findings are consistent with previous research which found poor agreement between physician diagnosis and patient self-reports of anxiety and depression . This low level of agreement may be due to a potential stigmatisation bias, as only 21.7% (78/359) of patients regularly dispensed anti-depressants self-reported as having depression in the older age cohort [49, 50]. Equally, it may be that certain anti-depressants (e.g. amitriptyline) are being used for other indications, such as neuropathic pain [51, 52].. There was also ‘poor’ agreement in both age cohorts for stomach ulcers, and for incontinence and chronic airways disease (COPD) in the older cohort. Like depression, poor agreement here may be due to gastrointestinal medications being used by patients for other indications, such as preventative or symptomatic reasons . The poor agreement for chronic airways disease may reflect the non-specific question used in TILDA to measure this self-reported morbidity, as there is evidence in the literature that questionnaire design is an important determinant of patient recall. In a US study, the prevalence of self-reported COPD was found to increase when more explicit questions were asked about emphysema, chronic bronchitis and COPD in combination . The poor agreement between the two measures for incontinence is most likely reflective of the current version of the Rx-Risk-V, which compares self-reported urinary incontinence with dispensed ‘diapers and pads (supplies)’. .
A number of factors were associated with discordance between the two measures of morbidity; particularly increasing age, poor delayed recall, depression, and polypharmacy. A study determining the agreement between self-reported and diagnosis-based multimorbidity in older community dwelling women reported similar findings, where agreement was found to decrease with decreasing cognition and education, increasing age, and four or more diseases . Multiple chronic conditions and polypharmacy have also been shown to negatively affect cognitive recall . In addition, patients with chronic disease often experience co-morbidities such as mental health conditions and psychosocial difficulties (e.g. depression), and these have been reported to negatively affect self-report [56, 57]; and have been shown to be associated with lower agreement between patient self-reported morbidity and GP report . Discordance per pharmacy claims data may result from poor adherence to prescribed medication, medications being used for other indications, or conditions being managed using non-pharmacological means. Studies have also found that other patient characteristics (e.g., sex) can influence treatment patterns . There is evidence that depression and impaired cognition are predictors of poor adherence and this study found a relationship between poor delayed recall and depression and potential misreporting .
This is the first study to assess the reliability of self-reported morbidity by older patients (≥50 years) in a primary care setting in Ireland, against pharmacy dispensing data using two validated measures of morbidity (Rx-Risk and Rx-Risk-V). However, this study has a number of limitations. The study only included patients with a GMS medical card and these patients tend to be older, female, more socially deprived and have reported more chronic diseases, medications and depressive symptoms than the general population . Future studies should compare the agreement between patient self-reported morbidity and medication-based morbidity (Rx-Risk and Rx-Risk-V) in other data sets which include participants from a broader range of socioeconomic and ethnic backgrounds and across different healthcare schemes. It is also not known whether patients adhered to their medications or had discontinued treatment. In addition, the pharmacy claims database used in this study does not include over-the-counter (OTC) items, although this may not be a significant factor as the GMS provides free medical treatment and patients must pay for OTC items .
There were also a number of conditions that we were unable to match in both TILDA and the Rx-Risk and the Rx-Risk-V and these were excluded from our study (Appendix 1 in Tables 5, 6 and 7). The two measures of morbidity were compared over a 1 year period but it was not known when participants were actually diagnosed with their self-reported condition(s) or when they initiated medication for their condition. Therefore, there may be differences in agreement for newly diagnosed conditions versus conditions which participants have been managing for a number of years. With this in mind, agreement between pharmacy refill data and self-reported morbidity may vary over time and future research should therefore investigate the relationship between these two measures longitudinally to obtain a clearer understanding of treatment patterns . The statistical significance of the association between the patient-level characteristics and discordance between the two measures of morbidity should also be interpreted with caution given the multiple tests/models that were conducted.
Notwithstanding the above limitations, this study is based on a national longitudinal study of community dwelling older adults (≥ 50 years) in Ireland, and enabled us to examine the reliability of two measures of morbidity across 29 conditions as well as a wide-range of potential predictors of discordance when measuring morbidity between self-report and medication-based models. The results of our study indicate that neither measure of morbidity is completely reliable. In addition, our study highlights a number of limitations to the current versions of the Rx-Risk and Rx-Risk-V medication-based measures of morbidity [9, 10]. Specifically, in the current version of the Rx-Risk and Rx-Risk-V, we identified a number of instances where commonly used medications for a condition have not been included – e.g., CCBs for hypertension; anti-epileptics for bipolar disorder; and drugs for urinary frequency and incontinence for incontinence. Further, for a number of Rx-Risk and Rx-Risk-V conditions, some of the medications identified are common across a number of conditions e.g. anti-platelet therapy is common for heart attack, stroke and mini-stroke; making it difficult to confidently establish which specific condition the patient may have.
Our study highlights the need to update the drugs included for each chronic disease class in the Rx-Risk and Rx-Risk-V in order to test the true reliability of these medication-based measures of morbidity. Indeed, if medication-based measures are to be used to assess the epidemiology of chronic conditions, then they need to be up-to-date with current evidence-based treatment guidelines, while also taking account of changing practice for the management of certain chronic conditions. This could be achieved through Delphi consensus or by review of the current Rx-Risk and Rx-Risk-V morbidities and associated prescribed medication by an expert panel. In addition, where a medication is licensed for more than one indication (e.g., amitriptyline is licensed for both depression and neuropathic pain)  or where the same medication or drug class is indicated for a range of conditions (e.g., anti-platelet therapy for heart attack and stroke), then the Rx-Risk and Rx-Risk-V may need to specify that patient medical data also needs to be reviewed to verify the indication for which the medication has been prescribed. Equally, as some conditions are managed using non-pharmacological means (e.g. physiotherapy for pain management), this also needs to be taken into consideration. Indeed, an integrated dispensing and medical record system, particularly across the interface between primary and secondary care, would enable a more accurate measure of medication-based morbidity .
There are also a number of limitations to patient self-report as a reliable measure of morbidity. Similar to the Rx-Risk and Rx-Risk-V, our findings suggest that certain morbidities (e.g. depression and emotional problems) may not be adequately measured by self-report alone; and other measures of morbidity may need to be considered alongside self-report, including physician assessment, measures that use both diagnosis codes from hospital records or medical claims and pharmacy data,  and/or application of validated clinical scales. More detailed and more specific questions for conditions where there are no clear diagnostic criteria and where there is variability in symptoms (e.g., incontinence, pain, COPD) may also need to be added to self-report measures, with a view to improving accuracy. There is also evidence that disease severity can influence the accuracy of self-report measures of morbidity; with previous research indicating that when severity assessment is taken into account, the predictive validity of self-report morbidity measures significantly improves in relation to health outcomes . A measure of disease severity may therefore need to be included when measuring morbidity. Studies have also indicated that older patients can have insufficient disease and medication knowledge and are often not aware of what medication they are taking for their diagnosed health conditions . Pharmacists and GPs in the community setting are ideally placed to provide patients with such information, which may improve the accuracy of measures of morbidity. This approach may also provide these healthcare professionals with a means of collaborative decision making and treatment planning for older patients with multimorbidity.
Indeed, as our older population continues to grow, and given the significant prevalence of chronic conditions among middle-aged and older adults, researchers, healthcare professionals, and policy-makers need to be able to measure morbidity in an accurate and efficient way. To do this, a single measure which incorporates both self-report and clinical/medication-based measures, but which also captures non-pharmacological interventions used to manage chronic conditions, may therefore be necessary. A recent study comparing the measurement of multimorbidity using different data sources, has highlighted the utility in combining self-report and administrative data sources . Our findings indicate the need for a similar trajectory, and we recommend that future research should employ a combination of measures in order to capture accurate prevalence estimates of multimorbidity.
Availability of data and materials
The data that support the findings of this study are available from Trinity College Dublin https://tilda.tcd.ie/but restrictions apply to the availability of these data and so are not publicly available.
The irish longitudinal study on ageing
World health organisation
Anatomical therapeutic classification
International classification of diseases
Medicines disease burden index
Ambulatory care sensitive
Health service executive
Primary care reimbursement service
General medical services
STrengthening the reporting of observational studies in epidemiology
Computer aided personal interview
Centre for epidemiologic studies depression scale
Congestive heart failure
Ischaemic heart disease
Calcium channel blockers
Chronic obstructive pulmonary disease
Over the counter
Wallace E, Salisbury C, Guthrie B, Lewis C, Fahey T, Smith SM. Managing patients with multimorbidity in primary care. Bmj. 2015;350:h176.
Fortin M, Stewart M, Poitras M-E, Almirall J, Maddocks H. A systematic review of prevalence studies on multimorbidity: toward a more uniform methodology. Ann Fam Med. 2012;10(2):142–51.
Violan C, Foguet-Boreu Q, Flores-Mateo G, Salisbury C, Blom J, Freitag M, et al. Prevalence, determinants and patterns of multimorbidity in primary care: a systematic review of observational studies. PLOS ONE 9(7): e102149. https://doi.org/10.1371/journal.pone.0102149.
Harrison C, Britt H, Miller G, Henderson J. Examining different measures of multimorbidity, using a large prospective cross-sectional study in Australian general practice. BMJ Open. 2014;4(7):e004694.
Le Reste JY, Nabbe P, Manceau B, Lygidakis C, Doerr C, Lingner H, et al. The European general practice research network presents a comprehensive definition of multimorbidity in family medicine and long term care, following a systematic review of relevant literature. J Am Med Dir Assoc. 2013;14(5):319–25.
Huntley AL, Johnson R, Purdy S, Valderas JM, Salisbury C. Measures of multimorbidity and morbidity burden for use in primary care and community settings: a systematic review and guide. Ann Fam Med. 2012;10(2):134–41.
Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83.
Prior A, Fenger-Grøn M, Larsen KK, Larsen FB, Robinson KM, Nielsen MG, et al. The association between perceived stress and mortality among people with multimorbidity: a prospective population-based cohort study. Am J Epidemiol. 2016;184(3):199–210.
Sloan KL, Sales AE, Liu C-F, Fishman P, Nichol P, Suzuki NT, et al. Construction and characteristics of the RxRisk-V: a VA-adapted pharmacy-based case-mix instrument. Med Care. 2003;41(6):761–74.
Fishman PA, Goodman MJ, Hornbrook MC, Meenan RT, Bachman DJ, Rosetti MCK. Risk adjustment using automated ambulatory pharmacy data: the RxRisk model. Med Care. 2003;41(1):84–99. https://doi.org/10.1097/00005650-200301000-00011.
Pratt NL, Kerr M, Barratt JD, Kemp-Casey A, Ellett LMK, Ramsay E, et al. The validity of the Rx-risk comorbidity index using medicines mapped to the anatomical therapeutic chemical (ATC) classification system. BMJ Open. 2018;8(4):e021122.
Lu CY, Barratt J, Vitry A, Roughead E. Charlson and Rx-risk comorbidity indices were predictive of mortality in the Australian health care setting. J Clin Epidemiol. 2011;64(2):223–8.
Vitry A, Wong SA, Roughead EE, Ramsay E, Barratt J. Validity of medication-based co-morbidity indices in the Australian elderly population. Aust N Z J Public Health. 2009;33(2):126–30.
Hansen H, Schäfer I, Schön G, Riedel-Heller S, Gensichen J, Weyerer S, et al. Agreement between self-reported and general practitioner-reported chronic conditions among multimorbid patients in primary care-results of the MultiCare cohort study. BMC Fam Pract. 2014;15(1):39.
De Groot V, Beckerman H, Lankhorst GJ, Bouter LM. How to measure comorbidity: a critical review of available methods. J Clin Epidemiol. 2003;56(3):221–9.
Fortin M, Hudon C, Dubois M-F, Almirall J, Lapointe L, Soubhi H. Comparative assessment of three different indices of multimorbidity for studies on health-related quality of life. Health Qual Life Outcomes. 2005;3(1):74.
Wallace E, McDowell R, Bennett K, Fahey T, Smith SM. Comparison of count-based multimorbidity measures in predicting emergency admission and functional decline in older community-dwelling adults: a prospective cohort study. BMJ Open. 2016;6(9):e013089.
Bayliss EA, Ellis JL, Steiner JF. Seniors’ self-reported multimorbidity captured biopsychosocial factors not incorporated into two other data-based morbidity measures. J Clin Epidemiol. 2009;62(5):550–7. e1.
Silliman RA, Lash TL. Comparison of interview-based and medical-record based indices of comorbidity among breast cancer patients. Med Care. 1999:339–49.
Schmier JK, Halpern MT. Patient recall and recall bias of health state and health status. Expert Rev Pharmacoecon Outcomes Res. 2004;4(2):159–63.
Haapea M, Miettunen J, Lindeman S, Joukamaa M, Koponen H. Agreement between self-reported and pharmacy data on medication use in the northern Finland 1966 birth cohort. Int J Methods Psychiatr Res. 2010;19(2):88–96.
Simpson CF, Boyd CM, Carlson MC, Griswold ME, Guralnik JM, Fried LP. Agreement between self-report of disease diagnoses and medical record validation in disabled older women: factors that modify agreement. J Am Geriatr Soc. 2004;52(1):123–7.
Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Ann Intern Med. 2007;147(8):573–7.
Donoghue OA, McGarrigle CA, Foley M, Fagan A, Meaney J, Kenny RA. Cohort profile update: the irish longitudinal study on ageing (TILDA). Int J Epidemiol. 2018;47(5):1398–l.
The Health Service Executive. Primary Care Reimbursement Service Statistical Analysis of Claims and Payments 2016 2016 [Available from: https://www.hse.ie/eng/staff/pcrs/pcrs-publications/pcrs-annual-report-2016.pdf.
The Central Statistics Office. Women and Men in Ireland 2013: persons with a medical card.
Sinnott S-J, Bennett K, Cahir C. Pharmacoepidemiology resources in Ireland—an introduction to pharmacy claims data. Eur J Clin Pharmacol. 2017;73(11):1449–55.
Richardson K, Kenny RA, Peklar J, Bennett K. Agreement between patient interview data on prescription medication use and pharmacy records in those aged older than 50 years varied by therapeutic group and reporting of indicated health conditions. J Clin Epidemiol. 2013;66(11):1308–16.
Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1(3):385–401.
Masnoon N, Shakib S, Kalisch-Ellett L, Caughey GE. What is polypharmacy? A systematic review of definitions. BMC Geriatr. 2017;17(1):230.
Ashby D. Practical statistics for medical research. Douglas G. Altman, Chapman and Hall, London. Statist Med. 1991;10:1635–6. https://doi.org/10.1002/sim.4780101015.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B Methodol. 1995;57(1):289–300.
Bowen A, James M, Young G. Royal College of Physicians National Clinical Guideline for Stroke 2016, [Available from: https://www.strokeaudit.org/SupportFiles/Documents/Guidelines/2016-National-Clinical-Guideline-for-Stroke-5t-(1).aspx.
Goldman N, Lin I-F, Weinstein M, Lin Y-H. Evaluating the quality of self-reports of hypertension and diabetes. J Clin Epidemiol. 2003;56(2):148–54.
Leikauf J, Federman AD. Comparisons of self-reported and chart-identified chronic diseases in inner-city seniors. J Am Geriatr Soc. 2009;57(7):1219–25.
Cricelli C, Mazzaglia G, Samani F, Marchi M, Sabatini A, Nardi R, et al. Prevalence estimates for chronic diseases in Italy: exploring the differences between self-report and primary care databases. J Public Health. 2003;25(3):254–7.
Diabetes Ireland community based education programme "CODE" for people diagnosed with Prediabetes and Type II Diabetes. https://www.diabetes.ie/living-with-diabetes/living-with-type-2/diabetes-ireland-education-programme/.
Popovic M, Chaudhary V, McKay BR, Moinul P, Mohaghagh M, Beattie A, et al. Discrepancies in physician–patient agreement in reporting ocular history. Can J Ophthalmol. 2016;51(5):378–81.
Bonovas S, Peponis V, Filioussi K. Diabetes mellitus as a risk factor for primary open-angle glaucoma: a meta-analysis. Diabet Med. 2004;21(6):609–14.
Corser W, Sikorskii A, Olomu A, Stommel M, Proden C, Holmes-Rovner M. Concordance between comorbidity data from patient self-report interviews and medical record documentation. BMC Health Serv Res. 2008;8(1):85.
Taylor A, Dal Grande E, Gill T, Pickering S, Grant J, Adams R, et al. Comparing self-reported and measured high blood pressure and high cholesterol status using data from a large representative cohort study. Aust N Z J Public Health. 2010;34(4):394–400.
The National Institute for Health and Care Excellence (NICE). Cardiovascular disease: risk assessment and reduction, including lipid modification. [CG181] 2016 [Available from: https://www.nice.org.uk/guidance/cg181/resources/cardiovascular-disease-risk-assessment-and-reduction-including-lipid-modification-pdf-35109807660997.
Sjahid SI, Van Der Linden PD, Stricker BHC. Agreement between the pharmacy medication history and patient interview for cardiovascular drugs: the Rotterdam elderly study. Br J Clin Pharmacol. 1998;45(6):591–5.
Klungel OH, de Boer A, Paes AH, Herings RM, Seidell JC, Bakker A. Agreement between self-reported antihypertensive drug use and pharmacy records in a population-based study in the Netherlands. Pharm World Sci. 1999;21(5):217–20.
National Institute for Health and Care Excellence. Hypertension in Adults: Diagnosis and Management (CG127) 2011 [Available from: https://www.nice.org.uk/guidance/cg127/resources/hypertension-in-adults-diagnosis-and-management-pdf-35109454941637.
Lulebo AM, Mutombo PB, Mapatano MA, Mafuta EM, Kayembe PK, Ntumba LT, et al. Predictors of non-adherence to antihypertensive medication in Kinshasa, Democratic Republic of Congo: a cross-sectional study. BMC Res Notes. 2015;8(1):526.
Hoffman BM, Papas RK, Chatkoff DK, Kerns RD. Meta-analysis of psychological interventions for chronic low back pain. Health Psychol. 2007;26(1):1.
McGrady A, Lynch DJ, Nagel RW, Tamburrino M. Coherence between physician diagnosis and patient self reports of anxiety and depression in primary care. J Nerv Ment Dis. 2010;198(6):420–4.
Knudsen P, Hansen EH, Traulsen JM. Perceptions of young women using SSRI antidepressants—a reclassification of stigma. Int J Pharm Pract. 2002;10(4):243–52.
Rauma PH, Koivumaa-Honkanen H, Kröger H, Tuppurainen MT, Kauhanen J, Honkanen RJ. The relationship between self-reported and registry-based data on use of psychoactive medications in postmenopausal women. BMC Psychiatry. 2013;13(1):180.
Freynhagen R, Bennett MI. Diagnosis and management of neuropathic pain. Bmj. 2009;339:b3002.
National Institute for Health and Care Excellence. Neuropathic pain in adults: pharmacological management in non- specialist settings 2013 [Available from: https://www.nice.org.uk/guidance/cg173/resources/neuropathic-pain-in-adults-pharmacological-management-in-nonspecialist-settings-pdf-35109750554053.
Scheiman JM. The use of proton pump inhibitors in treating and preventing NSAID-induced mucosal damage. Arthritis Res Ther. 2013;15(3):S5.
Ward BW, Nugent CN, Blumberg SJ, Vahratian A. Measuring the prevalence of diagnosed chronic obstructive pulmonary disease in the United States using data from the 2012-2014 National Health Interview Survey. Public Health Rep. 2017;132(2):149–56.
Guerard B, Omachonu V, Harvey RA, Hernandez SR, Sen B. The influence of respondent characteristics on the validity of self-reported survey responses. Health Serv Res. 2016;51(3):937–52.
Han B. Depressive symptoms and self-rated health in community-dwelling older adults: a longitudinal study. J Am Geriatr Soc. 2002;50(9):1549–56.
Damián J, Pastor-Barriuso R, Valderrama-Gama E. Factors associated with self-rated health in older people living in institutions. BMC Geriatr. 2008;8(1):5.
Stock SA, Stollenwerk B, Redaelli M, Civello D, Lauterbach KW. Sex differences in treatment patterns of six chronic diseases: an analysis from the German statutory health insurance. J Women's Health. 2008;17(3):343–54.
Osterberg L, Blaschke T. Adherence to medication. N Engl J Med. 2005;353(5):487–97.
Saunders K, Simon G, Bush T, Grothaus L. Assessing the feasibility of using computerized pharmacy refill data to monitor antidepressant treatment on a population basis: a comparison of automated and self-report data. J Clin Epidemiol. 1998;51(10):883.
Moore RA, Derry S, Aldington D, Cole P, Wiffen PJ. Amitriptyline for neuropathic pain in adults. Cochrane Database Syst Rev. 2015;7.
Milton JC, Hill-Smith I, Jackson SH. Prescribing for older people. BMJ. 2008;336(7644):606–9.
Morrow DG, Weiner M, Young J, Steinley D, Deer M, Murray MD. Improving medication knowledge among older adults with heart failure: a patient-centered approach to instruction design. The Gerontologist. 2005;45(4):545–52.
Guerra SG, Berbiche D, Vasiliadis H-M. Measuring multimorbidity in older adults: comparing different data sources. BMC Geriatr. 2019;19(1):166.
The authors wish to thank the staff at TILDA Trinity College Dublin and the HSE-PCRS for providing access to the data for this study.
This study was funded by the HRB Research Leader award (RL-2015-1579). The Irish Longitudinal Study on Ageing was supported by the Department of Health and Children, The Atlantic Philanthropies, and Irish Life. The HRB had no role in the design, methods, subject recruitment/data collection, or analysis of this study, or in the preparation of this article.
Ethics approval and consent to participate
Ethical approval for each wave of TILDA was obtained from the Trinity College Research Ethics Committee. Provision was made within this application to allow for the linking of participants GMS dispensing data, subject to participants’ consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Mannion, C., Hughes, J., Moriarty, F. et al. Agreement between self-reported morbidity and pharmacy claims data for prescribed medications in an older community based population. BMC Geriatr 20, 283 (2020). https://doi.org/10.1186/s12877-020-01684-8
- Older people