Adaptation and preliminary psychometric properties of three self-stigma outcome measures for people living with dementia
BMC Geriatrics volume 21, Article number: 34 (2021)
A diagnosis of dementia presents individuals with both social and psychological challenges but research on self-stigma in dementia has been largely confined to qualitative approaches due to a lack of robust outcome measures that assess change. The Stigma Impact Scale (SIS) is the most commonly used measure of self-stigma in dementia but its suitability as a tool to assess change in a UK population is unclear. Thus, the aim of this study was to identify, adapt and evaluate the acceptability and preliminary psychometric properties of self-stigma measures for people with dementia for use as measures of change.
A 4-step sequential design of identifying, selecting, adapting and testing psychometric measures as follows: 1) identification of stigma outcome measures through reviewing anti-stigma intervention literature, 2) selection of candidate measures through quality assessment (Terwee criteria) and expert consultation, 3) adaptation for UK dementia population (Stewart and colleagues Modification Framework) 4) testing of adapted measures in people living with dementia (N=40) to establish acceptability and preliminary reproducibility (test retest), criterion (concurrent with SIS) and construct (negative convergence with Rosenberg self-esteem scale) validity.
Seven measures were identified from the review, but most were poor quality (Terwee range: 0–4). Three measures were selected for modification: Stigma Stress Scale; Secrecy subscale of the Stigma Coping Orientation Scale; Disclosure Related Distress Scale. Internal consistency and test-retest reliability were acceptable (.866≤α≤ .938; ICC .721–.774), except for the Stigma Stress Scale (α= .643) for which the component subscales (perceived harm, ability to cope) had stronger psychometric properties. Concurrent validity with the SIS was not established (r<.7) although there were significant correlations between total SIS and perceived harm (r=.587) and between internalized shame and secrecy (r=.488). Relationships with self-esteem were in the hypothesized direction for all scales and subscales indicating convergent validity.
Stigma scales from mental health are not readily adapted for use with people with dementia. However there is preliminary evidence for the acceptability, reliability and validity of measures of perceived harm, secrecy and stigma impact. Further conceptual and psychometric development is required.
Dementia is a syndrome that comprises a collection of symptoms characterised by a decline in, and ultimately a loss of, cognitive functions such as decision-making, attention and awareness, planning, inhibition, learning, memory and language. Dementia is categorised as a major neurocognitive disorder in the Diagnostic and Statistical Manual of Mental Disorders 5th Edition . There are a number of underlying neuropathologies or neurodegenerative illnesses that ultimately lead to dementia, for example Alzheimer’s disease and vascular disease.
Receiving a diagnosis of dementia presents individuals with both social and psychological challenges where stigma can be a pivotal and powerful negative force shaping people’s experiences . The recent World Alzheimer Report on Attitudes to Dementia concluded that people living with dementia are stigmatised across many different domains, such as social life, finances, housing, healthcare, intimate relationships, making or keeping friends and being treated unfairly by children or family .
Self-stigma and its impact
Self-stigma, also referred to as internalized stigma, is a cognitive process whereby an individual internalises negative stereotypes and prejudice related to their stigmatised identity . There is a well evidenced connection between mental health difficulties and the experience of self-stigma which in turn was associated with lower levels of empowerment, self-esteem, hope, self-efficacy, symptom severity, treatment adherence, social support and quality of life [5, 6]. Self-stigma has also been linked to negative consequences of concealing a diagnosis (e.g. anxiety and depression) and withdrawal from health services [5, 7, 8].
People with dementia have also been found to be at risk of self-stigma. A recent systematic review found self-stigma to be associated with anxiety and depression, personal control, self-esteem, social support and activity participation [9,10,11]. More specifically, self-stigma has lasting negative consequences for people living with dementia such as withdrawing from everyday activities or interactions, delays in help-seeking, loss of confidence or feeling inferior [12,13,14,15,16].
The measurement of self-stigma in mental health is complex, with a recent review of 57 empirical papers documenting five self-stigma outcome measures for people with a mental health diagnosis . Authors of the five self-stigma measures reported content validity, however no or little detail was given on other important psychometric properties including internal consistency and convergent validity. A further systematic review examining the efficacy of psychosocial self-stigma interventions for people with schizophrenia-spectrum diagnoses identified six self-stigma measures from 12 studies but, again, these measures were subject to limitations including no of sensitivity to change in seven randomised controlled trials (RCTs). Collectively, both systematic reviews concluded that further refinement of self-stigma measures in line with reliability and validity criteria, careful cultural considerations and condition-specific adaptation with those who have lived experience of the condition are necessary avenues for future research [17,18,19].
The stigma impact scale
The Stigma Impact Scale (SIS) is the only self-stigma scale that had been previously tested in populations living with dementia . It has three subscales (social rejection, social isolation, internalized shame) and was based on the adapted Multidimensional Model of Perceived Stigma, which was used to explain self-stigma experienced by people living with Alzheimer’s and Parkinson’s disease . Recent testing of the SIS in people living with dementia suggests an association between decreased levels of self-esteem and increased levels of internalized shame and social isolation, speaking to the inverse relationship between self-esteem and stigma concepts which has been found in other mental health conditions [10, 21].
Rationale for study
The intervention that informed present work, Honest, Open, Proud (HOP) is a group-based psychosocial intervention delivered over three sessions to help people with mental health difficulties consider disclosing stigmatised identities (e.g. a diagnosis of schizophrenia) across settings [21, 22]. HOP has recently undergone adaptation to support people living with dementia , however, there are currently no ‘gold standard’ outcome measures available to evaluate the effectiveness of psychosocial stigma reduction interventions in dementia, with previous studies criticised for not reporting psychometric properties of measures used or using non-standardised outcomes [11, 24]. As such, there is a need for standardised and psychometrically robust outcome measures developed specifically to evaluate self-stigma for people with dementia. The aim of the current study was to identify, modify and test the feasibility and psychometric properties of existing stigma instruments used in mental health research for use with people living with dementia.
The design of the current study was a sequential process with four-stages consisting of identifying, selecting, adapting and testing psychometric measures.
Stage 1: review of HOP outcome measures
A review of Honest Open Proud (HOP) intervention studies was conducted to identify instruments that have been previously used in peer reviewed journal articles up until December 2018. Instruments were only included if: the focus of the measure was self-stigma as defined by Corrigan and Colleagues ; the instrument had been used as an outcome measure in the evaluation of a HOP intervention; intervention studies were published in peer reviewed academic journals. Instruments were excluded if the focus of the measure was on constructs not applicable to dementia, for example symptomatic recovery.
Stage 2: measure selection
Measures were selected using a combination of psychometric quality and research team appraisal.
Psychometric quality appraisal
The instruments identified were appraised for psychometric quality using guidance by , which has been used in previous research to establish the quality of psychometric instruments [26,27,28]. A focussed search for journal articles describing the development of each identified measure was conducted and each was appraised across seven domains: a) content validity, b) internal consistency, c) construct validity, d) reproducibility (in two parts: agreement and reliability), e) responsiveness, f) floor and ceiling effects and g) interpretability.
Any instrument could score a maximum of 2 per domain and a minimum of 0. Further details of scoring procedures are described in . Overall quality appraisal scores were calculated by summing the scores for each domain, with a potential score range between 0 and 18. Labels were assigned to interpret the quality of the instruments based on  where instruments that scored 0–4 were categorised as ‘poor’ quality, 5–9 as ‘moderate’ quality, 10–14 as ‘good’ quality, and 15–18 as ‘very good’ quality.
Research team appraisal
In addition to the quality appraisal criteria, two experts also appraised instruments, one an expert in stigma and disability (KS), the other an older adult’s expert with specialist knowledge in the measurement of psychological constructs (GC). Collectively, decisions were made to include instruments if all three of the following criteria were satisfied:
Instrument did not require significant changes to language that might invalidate previous psychometric findings (e.g. stereotypes and language used would be similar for a UK population);
The instrument was deemed acceptable and relevant for a person living with dementia;
The instrument could serve as a feasible outcome measure for an anti-stigma intervention for people living with dementia (“Who to tell, how and when?”)
Stage 3: adaptation and modification
Consultation with experts
Five expert researchers in the field of dementia research (1- dementia prevention assessment and intervention, 2- behaviour change and intervention fidelity, 3 - positive psychological outcomes and psychometrics, 4 - mixed methods research understanding the impact of chronic health conditions, 5- psychological support for people living with dementia and family carers) were asked to review the instruments on an item by item basis. The items were sent to each expert in a word document with instructions to indicate which items were relevant to people living with dementia based on their suitability and acceptability. Once all research experts indicated their views, they were collated in an excel spreadsheet.
Lived Experience Experts
A second expert group was made up of lived experience experts (people living with dementia and carers) involved in a patient and public involvement (PPI) capacity. PPI members were split into three sub-groups of approximately 2–3, with each group supported by one researcher. The instructions were to perform a card-sorting task where all items of the selected instruments were presented on strips of paper in no particular order and had to be sorted into two envelopes labelled “acceptable” and “not acceptable”. PPI members were informed that, in order for an item to be deemed acceptable, they must feel that it is understandable, relevant and that a person living with dementia would be able to answer the question. A round-robin technique was used to elicit thoughts and discussions on items from each member of the sub-groups. This methodology  allows for all group members to communicate a position rather than the acceptability of items being determined by a dominant personality. The card-sorting task was designed so that each item was reviewed at least twice by two different groups.
Measure modification framework
A measure modification framework  was used to incorporate modifications from consultation with two expert groups [29, 31]. In the event that expert groups had conflicting feedback about the instruments, discussions between authors were used to resolve this until a conclusion was reached. The Modification Framework  increased the likelihood that adaptations to the psychometric measures would lead to items with comparable meanings, reliability and validity to that of the original measures. Three types of modifications were used based on the above expert consultation: (1) drop dimension (a dimension (subscale) is omitted), (2) drop items (items are removed from an existing scale) and, (3) modify items (substituting a term or modifying wording without changing meaning).
Stage 4: pilot testing
Participants were included if they: (1) were an adult over the age of 18, and (2) had a primary progressive diagnosis of dementia. Participants were excluded if: (1) they had a chronic, terminal medical condition of which they were in the later stages, (2) they had a significant sensory impairment that could not be compensated for and precluded participation, and (3) they lacked capacity to consent to the study according to established guidelines [32, 33]. Ethical approval for this research was granted by the University College London Research Ethics Committee (Project: 11501/002).
Participants were recruited via three avenues: (1) researchers contacted participants who declared an interest or were matched to the study criteria on the Join Dementia Research (JDR) database, (2) self-identification where participants had heard about the research and expressed an interest in taking part (e.g. via social media and advertisements placed in local community buildings and shops), and (3) through outreach activities carried out by the researchers such as attending dementia groups (e.g. Alzheimer’s Society localities).
Selected and modified measures from steps 1 to 3 were administered alongside:
Stigma Impact Scale (SIS) to test for concurrent validity. All 21 items were rated from 1 (‘strongly disagree’) to 4 (‘strongly agree’) with the addition of 0 for ‘not applicable’ items across four subscales, namely, social rejection (9 items, e.g. “I feel others avoid me because of my impairment”), internalized shame (5 items, e.g. “I feel others think I am to blame for my impairment”) and social isolation (7 items e.g. “I feel set apart from others who are well”). As per previous research, the financial insecurity subscale was excluded [34,35,36].
Rosenberg Self-Esteem Scale (RSES) to test for convergent validity , which consisted of 10 items rated from 1 (‘strongly disagree’) to 4 (‘strongly agree’) measuring an individual’s beliefs and attitudes of themselves (e.g. “On the whole, I am satisfied with myself”).
Potential participants were given a study information sheet and at least 24 h to consider participating before consent was sought. Participation methods were either independently online or face-to-face data collection where one researcher (the lead author or an MSc student) conducted home visits. For the latter, participants completed the measures independently or adjustments were made if this was not possible, for example the researcher would support a participant by ticking their preferred response or providing hard copies with larger font format. Qualtrics (Qualtrics, Provo, UT) was used for online data collection, where a participant accessed the participant information sheet, screening questions, consent form and study measures through a survey link. During face-to-face data collection, these documents were presented to participants.
A subsample of participants were asked to complete the study instruments one to two weeks later (T2) in the same format in which they had completed them initially (T1).
The Statistical Package for Social Sciences (SPSS, Version 26) was used for data input and analysis.
Acceptability and Suitability
Acceptability and suitability were ascertained using completion rates, time taken to complete T1 and floor and ceiling effects. This was due to the premise that a more acceptable and suitable instrument would yield high completion rates, have similar times of completion across measures and no floor or ceiling effects would be present. If 15% of participants achieved the highest or lowest possible scores, floor and ceiling effects were considered significant. Researchers who conducted home visits took field notes on their experience of completing the instruments to understand the acceptability and suitability of the instruments.
The internal consistency for each scale and subscales was assessed using Cronbach’s Alpha. A value for alpha ≥ 0.7 is considered acceptable .
A Pearson Product-Moment Correlation Coefficient (Person’s r) was used to assess concurrent validity against the SIS. A correlation of ≥.70 was considered an indication of good concurrent validity .
The RSES was used to assess convergent validity as self-esteem has been previously negatively correlated with stigma experience (e.g. application of self-stigma and secrecy). It was hypothesised that a low to moderate negative correlation between self-stigma and self-esteem would be documented as per previous research . If at least 75% of the results are in accordance with this hypothesis, this demonstrates adequate convergent validity .
Stage 1: review of HOP outcome measures
Seven stigma instruments were identified from three HOP intervention studies: Perceived Devaluation Discrimination Questionnaire (PDDQ; ); Coming Out With Mental Illness Scale (COMIS; ); Stigma Stress Scale (SSS; ); Self-Stigma Of Mental Illness Scale (SSMIS; ); Stigma Coping Orientation Scale (SCOS; ); Internalized Stigma Of Mental Illness (ISMI; ); Disclosure Related Distress Scale (DRDS; [46, 47]).
Stage 2: measure selection
None of the identified measures reported information on reproducibility-agreement and responsiveness (see Table 1). Internal consistency findings using Cronbach’s alpha (between > 0.70 or < 0.95) in the absence of a factor analysis was reported for all measures apart from the SCOS. Criterion validity and floor and ceiling effects were only reported for the ISMIS . Content validity was adequately reported only for the COMIS, SSMIS, ISMI and SIS with a clear description of the measurement aim, target population, concepts being measured, item selection. The SCOS did not report any target population involvement in item selection. Construct validity was adequately reported for the ISMI but not for the SSMIS and all other measures only partially met the criterion (as less than 75% of hypotheses were confirmed despite adequate design and methods). Information on reproducibility reliability was adequately reported for only the SSMIS and ISMI. Interpretability was adequately reported for the PDDQ and SCOS however, only partially reported for COMIS, SSS, ISMI and SIS (no definition of minimal important change or absence of at least four subgroups). No interpretability findings were reported for SCOS. It was not possible to appraise the psychometric quality of the DRDS [42, 43] as the scale is an unvalidated measure previously used as a screening tool for HOP with no reported psychometric properties .
The SSS, SSMIS and SIS met all expert appraisal criteria (see Table 1). The PDDQ, ISMI, COMIS, SCOS would have required significant changes that would invalidate previous psychometric findings, such as mentions of symptomatic recovery throughout (‘going back to work after recovery’) and item stems across subscales that were not deemed relevant or acceptable for a UK population of people living with dementia (“I came out of the closet”; “I stayed in the closet”; “I will come out of the closet”; “I stay in the closet”) and the lack of transference of stereotypes from mental health to dementia. The COMIS was appraised as being the only measure that would not be accessible and relevant for people living with dementia. The COMIS, SCOS and ISMI were deemed unsuitable to serve as feasible outcome measures for a disclosure decision-making intervention for people living with dementia. This was because the COMIS dichotomised disclosure between ‘coming out’ and ‘staying in’ the closet rather than acknowledging the stages in-between (e.g. selective disclosure). The SCOS had only one subscale containing relevant concepts to disclosure, whilst the others were psychiatric treatment based.
Stage 3: results of adaptation and modification
Lack of appropriate or relevant language for people living with dementia, cognitive burden of completion and the inclusion of items around recovery were the main issues with the identified measures. It was necessary to drop all dimensions on the SSMIS and four subscales on the SCOS to leave only the secrecy subscale of the SCOS (SsSCOS). All dimensions on the SIS and SSS were retained. Item removal was necessary for the SsSCOS where two items were not relevant for people living with dementia “In order to get a job a former mental patient will have to hide his or her history of hospitalisation” and “you believe that a person who has recovered from mental illness earlier in life should not tell other people about it”. Item removal was necessary for the DRDS where the second item of the scale referring to employer/teacher disclosure was deemed irrelevant and removed. Consequently, the first item was divided in two, where the first item asked about disclosure to friends and the second to family. The DRDS items read as follows “In general how comfortable would you feel talking to [item one: a friend; item two: a family member] about dementia, for example, telling them you have a dementia diagnosis and how it affects you?”. Item modifications were made on the SSS, SsSCOS and DRDS to remove “mental illness” references to “dementia”. In the SSS, the term “prejudice” was replaced with “stigma” on the premise that prejudice and stigma are interchangeable terms yet stigma is the most colloquially appropriate. For the SIS, the term “dementia” was inserted into the instructions to be used interchangeably with “impairment”. See Table 2 for modification and adaptation summary.
Stage 4: pilot testing
Forty-One people living with dementia met the eligibility criteria and provided informed consent to take part in this study. One participant who took part online was excluded due to large amounts of incomplete data. Eighteen participants took part online and 22 participants completed the study during face-to-face visits. Sample characteristics are summarised in Table 3. Three participants were unable to remember the nature of their diagnosis. The majority of participants were native English speakers of ‘white’ ethnic background with one participant declining to complete this question.
Acceptability and suitability
The reported scores on the SSS, SIS and SsSCOS were normally distributed, with low levels of missing data. A Little’s Missing Completely At Random (MCAR) was non-significant for each measure (p = 1.00) indicating data were missing completely at random (MCAR) and therefore mean imputation at an item level was appropriate to deal with missing data [51, 52].
Time taken was recorded for a small sample of face-to-face participants who took a mean of 43 min (n = 7) to complete the measures at T1. The time taken for completion ranged from 15 to 60 min. No floor or ceiling effects were identified as the percentage of participants scoring the lowest or highest possible scores on an instrument was lower than 15%.
Field notes were collected during 14 of the 22 home visits carried out for face-to-face data collection. Three participants found the response categories of the SsSCOS challenging for items that were a double negative (item 1 and 4) but also because often the response was dependent on who the participant had in mind (e.g. item 7 of SsSCOS). For items that required more thought, participants read aloud items as questions for themselves with each response category (e.g. Do I agree that [item wording]) or included the item in a sentence with response categories (e.g. I agree that [item wording]), to establish a level of agreement and disagreement and whether it was strong or not. The scales were presented in tables with items on each row and response categories on each column. One participant found it difficult to align the column and rows to tick the appropriate response box.
Two participants found the phrase ‘stigma against people living with dementia’ (SSS) confusing due to being unsure whether the item was referring to themselves as a person living with dementia, to others with dementia but not themselves, or to people living with dementia more generally. One participant found item 21 of the SIS (“changes in my appearance have affected my social life”) difficult to relate to dementia.
The SIS (α =.906) and SsSCOS (α =.864) had acceptable internal consistency but the SSS (α =.643) did not. The Cronbach’s alpha values for all subscales were acceptable with the exception of the SIS subscale of internalized shame (α = .614) which fell below the cut-off for acceptability and the internal consistency was not improved through item removal.
Test re-test reliability
ICCagreement estimates and their 95% confidence intervals were calculated using data from 25 participants who completed both T1 and T2. Reliability of the majority of measures between T1 and T2 was moderate (see Table 4 for exceptions).
The SSS total was positively correlated with the SIS, however, the correlation coefficient was below the necessary cut-off to demonstrate satisfactory concurrent validity SIS (r = .525, p <.001). The perceived harm subscale of the SSS and the SIS total were positively correlated but the ability to cope subscale of the SSS did not correlate with the SIS total. This may be because they quantify conceptually different components (ability to cope vs social and psychological impact of stigma). The perceived harm subscale of the SSS was positively correlated with the social rejection and social isolation subscales of the SIS but not the internalized shame subscale. The ability to cope subscale of the SSS did not significantly correlate with the SIS subscales of social rejection, internalized shame or social isolation. The SsSCOS and the SIS total (r = −.001, p >.05), social rejection and social isolation subscales were not significantly correlated. The SsSCOS was positively correlated with the internalized shame subscale of the SIS.
In line with predictions, the overall SSS (r = −.475, p <.05) and SIS (r = −.587, p <.001), including all subscales with the exception of ability to cope subscale, were negatively correlated with the RSES. Correlations were within the predicted range of low-moderate with the exception of the perceived harm subscale. The SsSCOS (r = −.0.32, p >.05) did not significantly correlate with the RSES, lack of significance was not in line with predictions or previous research yet the direction of the correlation was.
This is, to our knowledge, the first study to report the acceptability, suitability and psychometric properties of self-stigma measures for people living with dementia. The results of the small-scale pilot suggest that the Stigma Stress Scale, secrecy subscale of the Stigma Coping Orientation Scale, and Stigma Impact Scale are acceptable for use in a UK population of people living with dementia. Almost all measures had moderate test-retest reliability, suggesting they may be suitable for use as outcomes measures (baseline versus follow-up), and all measures except the SSS total, and the internalized shame subscale, had good internal consistency. Concurrent (criterion) validity with the Stigma Impact Scale was tested for, but did not reach criterion for any correlation. Convergent (construct) validity was established with self-esteem with all correlations in the expected direction.
Findings in the context of existing research
The link between the appraisal of stigma as harmful (perceived harm subscale of the SSS) and social rejection and isolation was supported in the current study. However, the absence of a correlation between perceived harm and internalized shame was not predicted as previous mental health literature has found that internalized shame plays an integral role in shaping stigma experiences [42, 53]. The SSS may not adequately measure the stigma stress appraisal process for people living with dementia. Further, the internal consistency of the SSS was improved when the subscales were kept separate rather than as one overall score.
The secrecy subscale of the SCOS only correlated with the internalized shame subscale of the SIS, indicating secrecy may be associated more with cognitive components of self-stigmatisation than the more social and overt aspects (social rejection and isolation). Measuring levels of secrecy, therefore, may be a way of operationalising internalized shame rather than measuring the appraisal of stigma (SSS).
The current study found significant negative correlations between the SIS, all three subscales and the RSES, whereas previous work was only able to find this for the internalized shame subscale . The relationship between self-stigma and self-esteem is well documented in mental health stigma research, but less so in dementia. The current study, therefore, evidences the similarly important role of self-esteem in self-stigma for people living with dementia.
The internalized stigma of mental illness scale (ISMI) was excluded at the stakeholder consultation stage of the current study however it has been a popular measure for use in stigma reduction interventions for mental health (for a review see Wood et al., 2016). Although the ISMI had the highest quality rating of all identified measures, the content would have required significant changes for use in a population of people living with dementia. This speaks to the importance of acknowledging the nuances in the experience of self-stigma between clinical populations. With this in mind, the current study has begun to clarify the potential use of stigma measures in dementia, but efforts to establish specific frameworks (e.g. stress appraisal process in dementia) and theories should underpin the modification process as some measures may perform well in certain clinical populations and not others.
Methodological problems and limitations
The format of participation (online versus face-to-face) may have affected the results as participants may have been more likely to answer in a socially desirable manner if participation took place in person rather than online. In addition to this, four different researchers were involved in administering the instruments during face-to-face participation, potentially affecting inter-rater reliability. However, all researchers were trained in administration of the outcome measures and all had prior experience of working with people with dementia.
Although overall acceptability was satisfied, some participants felt that response categories were too absolute, where the answer would depend on whom the participant was thinking about at the time. For example, “how comfortable do you feel when talking to a friend about dementia?” depended on the “friend” in question, with some participants noting they had told some but not all of their “friends”. Thus, who the participant chose as the referent may have influenced the responses given. However, this feedback can be used to improve measures in the future.
The SIS was the only instrument available that had an existing evidence base for people living with dementia and was therefore used as the ‘gold standard’ measure to assess concurrent validity. However, the SIS may not truly offer a ‘gold standard’ measure as defined by Terwee and Collegues . For this reason, concurrent validity of the SSS and SsSCOS should be interpreted with caution.
The current study has begun to address the criticisms of previous work, namely the lack of reporting on psychometric properties. However, although previous research has suggested 25 to 40 participants are adequate for preliminary development and piloting measures,  further large-scale, quantitative studies are needed to confirm the psychometric properties of the SSS, SsSCOS and SIS.
As this study only provided tentative psychometric properties for three self-stigma measures, the next stage is to confirm these properties in a large-scale study and conduct further psychometric analysis to understand each measures sensitivity to change. Further, the various components of self-stigma and how they relate to each other and other mental and physical health concepts should be explored.
Currently, there are no models or frameworks to underpin the investigation of self-stigma in dementia, with little quantitative and qualitative work conceptualizing self-stigma. Work such as this should be established as it will form the basis of quantifying stigma experiences for people living with dementia. In addition, self-stigma in relation to other psychological comorbidities such as depression should be considered in future research.
Some participants were recruited through community groups (e.g. peer support) and others through the JDR database. Although the current study did not aim to quantify the experiences of people living with dementia, rather test the acceptability of doing so, it is important to note that those participants embedded in social groups that have shared experiences of dementia presented very different narratives regarding stigma and dementia to those not embedded in such groups. This may have a significant impact on wellbeing for people with dementia and the relationship between social connectedness, isolation and self-stigma which warrants further attention in future research.
Three self-stigma measures were identified and adapted using a robust four-stage process in which other identified measures were excluded due to poor quality of psychometrics or lack of relevance to dementia. Measures of secrecy, stigma impact and stress appraisal were acceptable for use in a UK population of people living with dementia. However, the psychometric properties were established using only a small sample. Further psychometric analysis is required before such measures can be implemented in psychosocial research.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Stigma Impact Scale
Randomized Controlled Trials
Honest Open Proud
Patient and public involvement
Join Dementia Research
Rosenberg Self-esteem Scale
Perceived Devaluation Discrimination Questionnaire
Coming Out With Mental Illness Scale
Stigma Stress Scale
Self-Stigma Of Mental Illness Scale
Stigma Coping Orientation Scale
Internalized Stigma Of Mental Illness
Disclosure Related Distress Scale
Secrecy subscale Stigma Coping Orientation Scale
American Psychiatric Association. Diagnostic and statistical manual of mental disorders (DSM-5®): American Psychiatric Pub.; 2013.
Harper LA, Dobbs BM, Buckwalter K. Stigma in dementia: its time to talk about it. Innov Aging. 2018;2(suppl_1):865.
Alzheimer’s Disease International. World Alzheimer Report 2019: Attitudes to dementia. London: Alzheimer’s Disease International; 2019. p. 311–29.
Corrigan PW, Watson AC. Understanding the impact of stigma on people with mental illness. World Psychiatry. 2002;1(1):16–20.
Pachankis JE. The psychological implications of concealing a stigma: a cognitive-affective-behavioral model. Psychol Bull. 2007;133(2):328–45. https://doi.org/10.1037/0033-2909.133.2.328.
Livingston JD, Boyd JE. Correlates and consequences of internalized stigma for people living with mental illness: a systematic review and meta-analysis. Soc Sci Med. 2010;71(12):2150–61. https://doi.org/10.1016/j.socscimed.2010.09.030.
Brouard P, Wills C. The Internalization of Stigma Related To HIV and Discrimination; 2006. p. 1–16.
Paxton S. The paradox of public HIV disclosure. AIDS Care. 2002;14(4):559–67. https://doi.org/10.1080/09540120220133080.
Burgener SC, Buckwalter K, Perkhounkova Y, Liu MF. The effects of perceived stigma on quality of life outcomes in persons with early-stage dementia: longitudinal findings: part 2. Dementia. 2015;14(5):609–32.
Burgener SC, Buckwalter K, Perkhounkova Y, Liu MF, Riley R, Einhorn CJ, et al. Perceived stigma in persons with early-stage dementia: longitudinal findings: part 1. Dementia. 2015;14(5):589–608.
Nguyen T, Li X. Understanding public-stigma and self-stigma in the context of dementia : a systematic review of the global literature. Dementia. 2018;19:148–81.
Morgan DG, Semchuk KM, Stewart NJ, D’Arcy C. Rural families caring for a relative with dementia: barriers to use of formal services. Soc Sci Med. 2002;55(7):1129–42.
O’Sullivan G, Hocking C, Spence D. Dementia: the need for attitudinal change. Dementia. 2014;13(4):483–97.
Walmsley B, McCormack L. Shame, hope, intimacy and growth: dementia distress and growth in families from the perspective of senior aged care professionals. Dementia. 2016;15(6):1666–84.
Werner P, Goldstein D, Buchbinder E. Subjective experience of family stigma as reported by children of Alzheimer’s disease patients. Qual Health Res. 2010;20(2):159–69.
Devlin E, MacAskill S, Stead M. ‘We’re still the same people’: developing a mass media campaign to raise awareness and challenge the stigma of dementia. Int J Nonprofit Volunt Sect Mark. 2006;21(July):47–58 Available from: http://eprints.uwe.ac.uk/15825/.
Brohan E, Slade M, Clement S, Thornicroft G. Experiences of mental illness stigma, prejudice and discrimination: a review of measures. BMC Health Serv Res. 2010;10:80 Available from: http://www.embase.com/search/results?subaction=viewrecord&from=export&id=L360303677.
Wood L, Byrne R, Varese F, Morrison AP. Psychosocial interventions for internalised stigma in people with a schizophrenia-spectrum diagnosis: a systematic narrative synthesis and meta-analysis. Schizophr Res. 2016;176(2–3):291–303. https://doi.org/10.1016/j.schres.2016.05.001.
Terwee CB, de Vet HCW, Knol DL, Bouter LM, Bot SDM, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.
Burgener SC, Berger B. Measuring perceived stigma in persons with progressive neurological disease: Alzheimer’s dementia and Parkinson’s disease. Dementia. 2008;7(1):31–53.
Corrigan PW, Kosyluk KA, Rüsch N. Reducing self-stigma by coming out proud. Am J Public Health. 2013;103(5):794–800.
Scior K, Rüsch N, White C, Corrigan PW. Supporting mental health disclosure decisions: the honest, open, Proud programme. Br J Psychiatry. 2019;216:1–3.
Bhatt J, Stoner C, Scior K, Charlesworth G. Adaptation and preliminary psychometric properties of three self-stigma outcome measures for people living with dementia; 2020.
Herrmann LK, Welter E, Leverenz J, Lerner AJ, Udelson N, Kanetsky C, et al. A systematic review of dementia-related stigma research: can we move the stigma dial? Am J Geriatr Psychiatry. 2018;26(3):316–31. https://doi.org/10.1016/j.jagp.2017.09.006.
Corrigan PW, Kerr A, Knudsen L. The stigma of mental illness: explanatory models and methods for change. Appl Prev Psychol. 2005;11(3):179–90.
Stansfeld J, Stoner CR, Wenborn J, Vernooij-Dassen M, Moniz-Cook E, Orrell M. Positive psychology outcome measures for family caregivers of people living with dementia: A systematic review. Int Psychogeriatr. 2017;29:1281–96.
Windle G, Bennett KM, Noyes J. A methodological review of resilience measurement scales. Health Qual Life Outcomes. 2011;9(1):8 Available from: http://www.ncbi.nlm.nih.gov/pubmed/21294858%0Ahttp://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC3042897.
Stoner CR, Orrell M, Spector A. Review of positive psychology outcome measures for chronic illness, traumatic brain injury and older adults: adaptability in dementia? Dement Geriatr Cogn Disord. 2015;40(5–6):340–57.
Delbecq AL, VandeVen AH. A group process model for problem identification and program planning. J Appl Behav Sci VII. 1971;7(4):466–92.
Stewart AL, Thrasher AD, Goldberg J, Shea JA. A framework for understanding modifications to measures for diverse populations. J Aging Health. 2012;24(6):992–1017.
Dening KH, Jones L, Sampson EL. Advance care planning for people with dementia: a review. Int Psychogeriatrics. 2011;23(10):1535–51 Available from: http://www.journals.cambridge.org/abstract_S1041610211001608.
Department of Health. Mental capacity act. London: HMSO; 2005.
British Psychological Society. Assessment of capacity in adults: Interim guidance for psychologists. In: Professional Practice Board and Assessment of Capacity Guidelines Group. Leicester: British Psychological Society; 2006.
Mangiaracina F, Chattat R, Farina E, Saibene FL, Gamberini G, Brooker D, et al. Not re-inventing the wheel: the adaptive implementation of the meeting centres support programme in four European countries. Aging Ment Health. 2017;21(1):40–8.
Szcześniak D, Urbańska K, Farina E, Saibene FL, Chattat R, Evans S, et al. Does participation in the Meeting Centre Support Programme change the stigma experienced by people with dementia? Eur Psychiatry. 2017;41:S177 Available from: http://linkinghub.elsevier.com/retrieve/pii/S092493381732093X.
Lion KM, Szcześniak D, Bulińska K, Evans SB, Evans SC, Saibene FL, et al. Do people with dementia and mild cognitive impairments experience stigma? A cross-cultural investigation between Italy, Poland and the UK. Aging Ment Health. 2019;0(0):1–9. https://doi.org/10.1080/13607863.2019.1577799.
George D, Mallery P. SPSS for Windows step by step: A simple guide and reference, vol. 14; 2003. p. 349–72.
Souza AC, Alexandre NM, Guirardello ED. Propriedades psicométricas na avaliação de instrumentos: avaliação da confiabilidade e da validade. Epidemiol e Serviços Saúde. 2017;26(3):649–59. https://doi.org/10.5123/S1679-49742017000300649&scielo=S2237-96222017000300649.
Link BG. Understanding labeling effects in the area of mental disorders: an assessment of the effects of expectations of rejection. Am Sociol Rev. 1987;52(1):96–112.
Corrigan PW, Morris S, Larson J, Rafacz J, Wassel A, Michaels P, et al. Self-stigma and coming out about One’s mental illness. J Community Psychol. 2010;38(3):259–75.
Rüsch N, Corrigan PW, Wassel A, Michaels P, Olschewski M, Wilkniss S, et al. A stress-coping model of mental illness stigma: I. predictors of cognitive stress appraisal. Schizophr Res. 2009;110(1–3):59–64. https://doi.org/10.1016/j.schres.2009.01.006.
Corrigan PW, Watson AC, Barr L. The self – stigma of mental illness : implications for self – esteem and self – efficacy. J Soc Clin Psychol. 2006;25(9):875–84.
Link BG, Struening EL, Neese-todd S, Asmussen S, Phelan JC. On describing and seeking to change the experience of stigma. Psychiatr Rehabil Skills. 2002;6(2):201–31 Available from: http://queensu.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwVZ0xDgIxDAQjxAuQQJT3gZOC48R2jTjxAD6QxHbJ_0t8EgW01rbe9RTWprQg6UCwnDsgK4rnyqaNhCTz9Pr3wf_j5tspHex9Tq_t8bo_128ZwDoFyzr3JK2lA5u0ESsc_I1K06EoYO1UZ6NO2QII2CnPIXE87PVaoZWYXtIxeNquaTFRLu7QoSmW5oPRUEb.
Ritsher JB, Otilingam PG, Grajales M. Internalized stigma of mental illness: psychometric properties of a new measure. Psychiatry Res. 2003;121(1):31–49.
Mulfinger N, Müller S, Böge I, Sakar V, Corrigan PW, Evans-Lacko S, et al. Honest, Open, Proud for adolescents with mental illness: pilot randomized controlled trial. J Child Psychol Psychiatry. 2018;6:684–91. https://doi.org/10.1111/jcpp.12853.
Rüsch N, Abbruzzese E, Hagedorn E, Hartenhauer D, Kaufmann I, Curschellas J, et al. Efficacy of coming out proud to reduce stigma’s impact among people with mental illness: pilot randomised controlled trial. Br J Psychiatry. 2014;204(5):391–7.
Kaiser CR, Major B, McCoy SK. Expectations about the Future and the Emotional Consequences of Perceiving Prejudice. Personal Soc Psychol Bull. 2004;30(2):173–84.
Link BG, Cullen FT, Struening E, Shrout PE, Dohrenwend P. A Modified Labeling Theory Approach to Mental Disorders: An Empirical Assessment. Am Sociol Rev. 1989;54(3):400–23.
Fife BL, Wright ER. The Dimensionality of Stigma: A Comparison of Its Impact on the Self of Persons with HIV / AIDS and Cancer. J Health Soc Behav. 2000;41(1):50–67.
Graham JW. Missing data analysis: making it work in the real world. Annu Rev Psychol. 2009;60(1):549–76.
Eekhout I. Don’t miss out!: incomplete data can contain valuable information; 2015.
Wood L, Byrne R, Burke E, Enache G, Morrison AP. The impact of stigma on emotional distress and recovery from psychosis: the mediatory role of internalised shame and self-esteem. Psychiatry Res. 2017;255(May):94–100. https://doi.org/10.1016/j.psychres.2017.05.016.
Johanson GA, Brooks GP. Initial scale development: Sample size for pilot studies. Educ Psychol Meas. 2010;70(3):394–400.
The authors would like to thank experts by experience from the UCL Research Advisory Group, Dr. Josh Stott, Dr. Holly Walton and Dr. Linda Birt for their expert input. We would also like to thank Rebecca Light and Ciara Rafter for their assistance in data collection and all the people who took part in this study.
This work was supported by the Alzheimer’s Society [AS - PhD - 16 – 022], the Economic and Social Research Council [ESRC grant number ES/ J500185/1] and the Promoting Independence in Dementia Project [ESRC grant number ES/L001802/2]. No funding bodies were involved in the design, collection, analysis interpretation or writing of the manuscript.
Ethics approval and consent to participate
University College London Research Ethics Committee granted ethical approval for the current study [REC No: 11501/002]. As per the ethics approval, all participants who participated were required to give consent by signing a consent form in person for face-to-face data collection, or signing electronically for online data collection.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Bhatt, J., Stoner, C.R., Scior, K. et al. Adaptation and preliminary psychometric properties of three self-stigma outcome measures for people living with dementia. BMC Geriatr 21, 34 (2021). https://doi.org/10.1186/s12877-020-01983-0