Papers

Effects of communicating individual risks in screening programmes: Cochrane systematic review

BMJ 2003; 327 doi: http://dx.doi.org/10.1136/bmj.327.7417.703 (Published 25 September 2003) Cite this as: BMJ 2003;327:703
  1. Adrian Edwards, reader (a.g.k.edwards{at}swan.ac.uk)1,
  2. Silvana Unigwe, medical student2,
  3. Glyn Elwyn, professor1,
  4. Kerenza Hood, senior lecturer in statistics2
  1. 1Department of Primary Care, University of Wales Swansea Clinical School, Singleton Park, Swansea SA2 8PP
  2. 2Department of General Practice, University of Wales College of Medicine, Llanedeyrn Health Centre, Cardiff CF23 9PN
  1. Correspondence to: A Edwards

    Abstract

    Abstract Objective To assess the effects of different types of individualised risk communication for patients who are deciding whether to participate in screening.

    Design Systematic review.

    Data sources Specialist register of the Cochrane consumers and communication review group, scientific databases, and a manual follow up of references.

    Selection of studies Studies were randomised controlled trials addressing decisions by patients whether or not to undergo screening and incorporating an intervention with an element of “individualised” risk communication–based on the individual's own risk factors for a condition (such as age or family history).

    Outcome measures The principal outcome was uptake of screening tests; further cognitive and affective measures were also assessed to gauge informed decision making.

    Results 13 studies were included, 10 of which addressed mammography programmes. Individualised risk communication was associated with an increased uptake of screening tests (odds ratio 1.5, 95% confidence interval 1.11 to 2.03). Few cognitive or affective outcomes were reported consistently, so it was not possible to conclude whether this increase in the uptake of tests was related to informed decision making by patients.

    Conclusions Individualised risk estimates may be effective for purposes of population health, but their effects on increasing uptake of screening programmes may not be interpretable as evidence of informed decision making by patients. Greater attention is required to ways of developing interventions for screening programmes that can achieve this.

    Introduction

    Various tests and procedures can be used for screening–to identify individuals and groups at “high risk” of various diseases or conditions. Many of these tests and procedures form part of screening programmes whose purposes are usually to reduce morbidity in the population but which may not always be effective for individuals. At the individual level several issues are important. These include the chances of detecting and preventing disease, or of false positive or negative tests with their important consequences in terms of tests or treatments to be undergone, or morbidity “unnecessarily” suffered.1 These chances of the potential harms and benefits must be considered by individuals making informed decisions about whether or not to undergo screening tests in health care.2

    Understanding of how best to present and discuss risks and benefits of health care in general, and screening in particular, for an individual is still limited. Some screening programmes provide information about population or “average” risks of contracting a disease; these often simply try to motivate people to attend for tests that are perceived by authorities to be in their own or the population's best interests.3 Other programmes attempt to provide information that is more personally relevant to the patient in question. We describe this as “individualised risk communication.”4 This may be based on the individual's own risk factors for a condition (such as age or family history). In some cases it is calculated from an individual's risk factors by using formulas derived from epidemiological data, such as the Gail formula for risk of breast cancer.5 The information itself may then be represented as an absolute risk or as a risk score, or categorised–for example, into high, medium, or low risk groups. It may be less detailed, entailing a listing–for example, of a patient's risk factors as a focus for discussion and intervention.

    In these scenarios it is generally anticipated that because the information is thought to be more pertinent individualised risk communication is more likely to be useful in making a decision about whether or not to participate in screening. But awareness is growing that decisions about screening can be influenced by the way in which information on risk is presented and that this may not necessarily be evidence of informed decision making.6 7 Raffle warns that harm to uninformed participants leads to anger, bitterness, and potentially litigation.8 The social and psychological costs of screening therefore need to be assessed.9

    Reviews of mass risk communication (to populations), primarily from the discipline of environmental health1012 and from narrow clinical fields such as familial cancer, are available.13 The effects of communicating risk in screening are not well understood to date. We undertook a systematic review to evaluate these effects, in particular to assess the effects of providing individual risk estimates in comparison with more general information on risk, and to see whether there is evidence that these contribute to informed decision making by consumers. This report summarises a Cochrane review published earlier this year.14

    Methods

    Two reviewers assessed for inclusion and extracted data on trial quality, the intervention, and relevant outcome data. We undertook meta-analysis where feasible. This review used standard methods based on guidance from the Centre for Reviews and Dissemination (UK)15 and from the Cochrane Collaboration's consumers and communication review group.

    Types of studies

    We included only randomised controlled trials. We did not exclude studies that were not by intention to treat, but their lower methodological quality is reflected in their method scores and the weight attached to their findings tempered accordingly.16

    Types of participants

    We included studies of people facing real decisions (not hypothetical exercises) about whether to undergo screening (presumptive identification of unrecognised disease or defect by the application of tests or other procedures, which can be applied rapidly). This could therefore include individuals making decisions alone or on another's behalf (for a young child), or couples making decisions together.

    The screening activities entailed investigations performed by or provided by health professionals. Examples could include mammography, cervical Pap smears, colorectal screening, screening for prostatic cancer (PSA test), antenatal screening, genetic screening (including breast cancer gene testing), screening for high cholesterol and cardiovascular risk, and neonatal screening.

    Types of interventions

    The interventions were providing information on individualised risk: firstly, individualised risk score or individual actual risk information (for example, calculated risk of breast cancer over the next 10 years17); secondly, categorisations of risk status based on these estimates (for example, high, medium, or low risk status, such as for colorectal cancer18); or, thirdly, discussion of personal risk factors relevant to the screening decision (the individual's own characteristics are taken into account in assessing their actual risk or heightened risk status relative to others–examples include risk factors for breast or prostate cancer19 20 that are relevant to the individual).

    We compared interventions providing information on individualised risk with those providing information on generalised risk, including average or population risk estimates (such as risk of breast cancer or cervical cancer), general information on risk factors, and general encouragement to acknowledge risks or change risk behaviour. We rejected studies if they simply evaluated health education or promotion to reduce risk factors or increase adherence to screening, without discussing the risks and benefits of undergoing or not undergoing screening.

    Types of outcome measures

    We extracted outcome data if available in the following areas21 22): firstly, cognitive outcomes: knowledge of risk, accurate risk perception; secondly, affective outcomes: anxiety, satisfaction with decisions made, decisional conflict, anxiety, intention to take up screening; thirdly, behavioural outcomes: uptake of tests, adherence to choice regarding screening programme, “appropriate” uptake; and fourthly, health status outcomes–for example specific status measures or quality of life measures such as the short form questionnaire 36 (SF-36).

    Search strategy for identification of studies

    Two reviewers (SU and AE) searched the specialised register of the Cochrane consumers and communication review group, Medline, EMBASE, CancerLit, CINAHL, ClinPSYC, and the Science Citation Index Expanded. The search strategies included three layers of search terms–keywords and medical subject headings (MeSH)–to identify articles about screening that included counselling or education on risk specifically. Databases were searched in Ovid (www.ovid.com) from 1985 onwards, as preceding years have low yields in this field.23 For the search strategies see appendix 1 on bmj.com.

    A manual follow up of references comprised the most frequently encountered journal (Preventive Medicine), contacting seven most frequently encountered authors (B K Rimer, C Lerman, M D Schwartz, V Champion, M W Kreuter, C S Skinner, and R Bastani) and citation index searches for these authors. We also checked other prominent reviews and a trials register in the field.24 25

    Methods of the review

    Two reviewers (AE and SU) independently selected publications from search outputs (titles and abstracts). Disagreements were resolved by discussion. In cases of doubt papers were retrieved in full for final assessment, including circulation of rejected papers to other members of the group to review the decision.

    Data extraction

    AE and SU extracted the data on to a template covering country of origin, group of health professionals involved, screening programme, group of patients involved, setting, sample size, and key outcomes. We extracted data on differences in baseline risk to assess effect modifiers. We extracted data on the nature and design of the intervention, including the type of individualised risk communication in the main intervention (see types of interventions). Outcome data comprised the absolute changes in numbers between groups (for dichotomous variables) and the mean change and standard deviation of the mean change (for continuous variables). We also recorded statistical significance of results. We extracted data to assess the quality of the study against methodological checklists.4 26 The checklist by Edwards et al assesses the quality of the trial and its report in the literature, but does not, for example, score on blinding of participants as it is often not feasible to do so in trials of risk communication.4 Differences in assessment of publications were resolved by discussion between the assessors.

    Data combination

    We first examined studies for qualitative synthesis. We then applied standard statistical methods for the consumers and communication review group to combine data by using MetaView where feasible, subject to assessment of homogeneity. We calculated odd ratios for dichotomous variables, and weighted mean differences for continuous outcomes. Sensitivity analyses entailed analysing different sections of the data–for example, according to different screening programme or studies based only on participants at high risk (as defined in the studies themselves, due to particular risk factors) rather than people at average risk. We also used the categorisation of individualised risk communication into three levels of detail given to consumers, to examine for evidence of different effect from heterogeneous groups of interventions.

    Insufficient data were provided in many studies to enable (raw) data entry into MetaView. In view of the heterogeneity of the studies in terms of the screening programmes addressed, participants, and design of intervention we used a random effects model (giving a more conservative confidence interval on estimates of effect sizes).

    Results

    Description of studies

    Thirteen studies met the inclusion criteria (please note that Lerman et al 199532 and Schwartz et al 199936 arise from the same study). Ten of these described interventions for mammography screening programmes or in relation to breast cancer risk and gene testing. Two addressed screening for (high) cholesterol, and one each addressed cervical, prostate, and colorectal screening (some studies covered more than one topic). Four studies were based on samples of people thought or known to be at higher risk than average for the population. Eleven studies were from the United States. The interventions were delivered by a range of healthcare professionals, ranging from doctors and nurses to staff specifically recruited and trained for the study.

    With regard to outcomes reported, 12 studies measured uptake of screening, but only 10 had reliable data for meta-analysis. Four measured changes in the perception of risk and susceptibility. Beyond this there were only occasional outcomes with reliable data for extraction. One study reported changes in knowledge with data that could be extracted, two measured intentions to undergo screening, and two measured movement across stages of change. We found no extractable data on costs, “appropriate” uptake, or health status (other than anxiety).

    Some studies were considered closely for inclusion but were eventually excluded. Broadly these fell into two groups. Some examined individualised risk communication but had either no control data or inadequate control data for comparison. Others did not specifically examine individualised risk communication as a separable intervention effect.

    Methodological quality of included studies

    The studies were of variable quality, but almost all method scores were above average for risk communication studies in health care.4 Although all were randomised trials, description of allocation concealment was adequate in two studies, inadequate in one, and unclear in the remainder.

    Review findings and meta-analysis

    The table shows principal data on the types of intervention, outcomes, and method scores of the 13 included studies. Appendix 2 on bmj.com and the Cochrane review contain further descriptions of the studies and outcomes.14 Overall we found evidence that individualised risk communication (whether written, spoken, or visually presented) was associated with an increased uptake of screening tests (odds ratio 1.5, 95% confidence interval 1.11 to 2.03) (figure for data from random effects models). The study outcomes showed statistical evidence of heterogeneity. Insufficient data were available (for example, on knowledge, perceived risk levels, attitudes to tests, and intentions to take or actual taking of tests) to assess whether this increase in test uptake was related to informed decision making.

    Effect modifiers

    Within this overall increase in uptake we found limited evidence that more detailed communication of individualised risk may lead to smaller increases in the uptake of tests (see figure). For individualised risk communication that used and presented numerical calculations of risk, the odds ratio for test uptake was 1.22 (0.56 to 2.68). For risk estimates or calculations that were categorised–for example, into high, medium, or low strata of risk–the odds ratio was 1.42 (1.07 to 1.88). For risk communication that simply listed personal risk factors the odds ratio was 1.7 (1.17 to 2.48). Differences between the categories did not reach significance.

    Figure1

    Uptake of test outcomes from 10 studies addressing decisions by patients on whether or not to undergo screening that were used in the review: random effects meta-analysis

    The results for the studies addressing mammography showed slightly smaller effects than among the whole group of studies (odds ratio for mammography studies 1.13, 0.98 to 1.29). The four studies examining risk communication in individuals at “higher risk”19 27 28 32 36 showed larger odds ratios (1.99, 1.52 to 2.6) for uptake of tests than the other studies.

    Discussion

    Principal findings

    Few studies in the field of screening have examined the effects of communicating individualised risk. Individualised risk communication is associated with higher uptake of tests, but the evidence that this is necessarily informed decision making by consumers is insufficient. We found insufficient studies to assess effect modifiers reliably, but some evidence showed that effects (on uptake) were greater among individuals at higher risk of disease.

    Strengths and weaknesses of the review and its findings

    The weaknesses of these data lie in the small number of studies. Findings or hypotheses arising from these data require further evaluation when more primary studies are available. The results are dominated by findings from the topic area of mammography. Caution is required in generalising from these results, and particularly for clinical topics other than mammography. Against this, the strength of these data lies in the fact that the studies have been gleaned from systematic searches of several key databases and contact with key authors in the field, and represent a synthesis of the existing literature base.

    Characteristics of studies included in this review

    View this table:

    The relative paucity of data in the screening area reflects the difficulties in communicating individualised risk to consumers. The range of clinical topics covered here is narrow. Calculation or estimation of risk is dependent on adequate epidemiological data, and feasible means of converting this into information for individual consumers on the basis of their own risk factors. Examples include the Gail model for risk of breast cancer5 and methods for calculating cardiovascular risk,38 but only the latter have permeated into routine clinical practice. Equivalent epidemiological research into a broader range of clinical topics is needed to enable calculation of individualised risk estimates for individuals with these conditions. Then further evaluation of the effects of providing such information on individualised risk to consumers would be possible.

    High risk status as an effect modifier

    The intervention effects seemed greater among consumers or patients deemed to be at higher risk than average.19 27 28 32 36 Thus a “high risk status” of consumers may be an important effect modifier for individualised risk communication, indicating substantial potential to modify choices made by such people. This may be a positive opportunity for clinicians to influence decisions among people with risk factors for a condition, but equally it could be potentially harmful if interventions are not introduced carefully.

    Informed decision making

    Two studies provided the most detailed risk estimates to patients, but were the only ones to show a reduction in uptake of tests.17 36 These effects of communicating risk are consistent with the effects of framing and other manipulations of data representation in health care7–that more information, especially information that is most pertinent to the individual and the decision on treatment in question, often makes consumers more wary of the treatments or tests on offer. Provision of a service may lead patients to perceive that professionals desire use of the service (in this case uptake of tests) rather than informed choices by patients. When the direction of effects is for lower uptake of tests, as in these two studies,17 36 it implies that information can have an important effect. This shows that the overall effect (of increasing uptake) in this review should be regarded with caution.

    Implications for screening programmes

    As above, the effects of interventions in this review may provide positive opportunities for clinicians to influence decisions among people with risk factors for a condition, but interventions must be introduced carefully to avoid harm. The opportunities to mislead are endless.39 The fact that screening decisions by consumers can be influenced substantially by the type of information generates tension between individual health policy (which seeks to enhance informed decision making) and objectives of population health. The data in this review indicate that the effects of informing patients about individualised risk are variable. In some instances the objectives of population health might be compromised (by lower uptake). The cost effectiveness of screening programmes in reducing the burden of disease depends on reaching a threshold level of coverage of the tests in the target population. Interventions using individualised risk communication may sometimes limit the ability of a programme to reach this threshold and sometimes enhance it.

    These tensions between the goals of population health and individual choices must be recognised.40 An informed debate should be conducted among the relevant interest groups–government, public health, clinicians, and particularly patients and their representative groups–and signs show that this is starting.41 Policy developments could explore whether individually appropriate choices, which may include choosing not to take tests, can be accommodated in standards and assessments of achieving best practice at population level.

    Further research

    If informed decision making by consumers is important, one consequence is that valid instruments will be needed to show that it has occurred. Some measures for specific conditions exist, such as the multidimensional measure of informed choice in screening for Down's syndrome.42 It examines the consistency between knowledge, attitudes to tests, intentions, and choices of uptake of tests. Further research should develop measures for other screening choices, or whether a generic measure of informed choice for screening decisions is feasible.

    Research should also evaluate individual cognitive and affective outcomes of interventions using risk communication. These include decisional conflict, satisfaction with decision making, and anxiety measures.4345 Further intervention studies in this field need to incorporate such measures into their evaluations as they address some of the core constructs that build towards informed decision making by consumers.

    These developments may make the effects of individualised risk communication interventions clearer, both in terms of informed decision making and uptake of tests. Until such data are available it seems premature to advocate the use of individualised risk communication simply on the basis that increased uptake of screening programmes has been shown.

    Conclusions

    Communication of individualised risk generally leads to increased uptake of screening programmes. This may meet professionally or policy driven agendas in health care, but it is not yet clear that the increased uptake is associated with informed decision making by consumers. Further evaluation of strategies to promote informed decision making is still required, and this must include detailed assessment of the cognitive and affective outcomes that may influence subsequent behavioural outcomes (namely, uptake of tests).

    What is already known on this topic

    Screening programmes are increasingly looking towards ways of promoting informed choices by people invited to have tests

    ndividualised risk communication–using specific risk estimates based, for example, on the individual's own risk factors for a condition (such as age or family history)–is associated with larger effects on patients' outcomes in general health care, but its effects in screening programmes are uncertain

    What this study adds

    individualised risk communication leads to increased participation in screening programmes

    It may be useful for purposes of population health, which depend on maximising participation

    Few data indicated that the increased uptake could be attributed to informed decision making by people invited to screening

    More developed strategies to promote informed decision making are still required

    Embedded ImageSearch strategies and descriptions of the included studies and their outcomes appear on bmj.com

    Acknowledgments

    We thank everyone who has commented on the project protocol and the parallel Cochrane protocol and review at various stages, helping to make it feasible. In particular this includes the Consumer Advisory Group within the Cochrane Consumers and Communication Review Group: Hilda Bastian and Genny Nolan (Australia); Teenah Handiside (New Zealand); Christine Brunswick (United States); the contact editor, Dominique Broclain; the editorial team; the review group coordinator, Megan Prictor; the coordinating editor, Sophie Hill; and external peer reviewers.

    Footnotes

    • Contributors AE designed the protocol, assessed studies for inclusion and data extraction, and led the drafting of this report. SU conducted the literature searches, assessed studies for inclusion and data extraction, and contributed to the drafting of this report. GE contributed to protocol design, was a third reviewer for inclusion and data extraction where required, and contributed to the drafting of this report. KH contributed to protocol design, the statistical data extraction and analysis, and contributed to the drafting of this report. AE is the guarantor.

    • Funding Cochrane Health Promotion and Public Health Field.

    • Competing interests None declared

    • Note about process AE is the guest editor for this theme issue of the BMJ but he submitted this research to the BMJ in the normal way and it was handled through the BMJ ‘s normal decision making mechanisms. He played no part in the decision making over this paper.

    • A fuller version of this review and its findings is available through the Cochrane Library. Issue 1. Update Software, 2003. (Consumers and Communication Review Group.)

    References