Increasing the usefulness of acupuncture guideline recommendations
BMJ 2022; 376 doi: https://doi.org/10.1136/bmj-2022-070533 (Published 25 February 2022) Cite this as: BMJ 2022;376:e070533Read the full collection
- Yu-Qing Zhang, executive director1 2 3 4,
- Liming Lu, professor5,
- Nenggui Xu, professor5,
- Xiaorong Tang, researcher5,
- Xiaoshuang Shi, researcher3,
- Alonso Carrasco-Labra, associate professor6,
- Holger Schünemann, professor2,
- Yaolong Chen, professor7 8,
- Jun Xia, associate professor4 9,
- Guang Chen, researcher10,
- Jianping Liu, professor11,
- Baoyan Liu, professor12,
- Jiyao Wang, professor13,
- Amir Qaseem, professor14,
- Xianghong Jing, professor3,
- Gordon Guyatt, professor2 15,
- Hong Zhao, professor3 16
- 1CEBIM (Center for Evidence Based Integrative Medicine)-Clarity Collaboration, Guang'anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
- 2Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- 3Institute of Acupuncture and Moxibustion, China Academy of Chinese Medical Sciences, Beijing, China
- 4Nottingham Ningbo GRADE Centre, University of Nottingham Ningbo, China
- 5South China Research Center for Acupuncture and Moxibustion, Medical College of Acu-Moxi and Rehabilitation, Guangzhou University of Chinese Medicine, Guangzhou, China
- 6Center for Integrative Global Oral Health, School of Dental Medicine, University of Pennsylvania, Philadelphia, PA, USA
- 7Institute of Health Data Science, Lanzhou University, China
- 8WHO Collaborating Centre for Guideline Implementation and Knowledge Translation, Lanzhou, China]
- 9Division of Epidemiology and Public Health, School of Medicine, University of Nottingham, UK
- 10Harvard Medical School, Harvard University, Boston, USA
- 11Centre for Evidence-Based Chinese Medicine, Beijing University of Chinese Medicine, Beijing, China
- 12China Academy of Chinese Medical Sciences, Beijing, China
- 13Zhongshan Hospital, Fudan University, Shanghai, China
- 14American College of Physicians, Philadelphia, Pennsylvania, USA
- 15Department of Medicine, Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada
- 16Shenzhen Luohu District Hospital of TCM, Shenzhen, China
- Correspondence to: H Zhao hongzhao2005{at}aliyun.com
Acupuncture is the most widely used traditional and complementary medicine, used in 113 of 120 countries according to a 2019 World Health Organization report.3 In addition to registered acupuncturists, medical doctors, nurse practitioners, and chiropractors occasionally deliver acupuncture treatment.4 Despite its widespread use and considerable available evidence, until recently, clinical practice guidelines from conventional medical organisations rarely included recommendations on acupuncture. Clinical practice guidelines aim to optimise patient care,1 and must meet standards of trustworthiness to avoid misleading clinicians, patients, and other stakeholders.2 We begin by summarising the progress made then address deficiencies that limit the clinical usefulness of acupuncture guidelines, examine the barriers to inclusion of acupuncture in guidelines, and suggest how to overcome them.
Which guidelines include acupuncture recommendations?
More than 1300 consensus and evidence based clinical practice guidelines were published between 1991 and 2007, and these included 2189 recommendations on the use of acupuncture.5 Two thirds of these recommendations focused on pain related conditions.5 Guidelines that include acupuncture fall into three types: those including acupuncture with conventional interventions, those restricted to traditional and complementary medicine, and those covering acupuncture only.
Although researchers have criticised the exclusion of acupuncture interventions from clinical guidelines,56 conventional medicine is increasingly including acupuncture as one more relevant intervention. For example, between 2010 and 2020, 133 guidelines included more than 430 acupuncture recommendations worldwide (fig 1).7 Over 70% of these guidelines were produced by conventional medical organisations, with the remainder published by organisations focused on traditional and complementary medicine in China, South Korea, and Australia.7 Acupuncture was most commonly recommended for musculoskeletal and connective tissue disease; neurological disorders; obstetrics, gynaecology, and women’s health; oncology; and gastrointestinal disorders.5678
Clinical guidelines that include acupuncture recommendations according to whether they are comprehensive (including conventional medicine), acupuncture only, or all traditional and complementary medicine
Are acupuncture guidelines evidence based?
Trustworthy guidelines are informed by systematic reviews of the best available evidence, including an assessment of the certainty of evidence and a rating of the strength of recommendations.1 Nearly half (49%) of the guidelines that included acupuncture interventions relied on systematic reviews, which is a higher proportion than for guidelines in general medicine (31% used systematic reviews).9 Roughly half of the guidelines used the GRADE approach to assessing evidence certainty and strength of recommendations,7 with other methods such as those of the Scottish Intercollegiate Guidelines Network, National Health and Medical Research Council, American College of Cardiology/American Heart Association, and Oxford Centre for Evidence-Based Medicine used in less than 5% of guidelines.7
How useful are current acupuncture guidelines?
To be useful, clinical recommendations should explicitly describe the target patients with sufficient detail to allow clinicians to judge the extent of similarity to their patients. In acupuncture guidelines, as in some others, this is not always the case.10 Among acupuncture recommendations published in the past 10 years, less than 4% reported the severity of the underlying condition to which their recommendations apply, and less than 30% reported disease stage.7 For example, in 2019, the China Association of Chinese Medicine published a guideline for the diagnosis and treatment of knee osteoarthritis using traditional Chinese medicine.11 It recommended using acupuncture for knee pain, swelling, and limited function without specifying the severity of the osteoarthritis. It is unclear to which patient population (mild, moderate, severe, or all) its recommendations apply.
Failure to provide sufficient details regarding the interventions also limits clinicians’ ability to implement the recommended acupuncture treatment. Just 40% of guidelines from conventional medicine organisations specified the types of acupuncture (eg, manual, electro-acupuncture, acupressure) they were recommending, and only 5% specified the range of points selected.7 The American College of Chest Physicians guideline on complementary therapies and integrative medicine for lung cancer suggested using acupuncture or related techniques as an adjunct treatment for nausea and vomiting from chemotherapy or radiation therapy (moderate certainty evidence, conditional recommendation).12 However, the recommendation did not specify the types of acupuncture, the range of acupoints selected, or the frequency and duration of treatment.
When using recommendations, clinicians need to understand how a particular intervention compares with available alternatives. The net benefit of a specific intervention is likely to differ substantially depending on the comparator. Current acupuncture recommendations often fail to make the comparator explicit (box 1).7 Without a clear comparison, a recommendation is not actionable.13
Examples of acupuncture recommendations that do and do not sufficiently define comparators
UK guideline on diagnosis and management of headaches in young people and adults14
The guideline from the National Institute for Health and Care Excellence concluded a net benefit of acupuncture over no treatment and recommended acupuncture. It also concluded that topiramate had net benefit over acupuncture and so recommended topiramate14
Korean medicine clinical practice guideline for lumbar herniated intervertebral disc in adults15
The recommendation favouring acupuncture for lumbar herniated intervertebral disc failed to specify whether the comparator is no intervention or other alternative intervention (eg, physical therapy)15
For clinicians to determine if the evidence justifies the recommendations, guidelines need to provide evidence on all “patient important” outcomes (benefits, harms, and burdens) for the competing interventions. Among guidelines that included acupuncture interventions in the past decade, 80% of the acupuncture specific guidelines reported outcomes to justify their recommendations. However, nearly half of the guidelines from conventional and complementary medicine do not report the outcomes evaluated.7 Moreover, failure to consider patients’ values and preferences further limited the usefulness of acupuncture recommendations. A review of clinical guidelines including acupuncture found less than 20% explicitly considered patients’ values and preferences (box 2).7
Example of acupuncture recommendation not explicitly considering patients’ values and preferences
Guidelines on recurrent urinary tract infection from the Canadian Society of Obstetricians and Gynaecologists16 suggest acupuncture as an alternative prevention strategy in women with recurrent infections who are unresponsive to or intolerant of antibiotic prophylaxis.
Continuous low dose antibiotics can cause antibiotic resistance, vaginal and oral candidiasis, and severe side effects such as skin rash and severe nausea.1617 Patients who place a high value on avoiding antibiotic related adverse effects might prefer acupuncture prophylaxis regardless of their responsiveness to or tolerance of antibiotics.
If the panel had considered patient values it might have proposed acupuncture as an alternative to antibiotics in all women considering prophylaxis. A recommendation explicitly addressing patients’ values would have a broader application beyond patients who are unresponsive to or intolerant of antibiotic prophylaxis.
RETURN TO TEXTWhat barriers exist in acupuncture guideline implementation?
Implementing an evidence based intervention into usual care takes an average of 17 years.18 Acupuncture is not an exception to this. For example, less than a quarter of clinicians in the US and China follow evidence based guidelines on use of acupuncture to treat low back pain and assist in recovery from cerebral infarction.192021 Barriers to implementation of acupuncture guidelines include personal factors related to physicians’ knowledge and attitudes, guideline related factors, and external factors such as organisational constraints, lack of resources or time, workload, and facilitation. For instance, a recent UK study surveyed general practitioners’ use of guidelines recommending acupuncture.22 Use of acupuncture was limited because of personal factors such as lack of awareness of the recommendations; external factors such as availability of practitioners to implement the intervention; and organisational constraints (clinical commissioning group controlling access).
Another study evaluated the implementation of evidence based traditional and complementary medicine guidelines on the care of inpatients after cerebral infarction in China.19 It found personal factors, including clinicians’ disagreement with the recommendations and lack of training and knowledge in the use of guidelines; external factors related to resources (coverage, unavailability of acupuncturists, and patients' economic status); and social and clinical norms or culture were the most important constraints on uptake of acupuncture recommendations.
Cultural factors also affect policy making, the composition of guideline development committees, allocation of resources, and the acceptability of acupuncture. For example, when considering resource use, whether a country relies on universal coverage or insurance companies, whether patients can choose the healthcare providers, and whether healthcare providers have the choice of therapies can substantially affect whether acupuncture recommendations are followed.
A hospital focused study across 11 cities in China identified inconvenient usage (eg, failure to link recommendations to the hospital information system); guideline unawareness; practicality (eg, unclear, unfeasible, and impractical to implement); and lack of evidence from local context among the highest barriers.
Further research is needed in guideline implementation given the limited number of studies available.
Do guidelines make recommendations for all questions of clinical interest?
Patients and clinicians often encounter situations in which limited evidence is available to support the use of an intervention. Even when there is uncertainty, clinicians still prefer to have guidelines rather than relying on systematic reviews, as it saves time and effort. In a randomised controlled trial that presented 500 clinicians with a clinical scenario for which sparse evidence was available, 80% of participants preferred receiving a recommendation.2324 However, 22% of the guidelines from conventional medicine organisations that included evidence on acupuncture with low or very low certainty refrained from making recommendations.7 For example, the 2021 US Department of Veterans Affairs guidelines on primary care management of headache mentioned acupuncture but did not make any relevant recommendation.25 By contrast, the UK guidelines (rightly in our view) made a conditional recommendation suggesting up to 10 sessions of acupuncture over 5-8 weeks for prevention of chronic tension type headache despite low certainty of evidence compared with no treatment.14
A recent overview of reviews26 found low or very low certainty of evidence for moderate to large benefits from acupuncture in 50 diseases or conditions. Despite the substantial potential benefits documented, clinical guidelines disregarded acupuncture as an alternative in 15 of these diseases or conditions (table 1).
Diseases and conditions for which acupuncture has a potential benefit (moderate or large effect) but is not included in clinical practice guidelines
Recommendations
Joint guideline development and definitive integration into patient care
When deciding on treatment, patients should have access to evidence supporting all reasonable care options regardless of whether they belong to conventional, traditional, or complementary medicine. When existing guidelines have compared acupuncture with other interventions, acupuncture specific guidelines can provide more specificity by considering different forms of acupuncture.
Conventional medical societies should collaborate with specialised acupuncture medical associations to increase the consideration of acupuncture treatments in recommendations. Collaboration can occur at two levels—firstly, in establishing joint priorities on critical clinical questions to consider in clinical guidelines, including acupuncture.27 For instance, collaboration would facilitate comprehensive guidelines focusing on whether acupuncture for headache prevention should be recommended versus no intervention or usual care, while acupuncture specific guidelines can concentrate on the optimal type of acupuncture, point selection, and duration of acupuncture treatment. Secondly, collaboration could facilitate recruiting a broad range of clinical experts to guideline panels.
An example of such a type of collaboration is reflected in the production of the first global acupuncture guideline, a joint effort between conventional medicine, traditional and complementary medicine, and acupuncture specific societies. The World Federation of Acupuncture and Moxibustion Society recently developed the first international acupuncture guideline for treating depression. This effort included 21 expert panels from Australia, South Korea, Germany, Norway, the USA, and China. Several international medical societies have endorsed the guideline. Such joint efforts could improve efficiency, reduce research waste, facilitate guidelines dissemination, and encourage the uptake of recommendations in clinical practice.
Produce more patient centric guidelines and recommendations
When making acupuncture recommendations, guidelines should summarise all patient important benefits, harms, and burdens of the competing interventions and specify the values and preferences underlying their recommendations, including how they arrived at those values. To ensure a consistent understanding of outcomes when discussing evidence, guideline developers should create standard health outcome descriptors (or marker states)— presentations in lay terms that describe the symptoms, time horizon (when and how long the outcome will persist), testing and treatment required, and consequences.28
Estimates of the relative importance patients place on different outcomes can come from systematic reviews of primary studies, surveys, or focus groups. Including patient partners in the panel may provide additional insights about patients’ perspectives.29
Increase use of existing extensive acupuncture evidence to inform recommendations
Much evidence in many clinical areas, including acupuncture, is of low certainty.26 When guideline developers identify relevant clinical questions, they should use the best available evidence to formulate recommendations even if it is low certainty. Evidence matrices can help guideline developers to identify relevant evidence. A 2021 evidence mapping identified systematic reviews of 1402 randomised controlled trials in acupuncture for 77 diseases, across 12 therapeutic areas, including 138 995 patients.26
Improve reporting standards
Acupuncture recommendations should improve reporting of patients’ condition, disease state and severity, intervention, comparator(s), and outcomes. The International Standard for Reporting Items for Practice Guideline in Healthcare (RIGHT) includes an extension that covers reporting of acupuncture guidelines and recommendations .3031 The Template for Intervention Description and Replication (TIDieR) and TIDieR-Placebo checklists help achieve optimal reporting of interventions and comparators.3233
Conclusion
Conventional medical communities increasingly consider acupuncture, contributing two thirds of all guidelines addressing acupuncture interventions. These recommendations are, however, still limited in their usefulness because of poor reporting of target populations, incomplete description of acupuncture intervention, failure to specify alternative care options, lack of comprehensive consideration of all patient important outcomes, failure to elucidate and apply patients’ values and preferences, and disregard of a large portion of the available body of acupuncture evidence. While limited available evidence suggests that existing barriers to implementation of acupuncture recommendations have commonality across cultures, few research efforts have focused on implementing acupuncture guidelines.
Guideline developers should establish joint efforts to set research priorities between conventional and complementary medicine communities and follow the relevant reporting standards and checklists to produce clear, actionable, trustworthy, patient centred guidelines. A global approach to guideline implementation research is needed to increase the uptake and adherence of evidence based acupuncture guidelines in practice.
Key messages
Local, regional, or international medical organisations producing conventional guidelines, including western interventions, contributed two thirds of acupuncture related guidelines
Failure to adequately characterise patient, intervention, and comparator undermines the usefulness of acupuncture recommendations
Clinical practice guidelines often fail to consider acupuncture interventions despite evidence of benefit
Establishing collaboration between conventional and traditional complementary medicine communities may help remedy the neglect of acupuncture
Key necessary improvements in acupuncture guidelines include explicit consideration of patients’ values and preferences, using entire body evidence in acupuncture, and a clearer description of interventions, comparators, and the patients to whom recommendations apply.
Footnotes
Contributors and sources: YQZ, HZ, LL, and NX conceived the study. XS and XT performed the data analysis. YQZ, LL, HZ, and XT wrote the manuscript’s first draft. AC-L, HS, GG, YC, JX, GC, BL, JL, JW, AQ, and XJ reviewed and edited the manuscript. All authors interpreted the data, critically revised the manuscript for important intellectual content, and approved the final version. As co-first authors, YQZ, LL, NX, and XT contributed equally to this work. XJ and HZ contributed equally.
Competing interests: We have read and understood BMJ policy on declaration of interests and declare that the study was supported by the special project of “Lingnan Modernization of Traditional Chinese Medicine” within the 2019 Guangdong Provincial Research and Development Program (2020B1111100008); the Innovation Team and Talents Cultivation Program of the National Administration of Traditional Chinese Medicine (ZYYCXTD-C-202004); and the National Natural Science Foundation of China (82174527). The funders had no influence on study design, data collection, analysis, decision to publish, or manuscript preparation.
Provenance and peer review: Commissioned; externally peer reviewed.
This article is part of a collection funded by the special purpose funds for the belt and road, China Academy of Chinese Medical Sciences, National Natural Science Foundation of China, the National Center for Complementary and Integrative Health, the Innovation Team and Talents Cultivation Program of the National Administration of Traditional Chinese Medicine, the Special Project of “Lingnan Modernization of Traditional Chinese Medicine” of the 2019 Guangdong Key Research and Development Program, and the Project of First Class Universities and High-level Dual Discipline for Guangzhou University of Chinese Medicine. The BMJ commissioned, peer reviewed, edited, and made the decision to publish. Kamran Abbasi was the lead editor for The BMJ. Yu-Qing Zhang advised on commissioning for the collection, designed the topic of the series, and coordinated the author teams. Gordon Guyatt provided valuable advice and guidance.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.