Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Published 27 February 2009, doi:10.1136/bmj.b351
Cite this as: BMJ 2009;338:b351
Jason W Busse, scientist, assistant professor1,2, Jagdeep Kaur, student2, Brent Mollon, student3, Mohit Bhandari, associate professor2, Paul Tornetta, third, professor4, Holger J Schünemann, professor5, Gordon H Guyatt, professor2
1 Institute for Work and Health, Toronto, Canada, 2 Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, ON, 3 Schulich School of Medicine and Dentistry, University of Western Ontario, London, ON, 4 Boston University School of Medicine, MA, USA, 5 Unit of Clinical Research Development and INFORMAtion Translation/CLARITY Research Team, Department of Epidemiology, Italian National Cancer Institute Regina Elena, Rome, Italy
Correspondence to: J W Busse, Institute for Work and Health, 481 University Avenue, Toronto, ON, Canada M5G 2E9 jbusse{at}iwh.on.ca
Design Systematic review of randomised controlled trials.
Data sources Electronic literature search without language restrictions of CINAHL, Embase, Medline, HealthSTAR, and the Cochrane Central Registry of Controlled Trials, from inception of the database to 10 September 2008.
Review methods Eligible studies were randomised controlled trials that enrolled patients with any kind of fracture and randomly assigned them to low intensity pulsed ultrasonography or to a control group. Two reviewers independently agreed on eligibility; three reviewers independently assessed methodological quality and extracted outcome data. All outcomes were included and meta-analyses done when possible.
Results 13 randomised trials, of which five assessed outcomes of importance to patients, were included. Moderate quality evidence from one trial found no effect of low intensity pulsed ultrasonography on functional recovery from conservatively managed fresh clavicle fractures; whereas low quality evidence from three trials suggests benefit in non-operatively managed fresh fractures (faster radiographic healing time mean 36.9%, 95% confidence interval 25.6% to 46.0%). A single trial provided moderate quality evidence suggesting no effect of low intensity pulsed ultrasonography on return to function among non-operatively treated stress fractures. Three trials provided very low quality evidence for accelerated functional improvement after distraction osteogenesis. One trial provided low quality evidence for a benefit of low intensity pulsed ultrasonography in accelerating healing of established non-unions managed with bone graft. Four trials provided low quality evidence for acceleration of healing of operatively managed fresh fractures.
Conclusion Evidence for the effect of low intensity pulsed ultrasonography on healing of fractures is moderate to very low in quality and provides conflicting results. Although overall results are promising, establishing the role of low intensity pulsed ultrasonography in the management of fractures requires large, blinded trials, directly addressing patient important outcomes such as return to function.
The Food and Drug Administration approved the use of low intensity pulsed ultrasonography for accelerating conservatively managed fresh fracture healing in 1994, and for treatment of established non-unions in 2000.4 Basic science research suggests that beneficial effects of low intensity pulsed ultrasonography on bone healing may include a positive impact on signal transduction, gene expression, blood flow, and tissue modelling and remodelling.5 Sales of bone stimulators in the United States alone represented a $500m (£351m;
380m) market in 2006, with projections of 6% or 7% growth per year.6 Based on data that suggested low intensity pulsed ultrasonography may reduce time to healing of operatively managed tibial fractures by a mean of 32 days (154 v 122 days), one study estimated savings of $13 259 per fracture.7 This economic analysis considered both direct and indirect costs; however, data for this model were based on a case series of 60 patients and an ultrasound registry and used radiographic healing as a surrogate for functional recovery.
In the absence of high quality evidence of improved patient important outcomes such as decreased time to weight bearing and earlier return to function, the widespread use of bone stimulators represents an uncertain investment of limited healthcare resources. Previous systematic reviews on the clinical effectiveness of low intensity pulsed ultrasonography and pulsed electromagnetic field therapy have proved inconclusive and in the case of low intensity pulsed ultrasonography focused exclusively on trials published before 2001 that utilised radiographic healing as the end point.8 9 10 We carried out a systematic review and meta-analysis of randomised controlled trials to determine the effect of low intensity pulsed ultrasonography on bone fractures, focusing on patient important outcomes, in particular functional recovery.
Eligibility criteria
Two reviewers (JWB and JK) screened the titles and abstracts of identified citations independently and in duplicate and acquired the full text of any article that either judged potentially eligible. These reviewers independently applied eligibility criteria to the methods section of potentially eligible trials. Eligible trials had to have randomly allocated patients presenting with any form of fracture to low intensity pulsed ultrasonography or to a control group. We resolved disagreements by discussion.
Data abstraction and analysis
Three reviewers (JWB, BM, and JK) extracted data from each eligible study independently and in triplicate. Data included personal information, methodology, details on interventions, and reported outcomes. Reviewers assessed study validity and applicability by appraising concealment of allocation, blinding, handling of withdrawals, cointerventions, compliance, similarity of timing of outcome assessment, and adherence to the intention to treat principle.11 12 The reviewers resolved disagreement by discussion. We attempted to contact study authors to settle any uncertainties.
Among eligible trials we found substantial diversity in the types of fractures targeted for treatment and the outcome measures used (table 1
). Two experienced trauma surgeons (MB and PT third) grouped the participants into the five clinical categories of non-operatively managed fresh fractures, non-operatively managed stress fractures, distraction osteogenesis, bone grafting for non-union, and operatively managed fresh fractures (table 1). We separated trials according to clinical presentation but not the bone involved. Although baseline healing time differs by size of bone and the site of fracture, the process of healing is consistent across all fractured bones13 and the effect of low intensity pulsed ultrasonography compared with control on the time to fracture healing is therefore likely to be similar. We reasoned that pooling trials with the same intervention directed towards clinically similar fractures of different bones would increase the generalisability of our results.14
|
We used random effects meta-analyses, which are conservative as they consider differences both within and among studies in calculating the error term used in the analysis.11 For the outcomes of time to return to active duty and time to full weight bearing we presented pooled data in the original units of measurement. For the outcome of time to radiographic healing we carried out meta-analyses by using the inverse variance method to combine the natural logarithms of the ratio of the mean time to healing in the treatment group to the mean time to healing in the placebo group. We then converted the resulting combined estimate and presented it as a percentage decrease in time to healing in the treatment group compared with the placebo group.15
Meta-analyses of small trials can provide evidence of benefit with what seem to be narrow estimates of precision; however, such reviews have often been subsequently refuted by large trials. To address this potential concern we determined that in cases in which our meta-analysis suggested benefit with an associated narrow measure of precision, if the sample size was less than the optimal information size (the number of patients generated by a conventional sample size calculation for a single trial)16 then we would consider the result imprecise. For the purposes of calculating the optimal information size we assumed a treatment effect (
) of 20%, an
of 0.05, and a β of 0.20. Our choice of
was based on a recent survey of orthopaedic trauma surgeons (268 respondents) in which 80% reported that a reduction of six weeks in healing of tibial fractures, attributed to a bone stimulator, would be important to patients3 and the assumption that a typical course of healing for tibial fractures is about seven months.
We examined heterogeneity using both a
2 test and the I2 statistic, the percentage of variability among studies that is due to true differences between studies (heterogeneity) rather than sampling error (chance).17 We considered an I2 value greater than 50% to reflect substantial heterogeneity.18 We generated three a priori hypotheses to explain variability between studies: fracture location, clinical category, and the technical specifications and application of ultrasound devices used. We did tests of interaction19 to establish if subgroups differed significantly from each other and used the criteria of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) to evaluate the quality of evidence by outcome.20
) on full text eligibility was 0.81 (95% confidence interval 0.68 to 0.94).
|
Three trials by the same group of authors, published in three different journals in 2005, reported on the effect of low intensity pulsed ultrasonography on lateral malleolar fractures.w7-w9 Contact with the lead author confirmed that there were two distinct trials: one randomised trial of 22 patientsw7 and another of 30 patients.w8 w9 This left 13 unique trials for analysis (fig 1).
Most studies reported only surrogate end points; five explored end points of importance to patients (table 1). Eleven trials used imaging methods to assess bone healing. Six studies used plain films,w1 w2 w6 w10-w13 one used dual energy x ray absorptiometry scans,w14 two used both dual energy x ray absorptiometry scans and multidetector computed tomograms,w7-w9 one used high resolution microradiographs of fixed biopsies,w5 and onew3 used sagittal computed tomography to assess scaphoid healing.
Study quality
Eligible trials were of limited quality (table 2
). Attempts were made to contact the authors of seven trials to resolve uncertainties,w3 w6-w10 w13 w15 and clarification was successful in four.w7-w10 w15 Eleven trials used a parallel design with random allocation of sham and active ultrasound devices; two did not use a sham device as their control.w3 w14 One trialw3 randomly assigned patients with non-operatively managed scaphoid fractures to usual care or to low intensity pulsed ultrasonography in addition to usual care, whereas another studyw14 randomly assigned one limb of patients who had undergone bilateral tibial osteotomy to ultrasonography and the other limb to control. Although one trialw13 stated that patients and care providers were blinded, the treatment and control devices were visually different. No study explicitly declared an intention to treat analysis, but no trials reported patient crossover and all patients were analysed according to the group to which they were randomly allocated. No trial described any cointerventions to which participants were exposed. Seven trials reported loss to follow-up, ranging from 3% to 47% (table 2), which in all cases was dealt with by excluding lost participants from both the numerator and denominator for all outcome calculations.
|
Five trials reported on patient compliance with low intensity pulsed ultrasonography.w1 w2 w5 w7 w11 w12 Compliance was measured by an elapsed time recorder that provided only the total time used and not the temporal picture of use and by a daily log book maintained by participants. All found high agreement between the internal device timer and patients log books, and that use of the device between treatment and control groups was not significantly different. One of the trialsw5 provided additional details on use of the device, noting that although the patients applied low intensity pulsed ultrasonography on a daily basis, treatment with the active device was interrupted in 11% of applications owing to disconnected cables, improper contact between transducer and skin, or a low battery; however, patients successfully corrected the error and resumed treatment in all cases but one.
One studyw10 used an alternate ultrasound device, the Theramed 101-B ultrasound device supplied by the Instituto Nacional de Investigaciones en Metrología (Havana, Cuba). The signal intensity was 30 mW/cm2, and the device was described as low intensity pulsed ultrasound therapy. Patients applied this device for 20 minutes each day until radiographic healing, and active and sham units were blinded in the same manner as the Exogen device. None of the 13 eligible trials reported any adverse reactions or complications attributable to the device.
Outcomes
When time to radiographic healing—the most commonly reported end point among eligible trials—was pooled across all studies it showed a moderate effect in favour of low intensity pulsed ultrasonography. The pooled mean reduction in radiographic healing time was 33.6% (95% confidence interval 21.4% to 43.8%) but the associated heterogeneity was high (I2=76.9%; heterogeneity P<0.01; fig 2
). Tests of interaction provided no evidence to support a different treatment effect across clinical presentations. The effect of low intensity pulsed ultrasonography was not significantly different between conservatively managed fresh fractures and operatively managed fresh fractures (P=0.48), between conservatively managed fresh fractures and operatively managed non-unions (P=0.61), or between operatively managed fresh fractures and operatively managed non-unions (P=0.39).
|
|
Low intensity pulsed ultrasonography significantly accelerated radiographic healing of fractures in all three trials that assessed this outcome.w1-w3 One trial found a 33.8% reduction in healing time, with distal radial fractures healing in 51 days compared with 77 days in the control group (mean difference 26 days, 95% confidence interval 6.4 to 38.6).w2 A second trial found a 30.3% reduction in healing time of scaphoid fractures; 43.2 days in the low intensity pulsed ultrasonography group compared with 62.0 days in the control group (mean difference 18.8 days, 7.6 to 30.0).w3 The authors did not specify the unit of their associated measures of variance, and for our analysis standard deviations were assumed. A third trial found a 46.3% reduction in healing time of tibial shaft fractures: 102 days in the low intensity pulsed ultrasonography group compared with 190 days in the control group (mean difference 88 days, 50.4 to 125.6).w1 This trial also found a significant improvement in surgeon assessed clinical healing (fracture stable and not painful to manual stress) of 86 days compared with 114 days (mean difference 28 days, 4.9 to 51.1), but not in time to partial weight bearing (45 days in the low intensity pulsed ultrasonography group v 49 days in the control group; mean difference 4 days, –11.0 to 19.0).15
The pooled results from the three trialsw1-w3 found a significant mean reduction in radiographic healing time of 36.9% (95% confidence interval 25.6% to 46.0%; I2=41.6%; heterogeneity P=0.18; fig 2). Calculating a
of 20% relevant to the control data for each trial (15, 12, and 38 days) and using the standard deviation associated with fracture healing in the three studies (31.6, 15.8, and 37.6 days) yields corresponding required sample sizes of 140, 56, and 32. The 158 patients available for this analysis therefore meet the optimal information size. Low quality evidence from three trials suggests a benefit of low intensity pulsed ultrasonography in non-operatively managed fresh fractures (tables 2 and 3).w1-w3
Non-operatively managed stress fractures
One studyw4 noted no improvement in return to full participation and duty among midshipmen sick listed because of tibial stress fractures. Patients treated with low intensity pulsed ultrasonography returned to active duty in a mean 55.8 days compared with 56.2 days for those receiving sham therapy (mean difference 0.4 days, 95% confidence interval –13.4 to 14.2). This trial provided moderate quality evidence of no effect of low intensity pulsed ultrasonography on return to function among non-operatively treated stress fractures (tables 2 and 3).
Operatively managed distraction osteogenesis
One studyw5 found no effect of low intensity pulsed ultrasonography in the stimulation of bone formation in the distraction gap created in severely resorbed mandibles, and suggested that future trials consider a longer consolidation period than 31 days. Another studyw6 found that low intensity pulsed ultrasonography accelerated radiographic healing in patients with tibial defects managed with distraction osteogenesis. The authors used a "healing index" as their outcome, which was defined as the duration of external fixation divided by the length of distraction gap. Patients using active low intensity pulsed ultrasonography had a healing index of 30 days/cm compared with 48 days/cm for those exposed to a sham device (mean difference 18.0 days/cm, 95% confidence interval 11.7 to 24.3). One studyw14 administered low intensity pulsed ultrasonography or sham treatment to patients undergoing opening wedge high tibial osteotomy to tackle varus deformity secondary to osteoarthritis. The authors noted that low intensity pulsed ultrasonography compared with sham treatment resulted in a significant increase in mean bone mineral density in the distraction callus (0.20 g/cm2 v 0.13 g/cm2; mean difference 0.07 g/cm2, 95% confidence interval 0.003 to 0.14) but not in bone mineral density distal to the distraction gap, nor in the mean consolidation period or duration of external fixator use. The authors did not specify the unit of their associated measures of variance, and for our analysis these were assumed to be standard deviations. Three trials provided very low quality evidence for accelerated functional improvement after distraction osteogenesis (table 2).w5 w6 w14
Operatively managed (bone graft) non-union
In one studyw10 the application of low intensity pulsed ultrasonography to patients with established scaphoid non-union and treated with vascularised pedicle bone graft compared with those exposed to a sham device accelerated healing by a mean difference of 38 days (95% confidence interval 26.3 to 49.7), which represents a 40.4% (95% confidence interval 30.8% to 48.7%) reduction in healing time (fig 2). Communication with the author established that the reported associated measures of variance were standard errors of the mean, and these were converted to standard deviations. To be considered healed, patients had to present with no tenderness at the scaphoid and show complete bridging of cortices on plain radiographs. Calculating a
of 20% relevant to the control data (94x0.2=19 days) and using the standard deviation associated with fracture healing (27 days) yielded a required sample size of 64. The 21 patients available for this analysis therefore did not meet the optimal information size. This trial provided low quality evidence for a benefit of low intensity pulsed ultrasonography in accelerating healing of established non-unions managed with bone graft (tables 2 and 3).
Operatively managed fresh fractures
Functional outcomes were inconsistent. One trial of patients with lateral malleolar fractures fixed using bioabsorbable screws found no differences in function at 18 months.w9 One trial of operatively managed tibial shaft fractures found no difference in time to full weight bearing (6.5 weeks for low intensity pulsed ultrasonography v 7.1 weeks for sham therapy; mean difference 0.6 weeks, –1.5 to 2.7).w11 w12 One trial of operatively managed tibial fractures reported that low intensity pulsed ultrasonography reduced average time to disappearance of site tenderness. Our reanalysis of the results found that this difference was not significant (6.1 weeks v 7.9 weeks; mean difference 1.8 weeks, –0.2 to 3.8, P=0.09). The authors did find that low intensity pulsed ultrasonography reduced time to full weight bearing (9.3 weeks v 15.5 weeks; mean difference 6.2 weeks, 4.4 to 8.0); there was no difference in time to partial weight bearing.w13
Two trialsw7-w9 of patients with lateral malleolar fractures fixed using bioabsorbable screws and treated with low intensity pulsed ultrasonography or a sham device found no significant differences in visualisation of the fracture line, external callus formation, percentage of bone healing, or bone mineral density. One studyw11 w12 found that low intensity pulsed ultrasonography had no effect on radiographic healing among patients with operatively managed (intramedullary nail) tibial shaft fractures. Active treatment resulted in a non-significant mean time to bridging of three cortices of 155 days compared with 125 days for sham treatment (mean difference 30 days, 95% confidence interval –16.5 to 76.5; fig 2). Leung et alw13 explored the effect of low intensity pulsed ultrasonography on operatively managed tibial fractures and found that it reduced time to removal of external fixator (9.9 weeks v 17.1 weeks; mean difference 7.2 weeks, 2.6 to 11.8) and time to first, second, and third callus formation; specifically, patients receiving active treatment showed formation of the third callus in an average of 11.5 weeks compared with 20 weeks for those receiving sham therapy (mean difference 8.5 weeks, 5.8 to 11.2), a 42.5% (95% confidence interval 31.7% to 51.6%) reduction in radiographic healing time (fig 2).
The pooled results from two trialsw11-w13 showed a non-significant mean reduction in radiographic healing time of 16.6% (–76.8% to 60.7%; I2=90.9%; heterogeneity P<0.01; fig 2). Four trials provided low quality evidence for acceleration of healing of operatively managed fresh fractures (tables 2 and 3).w7-w9 w11-w13
Quality of evidence
Our findings are strengthened by the comprehensive search and broad clinical eligibility criteria (including trials in any language), and by including only randomised controlled trials. In the GRADE system of rating quality of evidence for each outcome,20 24 randomised trials begin as high quality evidence but may be rated down by one or more of five categories of limitations. The eligible trials in our analysis had methodological limitations including lack of blinding of all relevant parties and substantial loss to follow-up in some trials. Results were sometimes inconsistent across trials, and most studies used surrogate end points; larger effects were typically reported for surrogates compared with direct measures of function. Concerns about publication bias arose from the limited number of small trials,25 and the inconsistent reporting of outcomes across trials raises the possibility of selective reporting bias,26 although we did not rate down the evidence for publication bias or selective reporting bias. The strength of inference is therefore limited.
Furthermore, two eligible trials did not specify the unit of measurement for their reported measures of variancew3 w14 and we were unable to clarify this information. We assumed that they reported standard deviations; however, three other eligible trials in our review reported the standard error of the meanw1 w2 w11 w12 and clarification with the author of another trial in which the unit of measurement was unclear established that they reported the standard error.w10 If our assumption was incorrect, and the authors of the two trials in questionw3 w14 reported the standard error, their results would become non-significant.
Implications for clinical practice and research
Recent Canadian surveys have found that 40% of senior residents in orthopaedic surgery (n=20) and 21% of trauma surgeons (n=268) are currently using low intensity pulsed ultrasonography as part of their management of tibial fractures.3 27 A 2008 narrative review in the Journal of Bone and Joint Surgery, American edition, that failed to include negative trials, said there is "overwhelmingly positive clinical data supporting low-intensity pulsed ultrasound as a treatment for fracture repair."5 Our results, however, suggest that despite the relatively common use of low intensity pulsed ultrasonography to enhance the healing of fractures the available evidence is only moderate to very low, few trials report on patient important outcomes (for example, time to full weight bearing or return to function), and of the five that didw4 w9 w11-w13 w15 only one reported a benefit.w13 Evidence to support the use of low intensity pulsed ultrasonography in operatively managed fresh fractures is inconsistent—inconsistency may (or may not) be explained by differences in the patient populations or by duration of low intensity pulsed ultrasonography use. A negative trialw11 w12 enrolled almost all closed tibial fractures and applied low intensity pulsed ultrasonography for 75 days, whereas a positive trialw13 enrolled mostly open tibial fractures and applied low intensity pulsed ultrasonography for 90 days. Future trials of the effect of low intensity pulsed ultrasonography on operatively managed fresh tibial fractures may enhance their usefulness by including a range of injury severity and stratifying by open and closed fractures, and by instructing patients to administer low intensity pulsed ultrasonography until their fracture is healed or until maximum likely healing has occurred (for example, no evidence of additional radiographic healing is apparent on two consecutive follow-up radiographs).
Even where the evidence for accelerating radiographic healing with low intensity pulsed ultrasonography is stronger, such as in conservatively managed fresh fractures, reduction in healing time as measured by plain films may not translate into patient important benefit. Nevertheless, low intensity pulsed ultrasonography may provide important benefits to patients with fracture through accelerated improvement in function. Large trials of high methodological quality focusing on patient important outcomes such as quality of life and return to function are needed to establish whether this is the case.
|
Cite this as: BMJ 2009;338:b351
Contributors: JWB, MB, and GHG were involved in the study design and concept. JWB, JK, and BM collected the data. JWB and GHG did the analysis. All authors critically revised the manuscript and approved the final version. JWB is the guarantor.
Competing interests: JWB, MB, and GHG are currently involved in a multicentre, randomised controlled trial that has received partial funding from Smith and Nephew, the company that manufactures Exogen. GHG and HJS are members of the GRADE working group.
Ethical approval: Not required.
© Busse et al 2009
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
![]()
CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
StumbleUpon
Technorati What's this?
Read all Rapid Responses