Commentary

This review addresses a clearly focused question: are fixed functional appliances as effective as removable functional appliances in correcting Class II malocclusions in children less than 16 years of age? The primary outcomes considered were clinical and cephalometric measurements and treatment duration; secondary outcomes were patient experience, harms and costs of both treatments. Since this was primarily a question evaluating therapy, the authors correctly included only randomised controlled trials (RCTs) or Controlled Clinical Trials (CCTs) in their search and analysis.

The authors increased the risk of missing potentially important studies by not including wildcards in search terms as well as omitting important literature sources (metaRegister of Controlled Trials, German National Library of Medicine, Bibliografia Brasileira de Odontologia and unpublished studies. Not looking at conference abstracts is an additional concern.1

There was no information on the inter-examiner agreement (kappa score) between the two authors involved in study selection and risk of bias assessment. The authors assessed the RoB by following Cochrane Handbook guidelines published in 2008. The Handbook has been updated twice since, and it would have been more appropriate for the authors to use the current edition (2011).

Another important limitation is that the authors have used the RoB assessment tool designed for randomised trials to evaluate the two controlled clinical trials as well. This is incorrect because these study designs are not equivalent and specific tools are available for assessing RoB in non-randomised studies including The Risk Of Bias In Non-randomized Studies – of Interventions (ROBINS-I) assessment tool as well as Downs and Black instrument.

Variability in the participants, interventions and outcomes studied may be described as clinical heterogeneity; variability in study design and risk of bias may be described as methodological heterogeneity; and variability in the intervention effects being evaluated in the different studies is known as statistical heterogeneity, and is a consequence of clinical or methodological diversity, or both, among the studies.

The authors' rationale not to do MA because the included trials suffered from methodological heterogeneity (study design and risk of bias) is inconsistent with the Cochrane Handbook recommendations 'Significant statistical heterogeneity arising from methodological diversity does not necessarily suggest that the true intervention effect varies.'2 Given the scope of the review evaluating any fixed vs any removable appliance in correcting class II malocclusions, clinical heterogeneity is expected. Given that statistical and methodological heterogeneity contribute to statistical heterogeneity, the authors should have performed a statistical test for heterogeneity and presented meta-analysis of primary outcomes. This is also supported by the fact that consistent trends were observed across studies with the use of fixed or removable functional appliances: significant improvement in anterior-posterior skeletal discrepancy and soft tissue profile, increase in mandibular length and a significant reduction in overjet. The overall treatment duration was not significantly different even though functional phase with fixed appliance was shorter.

Even though the quality of available evidence is low, doing a MA would have significantly enhanced the quality of the review.

Practice point

  • There is low quality evidence from clinical trials that indicate removable functional appliances are as effective as fixed functional appliances in treating Class II malocclusions among growing children

  • When patient compliance is an issue, fixed functional appliance can be a preferred option.