Commentary

The authors should be commended for their attempt to bring order to the chaos of studies of various graft materials and biological agents for the treatment of intra-osseous defects. The review shows that at least 18 distinctly different treatments were tested in 26 RCT that fulfilled the inclusion criteria. Most of the included studies have been of a rather short duration; have comprised rather few patients; and are characterised overall by considerable heterogeneity with respect to their design, methods, organisation, outcomes and maintenance-treatment schemes.

The authors conclude that the use of specific biomaterials/biologicals was more effective than OFD in improving the attachment levels of intra-osseous defects. They also note a significant heterogeneity between studies in most treatment groups, however, which necessitates a cautious interpretation of the possible clinical benefits of these biomaterials.

Although we agree with the latter statement, we find it difficult to support the conclusion about the beneficial effect of certain treatments that were investigated. The authors note that out of the 26 RCT, only 10 (38%) presented an adequate randomisation method; methods for allocation-concealment were adequate in only five trials (19%); blinded outcome assessment was reported in seven trials (27%); and therapists were blinded to treatment-assignment in only two trials (8%). These results again demonstrate the preponderance of poor-quality RCT in periodontology, as reported recently by Montenegro et al.1 We were able to deduce that only one study2 was found to fulfil all four quality criteria in the present review. All 26 RCT, however, were included in the analyses despite the fact that low-quality RCT are notoriously prone to bias and meta-analyses do not turn poor-quality studies into high-quality trials. We are therefore concerned that a review such as this may be interpreted as proof that the evidence has been carefully sifted, the reader stopping further scrutiny after reading the abstract statements that, “CAL change significantly improved after treatment with substance X, Y, and Z.”

One of the treatment modalities included in the present review is enamel matrix proteins, and this provided us with the opportunity to make a comparison with the recent Cochrane review of enamel matrix proteins.3 Indeed, interesting differences were noted. Hence, the only “high quality” study of the present review was scored as being not blinded with respect to the outcome assessors in the Cochrane review. The study of4 was excluded from the present review on the grounds of the defect/site, not the patient, being the statistical unit used; while it could be included in the Cochrane review. These disparities demonstrate that although systematic reviews add transparency to the review process, they do not provide a safeguard against biases, as high quality periodontal RCT's are all too few.

Practice point

  • Currently there is no evidence to support the use of these graft materials and biological agents for periodontal intra-osseous defects.