The aim of this study was to evaluate and compare the diagnostic accuracy, the inter-rater agreement and raters’ certainty of cone beam computed tomography (CBCT) and radiography for the detection of scaphoid fractures. Our hypothesis is that the CBCT has a higher diagnostic accuracy for scaphoid fractures than radiography. We retrospectively analysed patients who underwent both radiography and CBCT examinations within 4 days to rule out a scaphoid fracture over a 2-year period in our institution. 4 blinded radiologists and orthopaedic surgeons independently rated the images regarding the presence of a scaphoid fracture. The reference standard was evaluated by two radiologists in a consensus reading. Inter-rater correlation was evaluated, pooled sensitivity, specificity, positive and negative predictive values were calculated and compared. 102 patients met the inclusion criteria. 52% of them had a scaphoid fracture. The inter-rater correlation was higher in the CBCT compared to radiography (P < 0.001). Sensitivity, specificity, positive and negative predictive values were higher for CBCT than for radiography (P < 0.019). Observers’ fracture classifications showed a higher correlation with the reference standard in the CBCT. Observers’ certainty for fracture detection and classification were higher in the CBCT. CBCT shows a higher diagnostic accuracy for scaphoid fractures than radiography.
Diagnostic accuracy of plain radiography for scaphoid fractures is known to be low1. Especially on the initial X-ray scaphoid fractures may be occult, which may delay therapy2. However, if a scaphoid fracture is not adequately treated there is a risk of healing complications and possible degenerative changes3. Textbooks therefore recommended further clarification by means of follow-up imaging or sectional imaging in the case of negative X-ray images and the continued clinical concern for fracture4. Due to its high spatial resolution and potentially low radiation exposure, cone-beam computed tomography (CBCT) could be an ideal candidate the further diagnostic workup in this mostly young patient group5.
CBCT is increasingly applied in musculoskeletal imaging6,7,8. Although initial studies have suggested that CBCT allows imaging with lower doses than multidetector computed tomography (MDCT)5,9, recent studies show that both modalities allow imaging at low-dose settings10,11. However, in the case of musculoskeletal CBCT, it is also possible to shield the radiation-sensitive organs from radiation due to scanner design, which can further reduce the effective dose of the examinations12. Several studies have demonstrated CBCT’s ability to reliably examine the wrist, including arthrography or diagnosis of distal radius fractures13. For the diagnostic accuracy of scaphoid fractures, however, no significant difference between the sensitivity of radiographs and CBCT could be found in an initial study, which applied MRI as a reference standard14. This recent finding is in contrast to our clinical experience.
The purpose of our study was therefore to evaluate and compare the diagnostic accuracy of CBCT and radiography for the detection of scaphoid fractures. Our hypothesis is that the CBCT has a higher diagnostic accuracy for scaphoid fractures than radiography. We additionally investigate the inter-rater correlation of both modalities and the certainty the readers have in the diagnosis made.
1034 potentially eligible participants had undergone CBCT imaging of the wrist in our institution from November 2012 to November 2014. 873 patients were excluded because they had no radiographs (scaphoid series) taken+/− 4 days of the CBCT examination. 57 patients were excluded because there was no clinical suspicion of scaphoid fracture. 2 patients were excluded because the electronic health record was not complete. This left 102 eligible participants (Fig. 1). We included 20 women and 82 men with a mean age of 33 years (standard deviation 16 years). According to the reference standard 53 participants (52%) had a scaphoid fracture.
The image quality ratings are shown in Table 1 and reasons for restricted image quality in Table 2. No case in the CBCT had diagnostic limitation. There was a significant difference between the image quality ratings of the two modalities (P-value < 0.001).
Sensitivity, specificity, positive and negative predictive values for the detection of scaphoid fractures in radiography and CBCT are shown in Table 3, imaging examples in Fig. 2. CBCT was superior to radiography in all comparisons performed (P < 0.019). Pooled contingency tables for radiography and CBCT are given in Table 4 and Table 5, respectively. Inter-rater agreement for fracture detection was 0.51 (CI 0.42–0.61) for radiography and 0.78 (CI 0.70–0.86) for CBCT (P-value < 0.001).
Correlation of the fracture classification ratings with the reference standard was 0.62 (CI 0.53–0.72) for radiography and 0.78 (CI 0.72–0.85) for CBCT (P-value < 0.001). In 7% of all cases, CBCT led to upgrading in fracture classification from A- to B-fractures compared to radiography. In 8% of all cases CBCT led to downgrading in fracture classification from B- to A-fractures compared to radiography.
Median values of observers’ certainty for fracture detection were 2 in radiography and 1 in CBCT (P-value < 0.001). Median values of observers’ certainty for fracture classification were 2 in radiography and 1 in CBCT (P-value < 0.001).
We demonstrate that compared to radiography CBCT has a higher sensitivity, specificity, positive and negative predictive value for the detection of scaphoid fractures. Inter-rater agreement and the correlation of fracture classification with the reference standard were higher for CBCT. Observers were more confident in their fracture detection and classification using CBCT. Obviously the cross-sectional imaging technique, which allows a superimposition-free representation of the bony structures of the wrist, is better suited for the diagnosis of scaphoid fractures than the projection method radiography.
Studies with MDCT already showed that computed tomography can facilitate a higher diagnostic accuracy for scaphoid fractures than radiography15. The main difference between MDCT and CBCT is the employed detector technology16. CBCT has a higher spatial resolution than MDCT17, which could in principal allow better visualization of scaphoid fractures. However, CBCT is also more susceptible to motion artifacts16, which could hinder diagnostics. In our study, where patients’ wrists were fixed to the CBCT-table, no diagnostic limitations in terms of movement artifacts were identified in the CBCT images. The relatively high number of scanner related artifacts in this study most likely relates to ring artifacts scarcely visible and irrelevant for diagnostics. In our experience, images in the CBCT also frequently show hardening artifacts around the cortical or articular surface, in particular the distal radial joint surface. In our study, however, there was no diagnostic constraint by these artifacts. Our results confirm existing data on the MDCT in that CT is better suited for the diagnosis of scaphoid fractures than radiography15,18.
Contrary to our results a recent prospective study employing MRI as a reference standard found no significant difference between the sensitivity of CBCT and radiography in the detection of scaphoid fractures14. This may be due to the fact that that study was powered to detect a difference in sensitivity of 15% between radiography and CBCT14. However, our data suggest that this difference might not be as high and range around 6%.
The overall good performance of CBCT points to its potential benefit in the diagnostic workup of scaphoid fractures. Nowadays, treatment planning of scaphoid fractures is based on a modified Herbert classification system, meaning that A-fractures can be treated conservatively and B-fractures are treated surgically19. In our study, CBCT imaging resulted in 15% treatment-relevant change in fracture classification (A vs. B) compared to radiography, consisting of 7% upgrading and 8% downgrading. In the case of clinically suspected scaphoid fractures and negative radiographs, CBCT can also be considered a modality for further evaluation. Although our data do not cover this clinical scenario, the CBCT, as a low-dose imaging technique, could also be considered a primary diagnostic tool in patients with clinically suspected scaphoid fracture. This has already been discussed for MDCT20. Further studies are necessary to evaluate this potential role of the CBCT.
The main limitation of our study is a possible selection bias in patient recruitment due to the retrospective design of the study. Given our inclusion criteria, patients with ambiguous radiographic findings could have been preferentially included, which in turn could have over-emphasized the superiority of CBCT as a problem-solver (by making conventional radiography appear worse than it actually is for the detection of scaphoid fractures). There are two reasons that suggest that this selection bias might be relatively low. Firstly, in our institution all scaphoid fractures diagnosed in the X-ray are actually examined in the CBCT in order to enable an adequate classification of the fractures. Secondly, the prevalence of scaphoid fractures and the diagnostic accuracy for conventional radiography reported in our study agree well with previously-published data1,2. However, we cannot definitively quantify the selection bias and its impact on the predictive values cannot be finally estimated. We therefore argue that a prospective study is required to validate the superior diagnostic performance of CBCT.
To conclude, we show that CBCT has a higher diagnostic accuracy for scaphoid fractures than radiography. In the clinical scenario of suspected scaphoid fracture and negative radiographs, CBCT, as a new low-dose technique in trauma imaging of the extremities, may have a substantial benefit for the diagnostic workup.
The Ethics Committee of the Albert-Ludwig University of Freiburg approved this retrospective study and approved that informed consent was waived (application number: 175/16). This study is HIPAA compliant and all methods were performed in accordance with the relevant guidelines and regulations in our medical centre.
Patients were identified through our electronic health record system. We included all patients who underwent CBCT of the wrist from November 2012 to November 2014 in our institution. We excluded all patients without radiography examinations (scaphoid series) acquired four days before or after the CBCT exam. In our institution all patients with suspected scaphoid fracture are followed with prompt CBCT. We only included patients on whom CBCT was performed because of suspected scaphoid fracture; all other referral reasons for CBCT were excluded. For study inclusion, we required a complete electronic health record. These resulting patient records form a consecutive series.
Digital radiography (scaphoid series) included dorsopalmar, dorsopalmar with ulnar deviation and lateral projections and was performed with 55 kVp and automatic exposure control. CBCT was performed at 90 kVp and 36 mAs (Verity; Planmed, Helsinki, Finland). The patient’s wrist was fixed to the CBCT-table with a tape for immobilization purposes. Axial images were reconstructed with a matrix of 801 × 801, a slice thickness and sparing of 0.2 mm.
The studies were anonymized and randomized. The clinical information was not available to the observers. Two radiologists and two orthopedic surgeons (5–10 years of experience in musculoskeletal radiography and CT) independently interpreted the studies on dedicated workstations. CBCT examinations were read at least 6 weeks after the radiographs, patient order was again randomized and different from the order in which the radiographs were evaluated. Readers evaluated the presence or absence of a scaphoid fracture, the certainty regarding fracture evaluation (Likert scale from 1 = very high to 5 = very low), scaphoid fracture classification (Herbert Classification19 from A1 to B5), certainty regarding fracture classification evaluation (Likert scale from 1 = very high to 5 = very low), image quality (Likert scale with 1 = good, 2 = minimal complaint without diagnostic limitation, 3 = bad with diagnostic limitation) and reasons for restricted image quality (wrong rotation, superimposition of foreign material and incomplete depiction/out of field of view, physics-based artifacts, patient-based/motion artifacts, scanner-based artifacts and incomplete depiction21, multiple nominations were possible).
Two radiologists (5 & 11 years of experience in musculoskeletal radiography and CT) performed a consensus reading of all imaging studies for fractures and fracture classification in all patients. The imaging studies included radiographs and CBCT for all patients and MRI examinations for 10 patients. The complete electronic health records including the complete clinical course of all patients but not the index test results were available to the assessors.
Pooled sensitivity, specificity, negative predictive value and positive predictive values regarding scaphoid fractures were calculated and compared with McNemar’s test and generalized score statistic. Inter-rater correlation for fracture detection was evaluated with Fleiss’s kappa, bootstrapping (replicates: 1000) was applied to calculate confidence intervals and compare with Student’s t-Test. Correlation of the fracture classification with the reference standard was evaluated with Spearman’s ρ, bootstrapping (replicates: 1000) was applied to calculate confidence intervals and compare with Student’s t-Test. Ratings of image quality, certainty regarding fracture evaluation and certainty regarding fracture classification evaluation were compared with exact Wilcoxon-Mann-Whitney test. Confidence intervals (CI) were stated at 95% level. The Bonferroni Holm method was applied to account for alpha error accumulation. A P-value < 0.05 was considered to denote statistical significance. Statistical analysis was performed with R22,23.
All data generated or analysed during this study are included in this published article.
Jenkins, P. J., Slade, K., Huntley, J. S. & Robinson, C. M. A comparative analysis of the accuracy, diagnostic uncertainty and cost of imaging modalities in suspected scaphoid fractures. Injury 39, 768–774 (2008).
Carpenter, C. R. et al. Adult scaphoid fracture. Acad. Emerg. Med. 21, 101–21 (2014).
Langhoff, O. & Andersen, J. Consequences of late immobilization of scaphoid fractures. J. Hand Surg. British Eur. Vol. 13, 77–9 (1988).
Bruno, M. A. et al. ACR Appropriateness Criteria®: Acute hand and wrist trauma. at http://www.acr.org/~/media/0DA5C508B7E14323A1AE52F23543F093.pdf (2013).
De Cock, J. et al. Cone-beam computed tomography: A new low dose, high resolution imaging technique of the wrist, presentation of three cases with technique. Skeletal Radiol. 41, 93–96 (2012).
Carrino, J. A. et al. Dedicated cone-beam CT system for extremity imaging. Radiology 270, 816–24 (2014).
De Smet, E. et al. Direct comparison of conventional radiography and cone-beam CT in small bone and joint trauma. Skelet. Radiol. 44, 1111–1117 (2015).
Lang, H. et al. A retrospective, semi-quantitative image quality analysis of cone beam computed tomography (CBCT) and MSCT in the diagnosis of distal radius fractures. Eur. Radiol. 26, 4551–4561 (2016).
Loubele, M. et al. Comparison between effective radiation dose of CBCT and MSCT scanners for dentomaxillofacial applications. Eur. J. Radiol. 71, 461–468 (2009).
Neubauer, J. et al. Comparison of the Radiation Dose from Cone Beam Computed Tomography and Multidetector Computed Tomography in Examinations of the Hand. Fortschr Röntgenstr 188, 488–493 (2016).
Hofmann, E., Schmid, M., Lell, M. & Hirschfelder, U. Cone beam computed tomography and low-dose multi- slice computed tomography in orthodontics and dentistry A comparative evaluation on image quality and radiation exposure Digitale dentale Volumentomographie und low-dose Mehr- schicht-Computertomographie i. J. Orofac. Orthop. 75, 384–398 (2014).
Lee, C. H., Ryu, J. H., Lee, Y. H. & Yoon, K. H. Reduction of radiation exposure by lead curtain shielding in dedicated extremity cone beam CT. Br. J. Radiol. 88 (2015).
Guggenberger, R., Winklhofer, S., Jv, S., Andreisek, G. & Alkadhi, H. In vitro high-resolution flat-panel computed tomographic arthrography for artificial cartilage defect detection: comparison with multidetector computed tomography. Invest Radiol 48, 614–621 (2013).
Edlund, R., Skorpil, M., Lapidus, G. & Backlund, J. Cone-Beam CT in diagnosis of scaphoid fractures. Skeletal Radiol. 45, 197–204 (2016).
Welling, R. D. et al. MDCT and radiography of wrist fractures: Radiographic sensitivity and fracture patterns. Am. J. Roentgenol. 190, 10–16 (2008).
Kalender, W. a. & Kyriakou, Y. Flat-detector computed tomography (FD-CT). Eur. Radiol. 17, 2767–2779 (2007).
Neubauer, J. et al. Comparing the Image Quality of a Mobile Flat-Panel Computed Tomography and a Multidetector Computed Tomography: A Phantom Study. Invest. Radiol. 49, 491–7 (2014).
You, J., Chung, S. & Chung, H. The usefulness of CT for patients with carpal bone fractures in the emergency department. Emerg. Med. J. 24, 248–250 (2007).
Krimmer, H., Schmitt, R. & Herbert, T. [Scaphoid fractures–diagnosis, classification and therapy]. Unfallchirurg 103, 812–819 (2000).
Stevenson, J. D., Morley, D., Srivastava, S., Willard, C. & Bhoora, I. G. Early CT for suspected occult scaphoid fractures. J. Hand Surg. (European Vol. 37, 447–451 (2012).
Barrett, J. F. & Keat, N. Artifacts in CT: recognition and avoidance. Radiographics 24, 1679–1691 (2004).
R Core Team. R: A language and environment for statistical computing. (2016).
Stock, C. & Hielscher, T. DTComPair: comparison of binary diagnostic tests in a paired study design. (2014).
The article processing charge was funded by the German Research Foundation (DFG) and the University of Freiburg in the funding programme Open Access Publishing.
The authors declare no competing interests.
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Neubauer, J., Benndorf, M., Ehritt-Braun, C. et al. Comparison of the diagnostic accuracy of cone beam computed tomography and radiography for scaphoid fractures. Sci Rep 8, 3906 (2018). https://doi.org/10.1038/s41598-018-22331-8
Diagnostic performance of cone-beam computed tomography for scaphoid fractures: a systematic review and diagnostic meta-analysis
Scientific Reports (2021)
Measuring standing hindfoot alignment: reliability of different approaches in conventional x-ray and cone-beam CT
Archives of Orthopaedic and Trauma Surgery (2021)
Incremental diagnostic value of color-coded virtual non-calcium dual-energy CT for the assessment of traumatic bone marrow edema of the scaphoid
European Radiology (2021)
Diagnostic accuracy of history taking, physical examination and imaging for phalangeal, metacarpal and carpal fractures: a systematic review update
BMC Musculoskeletal Disorders (2020)
Emergency Radiology (2019)