Introduction

An estimated one million non-surgical root canal treatments are performed in the UK every year.1 In most cases, non-surgical root canal treatment may be considered as routine and may be carried out in general dental practice or other primary care settings. However, experience levels, equipment availability or tooth-related complications such as access limitations, or canal sclerosis, may necessitate the need to refer patients onwards for management.2 A survey in England of newly qualified dentists in vocational training reported that most expressed a lack of preparedness with regards to complex or molar endodontics.3 In addition, the UK regulatory body, the GDC, considers that dental practitioners have a duty of care to refer a patient onwards when it is in the patient's best interest.4

Radiographs of acceptable quality are essential for accurate diagnosis and treatment planning.5,6 They should accompany patient referrals to reduce the need for repeat radiographs and further radiation exposure; this also avoids delays and ensures correct allocation of cases via the referral triage system. There is no shortage of research evidence showing that the quality of radiographs, in primary dental care, is often poor.7

In clinical practice, every radiograph should be subjected to quality control and it has been recommended that a formal audit of radiograph quality, either prospectively or retrospectively, should be carried out approximately every six months.6,8 The quality guidelines9 published by the National Radiological Protection Board (NRPB), now part of Public Health England, include a rating system (Table 1) and targets for radiographic quality (Table 2). The European Commission7 has also published guidelines, which reflect those of the NRPB, on radiation protection and quality assurance in dental radiology. The latest, third edition of guidelines on selection criteria and quality assurance for all aspects of dental radiography, including for endodontics, was recently published by the Faculty of General Dental Practice (UK).10

Table 1 Subjective quality criteria (based on NRPB 2001 guidelines9)
Table 2 Recommended minimum targets for quality (based on NRPB 2001 guidelines9)

The aims of this prospective study were to assess the type and comparative quality of the radiographs accompanying endodontic referrals to a health authority clinic. The results may inform on quality assurance and provide guidance on radiographic requirements accompanying endodontic referrals for the benefit of patients.

Materials and methods

Patient selection

The Oxfordshire Priority Dental Service operates a clinic one day a week at The East Oxford Access Centre, Oxford, for the assessment and treatment of non-routine endodontic cases. General dental practitioners who wish to refer their patients for this service are required to provide a referral note and a radiograph.

Approval for this study was obtained from the Dental Directorate, Oxfordshire Primary Care Trust. Digital and conventional film radiographs accompanying the first 200 referrals received from 1 January 2012 onwards were collected. Patient confidentiality was strictly respected and no personal information was divulged.

Conventional film radiographs were evaluated under standardised and optimised conditions using a light-box and a Brynolf magnifier in a darkened room. Digital radiographs sent as an email attachment or on a computer disc were viewed on a 22 inch professional widescreen, flat panel computer monitor calibrated for medical imaging;11 those supplied printed on paper were viewed in ambient room light.

Assessor calibration

An initial, separate, 20 radiographs accompanying referrals were assessed jointly by two examiners, both experienced dentists with enhanced skills in endodontics, overseen by a specialist in endodontics and a lecturer in dental maxillofacial radiology. The variables assessed, inclusive of the three-category quality-rating criteria (Table 1) based on NRPB guidelines9 are shown in Table 3. The 'visible target area' referred to whether the radiographs showed the whole tooth including at least 2 mm beyond the apex; failure to satisfy this requirement would entail the need to take another radiograph. In addition, the quality of the digital radiographs, as a function of the size, was noted. Any digital radiographs which were equivalent to a conventional periapical film size (≤31 mm × 41 mm) were categorised as 'small'; those printed on A4 size (210 mm × 297 mm) paper were categorised as 'large', while any sizes in-between were assigned the 'medium' category. To ensure reproducibility, the assessor calibration exercise was repeated twice within a three-month period, using a further 20 cases, to determine the inter- and intra-examiner agreement.

Table 3 Variables and features assessed

Statistical analysis

The anonymised data was recorded on an Excel spreadsheet and analysed using SPSS statistical analysis software to calculate the kappa, weighted kappa and confidence intervals (CI). The frequency of the different variables for conventional and digital radiographs was calculated; the Chi-squared test and probability scores were used to assess whether the frequencies differed significantly from those observed.

Results

A total of 200 radiographs accompanying referrals were received from 42 practices. The vast majority (n = 36, 86%) of these practices use digital radiography. Out of the 200 radiographs evaluated, 38 (19%) were conventional film and 162 (81%) were digital. All the conventional film radiographs submitted were un-mounted (n = 38, 100%) whereas almost all the digital radiographs (n = 161, 99.5%) were in the printed form apart from one (n = 1, 0.5%), which was provided on a computer disc.

The inter-observer variability had a Kappa score of 84% and weighted Kappa score of 88%. The intra-observer variabilities were 76% and 80%; both had a CI of 95%. The frequency and percentage of each variable for the conventional film or digital radiographs including the p-values as a measure of statistical chance are shown in Table 4.

Table 4 Frequency and percentage of variables for digital and conventional film radiographs (n = 200)

The digital radiographs, categorised according to size (small, medium or large), were also assessed in relation to quality (Table 5). The 'small' radiographs were of better quality with 50% categorised as 'excellent', while 44% of the radiographs printed on A4 paper (large) were 'unacceptable'. Regardless of size, digital radiographs in the 'unacceptable' category (33%) exceeded the NRPB (2001) recommended maximum of 10%.

Table 5 Quality ratings (1, 2, 3) in relation to digital radiograph size (small, medium, large)

Discussion

The advent of digital radiography has led to increased adoption of this technology.12,13 It has been reported that 45% of practices in the UK employ digital radiography14 as opposed to 20% reported in a Swedish study12 or an estimated 10–20% in the USA.15 In this study, a significantly higher number (85%), of referring general dental practitioners used digital radiography. However, it was not possible to ascertain which digital system was used by each referring practitioner and this may have affected the quality of the radiographs.13,16,17

The number of 'excellent' scores for conventional film radiographs was over twice that of digital radiographs and this was unchanged even with the inclusion of the 'diagnostically acceptable' category. A more significant difference was noted with those considered 'unacceptable', which comprised of 33% digital, compared with 8% conventional film, radiographs; the difference may decrease as digital radiography becomes more common and expertise in its use improves. In addition, the relatively small number of practices still using conventional film radiography (14%) may mean the results are less relevant. However, it may also be true that practices which still use conventional film radiography may be very experienced with this format and are capable of producing good quality radiographs, and therefore, do not feel the need to adopt newer, digital technology.18

According to NRPB guidelines,9 no more than 10% of radiographs should be rated 'unacceptable'. The 8% of conventional film radiographs rated 'unacceptable' in this study is within the NRPB guideline target and lower than the 19% reported in a similar study carried out in Sweden;12 the difference may be because in the Swedish study,12 86% of radiographs were conventional film compared with only 19% in this study.

A major problem with comparing studies of radiograph quality is the criteria used and the rating system chosen; there is the inevitable element of subjectivity and this could lead to difficulties in achieving a high agreement score.19 The number, experience and training of the assessors will also have an influence on the results. Instead of the NRPB three-category system9 adopted in this study, other studies have chosen a two-category ('acceptable' and 'unacceptable')12 or even four-category ('excellent', 'diagnostically acceptable', 'diagnostically compromised' and 'unacceptable') system.20 The four-category system was reported to be a more flexible and sensitive but the inter-observer agreements were reduced, although the kappa scores were still rated as good or moderate despite there being 14 assessors.20

In this study, in 17% of the digital and 5% of conventional film radiographs, coverage did not include the apex and the surrounding 2 mm or 2–3 mm periapex as recommended by the guidelines of the European Society of Endodontology21 and the European Commission7 respectively. The higher percentage of insufficient coverage of the area of interest with digital radiographs may be dependent on the sensor used. Charged couple device (CCD) or complementary metal oxide semiconductor (CMOS) sensors are more bulky than conventional film whereas photo-stimulable phosphor (PSP) plates resemble conventional film in size and shape.6,13,17 The image quality of digital radiographs was also reported to be superior with a PSP plate system.17

Digital radiography sensors generally perform well in terms of spatial and contrast resolutions.13,22,23,24 However, the results from this study showed that only 39% of digital radiographs were judged to be of the correct density or contrast; 36% were too light and 25% were too dark. The greater percentage of conventional film radiographs which achieved the correct density and contrast (58%) may be due to automated processing largely superseding hand processing.

Since nearly all of the digital radiographs were supplied as hard copies, printing had significantly degraded image quality;12,25 most printers are not able to reproduce 256 shades of grey.8 The choice of paper is also a factor;25 in this study, only one digital radiograph was printed on photographic paper compared with one-third12 or two-thirds26 in other studies. In addition, the digital radiographs were printed in different sizes, ranging from that equivalent to a periapical radiograph up to A4 size paper. The smaller printed digital radiographs were of better quality with 50% being rated as 'excellent' and 28% as 'diagnostically acceptable'. Of the largest, A4 size, 44% of the prints were 'unacceptable'; hence, if digital radiographs accompanying referrals have to be printed, a smaller size would be more appropriate. However, it may be argued that the quality of digital radiographs in the form of paper copies is too poor to justify the use of printed copies.12,25 Therefore, within the parameters of information governance, digital radiographs should, ideally, be provided electronically via a secure image/mail web portal or computer disc to prevent quality degradation and to permit manipulation of the image to maximise the diagnostic information obtainable. In the future, software for digital radiography may include tools that will automatically optimise image quality without the need for manual manipulation.24 Since digital radiographic image quality is also dependent on the computer display performance and viewing conditions,6,14,27 these factors should be included in any quality assurance programme. Only if it is not possible to supply an electronic copy with referrals, then digital radiographs should be printed on radiographic film or photographic paper to ensure limited loss of quality.25

If the quality of the radiographs is considered 'unacceptable' or the periapical area of interest is not included, then a repeat radiograph would be necessary; in this study, this would apply to 33% of digital compared with 8% of conventional film radiographs. Given the very high percentage of repeat radiographs necessary with digital radiographs, it would negate the advantages of digital radiography including a reduction in radiation exposure.28,29,30 The poorer quality of digital radiographs confirmed the need for quality control6,31 to facilitate correct diagnosis, to avoid the need for repeat radiographs and unnecessary radiation exposure. Furthermore, the results of this study support the recommendation of regulatory bodies, such as the GDC, that radiography and radiation protection is among the topics to undertake as part of compulsory continuing professional development requirements.32

Conclusions

The use of digital radiography is increasing as exemplified by the greater number accompanying referrals. The quality of digital radiographs was significantly lower compared with conventional film radiographs and the percentage of 'unacceptable' digital radiographs was above the target as recommended by the NRPB guidelines. Digital radiographs printed on paper were of reduced quality so unless they are supplied in electronic form, the inability to optimise the images using the appropriate computer software negates the benefits of using a digital system.

Commentary

Achieving high quality dental radiographs is fundamental in meeting the statutory requirements of IRMER (2000). In undertaking any dental radiography, dental surgeons and dental care professionals are accepting one or more of the defined roles under the IRMER regulations, ensuring appropriate measures are taken to ensure high quality images. These requirements are dictated by the ICRP principle 'as low as reasonably practical' (ALARP), highlighting the need to restrict doses to patients as much as possible when obtaining diagnostic radiographs.

The ALARP principle goes beyond the capture and processing of images, extending to the sharing of such images with other health professionals to avoid repeat radiographs. With digital radiography, difficulties can arise in sending an appropriate copy of the radiograph to the second clinician for adequate diagnosis.

This paper by Chong et al. considers the quality of dental radiographs received within an endodontic service. The findings and problems arising are likely to be similar within many specialties throughout the UK. It is clear from the results demonstrated, and personal experience, that digital radiographs printed in large format on paper are not acceptable for diagnosis, but at best could be used to record that a digital radiograph exists.

There is clearly a need to improve the ease of safe exchange of digital radiographs from the primary dental setting to secondary and tertiary referral centres. The Image Exchange Portal allows a simple and safe transfer of digital radiographs from one NHS trust to another, significant improving the exchange of images within secondary and tertiary centres. It seems unlikely that this facility will be opened to primary care clinicians, despite the dental professions being the only significant group of primary care clinicians requiring such a facility to great extent.

Alternative methods of transfer could include the use of an encrypted CD and password. However, this can create logistical problems for an NHS trust in ensuring the password and the CD are available for a patient when required; in the present study only one radiograph (0.5%) was provided in this way. Alternatively, an email transfer could be sent with the referral, but this would require a secure email such as NHSMail (nhs.net). Unfortunately not all dental practitioners have access to this service and many trusts do not provide a means of referring via email.

Over the coming years the majority of dental radiographs captured will transfer to digital format. Each clinician can strive to optimise the quality of the radiographs they capture but the diagnostic benefit can be lost if the radiographs are not managed appropriately when transferred to other clinicians. This is an area that needs urgent attention from our profession and also from the NHS trusts with whom we work.

Dr Bethan Thomas

Consultant Dental and Maxillofacial Radiology, King's Health Partners