Abstract
This study aimed to develop a three-dimensional (3D) colour reproduction system to improve the aesthetic effects of dental prostheses. The system’s colour accuracy was also evaluated. Based on the concept of colour management, 96 colour patches were selected to develop colour profiles for an intraoral scanner and a 3D printer using polynomial regression. The colour differences Δ\({E}_{ab}^{\ast }\) between colour patches reproduced using different colour profiles and the original colour patches were analysed to select the best combinations of colour profiles. The 3D colour reproduction system with the best-performing (i.e. third-order polynomial regression) colour profiles was finally evaluated using tooth and gum shades. The median Δ\({E}_{ab}^{\ast }\) was 6.940 ranging from 1.504 to 32.660. In terms of tooth and gum shade, the median Δ\({E}_{ab}^{\ast }\) was 6.313, and half of the shade blocks were above the mismatch threshold (Δ\({E}_{ab}^{\ast }\) > 6.80). In conclusion, the colour management based on polynomial regression can decrease the colour difference of the 3D colour reproduction system, but not to clinically acceptable levels. Further advances are needed to improve the methods and hardware.
Similar content being viewed by others
Introduction
In aesthetic dentistry, colour plays an important role alongside tooth morphology and position in achieving a pleasing and natural-looking prosthetic result. The measuring and transferring of intraoral colour information are fundamental to achieve perfect mimicry of the natural teeth and the surrounding tissue, which is essential for aesthetic restorations. In digital dentistry, these processes are still limited by traditional methods. The digitally acquired colour information is mostly used in visualization of the design process, and not often transferred directly to the final prostheses or digitally fabricated dental models.
There are several ways of measuring colour information. A frequently used example is visual shading using shading guides. This is a subjective process and lacks accuracy in certain situations, as many factors can affect its results such as ambient illumination, the patient’s make-up, and the dentist’s colour perception. Another method is digital shading by a digital shading instrument, which is objective and quicker1,2,3 than conventional visual shading. However, these two methods are lossy to a certain extent as they “compress” the colour information of the tooth surface into a single notation (e.g. A2, 2L1.5 and ND2). Clinicians often need to provide technicians with chromatic maps or clinical photographs containing more details4, and achieving naturally coloured prostheses remains challenging. The correct interpretation of the chromatic maps relies on good cooperation between clinicians and technicians. The colours of photographs captured with different devices are usually device-dependent, and the colour of a photograph may be different on different displays. Recent research has reported using neural networks to match natural teeth directly with ceramic restorations, but the results were somewhat unstable5. The shortcomings of these methods mean a simple, visualized and device-independent method would be favourable.
Recent developments of digital impression technologies allowed the capture of not only the contour but also the detailed colouring of patients’ teeth. Digital impression systems employing real-colour scanning include shading modules capable of demonstrating acceptable accuracy and repeatability6,7,8. Meanwhile, the development of additive manufacturing has already realized full-colour three-dimensional (3D) printing of objects with colours based on the textures of digital models. This technology has been applied in artistic and industrial design for prototype verification. By combining real-colour scanning and full-colour printing, dental practitioners may transmit colour information using chromatic physical dental models that are simple, visualized and device-independent.
However, as scanning and printing systems each work in different colour spaces, a particular RGB value in the model may represent different visual colours. Therefore, colour management concepts are required to develop a conversion between the colour spaces, and so allow a 3D colour reproduction system to produce chromatic dental models with colours visibly perceived to be accurate.
This study sought to develop a 3D colour reproduction system based on intraoral scanning and 3D printing. Conventional colour management methods were applied to an intra oral scanner and a 3D printer to establish their colour profiles. These profiles allowed colour data to be transferred from device-dependent colour spaces to a device-independent colour space and vice versa. An in vitro evaluation of tooth and gum shades then verified the feasibility and accuracy of this system in dentistry.
Materials and Methods
Protocol for 3D colour reproduction
An intra oral scanner (TRIOS 3, 3Shape A/S, Denmark) and a 3D printer (J750, Stratasys Ltd., Israel) were used to build the 3D colour reproduction system. The 3D digital model was captured using the scanner, and saved as a virtual reality modelling language (VRML) file composed of geometry data and texture images. The scanner-based RGB values of each pixel from the texture image were converted to device-independent CIE XYZ tristimulus values using the scanner colour profile, and then to printer-based RGB values using the printer colour profile. The original scanner-based texture images of the VRML model file were replaced with the converted printer-based texture images. Finally, the modified 3D digital model was printed using the 3D printer to produce a physical 3D colour model (Fig. 1).
Development of colour profile for intra oral scanner
A crucial part of this research was the development of the colour profile for the intra oral scanner. This profile would link the RGB values of the scanner’s texture image to device-independent CIE XYZ tristimulus values.
A colour chart (ColorChecker Digital SG, X-Rite Inc., USA) (Fig. 2) provided colour patches. Excluding the outermost greyscale patches, 96 patches were selected from the chart for this process. The spectral reflectance of each patch was measured using a spectrophotometer (ColorEye 7000A, X-Rite Inc., USA). The CIE standard D65 illuminant [I(λ)] and 2° standard observer colour matching functions [\(\bar{x}(\lambda )\), \(\bar{y}(\lambda )\) and \(\bar{z}(\lambda )\)] were selected to calculate CIE XYZ tristimulus values based on the spectral data [S(λ)]:
where
The D65 illuminant and 2° standard observer were selected to simulate the practical requirements of dental shading which is generally bright neutral daylight and with a distance of about 1.5 m.
Each patch was then digitized by the intra oral scanner calibrated according to the manual. The “quality” of the colour acquired by the scanner was monitored using the built-in “Shade” function. Any target area marked blue would undergo additional scans from different angles to get correct colour representation (Fig. 3). The digital models were saved as VRML files. The central circular area of each texture image (radius 425 pixels) containing 567,460 pixels (Fig. 4) was selected to calculate average RGB values using Photoshop CC 2014 (Adobe Systems Inc., USA). To normalize the data sets, CIE XYZ tristimulus values were divided by the white point of D65 illuminant (95.047, 100, and 108.883) and the RGB values were divided by 255.
The colour profile represents a mathematical model calculated to relate the original RGB values and the target CIE XYZ tristimulus values. Conventional polynomial regression based on least squares is chosen for its convenient implementation and accurate results9,10,11. In this case, the mathematical relationship can be represented as
where T denotes an n × 3 matrix composed of the normalized CIE XYZ tristimulus values of the target colour patch, O denotes an n × p matrix composed of the normalized RGB values and their polynomial terms of the texture image (where n is the number of colour patches and p is the number of terms in the polynomial), and M is the transfer matrix we seek. Therefore, the least-square solution of M is
For simple linear regression, each row of O represents the normalized RGB values and a constant (usually 1) of a colour patch. The number of terms p therefore is 4, and
However, simple linear regression often cannot produce results with acceptable accuracy, thus quadratic and cubic polynomial regressions with more terms are considered. For the quadratic polynomial regression, p is 10, and
For the cubic polynomial regression, p is 20, and
In theory, there is no limitation on the order and number of terms in the polynomial. However, considering the number of samples available, the cost of computing and the required accuracy, the polynomial was constrained. Previous works9,10,11,12,13 indicate that quadratic and cubic polynomials might be suitable here. Adjusted R-squares were adopted for both models to evaluate their accuracy. All the calculations were performed via programming using the C++/Qt5 and C++/Eigen3 libraries.
Development of colour profile for 3D printer
Another crucial part of this research was the development of colour profile for the 3D printer. Different from the scanner colour profile, the printer profile would convert the device-independent CIE XYZ tristimulus values to printer-based RGB values.
The digital models of the colour patches were cropped and reconstructed to blocks of 13 mm (length) * 13 mm (width) * 4 mm (height), and were aligned together to form a 3D colour chart (Fig. 5). The colour chart was printed by the 3D printer using its “High Quality” and matte surface finishing mode (Fig. 6). The spectral reflectance of each block of the 3D colour chart was also measured using the spectrophotometer and was calculated to CIE XYZ tristimulus values under the same condition. The relationship between these CIE XYZ tristimulus values of the printed blocks and their corresponding RGB values was also resolved using polynomial regression based on least squares, as described above, in which the target matrix T was composed of the normalized RGB values of the texture images and the original matrix O was composed of the normalized CIE XYZ tristimulus values and their polynomial terms for the printed blocks. Both quadratic and cubic polynomials were resolved. Adjusted R-squares were adopted for both models to evaluate their accuracy.
Preliminary evaluation of the 3D colour reproduction system
As the CIE XYZ colour space is not particularly perceptually uniform, in order to evaluate the reproduction accuracy in terms of human visual perception, the CIE XYZ tristimulus values of the original colour chart and the printed colour chart are transformed to the CIE L*a*b* colour space according to the following formulas:
where
For D65 illuminant white point, Xn = 95.047, Yn = 100 and Zn = 108.883.
The difference of colours between the corresponding patches from the original 2D colour chart and the directly printed 3D colour charts can be calculated:
where \(\Delta {L}^{\ast }\), \(\Delta {a}^{\ast }\) and \(\Delta {b}^{\ast }\) respectively represent the differences of the two colours in the L*, a*, and b* parameters.
Given the compatibility of the profiles of the scanner and the printer, different profile combination might result in different colour reproduction performance. In order to select the most suitable combination of profiles, the texture images of the 3D colour chart were adjusted using four profile combinations: quadratic scanner profile - quadratic printer profile (QS-QP), quadratic scanner profile - cubic printer profile (QS-CP), cubic scanner profile - quadratic printer profile (CS-QP) and cubic scanner profile - cubic printer profile (CS-CP). The four adjusted 3D colour charts were printed using the configuration described above. The colour difference of each patch in the 3D colour charts was also measured and calculated. The combination with the lowest overall colour difference (CS-CP) was chosen for in vitro evaluation of tooth and gum shades.
In vitro evaluation of tooth and gum shades of the 3D colour reproduction system
After different colour profiles were created and evaluated, the CS-CP profile combination was chosen to test on tooth and gum shades for the assessment of dental applications. The intraoral scanner digitized 18 resin blocks, including 16 body shades (A1 to D4) and two gum shades (GUM-L and GUM-D) (Ceramage, Shofu Inc., Japan). The digital models were reconstructed, and the textures were adjusted according to the workflow in Fig. 1. The reconstructed and adjusted models were printed by the 3D printer. The CIE L*a*b* values of the original resin blocks and the printed samples were calculated as described above. Calculation of the corresponding \(\Delta {E}_{ab}^{\ast }\) evaluated the accuracy of this 3D colour reproduction system.
Statistical analysis
To evaluate the difference of \(\Delta {E}_{ab}^{\ast }\) for each profile combination, the non-parametric Friedman test was used following the Shapiro–Wilk test of normal distribution. The null hypothesis was that \(\Delta {E}_{ab}^{\ast }\) for each profile combination presented no difference. The results of in vitro evaluation for tooth and gum shades were simply analysed using the mean and median considering the small sample size.
Results
Colour profiles for the intra oral scanner and the 3D printer
Two colour profiles for each device were developed, and their adjusted R-squares are given in Table 1. The means of the differences, \(\Delta {E}_{ab}^{\ast }\), between the original and predicted values of the scanner colour profile are also provided. Increasing the order and number of terms achieved a better improvement for the 3D printer than for the intra oral scanner. The observed and predicted values for each patch using the colour profiles are plotted in Fig. 7. The adjusted R-squares and plots show both scanner colour profiles achieved good performance, whereas the cubic polynomial achieved better fitting for the printer colour profile than the quadratic polynomial.
Difference of colours between the original 2D colour chart and the printed 3D colour charts
Table 2 lists the means, medians, standard deviations (SDs), and minima and maxima of \(\Delta {E}_{ab}^{\ast }\) between the original 2D colour chart and the printed 3D colour charts.
The Shapiro–Wilk test indicated that all five groups did not follow the normal distribution (P < 0.001); therefore, non-parametric Friedman testing was used for analysis. Post hoc comparisons were performed using the Wilcoxon signed ranks test with Bonferroni adjustment (P < 0.005). The results showed statistical differences among the five groups. Group CS-CP showed the smallest median and statistically significant difference with directly printed group, which indicated that this combination of colour profiles performed best.
Difference of colours of reproduced tooth and gum shades
The CIE L*a*b* values and \(\Delta {E}_{ab}^{\ast }\) of each pair of shade block are listed in Table 3. The values \(\Delta {E}_{ab}^{\ast }\) ranged from 2.1850 to 11.2156 with a mean of 6.5378 and a median of 6.3129. The results matched the CS-CP profile described above. There was a tendency that darker tooth shades would result in larger errors. Based on the study of Johnston14, only A1 and B1 blocks achieved imperceptible colour difference (\(\Delta {E}_{ab}^{\ast }\) < 3.70), while blocks A3.5, A4, B3, B4, C3, C4, D4 and GUM-L blocks has differences above the mismatch threshold (\(\Delta {E}_{ab}^{\ast }\) > 6.80).
Discussion
This study developed a method of building a 3D colour reproduction system and evaluated the accuracy of its colour reproduction. The resulting colour differences were unsatisfactory, possible owing to the cumulative errors from scanning, converting and printing. Related works have shown the intraoral scanner used here to achieve acceptable accuracy and precision in shade measurement6,7,8. This is confirmed by the scanner colour profile representing an acceptable mean of \(\Delta {E}_{ab}^{\ast }\). However, the introduction of printing error made the system’s overall error unacceptable. The results resemble the outcome of traditional colour management using camera, scanner and printer. Digital cameras and desktop scanners based on additive colour models (e.g. RGB colour model) usually achieve good polynomial relationships between RGB and CIE standards9,10,15 with little prediction error. This is not the case for printers because of the properties of their colour model. Desktop printers usually use subtractive colour models (e.g. CMYK, Cyan, Magenta, Yellow and Key/Black) that absorb lights of certain wavelength from the ambient light, and reflect the others to the observers’ eyes. Subtractive colour models usually lead to a non-linear or non-polynomial relationship between the input RGB and output CIE standards11,16. The 3D printer employed here uses a similar CMYK colour model but with an additional white base material. Moreover, a CMYK colour model usually has a smaller gamut than RGB colour model and the CIE standard, which means that certain colours cannot be produced by the 3D printers17. Despite these shortcomings, the method employed here did decrease the colour difference of the reproduction result, and indicates the potential of further optimization.
Although this 3D colour reproduction system cannot transfer with sufficient accuracy shade information from a patient’s oral cavity to dental models for prostheses fabrication, some situations might have less stringent accuracy requirement. The 3D colour printed models can bring more detailed shade information of the natural abutment than a natural die shade guide and materials. For cases requiring the reproduction of complex textures of adjacent teeth or even gingiva and mucosa, the chromatic dental models can help dental technicians to locate these features on adjacent teeth and restorations in a visualized way (Fig. 8). The chromatic dental models may also be used as advanced wax-ups to enhance communication with patients.
To enhance the performance of the 3D colour reproduction system, besides improving the accuracy of the hardware, developing new colour profiles with higher precision would also be useful. Increasing the amount of training samples for the polynomial regression, particularly by adding more dental shades, may be the most straightforward way. Other methods such as using neural networks and lookup tables similar to traditional colour management workflows can also be introduced.
Conclusions
This study investigated a colour management method based on polynomial regression to develop a novel 3D colour reproduction system based on intraoral scanning and 3D printing. While the system’s use of polynomial regression can improve colour reproduction, it currently remains unable to achieve satisfactory results in terms of colour difference. Further improvements are needed in the form of advanced colour management methods and suitable hardware. The potential applications of the chromatic models also need further exploration.
Data availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Horn, D. J., Bulan-Brady, J. & Hicks, M. L. Sphere Spectrophotometer Versus Human Evaluation of Tooth Shade. J. Endod. 24, 786–790 (1998).
Baltzer, A. & Kaufmann-Jinoian, V. Shading of Ceramic Crowns Using Digital Tooth Shade Matching Devices. Int. J. Comput. Dent. 8, 129–152 (2005).
Odaira, C., Itoh, S. & Ishibashi, K. Clinical Evaluation of a Dental Color Analysis System: The Crystaleye Spectrophotometer(R). J. Prosthodont. Res. 55, 199–205 (2011).
Fradeani, M. & Barducci, G. Esthetic Rehabilitation in Fixed Prosthodontics, Vol. 2 Prosthetic treatment Quintessence Pub. Co (Chicago, 2008).
Li, H., Lai, L., Chen, L., Lu, C. & Cai, Q. The Prediction in Computer Color Matching of Dentistry Based On Ga+Bp Neural Network. Comput. Math. Methods Med. 2015, 816719 (2015).
Brandt, J., Nelson, S., Lauer, H. C., von Hehn, U. & Brandt, S. In Vivo Study for Tooth Colour Determination-Visual Versus Digital. Clin. Oral. Investig. 21, 2863–2871 (2017).
Deferm, J. T. et al. Validation of 3D Documentation of Palatal Soft Tissue Shape, Color, and Irregularity with Intraoral Scanning. Clin. Oral. Investig. 22, 1303–1309 (2018).
Mehl, A., Bosch, G., Fischer, C. & Ender, A. In Vivo Tooth-Color Measurement with a New 3D Intraoral Scanning System in Comparison to Conventional Digital and Visual Color Determination Methods. Int. J. Comput. Dent. 20, 343–361 (2017).
Hong, G., Luo, M. R. & Rhodes, P. A. A Study of Digital Camera Colorimetric Characterization Based On Polynomial Modeling. Color Res. Appl. 26, 76–84 (2001).
León, K., Mery, D., Pedreschi, F. & León, J. Color Measurement in L∗a∗B∗ Units From Rgb Digital Images. Food. Res. Int. 39, 1084–1091 (2006).
Kang, H. R. & Anderson, P. G. Neural Network Applications to the Color Scanner and Printer Calibrations. J. Electron. Imaging. 1, 125–135 (1992).
Xiao, K., Zardawi, F., van Noort, R. & Yates, J. M. Color Reproduction for Advanced Manufacture of Soft Tissue Prostheses. J. Dent. 41(Suppl 5), e15–e23 (2013).
Xiao, K., Zardawi, F., van Noort, R. & Yates, J. M. Developing a 3D Colour Image Reproduction System for Additive Manufacturing of Facial Prostheses. Int. J. Adv. Manuf. Technol. 70, 2043–2049 (2014).
Johnston, W. M. & Kao, E. C. Assessment of Appearance Match by Visual Observation and Clinical Colorimetry. J. Dent. Res. 68, 819–822 (1989).
Kang, H. R. Color Scanner Calibration. J. Imaging. Sci. Technol. 36, 162–170 (1992).
Zhang, Y., Cheung, V., Westland, S. & Beverley, K. J. Colour Management of a Low-Cost Four-Colour Ink-Jet Printing System On Textiles. Color. Technol. 125, 29–35 (2009).
Brunton, A., Arikan, C. A. & Urban, P. Pushing the Limits of 3D Color Printing. ACM Trans Graph. 35, 1–13 (2015).
Acknowledgements
This work was supported by the Capital’s Funds for Health Improvement and Research (CFH 2018-2-4101), the National Natural Science Foundation of China (81801015) and the New Medical Technology Program of Peking University Hospital of Stomatology (PKUSSNCT-19G01). The authors gratefully acknowledge Dr. W. Pan from the Second Dental Clinical Division of Peking University School and Hospital of Stomatology for providing intraoral scanner, Ms. J. He, Mr. J. Pan from 3Shape China and Mr. L. Liu from Beijing Magic Medical Instruments Co., Ltd. for their support on scanner operation and technical support, Dr. Y. Li from Beijing Institute of Technology for providing spectrophotometer and mathematical algorithm and Mr. L. Jia from the Dental Laboratory of Peking University School and Hospital of Stomatology for sample fabrication.
Author information
Authors and Affiliations
Contributions
Yushu Liu, Yunsong Liu and Yongsheng Zhou planned the research, Yushu Liu and Rui Zhang completed the experiment procedures, Hongqiang Ye and Shimin Wang helped with the statistical analysis, and Kuan-Paul Wang performed the preliminary clinical application. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Liu, Y., Zhang, R., Ye, H. et al. The development of a 3D colour reproduction system of digital impressions with an intraoral scanner and a 3D printer: a preliminary study. Sci Rep 9, 20052 (2019). https://doi.org/10.1038/s41598-019-56624-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-019-56624-3
This article is cited by
-
Simulation of 3D digital design of clothing fabrics based on optical imaging detection and image acquisition
Optical and Quantum Electronics (2024)
-
Deathdaily: A Python Package Index for predicting the number of daily COVID-19 deaths
Network Modeling Analysis in Health Informatics and Bioinformatics (2022)
-
Evaluation of accuracy and characteristics of tooth-color matching by intraoral scanners based on Munsell color system: an in vivo study
Odontology (2022)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.