Abstract
We conducted a prospective study to evaluate the efficacy of simulation-based education using a three-dimensional (3D)-printed schematic eye model in improving the retinoscopy refraction skills of medical students. A schematic eye model was printed using a fused deposition modeling-based 3D printer. Twenty medical students randomized into 3D (n = 10) and control (n = 10) groups received a 1-h lecture on the principles and methods of manifest refraction and were shown how to use the retinoscope and sciascope bars. The 3D group additionally attended a tutorial on the schematic eye. Both groups performed refractive examinations on four eyes of volunteer patients, and the results were recorded as a baseline. Instructor feedback and refraction practice was provided with the 3D group or with control group. To account for subject fatigue, patients spent no more than 8 min on the examination. After a 1-h break to allow for fatigue and familiarity, refraction tests were repeated on four randomly selected eyes of patients. Students’ refraction readings were compared with the autorefractor values using a spherical equivalent value and blur strength. All participants measured the time required to complete the refraction test and reported their subjective confidence in the results of each refraction test. Refractive errors before and after training did not differ between the control and 3D groups, with a significant improvement in errors observed in both groups (p = 0.005 and 0.008, respectively). The time to complete refraction before and after training did not differ between the two groups, both of which showed a significant reduction in time (p = 0.005 and 0.028, respectively). Pre- and post-training confidence scores for the accuracy of each refraction on a 10-point Likert scale were not significantly different. However, when comparing score changes between pre- and post-training, only the control group showed a significant increase in confidence (p = 0.005). Tests for the non-inferiority of refractive errors after training indicated that the 3D group was non-inferior to the control group. In conclusion, training in retinoscopy refraction skills using a 3D-printed eye model resulted in significant improvement in accuracy and speed compared to practice with real patients. Except for better confidence in the control group, schematic eye model training was not inferior to practice with real patients.
Similar content being viewed by others
Introduction
Retinoscopy is an objective tool to assess refractive errors1. In the field of ophthalmology, the retinoscopic examination may be the most important and indispensable test for providing the best-corrected visual acuity2. Despite advances in automated refractors, objective manifest refraction remains essential, especially for patients with underlying diseases that cause media opacities, such as cataract or corneal opacity3. In addition, the objective manifest refraction test is particularly important in pediatric ophthalmology, as young children may have difficulty cooperating with automated refraction measurements4. As a result, the objective manifest refraction test is essential to accurately determine refractive errors in these cases and ensure the appropriate prescription for visual correction5.
Practicing retinoscopic examinations is crucial for ophthalmologists, optometrists, and orthoptists. Repeated practice and experience are essential to improve refraction accuracy6,7. Traditional methods involving repeated testing on patients or standardized actors are very effective, but have limitations such as patient fatigue, recruitment difficulties, and potential risks to real patients8. The development of schematic mechanical eyes may be a valuable solution that addresses these challenges9,10. However, many advanced simulators on the market can be prohibitively expensive, limiting access for institutions with limited resources11.
Many commercial schematic eye models have been developed for training in retinoscopic examinations. In the era of three-dimensional (3D) printing technology, a schematic eye could be made at a much lower price12. In our previous study, we presented a schematic eye that can be printed in less than 4 h for under 5 USD on a 3D printer of the fused deposition modeling type, the most common type printer12. The device was designed to facilitate the adjustment of refractive errors by inserting a trial lens. If this type of inexpensive schematic eye could enhance retinoscopic skills, it would be helpful in improving healthcare worldwide. We performed this study to assess the efficacy of simulation-based education using a 3D printed-schematic eye model in enhancing the retinoscopic skills of medical students.
Results
The mean age of students in the control group was 24.0 ± 2.6 years of age and in the 3D group was 23.3 ± 2.8 years of age, which was not significantly different (p = 0.579). The male-to-female ratio was 7:3 in both groups.
The patients who volunteered for the study were between the ages of 19 and 34, with a mean age of 23.5 ± 2.7 years for the control group and 24.4 ± 3.9 years for the 3D group with no significant difference (p = 0.816). Spherical powers were − 2.28 ± 3.20 D in the control group and − 2.53 ± 2.53 D in the 3D group, and cylindrical powers were − 1.13 ± 0.73 in the control group and − 0.81 ± 0.61 in the 3D group, both of which were not statistically different (p = 0.545, 0.130, respectively). In the control group, the cylindrical axis consisted of 16 eyes of with-the-rule (WTR) astigmatism and 4 eyes of oblique axis. Meanwhile, in the 3D group, there were 12 eyes of WTR astigmatism, 12 eyes of against-the-rule (ATR) astigmatism, and 4 eyes of oblique axis (Table 1).
Spherical equivalent refraction results
Before training, the students’ refractive error (spherical equivalents) compared with that of the autorefractor was 2.11 ± 1.08 D in the control group and 1.86 ± 1.03 D in the 3D group, with no statistically significant difference observed between the two groups (p = 0.604). After training, the refractive error was 0.71 ± 0.21 D in the control group and 0.83 ± 0.52 D in the 3D group, with no significant difference (p = 0.796). A significant improvement in refractive error was observed in both the control group and 3D group (p = 0.005 and 0.008, respectively) (Fig. 1A).
Vector analysis
The power vector analysis before and after training is presented in Table 2. Before training, the students’ blur strength compared with that of the autorefractor was 2.30 ± 1.10 D in the control group and 1.83 ± 1.13 D in the 3D group, with no statistically significant difference observed between the two groups (p = 0.353). After training, the blur strength was 0.81 ± 0.19 D in the control group and 0.95 ± 0.48 D in the 3D group, with no significant difference (p = 0.739). A significant improvement in blur strength was observed in both the control group and 3D group (p = 0.007 and 0.017, respectively) (Fig. 1B).
Time spent
The time to complete the refraction test was 6.5 ± 1.2 min in the control group and 5.4 ± 2.0 min in the 3D group, with no significant difference at pre-training (p = 0.313). After training, there was no significant difference between the two groups (3.9 ± 0.8 min in control group and 3.9 ± 1.3 min in the 3D group; p = 0.875). Comparing pre- and post-training, both the control and 3D groups showed a significant reduction in time (p = 0.005 and 0.028, respectively) (Fig. 2).
Confidence level
When asked to rate their pre-training confidence in the accuracy of each refraction on a 10-point Likert scale, the control group scored 4.9 ± 2.2 and the 3D group scored 4.3 ± 1.8, which was not significantly different (p = 0.684). After training, the control group scored 6.5 ± 1.3 and the 3D group scored 5.4 ± 1.8, which was not significantly different (p = 0.143). Comparing pre- and post-training, the 3D group showed no significant change in confidence scores (p = 0.083), whereas the control group showed a significant increase in confidence (p = 0.005) (Fig. 3).
Test for non-inferiority of refraction errors
The approximate 95% confidence interval (exact level is 95.7%) of refractive errors in spherical equivalent values between the 3D group and control group was − 0.43 D to 0.23 D. Defining the non-inferiority margin as Δ0.25 D, a clinically relevant refractive error, the 95% confidence interval for the errors in spherical equivalents between the two groups did not exceed Δ0.25 D, indicating that the 3D group was non-inferior to the control group (Fig. 4).
Discussion
This study showed that novice medical students comparatively improved their retinoscopic refraction skills either with a schematic eye or with real patients. Both groups showed a significant improvement in errors after training and significantly reduced time to complete the refraction test. Although tests for the non-inferiority of spherical equivalents after training indicated that the 3D group was non-inferior to the control group, only the control group showed a significant increase in confidence on a 10-point Likert scale. This finding is consistent with previous studies in healthcare that reported that real-patient cases were more effective in improving students’ refraction skills than digital and paper cases13.
Three-dimensional printing technology has been widely applied in the field of ophthalmology, including ocular prostheses, orbital implants, drug delivery systems, retrobulbar-anesthesia simulators12,14,15,16,17. However, there has been no report of a schematic eye except ours12. In our previous study, we made this schematic eye for less than $5 using a 3D printer12. This price is competitive to any of the available commercial schematic eyes. This type of inexpensive and convenient schematic eye could open a new era of simulation as an educational tool.
Retinoscopy is an indispensable tool in the field of eye care, and ophthalmologists, optometrists, and orthoptists should master their skills. Therefore, education on retinoscopic refraction could be essential for training in the field of eye care. Our schematic eye was helpful in the practice of retinoscopy and successfully enhanced retinoscopic skills. Traditional methods of retinoscopy training involve repeated testing of patients or standardized actors, but these methods lead to subject fatigue and recruitment difficulties18,19. Other studies have reported a web-based learning environment that simulates a clinical subjective refraction assessment, a virtual refractor, or a psychophysical technique for estimating the accuracy and precision of manifest refraction, all of which have found simulation to be beneficial for training20,21,22. In this study, the 3D-printed eye model demonstrated non-inferior improvements in refractive accuracy compared to students practicing on real patients, demonstrating its potential as an effective refractive training tool, similar to other simulators.
In our study, the group that practiced with the 3D-printed eye model showed significant improvements in refractive accuracy and time but less improvement in their perceived confidence in refraction. Simulation training provides a learning environment for managing complex crisis situations without compromising the safety of human patients23. Repeated simulations increase student confidence24. In our research, the simulation training lasted only one hour, which may explain the smaller confidence gains than those of the control group that practiced on real patients. Repeated practice was expected to contribute to confidence gains, as well as improvements in refractive accuracy and time.
The high cost of simulators has been a commonly cited critique of simulation training25. This is because of the significant importance of assessing the cost-effectiveness and cost–benefit of simulator training26. Currently, several mechanical schematic eyes are available within the range of 60 to 120 USD, but the price can impede student access. In our study, we printed a refraction-training schematic eye model in less than 4 h using a 3D printer at a cost of approximately $0.92 to $1.24. Thus, our results indicated that this device could offer affordable training by reducing costs.
This study had some limitations. First, we only included medical students. We could not perform the same study with optometry students because we do not have a system for optometrists in Korea. Second, no other studies have compared training using a schematic eye model versus real patients. Therefore, we cannot compare our results with those of previous studies. Third, medical students who want to acquire refraction skills could be highly motivated to learn more, thus affecting their results. Finally, this study only assessed the immediate effects of training, and further follow-up would be warranted to determine the long-term retention of skills and knowledge acquired through 3D-printed eye model training. To strengthen the evidence of the efficacy and feasibility of 3D training aids in the field of refraction, future studies should consider larger and more diverse samples, longer training durations, and more comprehensive comparisons with other training methods, especially with commercial retinoscopy simulators.
In conclusion, retinoscopic refraction training using a 3D-printed schematic eye model resulted in a significant improvement in errors and a reduction in time to complete the refraction, similar to the practice with real patients. Except for a difference in confidence in the control group, schematic eye training was not inferior to practice with actual patients.
Methods
3D printed-schematic eye model
A schematic eye model for retinoscopy training was designed and printed using a fused deposition modeling-based 3D printer as described in a previous study12. Seven parts were printed and assembled with additional components of a paper cylinder, + 10-diopter (D) spherical lens, and tripod (Fig. 5). The entire printing process required less than one hour to complete using a conventional 3D printer.
Participants
Twenty medical students participated in this study. Participation was voluntary, and written informed consent, which could be withdrawn at any time without penalty, was obtained from each student before the study began. The participants were recruited through an IRB-approved advertisement and informed that participation in the study was not tied to their grades. The study was conducted outside of the grading period, and the researcher did not have access to the data collected until the class grades were posted. The study protocol adhered to the tenets of the Declaration of Helsinki and was approved by the Institutional Review Board of Seoul National University Bundang Hospital (B-2201-735-305).
All students received a 1-h lecture on the principles and methods of manifest refraction and were shown how to use the retinoscope and sciascope bars. The students were randomized into two groups: a 3D-printed schematic eye training aid group (3D group, n = 10) and a real patient group (control group, n = 10). The 3D group additionally attended a tutorial on the schematic eye.
Based on the previous lecture, the students in both groups performed refractive examinations on four eyes of the volunteer patients and recorded the results as a baseline. After the baseline examination, 1 h of instructor feedback and refraction practice were provided. The instructor provided personalized feedback with practice repetition for more eyes or theoretical reinforcement based on the student’s individual needs. The 3D group practiced with the 3D-printed schematic eye training device, whereas the control group practiced with volunteer patients. To account for subject fatigue, patients were not allowed to spend more than 8 min on the examination. After a 1-h break to allow for fatigue and familiarity, refraction tests were repeated on four eyes of randomly selected patients. The students’ refractive error results were compared with those of the autorefractor by taking the spherical equivalent value and blur strength (mean of three readings on a Huvitz HRK-8000A; Anyang, Korea).
All participants measured the time taken to complete the refraction test and provided their subjective confidence in the results of each refraction test (on a 10-point Likert scale: 10 = very accurate, 1 = not at all accurate).
Definitions
The orientation of astigmatism was defined as with-the-rule (WTR) astigmatism in case of the axis of the minus cylinder is placed between 0 and 30 and 150 and 180 degrees, oblique astigmatism between 30 and 60 and 120 and 150 degrees, and against-the-rule (ATR) astigmatism between 60 and 120 degrees27.
To conduct the vectorial analysis, we transformed the refractive astigmatism from spherocylinder notation to power vector notation using Fourier transformation with the following equations (S (spherical diopters), C (cylindrical diopters), α (axis) B (blur strength))28.
Statistical analysis
Data were analyzed using SPSS version 26.0 (IBM SPSS Statistics for Windows, V.26.0; IBM Corp, Armonk, New York, USA). Results were considered statistically significant at p < 0.05. Data are presented as mean ± standard deviation unless otherwise noted. Mann–Whitney tests were used for comparisons between the two groups, and Wilcoxon signed-rank tests were used for comparisons before and after training. Confidence intervals and non-inferiority tests for nonparametric tests were conducted according to a previous study29.
Ethics statement
Ethics approval was obtained from our institutional ethics review board.
Data availability
The Institutional Review Board of Seoul National University Bundang Hospital/Ethics committee has placed ethical restrictions to protect patient identities. However, the data are available to anyone who is interested without restriction. The minimal data set will be available upon request. For data requests, please contact the SNUBH IRB office at 82-31-787-8804, 98614@snubh.org.
References
Akil, H., Keskin, S. & Cavdarli, C. Comparison of the refractive measurements with hand-held autorefractometer, table-mounted autorefractometer and cycloplegic retinoscopy in children. Korean J. Ophthalmol. 29, 178–184. https://doi.org/10.3341/kjo.2015.29.3.178 (2015).
Yoo, S. G., Cho, M. J., Kim, U. S. & Baek, S. H. Cycloplegic refraction in hyperopic children: Effectiveness of a 0.5% tropicamide and 0.5% phenylephrine addition to 1% cyclopentolate regimen. Korean J. Ophthalmol. 31, 249–256. https://doi.org/10.3341/kjo.2016.0007 (2017).
Heher, K. L., Stark, W. J. & Miller, N. R. Oil-drop cataracts. J. Cataract Refract. Surg. 19, 306–308. https://doi.org/10.1016/s0886-3350(13)80962-5 (1993).
Dahlmann-Noor, A. H. & Vivian, A. J. A comparison of photorefraction and retinoscopy in children. J. AAPOS 12, 104–105. https://doi.org/10.1016/j.jaapos.2007.10.006 (2008).
Hollis, J., Allen, P. M. & Heywood, J. Learning retinoscopy: A journey through problem space. Ophthal. Physiol. Opt. 42, 940–947. https://doi.org/10.1111/opo.13007 (2022).
Zadnik, K., Mutti, D. O. & Adams, A. J. The repeatability of measurement of the ocular components. Investig. Ophthalmol. Vis. Sci. 33, 2325–2333 (1992).
Walline, J. J., Kinney, K. A., Zadnik, K. & Mutti, D. O. Repeatability and validity of astigmatism measurements. J. Refract. Surg. 15, 23–31. https://doi.org/10.3928/1081-597X-19990101-05 (1999).
Aydin, P., Gunalp, I., Hasanreisoglu, B., Unal, M. & Erol Turacli, M. A pilot study of the use of objective structural clinical examinations for the assessment of ophthalmology education. Eur. J. Ophthalmol. 16, 595–603. https://doi.org/10.1177/112067210601600415 (2006).
Dodaro, N. R. & Maxwell, D. P. An eye for an eye. A simplified model for teaching. Arch. Ophthalmol. 113, 824–826. https://doi.org/10.1001/archopht.1995.01100060150051 (1995).
Lewallen, S. A simple model for teaching indirect ophthalmoscopy. Br. J. Ophthalmol. 90, 1328–1329. https://doi.org/10.1136/bjo.2006.096784 (2006).
Donovan, L., Brian, G. & du Toit, R. A device to aid the teaching of retinoscopy in low-resource countries. Br. J. Ophthalmol. 92, 294. https://doi.org/10.1136/bjo.2007.121699 (2008).
Baek, C. & Seo, J.-M. Development of schematic eye for retinoscopy training using 3D printer. Ann. Optom. Contact Lens 15, 145–149 (2016).
Li, J. et al. Comparison of three problem-based learning conditions (real patients, digital and paper) with lecture-based learning in a dermatology course: A prospective randomized study from China. Med. Teach. 35, e963–e970. https://doi.org/10.3109/0142159X.2012.719651 (2013).
Kang, S. et al. Generation of customized orbital implant templates using 3-dimensional printing for orbital wall reconstruction. Eye (Lond.) 32, 1864–1870. https://doi.org/10.1038/s41433-018-0193-1 (2018).
Kim, B. R. et al. A pilot clinical study of ocular prosthesis fabricated by three-dimensional printing and sublimation technique. Korean J. Ophthalmol. 35, 37–43. https://doi.org/10.3341/kjo.2020.0125 (2021).
Park, B. C., Kim, H. T. & Koh, J. W. New biodegradable drug delivery system for patients with dry eye. Korean J. Ophthalmol. 35, 455–459. https://doi.org/10.3341/kjo.2021.0126 (2021).
Choi, Y. J., Joo, Y. H., Oh, B. L. & Lee, J. C. 3D-printed ophthalmic-retrobulbar-anesthesia simulator: Mimicking anatomical structures and providing tactile sensations. IEEE J. Transl. Eng. Health Med. 9, 1–6. https://doi.org/10.1109/JTEHM.2021.3099971 (2021).
Rodriguez-Lopez, V. & Dorronsoro, C. Beyond traditional subjective refraction. Curr. Opin. Ophthalmol. 33, 228–234, https://doi.org/10.1097/ICU.0000000000000834 (2022).
Levine, N. R. Improving student understanding and management of patients through role-playing and video taping. Am. J. Optom. Physiol. Opt. 53, 95–99, https://doi.org/10.1097/00006324-197602000-00009 (1976).
Woodman-Pieterse, E. C., De Souza, N. J. & Vincent, S. J. The influence of a novel simulated learning environment upon student clinical subjective refraction performance: A pilot study. Clin. Exp. Optom. 99, 342–349. https://doi.org/10.1111/cxo.12374 (2016).
Alhazmi, M. S., Butler, C. W. & Junghans, B. M. Does the virtual refractor patient-simulator improve student competency when refracting in the consulting room? Clin. Exp. Optom. 101, 771–777. https://doi.org/10.1111/cxo.12800 (2018).
Bharadwaj, S. R., Malavita, M. & Jayaraj, J. A psychophysical technique for estimating the accuracy and precision of retinoscopy. Clin. Exp. Optom. 97, 164–170, https://doi.org/10.1111/cxo.12112 (2014).
Mitchell, M., Newall, F., Sokol, J., Heywood, M. & Williams, K. Simulation-based education to promote confidence in managing clinical aggression at a paediatric hospital. Adv. Simul. (Lond) 5, 21. https://doi.org/10.1186/s41077-020-00139-9 (2020).
McInerney, N., Nally, D., Khan, M. F., Heneghan, H. & Cahill, R. A. Performance effects of simulation training for medical students—a systematic review. GMS. J. Med. Educ. 39, Doc51. https://doi.org/10.3205/zma001572 (2022).
Zendejas, B., Wang, A. T., Brydges, R., Hamstra, S. J. & Cook, D. A. Cost: The missing outcome in simulation-based medical education research: A systematic review. Surgery 153, 160–176. https://doi.org/10.1016/j.surg.2012.06.025 (2013).
Maloney, S. & Haines, T. Issues of cost-benefit and cost-effectiveness for simulation in health professions education. Adv. Simul. (Lond) 1, 13, https://doi.org/10.1186/s41077-016-0020-3 (2016).
Nemeth, G., Szalai, E., Berta, A. & Modis, L., Jr. Astigmatism prevalence and biometric analysis in normal population. Eur. J. Ophthalmol. 23, 779–783. https://doi.org/10.5301/ejo.5000294 (2013).
Thibos, L. N., Wheeler, W. & Horner, D. Power vectors: an application of Fourier analysis to the description and statistical analysis of refractive error. Optom. Vis. Sci. 74, 367–375. https://doi.org/10.1097/00006324-199706000-00019 (1997).
Campbell, M. J. & Gardner, M. J. Calculating confidence intervals for some non-parametric analyses. Br. Med. J. (Clin Res Ed) 296, 1454–1456. https://doi.org/10.1136/bmj.296.6634.1454 (1988).
Acknowledgements
This research was supported by the SNUBH research funds (No. 02-2021-0045).
Author information
Authors and Affiliations
Contributions
Dr. J.-M.H. and C.B. led the research team throughout the project and was primarily responsible for analysis and manuscript writing. Drs. H.K.Y. and D.H.K. participated in study design, data analysis and manuscript preparation. Dr. C.B. and J.S. designed and built the model eyes, and participated in manuscript preparation. All authors were directly involved in methodological decisions, analysis and manuscript preparation. In accordance with the ICMJE Uniform requirements, all five authors made substantial contributions to (i) study design and data analysis, (ii) drafting and revising the manuscript and (iii) have approved of the version submitted for publication.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kim, D.H., Yang, H.K., Baek, C. et al. Efficacy of 3D-printed eye model to enhance retinoscopy skills. Sci Rep 14, 4207 (2024). https://doi.org/10.1038/s41598-024-53321-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-024-53321-8
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.