Surgical trauma in those under a prolonged use of bisphosphonates, can lead to mediation-related osteonecrosis of the jaw (MRONJ). This study aimed to evaluate the preventive therapies for MRONJ. Following four cycles of zoledronic acid administration, Wistar rats had their molar extracted, and were organized into nine treatment groups: negative control group (NCG), treated with saline solution and blood-clot in the alveolus; positive control group (PCG), with blood-clot in the alveolus; BG, β-tricalcium phosphate-based biomaterial; DG, 10% doxycycline gel; aG, antimicrobial photodynamic therapy; and DBG, aBG, aDG, and aDBG, using combination therapy. After 28 days, the lowest bone volume (BV/TV) was reported in PCG (42.17% ± 2.65), and the highest in aDBG (69.85% ± 6.25) (p < 0.05). The higher values of daily mineral apposition rate were recorded in aDBG (2.64 ± 0.48) and DBG (2.30 ± 0.37) (p < 0.001). Moreover, aDBG presented with the highest neoformed bone area (82.44% ± 2.69) (p < 0.05). Non-vital bone was reported only in the PCG (37.94 ± 18.70%). Owing to the key role of the biomaterial, the combination approach (aDBG) was the most effective in preventing MRONJ following tooth extraction.
Anti-resorptive drugs (ARs), including anti-RANKL antibodies inhibit osteoclastic activity, and are thus commonly used to prevent hypercalcemia or bone metastases in patients with cancer1,2, and fractures in osteopenic/osteoporotic patients3. However, the prolonged use of these medications is a risk factor for medication-related osteonecrosis of the jaw (MRONJ)4,5,6,7. The prevalence of MRONJ is higher with the use of high bisphosphonate (BP) doses, especially of nitrogen-containing bisphosphonates (N-BPs), as they are more resistant to enzymatic degradation8,9.
According to a recent by the American Association of Oral and Maxillofacial Surgeons (AAOMS) position paper9, MRONJ is defined as an area of exposure in the maxillofacial region, persistent for > 8 weeks, that can be diagnosed in patients undergoing to antiresorptive therapy alone or in combination with immune modulators or antiangiogenic medications, without prior exposure to radiotherapy in the head and neck region10,11,12,13,14. Despite its advantages and benefits in the treatment of skeletal disorders, prolonged use of BPs can lead to the development of MRONJ13,15,16.
There is currently no universal protocol for the treatment of MRONJ. Treatment can range from conservative therapy to surgical intervention, depending on the disease stage. Several patients undergo conservative treatment, including oral health maintenance, infection removal, and antibiotic use17. Numerous published reports have described the success of antimicrobial photodynamic therapy (aPDT) in clinically treating this condition18,19,20,21,22.
Thus, studies exploring the prevention of MRONJ have emerged23,24,25. Recent in vitro studies have demonstrated the use of calcium phosphate ceramics in the reduction or elimination of zoledronic acid (ZOL) toxicity in fibroblasts26. In antimicrobial photodynamic therapy (aPDT), a low-power laser biostimulates the osteoblasts, even during ZOL treatment27, and reduces the number of bacterial colonies with a photosensitizing agent24. Moreover, satisfactory results were observed with doxycycline-loaded collagen sponge placed over the alveolar bone, in rats undergoing antiresorptive drug treatment28.
Thus, this study aimed to comparatively evaluate the preventive effects of locally applied β-tricalcium phosphate (BTCP) ceramics, aPDT, and doxycycline, alone or in combination, on the development of MRONJ, in the alveolar bone of rats undergoing ZOL therapy.
This study was approved by the Ethics Committee on Animal Experimentation (CEUA) of São Paulo State University (UNESP), School of Dentistry, Araçatuba, Brazil (#0810-2018), following the Animal Research: Reporting of In Vivo Experiments (ARRIVE) guidelines, and in accordance with the Guide for the Care and Use of Laboratory Animals of the National Institutes of Health (Institute of Laboratory Animal Resources [U.S.])29.
Seventy-two 3-month-old male Wistar rats (Rattus norvegicus albinus) (weight, 300–350 g), obtained from the UNESP facility were group-housed in cages (four animals per box), and acclimatized to a temperature of 24 ± 2 °C, with controlled light cycle (12/12 h), and free access to water and feed. To determine the sample size, a power test was performed at a significance level of 5% (with a standard deviation of 2%), α = 0.05, and 80% power. Thus, eight rats (n = 8) were required per group.
All animals were treated with Zoledronate (ZOL) (Zometa®, Novartis Biosciences SA, São Paulo, Brazil), except for the animals in the negative control group (NCG), which received only 0.1 mL of saline solution (0.9% NaCl), using the same application protocol. Following an experimental model proposed by Curra et al.30 the animals received four intravenous (IV) applications of 0.035 mg/kg of ZOL, dissolved in 0.1 mL of vehicle (0.9% NaCl), through the tail vein, at 15-day intervals. One week after the fourth ZOL application, the mandibular right first molars of the animals were extracted, and locally treated. ZOL injections were continued until euthanasia.
Tooth extraction and experimental groups
All animals had the mandibular right first molars extracted23 on the 52nd day of ZOL treatment initiation (corresponding to 7 days after the fourth ZOL application). The surgical procedure was performed under anesthesia via an intraperitoneal injection (IP) of 90 mg/kg of ketamine hydrochloride (Vetaset, Fort Dodge Animal Health Ltd., São Paulo, Brazil) and 10 mg/kg of xylazine hydrochloride (Dopaser, Laboratórios Calier do Brasil Ltda, São Paulo, Brazil). After sedation, antisepsis was performed with degerming and topical povidone-iodine (10% PVP-I; Riodeine, Rioquímica, São José do Rio Preto, Brazil) application, followed by sterile draping. The animals were placed in the dorsal decubitus position on a customized operating table, and syndesmotomy was carefully performed using a delicate detacher (Molt Descolador no. 9, Quinelato, São Paulo, Brazil), followed by luxation and extraction of the tooth. The animals were randomly divided into nine treatment groups (www.randomization.com) by a blinded assessor, unrelated to the study.
Negative Control group (NCG): Treated systemically with NaCl and locally left empty, except for the blood clots in the alveolus.
Positive control group (PCG): Treated systemically with ZOL and locally left empty, except for the blood clots in the alveolus.
Biomaterial group (BG): The alveolus in the mandibular right first molar was filled with approximately 0.03 cc of BTCP paste (Graftys HBS, Latin American Solutions [LAS], Brazil).
Doxycycline group (DG): The alveolus in the mandibular right first molar was filled with approximately 0.03 cc of 10% doxycycline gel.
aPDT group (aG): The alveolus in the mandibular right first molar was irrigated for 1 min with 1 mL of neutral methylene blue photosensitizer, followed by a diode laser of indium gallium aluminum phosphide at the red wavelength (660 ± 10 nm), with a spot size of 0.0283 mm, 35 mW, in continuous mode, with a 2.1 J/point for 60 s, according to the model proposed by Ervolino et al.24.
Doxycycline + biomaterial group (DBG): The alveolus in the mandibular right first molar was filled with approximately 0.03 cc of mixture in a proportion of 50% each (10% doxycycline gel and B-tricalcium phosphate paste, 1:1) (Graftys HBS, LAS, Brazil).
aPDT + biomaterial group (aBG): The alveolus in the mandibular right first molar received aPDT (as described above) and was subsequently filled with approximately 0.03 cc of BTCP paste (Graftys HBS, LAS, Brazil).
aPDT + doxycycline group (aDG): The alveolus in the mandibular right first molar received aPDT (as described above) and was subsequently filled with approximately 0.03 cc of 10% doxycycline gel.
aPDT + doxycycline + biomaterial group (aDBG): The alveolus in the mandibular right first molar received aPDT (as described above) and was subsequently filled with approximately 0.03 cc of mixture in a proportion of 50% each (10% doxycycline gel and BTCP paste, 1:1) (Graftys HBS, LAS, Brazil).
Post-extraction, the soft tissue was detached from the extraction site, and sutured with 4–0 polyglactin 910 (Vicryl, Ethicon, Johnson Prod., São José dos Campos, Brazil), to assist in the clot maintenance, treatment as previously randomized, and primary closure of the alveolus.
Fifteen days after molar extraction, the fluorochrome calcein was administered intramuscularly (20 mg/kg) to each animal, and repeated after 10 days, using alizarin red (30 mg/kg)31,32,33.
All animals were euthanized 80 days after ZOL application (28 days after molar extraction) with a lethal dose of sodium thiopental (150 mg/kg; Thiopentax, Cristália Ltda, Itapira, SP, Brazil) and IV administration of 2% injectable lidocaine hydrochloride (VETOne®; Pasadena, ID, USA). The right hemimandibles of all animals were collected and analyzed for the following; Fig. 1 shows the working scheme of the study.
Microcomputed tomography analysis
The hemimandibles of the animals from the nine experimental groups were fixed in a 10% buffered formalin solution (Analytical Reagents, Dinâmica Odonto-Hospitalar Ltda, Catanduva, SP, Brazil) for 24 h, followed by washing under running water for 24 h. After fixation, the samples were stored in 70% alcohol for microcomputed tomography (micro-CT) analysis.
Micro-CT analysis was performed according to the methodology described by Bouxsein et al. (2010), using a SkyScan microtomograph (SkyScan 1272 Bruker MicroCT, Aatselaar, Belgium, 2003)34. The samples were scanned in 6-µm thick Sects. (90 kV and 111 μA), with a 0.5 mm Al + 0.038 mm Cu filter, and a 0.5-mm rotation step, at a pixel size of 2,016 × 1,344 µm, and acquisition time of 52 min. The distal root of the mandibular first molar was established as the region of interest (ROI), and a circular ROI size of 200 was used for all the specimens. The X-ray projection images of the samples were stored and reconstructed, and the area of interest was determined using the NRecon software (version 126.96.36.199; SkyScan, 2011), with the following modes: smoothing, 1; correction of artifact rings, 8; correction, 24% beam hardening, and image conversion, ranging from 0.0 to 0.14. The images were reconstructed in three planes (transverse, longitudinal, and sagittal), using the DataViewer software (version 1.4.4, 64-bit; SkyScan). The percentage of bone volume (BV/TV), trabecular bone thickness (TbTh), separation and number of trabeculae (TbSp and TbN), and total porosity (PoTot) were evaluated using the CT-Analyser software (version 188.8.131.52; 2003-11SkyScan, 2012 Bruker MicroCT), and subsequently reconstructed in three dimensions (3D), using the CTVox software (version 2.7; SkyScan).
After micro-CT analysis, the hemimandibles of the nine experimental groups were dehydrated using increasing concentrations of alcohol (70%, 90%, and 100%), and subsequently immersed at different concentrations (70/30, 50/50, 30/70, 0/100, and 0/100) of Technovit® light-curing resin (Heraeus Kulzer GmbH, Wehrheim, Germany), in a mixture with 100% alcohol solution. The samples were stabilized on a glass plate with composite resin, such that the long axis of the distal alveolus of the mandibular first molar was parallel to the ground. Subsequently, the Technovit resin was incorporated, light-cured, Exakt microtome-cut (Apparatebau GmbH, Hamburg, Germany), calcified, and ground using an Exakt system sander, until the center of the mesial root of the mandibular right second molar was located (standardized to establish the center of the alveolus of the first molar). Longitudinal sections of approximately 50-μm thickness, were obtained in the alveolar region (in the mesiodistal plane).
Laser confocal microscopy
These sections were captured using a Leica CTR 4000 CS SPE confocal laser microscope (Leica Microsystems, Heidelberg, Germany) with a 10 × at the Confocal Fluorescence Microscopy Laboratory of the São Paulo State University (UNESP), School of Dentistry, Araraquara, Brazil. Thus, images of the fluorochromes calcein and alizarin red (old/new bone) were obtained separately, and finally reconstructed with an overlap, to assess bone turnover through the mineral apposition rate (MAR). The area of fluorochrome precipitation (calcein/alizarin) was measured using ImageJ software (National Institutes of Health, Bethesda, Maryland, USA). MAR was determined using the value obtained on tracing five measurements extending from the outer margin of calcein towards the outer margin of alizarin, and dividing it by 10, which represents the time interval between the two injections35.
After confocal microscopy analysis, all the slides were stained with Stevenel’s blue and acid fuchsin. Images of the sections, obtained at 1.6 × and 40 × magnifications, were analyzed under an optical light microscope (Diastar, Leica Reichert and Jung Products, Germany), and captured using an attached digital camera (Leica Microsystems DFC-300-FX, Germany), with 1.3 MP resolution. Histomorphometric analyses were performed using the ImageLab 2000 analysis software (version 2.4, Image Laboratory Inc., Belmont, MA, USA). The measurements obtained in micrometers (µm), were presented after conversion as percentage of the neoformed bone area (%NBA), connective tissue, and necrotic bone area (non-vital bone).
Data were analyzed using SigmaPlot (version 12.0; Exakt Graph and Data Analysis, USA). After performing a normality test (Shapiro–Wilk test) to determine the data distribution, a one-way analysis of variance test (ANOVA) was performed to verify the difference between the means of the groups, followed by Tukey’s post hoc test for multiple comparisons.
Bone volume percentage (BV/TV)
The NCG had an average BV/TV of 54.01% ± 2.60, whereas the PCG had an average BV/TV of 42.17% ± 2.65 (p = 0.193). Notably, all treatment groups exhibited a higher BV/TV than that of PCG (Fig. 2A). The aDBG had the highest BV/TV (69.85% ± 6.25), which was significantly different from that of NCG, PCG, aG, and aDG (p = 0.034, p < 0.001, p < 0.001 and, p = 0.003, respectively). However, no difference was observed when compared to BG, DG, aDG, and DBG (p = 0.071, p = 0.092, p = 0.941, and p = 0.939, respectively). The aDG and DBG presented with similar BV/TV values (64.62% ± 0.13 and 64.69% ± 4.40, respectively), significantly different from that of PCG, aG, and aBG (p = 0.002, 0.005, and 0.034, respectively).
Total porosity (PoTot)
The NCG had an average PoTot of 45.98% ± 2.60, whereas the PCG presented the highest value of 57.82% ± 2.65 (p = 0.193), which was significantly different from that of aDBG, aDG, and DBG (p < 0.001, p = 0.001, and p = 0.002, respectively), followed by aG with 55.31% ± 1.67, which was also significantly different when compared to aDBG, aDG, and DBG (p < 0.001, p = 0.005, and p = 0.005, respectively) (Fig. 2B).
Trabecular thickness (TbTh)
The NCG presented with a mean TbTh of 0.138 ± 0.0074 mm, whereas PCG had a mean TbTh of 0.115 mm ± 0.016 (p = 0.792). A significant difference (p = 0.043) was noted between DG (0.163 ± 0.015 mm) and aG (0.111 ± 0.0070 mm) (Fig. 2C).
Trabecular number (TbN)
A significant difference (p < 0.05) was observed between aDG (5.53 ± 5.3 mm) and PCG (3.68 ± 3.48 mm) (Fig. 2D).
Trabecular separation (TbSp)
In contrast to BV/TV, the aDBG, aDG, and DBG, which presented with the highest bone volume, in this analysis, demonstrated the lowest TbSp (0.177 ± 0.05 mm, 0.176 ± 0.03 mm, and 0.243 ± 0.02 mm, respectively); however, all groups remained within the general average (Fig. 2E).
Qualitative analysis of the alveolus
Micro-CT images (Fig. 3) revealed a normal alveolar healing process, with mature, trabecular bone formation in the apical and middle thirds, thus maintaining the alveolar crest in the NCG. Conversely, in the PCG, bone sequestrum prevented the assessment of alveolar characteristics. Osteonecrosis was prevented in all the treatment groups, thus facilitating alveolar healing, and maintaining the alveolar anatomy. Furthermore, the alveolar volume was maintained in the BG, DG, and combination therapy groups (aDG, DBG, aBG, and aDBG), with aDBG exhibiting the most satisfactory results.
Laser confocal microscopy
Mineral apposition rate
The aDBG had the highest daily MAR (2.64 ± 0.48), when compared to the other groups (p < 0.001), except for DBG (2.30 ± 0.37, p = 0.359). All groups had higher MAR values, when compared to NCG and PCG (p < 0.05) (Fig. 4).
Calcium precipitation in the organic matrix with calcein and alizarin, was observed as a fluorescent line in the images. In this study, the fluorochromes were injected 15 (calcein) and 25 (alizarin) days after molar extraction. It stands out that, a green line (calcein) marked the older bone, whereas a red line (alizarin) marked the new bone. Concomitant observation of the images helped differentiate the amount of old and new bone (Fig. 5).
Analysis revealed that bone formation occurred through a continuous remodeling process involving resorption of old bone and subsequent formation of new bone by osteoblastic action (Figs. 6 and 7). The presence of mature cortical bone (Fig. 6A), along with concentric lamellae, and osteocytes (Fig. 7A) were indicative of the alveolar bone healing in the apical and middle thirds, in the NCG. However, irregularities were observed on the surface of the bony trabeculae in PCG, with the absence of continuity of the cortical layer, and bone fragment loosening, characterizing the bony sequestrum (necrotic bone) (Fig. 6B). At higher magnification, osteocytes and empty Haversian canals were observed (Fig. 7B).
Similarly, the isolated treatments (aG, BG, and DG) allowed bone neoformation in the middle and apical thirds, with foci of vital bone in the connective tissue (Fig. 6C–E, respectively), with a greater amount of bone area in the BG. It can be highlighted that the BG and DG had more trabecular bone (Fig. 7D,E), whereas the aG (Fig. 7C) demonstrated less bone formation.
The combination therapies proposed in this study (aBG, aDG, DBG, and aDBG) were effective in the bone-healing process. Bone neoformation was noted in the apical and middle thirds of the alveolus, in addition to the cervical-third portion, in the DBG and aDBG. aBG (Fig. 6F) and aDG (Fig. 6G) demonstrated more trabecular bone tissue, with several islands of surrounding connective tissue (Fig. 7F,G, respectively), whereas DBG (Fig. 6H) and aDBG (Fig. 6I) showed more organized bone tissue and less connective tissue (Fig. 7H,I, respectively).
The dynamics of the tissues present within the distal alveolus of the extracted tooth were quantified and organized into (1) %NBA, (2) connective tissue, and (3) necrotic bone (non-vital bone) (Fig. 8); their quantifications and p values are presented in Table 1.
Percentage of new bone area (%NBA)
The NCG had a %NBA of 47.16% ± 4.03, whereas the PCG had the lowest %NBA (11.15% ± 7.45; p < 0.001) (Fig. 9). The aDBG had the highest %NBA (82.44% ± 2.69) (p < 0.05), followed by the DBG (60.82% ± 4.37). The combination therapies aBG and aDG showed satisfactory results for %NBA (52.08% ± 10.70 and 55.90% ± 13.78, respectively), which were different from those of the PCG (p < 0.001). Furthermore, the %NBA of aDG was superior to that of aG (p = 0.037). Among the isolated treatment groups, the BG showed the best results (57.13% ± 5.89), with significant differences from that of aG (p = 0.022) and PCG (p = 0.001). The DG and aG showed %NBA of 41.64% ± 11.46 and 35.48% ± 6.58, respectively, which were both superior to that of the PCG (p < 0.001 and p = 0.007, respectively).
Percentage of connective tissue
The NCG presented with 51.36% ± 4.03 of connective tissue, whereas the PCG presented with a smaller amount (47.78% ± 20.73; p = 0.688) (Fig. 10). In contrast to the %NBA, the aDBG had the lowest mean percentage of connective tissue (17.59% ± 2.69), especially when compared to that of the aG and DG (both p < 0.05). For the DBG, aDG, and aBG, the percentages of connective tissue were 39.17% ± 4.37, 44.10% ± 13.78, and 47.92% ± 10.70, respectively (p > 0.05). The BG had the lowest mean connective tissue among the isolated treatment groups (42.86% ± 5.89), followed by the DG (58.35% ± 11.46) and aG (64.52% ± 6.58) (p > 0.05).
Percentage of necrotic bone (non-vital bone)
Necrotic bone was not observed in the samples from any of the groups, except for those from PCG (37.94% ± 18.70).
In this study, we hypothesized that local therapies would help prevent MRONJ, thus favoring the bone-healing process. The therapies used here, either alone or in combination, facilitated the formation of vital and organized bone tissue (Figs. 6 and 7). The aDBG, DBG, and aDG exhibited the best results, as demonstrated by the BV/TV through micro-CT analyses (Fig. 2), MAR (Fig. 4), bone dynamics (Fig. 8), and %NBA (Fig. 9); however, the PCG presented 37.94 ± 18.70% of non-vital bone (Fig. 8), embedded in a loose connective tissue stroma (Figs. 6B and 7B).
Precipitation analysis (MAR) represents the amount of bone formed after calcium precipitation in the collagen-bone matrix; owing to the fluorochromes' property of binding to calcium, the amount of fluorescence represents the amount of bone formed32,33,36,37. It is noteworthy that BG exhibited the highest response among the therapies applied in isolation (Fig. 4), and among all treatments, the highest MAR was observed in the aDBG (p < 0.05). It is believed that the osteoconductive potential of the BTCP-based biomaterial could induce and guide bone formation, providing good results as demonstrated in this research. Furthermore, the aDBG group conglomerated the beneficial effects of each therapy, as demonstrated by MAR.
Excessive suppression of osteoclasts is believed to impair bone turnover, and bone trauma prevents tissue healing, resulting in bone necrosis16. Moreover, some BPs, such as ZOL, have antiangiogenic effects that decrease the expression of endothelial growth factors in the circulation, leading to areas of ischemia, facilitating MRONJ development38,39. Unfortunately, in this study, the vascularization potential was not assessed; however, it was demonstrated that the use of BPs resulted in the formation of non-vital bone fragments (Fig. 7B), characterizing bone sequestrum (Fig. 3). The use of ZOL allows the tissues to present an intense daily MAR (Fig. 4), reflecting an altered bone function40,41.
The presence and viability of fibroblasts and endothelial cells are essential for alveolar bone healing42,43,44. ZOL can inhibit osteoclast formation, alter cell migration, suppress angiogenesis and osteogenesis, thus generating toxicity in these cells45,46,47,48,49,50,51. Inhibition of these cells encourages the formation of a more dense, cortical bone, instead of a vascularized tissue (Fig. 6B), thus increasing the likelihood of bone sequestration associated with inflammation, and consequentially, local infection52,53, as demonstrated in the PCG (Fig. 7B).
Animal models have been used to demonstrate the repercussions of BPs on bone, such as an increase in bone density and a decrease in the spaces between the trabeculae, causing a decrease in the nutritive channels of the bone tissue30,54,55,56. In the present study, the region corresponding to the distal alveolus of the first molar was evaluated, and no suggestive results of an increased bone density were found (TbTh, p = 0.792; TbN, p = 1.901; TbSp, p = 0.199; and PoTot, p = 0.109). However, in the micro-CT analysis using the NRecon tool in the PCG, areas of bone irregularities, sequestration, and absence of bone within the alveolus were observed, as demonstrated in previously published studies on animals treated with ZOL20,57,58,59,60,61.
Recently, an in vitro study demonstrated that the use of calcium phosphate-based synthetic ceramics in a fibroblast culture exposed to ZOL therapy reduced or prevented toxicity26, thus favoring alveolar bone healing, as observed in the present study in BG, DBG, and aBG, as %NBA (Fig. 9) and BV/TV (Fig. 2D). Ceramics-based biomaterials composed of BTCP are highly biocompatible and bioactive, in addition to being osteoinductive62,63,64, and are thus indicated for filling bone cavities65. Studies have shown beneficial effects on cell growth, and these biomaterials can be considered as good candidates for bone tissue engineering applications66,67, in addition to demonstrating ectopic bone formation even in large animal models, with a rapid bone formation pattern as that of autogenous bone68. The use of ceramic biomaterials based on BTCP69 or borate bioactive glass70 can help prevent MRONJ and enhance vital bone tissue formation.
The multi-session aPDT in newly extracted alveoli of senile rats treated with ZOL, has prevented MRONJ24, as demonstrated in this study (Fig. 3). Biomodulation with a low-power laser has biostimulatory effects on osteoblasts, even when treated with ZOL27; the association with a photosensitizing agent (methylene blue) reduces the bacterial load71, thus preventing MRONJ, as observed in this study in aG (Fig. 7C).
Infection control strategies, ranging from topical to systemic antibiotics, are essential in the treatment of MRONJ17. Several antimicrobial combinations serve as adjuvant therapies. Doxycycline, a structural isomer of tetracycline, has antibacterial, anti-inflammatory, and anti-collagenase activities; its anti-osteoclastogenic potential is essential for bone healing72,73,74,75. The application of a collagen sponge with doxycycline to the alveolus, after treatment with ZOL, showed positive effects on the reduction of necrotic bone tissue in rats28. Similarly, in this study, the use of 10% DG prevented MRONJ (Fig. 3), and contributed to the maintenance of bone volume (Figs. 6E and 7E).
Further, the combination of local treatments showed good results by their synergistic effect, thus satisfying the primary objective of this study to prevent osteonecrosis (Fig. 8). Even though the isolated use of aPDT (aG) has not demonstrated large amounts of bone in %NBA analysis, the authors believe that its antimicrobial and biostimulatory potentials are essential for the prevention of osteonecrosis, and when associated with doxycycline (aDG) and a biomaterial (aBG), a greater amount of bone volume was observed in %NBA analysis. The use of 10% DG alone showed good results in repairing critical bone defects in rat calvaria76. It is believed that the anti-osteoclastogenic effect of doxycycline allows the biomaterial to maintain its osteoconductive function. Thus, the combination of the three local methods (aDBG) prevented MRONJ (Fig. 3), favoring alveolar bone healing (Figs. 9I and 10I) with higher %NBA, BV/TV, and MAR.
The mechanisms of alveolar bone healing are similar among species77, and rodent models are ideal for assessment as there is no evidence of superiority for the larger animal models in representing human bone biology78. Given the methodology and results demonstrated in this study, we believe that the use of a low-dose concentration of ZOL in this study (0.035 mg/kg) could be a limiting factor; it is similar to that used for preventing osteoporosis30,79, unlike the high-dose concentrations used in cancer treatment23,24. In addition, it can be noted that the choice for male rats could be a limitation in this research, since in translational clinical application, women are more likely to develop osteoporosis, owing to menopause and estrogen deficiency. Further, they pose a higher risk of developing osteonecrosis with the use of antiresorptive drugs to prevent bone loss. Therefore, future studies are necessary to evaluate different concentrations of ZOL, as well as methodologies for the evaluation of demineralized tissues such as immunohistochemical analysis and real-time polymerase chain reaction.
This research reveals that MRONJ induced by the ZOL protocol (0.035 mg/kg) is counteracted by the use of beta tricalcium phosphate, either alone or in combination, by guiding alveolar bone healing. While the use of doxycycline and aPDT demonstrated positive effects on MRONJ prevention, the combination of all three therapies proved satisfactory.
The datasets generated and/or analyzed are available from the corresponding author upon reasonable request.
Van Poznak, C. et al. Role of bone-modifying agents in metastatic breast cancer: an American Society of Clinical Oncology—Cancer Care Ontario focused guideline update. J. Clin. Oncol. 35(35), 3978–3986. https://doi.org/10.1200/JCO.2017.75.4614 (2017).
Duran, I. et al. Health resource utilization associated with skeletal-related events in patients with bone metastases secondary to solid tumours: regional comparisons in an observational study. Eur. J. Cancer Care (Engl.) 26(6), e12452. https://doi.org/10.1111/ecc.124522 (2017).
Yu, E. W., Tsourdi, E., Clarke, B. L., Bauer, D. C. & Drake, M. T. Osteoporosis management in the era of COVID-19. J Bone Miner Res 35(6), 1009–1013. https://doi.org/10.1002/jbmr.4049 (2020).
Zhang, J. et al. Efficacy of intravenous zoledronic acid in the prevention and treatment of osteoporosis: a meta-analysis. Asian Pac. J. Trop. Med. 5(9), 743–748. https://doi.org/10.1016/S1995-7645(12)60118-7 (2012).
Close, P., Neuprez, A. & Reginster, J. Y. Developments in the pharmacotherapeutic management of osteoporosis. Expert Opin. Pharmacother. 7(12), 1603–1615. https://doi.org/10.1517/146565184.108.40.2063 (2006).
Guyatt, G. H. et al. Summary of meta-analyses of therapies for postmenopausal osteoporosis and the relationship between bone density and fractures. Endocrinol. Metab. Clin. North Am. 31(3), 659–679. https://doi.org/10.1016/s0889-8529(02)00024-5 (2002).
Fung, P. et al. Time to onset of bisphosphonate-related osteonecrosis of the jaws: A multicentre retrospective cohort study. Oral Dis. 23(4), 477–483. https://doi.org/10.1111/odi.12632 (2017).
Kumar, V. & Shahi, A. K. Nitrogen containing bisphosphonates associated osteonecrosis of the jaws: A review for past 10 years literature. Dent Res. J. 11(2), 147–153 (2014).
Ruggiero, S. L. et al. American Association of Oral and Maxillofacial Surgeons’ Position Paper on Medication-Related Osteonecrosis of the Jaw—2022 Update. J. Oral Maxillofac. Surg. 80(5), 920–943. https://doi.org/10.1016/j.joms.2022.02.008 (2022).
Ruggiero, S. L. & Drew, S. J. Osteonecrosis of the jaws and bisphosphonate therapy. J. Dent Res. 86(11), 1013–1021. https://doi.org/10.1177/154405910708601101 (2007).
Hamadeh, I. S., Ngwa, B. A. & Gong, Y. Drug induced osteonecrosis of the jaw. Cancer Treat Rev. 41(5), 455–464. https://doi.org/10.1016/j.ctrv.2015.04.007 (2015).
Drake, M. T., Clarke, B. L. & Khosla, S. Bisphosphonates: mechanism of action and role in clinical practice. Mayo Clin Proc. 83(9), 1032–1045. https://doi.org/10.4065/83.9.1032 (2008).
Marx, R. E. Pamidronate (Aredia) and zoledronate (Zometa) induced avascular necrosis of the jaws: a growing epidemic. J. Oral. Maxillofac. Surg. 61(9), 1115–1117. https://doi.org/10.1016/s0278-2391(03)00720-1 (2003).
Hagiwara, M., Delea, T. E., Cong, Z. & Chung, K. Utilization of intravenous biphosphonates in patientes with bone metastases secondary to breast lung or prostate cancer. Support Care Cancer 22(1), 103–113. https://doi.org/10.1007/s00520-013-1951-z (2014).
Bamias, A. et al. Osteonecrosis of the jaw in cancer after treatment with bisphosphonates: Incidence and risk factors. J. Clin. Oncol. 23(34), 8580–8587. https://doi.org/10.1200/JCO.2005.02.8670 (2005).
Ruggiero, S. et al. American association of oral and maxillofacial surgeons position paper on medication-related osteonecrosis of the jaws - 2014 update. J Oral Maxillofac Surg 72(10), 2381–2382. https://doi.org/10.1016/j.joms.2014.04.031 (2014).
Khan, A. A. et al. Diagnosis and management of osteonecrosis of the jaw: a systematic review and international consensus. J. Bone Mineral Res. 30(1), 3–23. https://doi.org/10.1002/jbmr.2405 (2015).
Poli, P. P., Souza, F. Á. & Maiorana, C. Adjunctive use of antimicrobial photodynamic therapy in the treatment of medication-related osteonecrosis of the jaws: A case report. Photodiagnosis Photodyn. Ther. 23, 99–101. https://doi.org/10.1016/j.pdpdt.2018.06.004 (2018).
de Castro, M. S. et al. Photodynamically dealing with bisphosphonate-related osteonecrosis of the jaw: Successful case reports. Photodiagnosis Photodyn. Ther. 16, 72–75. https://doi.org/10.1016/j.pdpdt.2016.08.007 (2019).
Minamisako, M. C., Ribeiro, G. H., Lisboa, M. L., Cordeiro, M. R. & Grando, L. J. Medication-related osteonecrosis of jaws: A low-level laser therapy and antimicrobial photodynamic therapy case approach. Case Rep. Dent. 2016, 6267406. https://doi.org/10.1155/2016/6267406 (2016).
Sardella, A., Carrassi, A., Tarozzi, M. & Lodi, G. Bisphosphonate-related osteonecrosis of the jaws associated with photodynamic therapy. J. Oral. Maxillofac. Surg. 69(10), e314-316. https://doi.org/10.1016/j.joms.2011.06.219 (2011).
Rugani, P., Acham, S., Truschnegg, A., Obermayer-Pietsch, B. & Jakse, N. Bisphosphonate-associated osteonecrosis of the jaws: surgical treatment with ErCrYSGG-laser. Case report. Oral Surg. Oral Med Oral. Pathol Oral. Radiol. Endod. 110(6), e1-6. https://doi.org/10.1016/j.tripleo.2010.08.013 (2010).
Statkievicz, C. et al. Photomodulation multiple sessions as a promising preventive therapy for medication-related osteonecrosis of the jaws after tooth extraction in rats. J. Photochem. Photobiol. B 184, 7–17. https://doi.org/10.1016/j.jphotobiol.2018.05.004 (2018).
Ervolino, E. et al. Antimicrobial photodynamic therapy improves the alveolar repair process and prevents the occurrence of osteonecrosis of the jaws after tooth extraction in senile rats treated with zoledronate. Bone 120, 101–113. https://doi.org/10.1016/j.bone.2018.10.014 (2019).
Toro, L. F. et al. Application of autologous platelet-rich plasma on tooth extraction site prevents occurrence of medication-related osteonecrosis of the jaws in rats. Sci. Rep. 9(1), 22. https://doi.org/10.1038/s41598-018-37063-y (2019).
Paulo, S. et al. Synthetic calcium phosphate ceramics as a potential treatment for bisphosphonate-related osteonecrosis of the jaw. Materials (Basel) 12(11), 1840. https://doi.org/10.3390/ma12111840 (2019).
Bayram, H., Kenar, H., Taşar, F. & Hasırcı, V. Effect of low level laser therapy and zoledronate on the viability and ALP activity of Saos-2 cells. Int. J. Oral. Maxillofac. Surg. 42(1), 140–146. https://doi.org/10.1016/j.ijom.2012.03.026 (2013).
Çapar, G. D. et al. Preventive effect of doxycycline sponge against bisphosphonate-related osteonecrosis of the jaws: An animal study. Biotechnol. Biotechnol. Equip. 30, 752–761. https://doi.org/10.1080/13102818.2016.1174078 (2016).
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M. & Altman, D. G. The ARRIVE guidelines animal research: Reporting in vivo experiments. PLoS Biol 8(6), e1000412 (2010).
Curra, C. et al. Medication-related osteonecrosis of the jaw. Introduction of a new modified experimental model. Acta Cir Bras 31(5), 308–313. https://doi.org/10.1590/S0102-865020160050000003 (2016).
Luvizuto, E. R., Dias, S. S., Okamoto, T., Dornelles, R. C. & Okamoto, R. Raloxifene therapy inhibits osteoclastogenesis during the alveolar healing process in rats. Arch. Oral. Biol. 56(10), 984–990. https://doi.org/10.1016/j.archoralbio.2011.03.015 (2011).
Ramalho-Ferreira, G., Faverani, L. P., Grossi-Oliveira, G. A., Okamoto, T. & Okamoto, R. Alveolar bone dynamics in osteoporotic rats treated with raloxifene or alendronate: Confocal microscopy analysis. J Biomed Opt 20(3), 038003. https://doi.org/10.1117/1.JBO.20.3.038003 (2015).
Ramalho-Ferreira, G., Faverani, L. P., Prado, F. B., Garcia, I. R. Jr. & Okamoto, R. Raloxifene enhances peri-implant bone healing in osteoporotic rats. Int. J. Oral. Maxillofac. Surg. 44(6), 798–805. https://doi.org/10.1016/j.ijom.2015.02.018 (2015).
Bouxsein, M. L. et al. Guidelines for assessment of bone microstructure in rodents using micro–computed tomography. J. Bone Mineral Res. 25(7), 1468–1486. https://doi.org/10.1002/jbmr.141 (2010).
Dempster, D. W. et al. Standardized nomenclature, symbols, and units for bone histomorphometry: a 2012 update of the report of the ASBMR Histomorphometry Nomenclature Committee. J. Bone Miner. Res. 28(1), 2–17. https://doi.org/10.1002/jbmr.1805 (2013).
Wang, N. et al. Prostate cancer cells preferentially home to osteoblast-rich areas in the early stages of bone metastasis: evidence from in vivo models. J. Bone Miner. Res. 29(12), 2688–2696. https://doi.org/10.1002/jbmr.2300 (2014).
Hassler, N. et al. Sclerostin deficiency is linked to altered bone composition. J Bone Miner. Res. 29(10), 2144–2151. https://doi.org/10.1002/jbmr.2259 (2014).
Soares, M. Q. S. et al. Zoledronic acid induces site-specific structural changes and decreases vascular area in the alveolar bone. J. Oral. Maxillofac. Surg. 76(9), 1893–1901. https://doi.org/10.1016/j.joms.2018.03.007 (2018).
Wood, J. et al. Novel antiangiogenic effects of the bisphosphonate compound zoledronic acid. J. Pharmacol. Exp. Ther. 302(3), 1055–1061. https://doi.org/10.1124/jpet.102.035295 (2002).
Russell, R. G. Bisphophonates: The first 40 years. Bone 49(1), 2–19. https://doi.org/10.1016/j.bone.2011.04.022 (2011).
Russell, R. G., Watts, N. B., Ebetino, F. H. & Rogers, M. J. Mechanisms of action of bisphosphonates: Similarities and differences and their potential influence on clinical efficacy. Osteoporos Int. 19(6), 733–759. https://doi.org/10.1007/s00198-007-0540-8 (2008).
Okamoto, T. & Russo, M. C. Wound healing following tooth extraction: Histochemical study in rats. Rev. Fac. Odontol. Araçatuba 2(2), 153–169 (1973).
Okamoto, T., Okamoto, R., Alves Rezende, M. C. & Gabrielli, M. F. Interference of the blood clot on granulation tissue formation after tooth extraction: histomorphological study in rats. Braz. Dent J. 5(2), 85–92 (1994).
Broughton 2nd G, Janis JE, Attinger CE (2006) Wound healing: An overview. Plast Reconstr Surg. 117(7):1e-S-32e-S. https://doi.org/10.1097/01.prs.0000222562.60260.f9
Walter, C., Pabst, A., Ziebart, T., Klein, M. O. & Al-Nawas, B. Bisphosphonates affect migration ability and cell viability of HUVEC, fibroblasts and osteoblasts in vitro. Oral. Dis. 17(2), 194–199. https://doi.org/10.1111/j.1601-0825.2010.01720.x (2011).
Gao, S. Y. et al. Zoledronate suppressed angiogenesis and osteogenesis by inhibiting osteoclasts formation and secretion of PDGF-BB. PLoS ONE 12(6), e0179248. https://doi.org/10.1371/journal.pone.0179248 (2017).
Lang, M. et al. Influence of zoledronic acid on proliferation, migration, and apoptosis of vascular endothelial cells. Br. J. Oral. Maxilllofac. Surg. 54(8), 889–893. https://doi.org/10.1016/j.bjoms.2016.05.030 (2016).
Abdik, H. et al. The effects of bisphosphonates on osteonecrosis of jaw bone: a stem cell perspective. Mol. Biol. Rep. 46(1), 763–776. https://doi.org/10.1007/s11033-018-4532-x (2019).
Scheper, M. A., Badros, A., Chaisuparat, R., Cullen, K. J. & Meiller, T. F. Effect of zoledronic acid on oral fibroblasts and epithelial cells: A potential mechanism of bisphosphonate-associated osteonecrosis. Br. J. Haematol. 144(5), 667–676. https://doi.org/10.1111/j.1365-2141.2008.07504.x (2009).
Pabst, A. M. et al. The influence of bisphosphonates on viability, migration, and apoptosis of human oral keratinocytes—In vitro study. Clin. Oral. Investig. 16(1), 87–93. https://doi.org/10.1007/s00784-010-0507-6 (2012).
Basso, F. G. et al. Cytotoxic effects of zoledronic acid on human epithelial cells and gingival fibroblasts. Braz. Dent. J. 24(6), 551–558. https://doi.org/10.1590/0103-6440201302229 (2013).
Reid, I. R., Bolland, M. J. & Grey, A. B. Is bisphosphonate-associated osteonecrosis of the jaw caused by soft tissue toxicity?. Bone 41(3), 318–320. https://doi.org/10.1016/j.bone.2007.04.196 (2007).
Yuan, A., Munz, A., Reinert, S. & Hoefert, S. Gingival fibroblasts and medication-related osteonecrosis of the jaw: Results by real-time and wound healing in vitro assays. J. Craniomaxillofac. Surg. 47(9), 1464–1474. https://doi.org/10.1016/j.jcms.2019.06.004 (2019).
Poubel, V. L. N., Silva, C. A. B., Mezzomo, L. A. M., Canto, G. D. L. & Rivero, E. R. C. The risk of osteonecrosis on alveolar healing after tooth extraction and systemic administration of antiresorptive drugs in rodents: a systematic review. J. Craniomaxillofac. Surg. 46(2), 245–256. https://doi.org/10.1016/j.jcms.2017.11.008 (2018).
Yang, H. et al. A novel model of bisphosphonate related osteonecrosis of the jaw in rats. Int. J. Clin. Exp. Pathol. 8(5), 5161–5167 (2015).
Vasconcelos, A. C. et al. Comparison of effects of clodronate and zoledronic acid on the repair of maxilla surgical wounds - histomorphometric, receptor activator of nuclear factor-kB ligand, osteoprotegerin, von Willebrand factor, and caspase-3 evaluation. J. Oral. Pathol. Med. 41(9), 702–712. https://doi.org/10.1111/j.1600-0714.2012.01140.x (2012).
Williams, D. W. et al. Impaired bone resorption and woven bone formation are associated with development of osteonecrosis of the jaw-like lesions by bisphosphonate and anti-receptor activator of nf-kappaB ligand antibody in mice. Am. J. Pathol. 184(11), 3084–3093. https://doi.org/10.1016/j.ajpath.2014.07.010 (2014).
Kolpakova, M. E. et al. Experimental model of osteonecrosis of the jaw in rats treated with zoledronic acid. Br. J. Oral Maxillofac. Surg. 55(2), 156–159. https://doi.org/10.1016/j.bjoms.2016.10.006 (2017).
Howie, R. N. et al. A model for osteonecrosis of the jaw with zoledronate treatment following repeated major trauma. PLoS ONE 10(7), e0132520. https://doi.org/10.1371/journal.pone.0132520 (2015).
Janovszky, A. et al. Periosteal microcirculatory reactions in a zoledronate-induced osteonecrosis model of the jaw in rats. Clin. Oral Investig. 19(6), 1279–1288. https://doi.org/10.1007/s00784-014-1347-6 (2015).
Pacheco, V. N., Langie, R., Etges, A., Ponzoni, D. & Puricelli, E. Nitrogen-containing bisphosphonate therapy: assessment of the alveolar bone structure in rats e a blind randomized controlled trial. Int. J. Exp. Pathol. 96(4), 255–260. https://doi.org/10.1111/iep.12133 (2015).
Boyne, P. J. Current developments with growth factors and bone proteins. Dent Implantol Update 10(4), 25–27 (1999).
Daculsi, G., Jegoux, F. & Layrolle, P. The Micro Macroporous Biphasic Calcium Phosphate Concept for Bone Reconstruction and Tissue Engineering. Advanced Biomaterials: Fundamentals, Processing and Applications 768 (Wiley-American Ceramic Society, 2009).
Bucholz, R. W. Non allograft osteoconductive bone graft substitutes. Clin. Orthop. Relat. Res. 395, 44–52. https://doi.org/10.1097/00003086-200202000-00006 (2002).
Schmidt, L. E. et al. Critical defect healing assessment in rat calvaria filled with injectable calcium phosphate cement. J. Funct. Biomater. 10(2), 21. https://doi.org/10.3390/jfb10020021 (2019).
Bodde, E. W., Wolke, J. G., Kowalski, R. S. & Jansen, J. A. Bone regeneration of porous beta-triclacium phosphate (Conduict TCP) and biphasic calcium phosphate ceramic (Biosel) in trabecular defects in sheep. J. Biomed. Mater Res. A 82(3), 711–722. https://doi.org/10.1002/jbm.a.30990 (2007).
Wang, Y. et al. 3D fabrication and characterization of phosphoric acid scaffold with a HA/beta-TCP weight ratio of 60:40 for bone tissue engineering applications. PLoS ONE 12(4), e0174870. https://doi.org/10.1371/journal.pone.0174870 (2017).
Yuan, H. et al. Osteoinductive ceramics as a synthetic alternative to autologous bone grafting. Proc. Natl. Acad. Sci. USA 107(31), 3614–3619. https://doi.org/10.1073/pnas.1003600107 (2010).
da Silva, J. R. et al. The role of bone grafts in preventing medication-related osteonecrosis of the jaw: Histomorphometric, immunohistochemical, and clinical evaluation in animal model. Craniomaxillofac. Trauma Reconstr. https://doi.org/10.1177/19433875211048367 (2021).
Su, Z. et al. Borate bioactive glass prevents zoledronate-induced osteonecrosis of the jaw by restoring osteogenesis and angiogenesis. Oral Dis. 26(8), 1706–1717. https://doi.org/10.1111/odi.13436 (2020).
Hafner, S., Ehrenfeld, M., Storz, E. & Wieser, A. Photodynamic Inactivation of Actinomyces naeslundii in Comparison With Chlorhexidine and Polyhexanide—A new approach for antiseptic treatment of medication-related osteonecrosis of the jaw?. J. Oral Maxillofac. Surg. 74(3), 516–522. https://doi.org/10.1016/j.joms.2015.09.014 (2016).
Yagan, A., Kesim, S. & Liman, N. Effect of low-dose doxycycline on serum oxidative status, gingival antioxidant levels, and alveolar bone loss in experimental periodontitis in rats. J. Periodontol. 85(3), 478–489. https://doi.org/10.1902/jop.2013.130138 (2014).
Udagawa, N., Koide, M., Nakamura, M. & Takahashi, N. Minocycline to be used a potential anti bone resorption agent due to the suppression of osteoclastic bone resorption. J. Oral. Biosci. 55(1), 16–22. https://doi.org/10.1016/j.job.2013.01.001 (2013).
Kinugawa, S. et al. Tetracyclines convert the osteoclastic-differentiation pathway of progenitor cells to produce dendritic cell-like cells. J. Immunol. 188(4), 1772–1781. https://doi.org/10.4049/jimmunol.1101174 (2012).
Silva, A. C. et al. Effect of doxycycline in gel form on bone regeneration: histomorphometric and tomographic study in rat calvaria. J. Periodont. 87(1), 74–82. https://doi.org/10.1902/jop.2015.150343 (2016).
Lucateli, R. L. et al. Doxycycline and autogenous bone in repair of critical-size defects. Implant Dent. 27(4), 461–466. https://doi.org/10.1097/ID.0000000000000783 (2018).
Pan, J. et al. Interspecies comparison of alveolar bone biology: Tooth extraction socket healing in mini pigs and mice. J. Periodont. 91(12), 653–663. https://doi.org/10.1002/JPER.19-0667 (2020).
Pilawski, I. et al. Interspecies comparison of alveolar bone biology, Part I: Morphology and physiology of pristine bone. JDR Clin. Trans. Res. 6(3), 352–360. https://doi.org/10.1177/2380084420936979 (2021).
Biguetti, C. C. et al. Medication-related osteonecrosis of the jaws after tooth extraction in senescent female mice treated with zoledronic acid: Microtomographic, histological and immunohistochemical characterization. PLoS ONE 14(6), e0214173. https://doi.org/10.1371/journal.pone.0214173 (2019).
The São Paulo State Foundation for Research (FAPESP) awarded Dr. Henrique Hadad, a Ph.D. scholarship (#2019/22657-8), and Ms. Leticia R. Souza, a graduate scholarship (#2019/27609-1). This study was supported by a scholarship granted by the Brazilian Federal Agency for Support and Evaluation of Graduate Education (CAPES), within the scope of the Program CAPES-Print; process number #88887.570145/2020-00. Multiuser Laboratory at FOA/UNESP (FINEP 01.12.0530.00 – PROINFRA 01/2011), where micro-CT was performed, and the confocal fluorescence microscopy laboratory at FOAr/Unesp (FINEP 01/2008, #01.09.0313.00—REF 0349/2009).
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Hadad, H., Kawamata de Jesus, L., Piquera Santos, A.F. et al. Beta tricalcium phosphate, either alone or in combination with antimicrobial photodynamic therapy or doxycycline, prevents medication-related osteonecrosis of the jaw. Sci Rep 12, 16510 (2022). https://doi.org/10.1038/s41598-022-20128-4
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.