Abstract
Oral lichen planus (OLP) is a common, chronic relapsing inflammatory disorder of the mucous membranes, which causes major discomfort. Current treatment includes topical/systemic glucocorticoids, immune modulators and systemic immunosuppressants, which may lead to considerable side-effects. The aim of this study was to determine the clinical and immunological efficacy of photodynamic therapy (PDT) in OLP as an alternative, easy-to-use, safe and non-invasive treatment. Twenty patients with OLP were treated with PDT in a prospective case-controlled pilot-study. PDT was performed on the most extensive oral lesion in 4 sessions (day 1, 3, 7, 14). Peripheral blood and lesional T cells were analysed before (day 1) and after PDT treatment (day 28). PDT led to a statistically significant reduction of clinical parameters (lesion size, ABSIS, Thongprasom-score) and improvement of all evaluated quality-of-life (QOL) items. The clinical improvement was accompanied by a significant decrease of the relative number of CD4+ and CD8+ T cells in mucosal OLP-lesions. Furthermore, CXCL10 plasma levels were decreased and the number of activated peripheral CD4 + CD137+ and CD8 + CD137+ T cells and IL-17-secreting T cells was diminished. PDT treatment in OLP leads to lesion reduction and improvement of QOL, and induces local and systemic anti-inflammatory effects. The study identifies PDT as a novel therapeutic option in OLP.
Introduction
Lichen planus (LP) is a common T cell mediated, chronic inflammatory disorder which affects the oral mucosa and causes major discomfort, its etiology is still not entirely elucidated1,2,3,4. Oral LP (OLP) affects the buccal mucosa, tongue and gingiva, and usually presents with symmetrical, bilateral or multiple lesions5,6. The erosive and atrophic forms may present with remarkable burning and pain sensations that restrict food intake and performance of oral hygiene measures leading to weight loss, nutritional deficiencies7,8, loss of teeth and function with a major impact on the quality of life (QOL). These OLP forms are often resistant to treatment9,10 and have a higher tendency to malignant transformation11,12.
At present, topical corticosteroids are widely accepted as the primary choice of OLP therapy, but other therapeutical protocols have also been investigated, i.e. topical and systemic retinoids, calcineurin inhibitors, aloe-vera, and thalidomide6,7,13,14,15,16,17,18,19,20,21,22,23,24,25. However, some of these treatment options proved to be ineffective or only partially effective12. Photodynamic therapy (PDT) as an easy-to-use and safe treatment option induces cell and tissue damage by combining the use of a photosensitizer and light that activates the photosensitizer by exposure to low-level visible light in an appropriate wavelength. The general principle of PDT was first described in 1900 by the work of Raab and Tappeiner who evaluated the effects of acridine on malaria-causing protozoa showing a lethal effect of this combination on a species of paramecium (Infusoria)26. They discovered the optical property of fluorescence and that one of its products was responsible for the cytotoxic effects in vitro which relies on the energy transfer from light to the chemical, similar to the plants (light-chlorophyll absorbtion). This effect was later applied by Tappeiner and Jesionek for the treatment of skin cancers and described the therapy as “photodynamic phenomenon”27. For the successful inactivation of bacteria, Jodlbauer and Tappeiner, and Huber demonstrated that oxygen was a prerequisite for the photosensitization reactions28,29. Based on these early studies PDT was then used for the treatment of actinic keratosis and various types of skin cancers (such as basal cell carcinoma) and in the past 15 years for the treatment of OLP.
The human tissue transmits efficiently red light and this combined with a longer activation wavelength of a photosensitizer leads to a deeper light penetration30. Most photosensitizers allow a light penetration of 0.5 cm (for 630 nm) to 1.5 cm (for ab. 700 nm)31,32. According to these properties, the therapeutical effect of various photosensitizers is defined for different pathological conditions and tumors. Thus, for each tissue and photosensitizer a different total light dose, dose rate and tissue destruction is achieved30. Light radiation in a specific wavelength for the photosensitizer, sends the photosensitizer from a low-energy ground state to an excited singlet state. This may afterwards undergo a transition to a higher energy triplet state which reacts with the endogenous oxygen. Thus, singlet oxygens and cytotoxic free radicals are released and determine membrane lysis, destruction of targeted cells, and inactivation of proteins13,22. The cytotoxic effects of PDT rely on the fact that during light radiation, photosensitizers that localize in lysosomes and cell membranes induce necrosis, while those penetrating mitochondria lead to apoptosis33. Additionally, PDT seems to induce complex inflammatory and immune responses34. In murine tumor models a strong invasion of neutrophils, mast cells and monocytes had been observed during and after PDT35 accompanied by activation of specific T-lymphocytes36 and apoptosis in the hyperproliferating inflammatory cells37,38.
PDT has been increasingly used for treating various types of oral cancer, mucosal hypertrophy, leukoplakia or erythroplakia showing no to optimal efficacy (no response to treatment to complete remission)39,40,41,42,43. A few studies investigated the efficacy of PDT in reducing the clinical symptoms of OLP, i.e. lesion size and symptoms, and found mixed clinical responses22,44,45,46,47,48,49. Furthermore, limited evidence exists regarding the histological, immunological effects of PDT in OLP. The aim of this study was to determine the efficacy of PDT in OLP based on the combination of clinical and immunological parameters. The results show a reduction of lesion size and decrease of ABSIS and Thongprasom scores and an improvement of QOL parameters. These effects are accompanied by a decrease of CD4+, CD8+ and IL-17+ cells in OLP lesions. In peripheral blood, PDT induces a decrease of CD4+CD137+ and CD8+CD137+ and IL-17+ T cells and CXCL10 plasma levels.
Results
PDT treatment is accompanied by clinical amelioration of OLP
Mucosal lesions of 20 patients with OLP were treated with PDT within 14 days (4 sessions; day 1, 3, 7, and 14; Fig. 1) and clinical parameters were assessed at day 1 (baseline) and day 28, 42, and 56. PDT treatment led to a highly significant size (P < 0.001) reduction of the mucosal lesion starting from 14 days after PDT (day 28; Fig. 2a,c) that correlated with a significant improvement of the ABSIS I score (P < 0.05) at days 42 and 56 (Fig. 2b). Stratification of patients with moderate (≤5 years; n = 9) and long-lasting disease duration (>5 years; n = 11, see Table 1) showed a similar reduction of the lesion size and ABSIS I scores though statistical differences could not be detected due to the reduced patient numbers in the groups (see Supplementary Fig. S1). Six weeks after PDT (day 56), two scores reflecting treatment efficacy50,51 showed a shift from more severe lesions (Thongprasom score 3,4,5) to lesions with softer forms (score 1,2,3) or to complete/partial remission (Carrozzo-Gandolfo score) in the majority of patients (Table 2). At day 56, all evaluated items for QOL showed improvements. Statistically significant however, was the decrease of the burning sensation and self-performed oral hygiene (Fig. 2d, P = 0.003) in concordance with decreasing ABSIS II scores at follow-ups compared to baseline (Fig. 2e, P = 0.005) which was most prominent in patients with long-lasting disease duration (see Supplementary Fig. S1).
Time line of PDT treatment. Clinical and QOL parameters were assessed on day 1 (D1; before therapy), day 28 (D28, 14 days after therapy), day 42 (D42, 28 days after therapy) and day 56 (D56; 42 days after therapy). Samples were collected at D1 and D28. PDT, photodynamic treatment; QOL, quality of life.
PDT leads to clinical amelioration of OLP. (a) PDT induces a reduction of lesion size over time (D1-D56). (b) PDT leads to reduction of ABSIS score I over time (D1-D56). (c) Photographically documentation of lesion size reduction over time (D1-D56). (d) PDT leads to a reduction of ABSIS II score over time (D1-D56). (e) QoL parameters (burning, pain, food, oral hygiene) are improved after PDT treatment (D1-D56). *p < 0.05, **p < 0.01, ***p < 0.001. PDT, photodynamic treatment; QOL, quality of life.
PDT determines an insignificant reduction of the oral bacteria
Two weeks after the final PDT session (day 28), There was a quantitative reduction of the majority of the investigated oral bacteria. Nevertheless, none was significantly reduced (Table 3).
PDT leads to a decrease of peripheral CD4+CD137+ and CD8+CD137+ and IL-17+ T cells and CXCL10 plasma levels
Fourteen days after the last PDT treatment (day 28), relative numbers of peripheral blood CD4+ T cells or CD8+ T- cells remained stable (Fig. 3a,b). Additionally, the relative numbers of CD4+ and CD8+ T- cells expressing the skin-homing factor CCR4 were not altered. In contrast, after PDT treatment, the relative numbers of CD137+ (activated) CD4+ and CD8+ cells were significantly decreased (Fig. 3a,b). Furthermore, the relative number of peripheral γδ+ T- cells was significantly increased whereas the relative number of CD4+CD25+CD127low T regulatory cells remained unaffected (Fig. 3c). ELISpot analysis revealed a consistent number of peripheral blood Th1 (IFNγ+) and Th2 (IL-5+) cells after PDT while peripheral Th17 (IL-17a+) cells declined (P = 0.061; Fig. 3d). CCL5 plasma levels were unaffected whereas CXCL10 plasma concentrations were significantly decreased (Fig. 3e). CXCL8 plasma levels were below the detection limit (data not shown). In contrast, in saliva of treated OLP patients, CXCL8 concentrations were slightly but not significantly lowered (Fig. 4). CCL5 and CXCL10 saliva concentrations were below the detection limit (data not shown).
PDT induces systemic anti-inflammatory effects in OLP. (a) Relative number of CD137 expressing peripheral blood CD4+ T- cells is decreased 14 days after PDT treatment. Results based on analysis by flow cytometry. (b) Relative number of CD137 expressing peripheral blood CD8+ T- cells is decreased 14 days after PDT treatment. Results based on analysis by flow cytometry. (c) PDT leads to an increase of the relative number of peripheral blood γδ T cells. Results based on analysis by flow cytometry. (d) Number of peripheral blood IL-17a producing T cells is decreased 14 days after PDT treatment. Results based on ELISpot. analysis. (e) CXCL10 plasma levels are decreased 14 days after PDT treatment. Results based on ELISA analysis.*p < 0.05, **p < 0.01. PDT, photodynamic treatment.
CXCL8 saliva levels are slightly decreased after PDT treatment. Shown are saliva concentrations (pg/ml) of CXCL8 before (day 1, D1) and after (day 28, D28) PDT treatment of oral OLP lesions.
PDT leads to a reduction of infiltrating CD4+ and CD8+ T- cells in mucosal lesions
Immunohistologically, mucosal lesions of OLP showed the characteristic T cell-dominated subepidermal band-like infiltrate (Fig. 5a). Lesional CD4+ T- cells were widely spread in the upper dermis, particularly at the perivascular region, while lesional CD8+ T -cells were mainly located in a band-like pattern along the basal membrane zone (BMZ). IL-17a+ T -cells were also found along the BMZ and at the perivascular regions (Fig. 5a) as recently described52. After PDT, the CD3+ lesional T- cell infiltrate was markedly but not significantly diminished at day 28, while the relative numbers of skin infiltrating CD4+ T cells and CD8+ T- cells were significantly decreased (Fig. 5b–d). Of note, PDT led to an altered redistribution of dermal CD8+ T- cells from the BMZ to the perivascular area (Fig. 5d). Notably, the relative number of IL-17a+ cells was significantly increased in mucosal lesions after PDT treatment (Fig. 5e).
PDT induces local anti-inflammatory effects in OLP. (a) Overview of immunohistochemical staining of mucosal tissue sections with a lesional T- cell infiltrate before and after PDT treatment (D1, D28). (b–d) Relative number of lesional CD3+, CD4+ and CD8+ cells are decreased 14 days after PDT treatment. (e) Relative number of lesional IL-17+ cells is increased 14 days after PDT treatment. **p < 0.01. PDT, photodynamic treatment.
Discussion
PDT treatment led to a highly significant reduction of the size of OLP lesions, also reflected by a significant decrease of the ABSIS scores. Moreover, treatment efficacy was evident by the increasing numbers of mucosal lesions showing complete remission (day 28: 10%; day 56: 35%), also reflected by decreasing Thongprasom scores at day 56 compared to baseline (Table 2). These results are in concordance with reports by others who used PDT in treating OLP and showed marked improvement of the lesion size22,45,46,47,49,53. Furthermore, the results of our study show a marked improvement of all investigated QOL parameters. Specifically, there was a statistically significant improvement of the burning sensation and oral hygiene measures as early as 6 weeks after PDT treatment extending previous observations showing improvement QOL parameters upon PDT treatment13,45,46,49. However, lesion size reduction alone may be a difficult parameter to assess since OLP lesions have irregular forms, and variable clinical phenotypes, i.e. atrophic or/and erosive areas within the same lesion.
Major efforts have been made to develop and validate clinical markers for mucosal lesions in OLP including individual scoring systems53 and measurement of lesions with calipers or periodontal probes46 and /or scored the lesions using the Thongprasom score5,13,45,46,47,49. To address this issue, we sought to standardize the measurement of OLP lesions by a computer software using clinical photographs on one hand, and by measuring the lesions in two directions (horizontally and vertically) related to fixed intraoral reference points on the other hand. In contrast to previous studies, only one oral lesion per patient was treated to give a single value per lesion size per time point45,46,53. This may have been a drawback of the study, when considering the parameter QOL.
The effect of PDT on the oral microbiome has been only minimally investigated. Reports based on studies in mice54,55 and humans56,57 have shown that photobiomodulation (therapeutical application of low levels of red and/or near-infrarated light) may positively affect the human microbiome54. Additionally, studies investigating the effect of antibacterial PDT on oral bacteria have shown that various photosensitizers may exercise various effects on oral pathogens inducing selective biofilm inactivation58,59. Nonetheless, debatable is its efficiency in the deeper parts of the oral biofilm since bacteria embedded in biofilms provide a higher tolerance towards antimicrobials60,61. In the present study, bacterial analysis of 18 oral pathogens (A. actinomycetemcomitans, A. viscosus, T. forsythia, C. rectus/showae, T. denticola, E. corrodens, P. intermedia, P. micra, P. gingivalis, F. nucleatum, A. odontolyticus, Capnocytophaga sp., C. concisus, E. nodatum, S. constellatus group, C. gracilis, S. mitis group, P. nigrescens, S. gordonii group, V. parvula) was performed from saliva samples before and (Table 3) two weeks after PDT. Despite a reduction of the majority of bacteria, none was statistically significantly reduced two weeks after therapy. Thus, in the present study, a significant influence of the oral microbiome by PDT cannot be admitted.
Clear guidelines regarding the recommended photosensitizer or the duration of PDT exposure are currently not available. Some authors used 8 applications in 1 month with 50 µl toluidine blue (1 mg/ml) combined with laser irradiation for 2.5 min (fluence: 1.5 J/cm2, power density: 10 mW/cm2, 630 nm)46. Others used a 5% methylene blue solution combined with diode laser irradiation (power density: 100–130 mW/cm2, 660 nm) with 8 applications in 2 month49 or with a different light source (LED light, 630 nm, power 7.2–14.4 J/cm2) with 4 aplications (days 1, 4, 7 and 14) at different doses with 120 J/cm2 45,46. We here used 4 applications of PDT within 2 weeks (days 1, 3, 7, and 14) and chose phenothiazine chloride as photosensitizer combined with a low level laser (fluence: 2.49 J/cm2, power density: 200 mW/cm2, 660 nm).
PDT was used in the present study based on the so far proven cytotoxic effects, and the induced complex inflammatory and immune responses33,34,35,36,37,38. PDT treatment led to a significant reduction of the dermal CD4+ and CD8+ T- cellular infiltrate in OLP lesions which was merely visible on day 28, indicating a diminished inflammatory cell infiltrate. However, whether PDT treatment has a direct impact on lesional T- cells in OLP or whether this observation is a consequence of an overall PDT-mediated reduced inflammatory process, still needs to be further analyzed. Of note, the number of IL-17a-producing lesional T- cells was increased after PDT treatment. This finding is in contrast to a recent observation by our group which suggests that Th1/Th17 cells in lichen planus are pathogenic52. However, recent reports demonstrate that PDT treatment by itself can induce Th17 cell accumulation62. As peripheral blood IL-17a+ T -cells were decreased after PDT treatment, this may have been the consequence of a transmigration of anti-inflammatory Th17 cells from peripheral blood into the mucosal tissue upon resolution of PDT-induced mucosal inflammation. Further studies are needed to elucidate the functional phenotype of Th17 cells after PDT treatment in OLP. Along this line, Th17 cells and their associated cytokine IL-17a were elevated in the peripheral blood of OLP patients and were also detected in OLP lesions63,64,65,66,67. Under non-inflammatory conditions, Th17 cells are critical for the induction of innate and adaptive host responses at mucosal areas and show a great deal of plasticity with pro- and anti-inflammatory functions68. Thus, Th17 transmigration in peripheral blood may point towards a transformation towards an anti-inflammatory phenotype. In contrast to peripheral blood IL-17a+ T- cells, the relative number of peripheral γ/δ+ T- cells was found to be increased after PDT. As γδ T- cells were also sparsely detected in OLP lesions69, their elevated numbers in the periphery subsequent to a reduction of local inflammation suggests a rather pro-inflammatory function.
CCL5 and CXCL10 were described as central chemokines for the recruitment of T- cells into OLP lesions70,71. Strikingly, 14 days after PDT treatment of single mucosal lesions, serum levels of CXCL10 were significantly reduced. This is in line with the finding that lesional CD8+ T- cells, which had been described as a main producer of CXCL1071, were significantly decreased after PDT treatment.
PDT leads to a significant decrease of peripheral blood CD4+CD137+ and CD8+CD137+ T- cells in OLP patients indicating a systemic anti-inflammatory effect of PDT with a direct impact on activated CD4+ and CD8+ T- cell subsets, which are presumably critical in the OLP pathogenesis72. CD137 (4-1BB) is a co-stimulatory surface molecule expressed on various immune cells including antigen-activated T- cells73,74,75. The natural counter receptor 4-1BBL is up-regulated on activated antigen-presenting cells particularly on dendritic cells73. CD137 ligand-mediated co-stimulation of human T- cells induces CD4+ and CD8+ T- cell expansion, cytokine release and cytolytic effector mechanisms74. The detection of CD137 expression by flow cytometry is described as an effective assay for the detection of alloreactive T cells76 and therapies targeting CD137 showed anti-inflammatory effects in autoimmune diseases77,78,79.
Nonetheless, in order to evaluate the real benefit of PDT as compared to other phototherapies and to determine the therapeutic effect of a photosensitizer in OLP, in future studies a control group treated with photobiomodulation at a similar wavelength and power density but without a dye may be taken into consideration.
In conclusion, PDT leads to a significant improvement of clinical and QOL parameters in OLP which are associated with local and systemic anti-inflammatory effects. PDT holds promise as a novel therapeutic option in OLP and may deliver new insights for a better understanding of OLP pathogenesis in general.
Methods
Study design and OLP patient cohort
Forty-three patients with OLP were screened for participation in this prospective, case-controlled, clinical intervention trial. Inclusion criteria were: histologically proven OLP with a minimal lesion size of 10 mm, age >18 years. Exclusion criteria were pregnancy, renal insufficiency, HIV-, hepatitis C, and untreated heart disease. Finally, 20 eligible patients (mean age: 62 ± 8.66 years, 17 female, 2 smokers) gave their informed written consent to participate in the study (Table 1;) approved by local Ethical Committee Philipps University Marburg, Germany; identification AZ:57/14, approval on 22.07.2014). The study has also been registered in the publicly accessible primary german register DRKS (Deutsches Register Klinischer Studien, registration date 01.07.2019, number DRKS00017540). The study was conducted according to the Declaration of Helsinki (1964, revision 2008) and all study procedures were performed in accordance with its guidelines and regulations.
Study protocol and evaluated parameters
The most extensive oral lesion was chosen for treatment with PDT which was performed in 4 sessions at days 1, 3, 7, and 14 as shown in Fig. 1. In detail, HELBO® Blue Photosensitizer* was applied and left for 3 min on a previously dried mucosal OLP lesion. After thorough rinsing with sterile saline solution, the lesion was irradiated with a spot probe (HELBO® 2D Spot Probe*) for 30 s/spot (active surface of the spot 19 mm2) using a low level laser (HELBO® TheraLite Laser, Bredent® Medical GmbH&Co.KG, Senden, Germany) at an output power of 200 mW/cm2 and at an emission of 660 nm.
Lesions were measured and scored at baseline (prior to first PDT; day 1) and 2, 4 and 6 weeks after the last PDT session (day 28, 42, and 56). Lesion size was measured horizontally and vertically at the nearest 0.5 mm with a periodontal probe (PCP UNC-15, Hu-Friedy) and with an image measuring software (ImageJ2) using clinical photographs. Lesions were scored using the Thongprasom score50 (0: no lesion, normal mucosa; 1: mild white striae, no erythematous area; 2: white striae with atrophic area <1 cm2; 3: white striae with atrophic area ≥1 cm2; 4: white striae with erosive area <1 cm2; 5: white striae with erosive area ≥1 cm2). Treatment evaluation were scored after PDT (day 28, 42, and 56) as proposed by Carozzo and Gandolfo51 (complete remission: disappearance of all ulcerative lesions with/without remaining mild striae; partial response: improvement without complete healing of the ulcerative lesions; no response: worsening or absence of any improvement of the lesions).
Additionally, the Autoimmune Bullous Skin Disorder Intensity Scores80 (ABSIS) I and II were determined. Moreover, at baseline and 6 weeks after therapy, QOL was assessed for the items pain, burning sensation, impaired food intake and self-performed oral hygiene by means of a Visual Analogue Scala (VAS; 0: no symptom, 10: very severe pain/strong impairment).
Laboratory analyses
For performing flow cytometry, CPDA-treated peripheral blood samples from OLP patients before and 14 days after PDT therapy were stained for 30 min at 4 °C with the following monoclonal antibodies: mouse-anti human CD3-PE-Cy5 (UCHT1), mouse anti-human CD3-APC (UCHT1), mouse anti-human CD4-FITC (RPA-T4), mouse anti-human CD8-FITC (SK1), mouse anti-human CD25-APC (M-A251), mouse anti-human CD127-PE (HIL-7R-M21), mouse anti-human CD137 (4B4-1), mouse anti-human TCR-γδ (B1), mouse IgG1-FITC (MOPC-21), mouse IgG1-PE (G18-145), mouse IgG1-PE-Cy5 (MOPC-21), mouse IgG1-APC (G18-145) (all Becton Dickinson, Franklin Lakes, USA), mouse anti-human CCR4-APC (205410), mouse IgG2-APC (133303) (all R. & D. Systems, Minneapolis, USA). Red blood cells were lysed by ACK lysis buffer (0.15 M NH4Cl, 1 mM KHCO3 and 0.1 mM EDTA). Subsequently, cells were washed twice (PBS, 1% BSA, 0.1% NaN3), resuspended and analysed by FACS (FACSCalibur, Becton Dickinson, Franklin Lakes, USA). FCS-files were analyzed by FlowJo 7.6 single cell analysis software (FlowJo LLC, Ashland, USA).
The Enzyme-linked immunospot (ELISpot) assays were performed as previously described81. IFNγ-, IL-5- and IL-17A- positive spots were developed according to the manufacturers’ instructions (Human IFNγ-ELISpot, Human IL-5-ELISpot, Becton Dickinson, Franklin Lakes, US; Human IL-17A ELISpot Ready-Set-Go, eBioscience, San Diego, US). The ELISpot plates were analysed by an ELISpot plate reader (A.EL.VIS, Hannover, Germany).
For performing the Enzyme-linked immunosorbent assay (ELISA), Citrate phosphate dextrose adenine (CPDA)-treated peripheral blood and saliva samples were centrifuged, and plasma and saliva supernatants were collected and stored at −20 °C. Saliva was collected by spitting method82. Saliva was allowed to accumulate and the patients spat every 60 sec over 5 min into a collection tube. Saliva concentrations of the chemokines CCL5, CXCL10 and IL-8 were determined by commercial ELISA (all Biolegend, San Diego, USA).
From the saliva samples collected as previously described, quantitative microbial analysis of 18 oral bacteria (A. actinomycetemcomitans, A. viscosus, T. forsythia, C. rectus/showae, T. denticola, E. corrodens, P. intermedia, P. micra, P. gingivalis, F. nucleatum, A. odontolyticus, Capnocytophaga sp., C. concisus, E. nodatum, S. constellatus group, C. gracilis, S. mitis group, P. nigrescens, S. gordonii group, V. parvula) was performed prior and two weeks after therapy by means of real-time PCR using a commercially available test (Firma Greiner Bio-One, Solingen, Germany).
Immunochemistry was conducted on paraffin-embedded skin sections that were processed for immunohistochemistry as recently described52. Primary antibodies used were mouse anti-human CD3, CD4, CD8 (all Novocastra, Leica, Wetzlar Germany); rabbit anti-human IL-17A (Novus, Littleton, Co, USA). Secondary antibodies were based on Bond Polymer Refine Detection Kit (Leica, Wetzlar Germany) biotinylated anti-mouse IgG, biotinylated anti-rabbit IgG (Vector Laboratories; Burlingame, CA, USA). Secondary antibodies were subsequently detected by peroxidase- or alkaline phosphatase-labeled ABC-systems (Dako). Visualization was carried out using 3,3’-diaminobenzide (DAB; Dako) as chromogene. The T cell infiltrate of skin biopsies were quantified by microscopical images (Axiostar, Zeiss, Jena, Germany) in combination with Cell^D (Soft Imaging System, Berlin, Germany) and ImageJ software (freeware). CD3+, CD4+, CD8+ and IL-17A+ T- cells were counted at 100x magnification. After generating a grid (ImageJ software; area per point: 50.000 pixels^2), all stained/unstained cells were counted in three squares adjacent to basal membrane zone (ImageJ, cell counter; Fig. 6).
Analysis of T lymphocyte subsets in OLP lesions. The T- cell infiltrate of mucosal sections was quantified by microscopical images (Axiostar, Zeiss, Jena, Germany) in combination with Cell^D (Soft Imaging System, Berlin, Germany) and ImageJ software (freeware). T cells were counted at a 100x magnification. After generating a grid (ImageJ software; area per point: 50.000 pixels^2), all stained T- cells were counted in three squares adjacent to basal membrane zone (ImageJ, cell counter) and their proportion of all infiltrating cells was determined subsequently.
Statistcal Analyses
The study has been registered in the DRKS (Deutsches Register Klinischer Studien), Registration Number DRKS00017540, accepted registration 01.07.2019. (WHO website: http://apps.who.int/trialsearch/).
Accession code
For statistical analyses the statistical unit was the patient and the main outcome variable was the reduction of the lesion size. Secondary variables were changes in the lesion scores, QOL symptoms, ABSIS I and II scores and changes in the numbers of peripheral blood T- cell subsets (CD8+, CD4+, CD8+CCR4+, CD4+CCR4+, CD8+CD137+, CD4+CD137+, IFNγ+, IL-5+, IL-17a+). For all pairwise comparisons of ABSIS scores, lesion size and cell counts between time points generalized least squares (GLS) estimations were used. In the case of the ordinally scaled lesions scores50,51 as well as the non-normally distributed QOL scores, non-parametric Friedman test were used to test for a tendency toward higher scores between time points. For the multivariate comparison of QOL scores between day 0 and day 56 the multivariate extension of the Friedman test was applied. P-values were calculated adjusted for multiple comparisons and the level of significance was set at 0.05.
Data availability
Study protocol data are available https://www.drks.de/ui_data_web/DrksUI.html?locale=de, http://apps.who.int/trialsearch/. Data results are available from arweiler@med.uni-marburg.de, ralucacosgrea@gmail.com.
References
Lavanya, N., Jayanthi, P., Rao, U. K. & Ranganathan, K. Oral lichen planus: An update on pathogenesis and treatment. Journal of oral and maxillofacial pathology: JOMFP 15, 127–132, https://doi.org/10.4103/0973-029X.84474 (2011).
Lodi, G., Carrozzo, M., Furness, S. & Thongprasom, K. Interventions for treating oral lichen planus: a systematic review. The British journal of dermatology 166, 938–947, https://doi.org/10.1111/j.1365-2133.2012.10821.x (2012).
Lodi, G. et al. Current controversies in oral lichen planus: report of an international consensus meeting. Part 1. Viral infections and etiopathogenesis. Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics 100, 40–51, https://doi.org/10.1016/j.tripleo.2004.06.077 (2005).
Thornhill, M. H. Immune mechanisms in oral lichen planus. Acta odontologica Scandinavica 59, 174–177 (2001).
Aghahosseini, F., Arbabi-Kalati, F., Fashtami, L. A., Fateh, M. & Djavid, G. E. Treatment of oral lichen planus with photodynamic therapy mediated methylene blue: a case report. Medicina oral, patologia oral y cirugia bucal 11, E126–9 (2006).
Eisen, D., Carrozzo, M., Bagan Sebastian, J.-V. & Thongprasom, K. Number V Oral lichen planus: clinical features and management. Oral diseases 11, 338–349, https://doi.org/10.1111/j.1601-0825.2005.01142.x (2005).
Cheng, S. et al. Interventions for erosive lichen planus affecting mucosal sites. The Cochrane database of systematic reviews, CD008092; https://doi.org/10.1002/14651858.CD008092.pub2 (2012).
Eisen, D. The evaluation of cutaneous, genital, scalp, nail, esophageal, and ocular involvement in patients with oral lichen planus. Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics 88, 431–436 (1999).
Eisen, D. The clinical features, malignant potential, and systemic associations of oral lichen planus: a study of 723 patients. Journal of the American Academy of Dermatology 46, 207–214 (2002).
Carrozzo, M. & Thorpe, R. Oral lichen planus: a review. Minerva stomatologica 58, 519–537 (2009).
Lodi, G. et al. Current controversies in oral lichen planus: report of an international consensus meeting. Part 2. Clinical management and malignant transformation. Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics 100, 164–178, https://doi.org/10.1016/j.tripleo.2004.06.076 (2005).
Neppelberg E. Pathological mechanisms in oral lichen planus. Oral Sciences, Oral Pathology and Oral Medicine, Faculty of Dentistry: University of Bergen, Norway (2007).
Aghahosseini, F. et al. Methylene blue-mediated photodynamic therapy: a possible alternative treatment for oral lichen planus. Lasers in surgery and medicine 38, 33–38, https://doi.org/10.1002/lsm.20278 (2006).
Camisa, C. & Popovsky, J. L. Effective treatment of oral erosive lichen planus with thalidomide. Archives of dermatology 136, 1442–1443 (2000).
Cheng, A. & Mann, C. Oral erosive lichen planus treated with efalizumab. Archives of dermatology 142, 680–682, https://doi.org/10.1001/archderm.142.6.680 (2006).
Farhi, D. & Dupin, N. Pathophysiology, etiologic factors, and clinical management of oral lichen planus, part I: facts and controversies. Clinics in dermatology 28, 100–108, https://doi.org/10.1016/j.clindermatol.2009.03.004 (2010).
Heffernan, M. P., Smith, D. I., Bentley, D., Tabacchi, M. & Graves, J. E. A single-center, open-label, prospective pilot study of subcutaneous efalizumab for oral erosive lichen planus. Journal of drugs in dermatology: JDD 6, 310–314 (2007).
Kaliakatsou, F. et al. Management of recalcitrant ulcerative oral lichen planus with topical tacrolimus. Journal of the American Academy of Dermatology 46, 35–41 (2002).
Lundquist, G., Forsgren, H., Gajecki, M. & Emtestam, L. Photochemotherapy of oral lichen planus. A controlled study. Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics 79, 554–558 (1995).
McCreary, C. E. & McCartan, B. E. Clinical management of oral lichen planus. The British journal of oral & maxillofacial surgery 37, 338–343, https://doi.org/10.1054/bjom.1999.0131 (1999).
Reddy, R. L. et al. Randomized trial of aloe vera gel vs triamcinolone acetonide ointment in the treatment of oral lichen planus. Quintessence international (Berlin, Germany: 1985) 43, 793–800 (2012).
Sadaksharam, J., Nayaki, K. P. T. & Selvam, N. P. Treatment of oral lichen planus with methylene blue mediated photodynamic therapy–a clinical study. Photodermatology, photoimmunology & photomedicine 28, 97–101, https://doi.org/10.1111/j.1600-0781.2012.00647.x (2012).
Setterfield, J. F., Black, M. M. & Challacombe, S. J. The management of oral lichen planus. Clinical and experimental dermatology 25, 176–182 (2000).
Soria, A., Agbo-Godeau, S., Taïeb, A. & Francès, C. Treatment of refractory oral erosive lichen planus with topical rapamycin: 7 cases. Dermatology (Basel, Switzerland) 218, 22–25, https://doi.org/10.1159/000172830 (2009).
Thongprasom, K. et al. A multicenter study of oral lichen planus in Thai patients. Journal of investigative and clinical dentistry 1, 29–36, https://doi.org/10.1111/j.2041-1626.2010.00005.x (2010).
Raab, O. Uber die Wirkung fluorescirender Stoffe auf Infusorien. Z. biol. 39, 524–546 (1900).
Jesionek, A. & Tappeiner, H. von. Zur behandlung der hautcarcinome mit fluorescierenden stoffen. Dtsch Arch Klin Med 85, 223–239 (1905).
Jodlbauer, A. & Tappeiner, H. von. Uber die wirkung photodynamischer (fluoreszierender) stoffe auf bakterien. Munch Med Wochenschr 51, 1096–1097 (1904).
Huber, H. Weitere Versuche mit photodynamischen sensibilisierenden Farbstoffen (Eosin, Erythrosin). Prüfung der Wirkung des Tageslichtes auf Lebensfähigkeit und Virulenz von Bakterien, auf Toxine, Antitoxine und das Labferment. Arch. f. Hygiene 54, 53 (1905).
Konopka, K. & Goslinski, T. Photodynamic therapy in dentistry. Journal of dental research 86, 694–707, https://doi.org/10.1177/154405910708600803 (2007).
Salva, K. A. Photodynamic therapy: unapproved uses, dosages, or indications. Clinics in dermatology 20, 571–581, https://doi.org/10.1016/s0738-081x(02)00266-3 (2002).
Kübler, A., Niziol, C., Sidhu, M., Dünne, A. & Werner, J. A. Eine Kosten-Effektivitäts-Analyse der photodynamischen Therapie mit Foscan (Foscan-PDT) im Vergleich zu einer palliativen Chemotherapie bei Patienten mit fortgeschrittenen Kopf-Halstumoren in Deutschland. Laryngo- rhino- otologie 84, 725–732, https://doi.org/10.1055/s-2005-861048 (2005).
Castano, A. P., Demidova, T. N. & Hamblin, M. R. Mechanisms in photodynamic therapy: part two-cellular signaling, cell metabolism and modes of cell death. Photodiagnosis and photodynamic therapy 2, 1–23, https://doi.org/10.1016/S1572-1000(05)00030-X (2005).
Dougherty, T. J. et al. Photodynamic therapy. Journal of the National Cancer Institute 90, 889–905, https://doi.org/10.1093/jnci/90.12.889 (1998).
Krosl, G., Korbelik, M. & Dougherty, G. J. Induction of immune cell infiltration into murine SCCVII tumour by photofrin-based photodynamic therapy. British journal of cancer 71, 549–555, https://doi.org/10.1038/bjc.1995.108 (1995).
Nowis, D. et al. The influence of photodynamic therapy on the immune response. Photodiagnosis and photodynamic therapy 2, 283–298, https://doi.org/10.1016/S1572-1000(05)00098-0 (2005).
Henderson, B. W. & Dougherty, T. J. How does photodynamic therapy work? Photochemistry and photobiology 55, 145–157, https://doi.org/10.1111/j.1751-1097.1992.tb04222.x (1992).
Zeitouni, N. C., Shieh, S. & Oseroff, A. R. Laser and photodynamic therapy in the management of cutaneous malignancies. Clinics in dermatology 19, 328–338, https://doi.org/10.1016/s0738-081x(01)00170-5 (2001).
Biel, M. A. Photodynamic therapy in head and neck cancer. Current oncology reports 4, 87–96 (2002).
Chen, H.-M. et al. Successful treatment of oral verrucous hyperplasia with topical 5-aminolevulinic acid-mediated photodynamic therapy. Oral oncology 40, 630–637, https://doi.org/10.1016/j.oraloncology.2003.12.010 (2004).
Kübler, A. C. et al. Photodynamic therapy of primary nonmelanomatous skin tumours of the head and neck. Lasers in surgery and medicine 25, 60–68 (1999).
Massano, J., Regateiro, F. S., Januário, G. & Ferreira, A. Oral squamous cell carcinoma: review of prognostic and predictive factors. Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics 102, 67–76, https://doi.org/10.1016/j.tripleo.2005.07.038 (2006).
Wildeman, M. A. M., Nyst, H. J., Karakullukcu, B. & Tan, B. I. Photodynamic therapy in the therapy for recurrent/persistent nasopharyngeal cancer. Head & neck oncology 1, 40, https://doi.org/10.1186/1758-3284-1-40 (2009).
Akram, Z. et al. Photodynamic therapy in the treatment of symptomatic oral lichen planus: A systematic review. Photodermatology, photoimmunology & photomedicine 34, 167–174, https://doi.org/10.1111/phpp.12371 (2018).
Bakhtiari, S. et al. Comparing clinical effects of photodynamic therapy as a novel method with topical corticosteroid for treatment of Oral Lichen Planus. Photodiagnosis and photodynamic therapy 20, 159–164, https://doi.org/10.1016/j.pdpdt.2017.06.002 (2017).
Jajarm, H. H. et al. A comparative study of toluidine blue-mediated photodynamic therapy versus topical corticosteroids in the treatment of erosive-atrophic oral lichen planus: a randomized clinical controlled trial. Lasers in medical science 30, 1475–1480, https://doi.org/10.1007/s10103-014-1694-1 (2015).
Kvaal, S. I., Angell-Petersen, E. & Warloe, T. Photodynamic treatment of oral lichen planus. Oral surgery, oral medicine, oral pathology and oral radiology 115, 62–70, https://doi.org/10.1016/j.oooo.2012.08.448 (2013).
Maloth, K. N. et al. Photodynamic Therapy - A Non-invasive Treatment Modality for Precancerous Lesions. Journal of lasers in medical sciences 7, 30–36, https://doi.org/10.15171/jlms.2016.07 (2016).
Mostafa, D., Moussa, E. & Alnouaem, M. Evaluation of photodynamic therapy in treatment of oral erosive lichen planus in comparison with topically applied corticosteroids. Photodiagnosis and photodynamic therapy 19, 56–66, https://doi.org/10.1016/j.pdpdt.2017.04.014 (2017).
Thongprasom, K., Luangjarmekorn, L., Sererat, T. & Taweesap, W. Relative efficacy of fluocinolone acetonide compared with triamcinolone acetonide in treatment of oral lichen planus. Journal of oral pathology & medicine: official publication of the International Association of Oral Pathologists and the American Academy of Oral Pathology 21, 456–458 (1992).
Carrozzo, M. & Gandolfo, S. The management of oral lichen planus. Oral diseases 5, 196–205 (1999).
Schmidt, T. et al. TH1/TH17 cell recognition of desmoglein 3 and bullous pemphigoid antigen 180 in patients with lichen planus. The Journal of allergy and clinical immunology. https://doi.org/10.1016/j.jaci.2018.02.044 (2018).
Sobaniec, S. et al. Clinical assessment of the efficacy of photodynamic therapy in the treatment of oral lichen planus. Lasers in medical science 28, 311–316, https://doi.org/10.1007/s10103-012-1153-9 (2013).
Liebert, A. et al. “Photobiomics”: Can Light, Including Photobiomodulation, Alter the Microbiome? Photobiomodulation, photomedicine, and laser surgery. https://doi.org/10.1089/photob.2019.4628 (2019).
Bicknell, B., Liebert, A., Johnstone, D. & Kiat, H. Photobiomodulation of the microbiome: implications for metabolic and inflammatory diseases. Lasers in medical science 34, 317–327, https://doi.org/10.1007/s10103-018-2594-6 (2019).
Wu, X., Hu, X. & Hamblin, M. R. Ultraviolet blood irradiation: Is it time to remember “the cure that time forgot”? Journal of photochemistry and photobiology. B, Biology 157, 89–96, https://doi.org/10.1016/j.jphotobiol.2016.02.007 (2016).
Hamblin, M. R. Ultraviolet Irradiation of Blood: “The Cure That Time Forgot”? Advances in experimental medicine and biology 996, 295–309, https://doi.org/10.1007/978-3-319-56017-5_25 (2017).
Cieplik, F., Tabenski, L., Buchalla, W. & Maisch, T. Antimicrobial photodynamic therapy for inactivation of biofilms formed by oral key pathogens. Frontiers in microbiology 5, 405, https://doi.org/10.3389/fmicb.2014.00405 (2014).
Kang, S.-M., Jung, H.-I. & Kim, B.-I. Susceptibility of oral bacteria to antibacterial photodynamic therapy. Journal of oral microbiology 11, 1644111, https://doi.org/10.1080/20002297.2019.1644111 (2019).
Mah, T. F. & O’Toole, G. A. Mechanisms of biofilm resistance to antimicrobial agents. Trends in microbiology 9, 34–39, https://doi.org/10.1016/s0966-842x(00)01913-2 (2001).
Marsh, P. D. Dental plaque as a microbial biofilm. Caries research 38, 204–211, https://doi.org/10.1159/000077756 (2004).
Brackett, C. M., Muhitch, J. B., Evans, S. S. & Gollnick, S. O. IL-17 promotes neutrophil entry into tumor-draining lymph nodes following induction of sterile inflammation. Journal of immunology (Baltimore, Md.: 1950) 191, 4348–4357, https://doi.org/10.4049/jimmunol.1103621 (2013).
Piccinni, M.-P. et al. Potential pathogenetic role of Th17, Th0, and Th2 cells in erosive and reticular oral lichen planus. Oral diseases 20, 212–218, https://doi.org/10.1111/odi.12094 (2014).
Pouralibaba, F., Babaloo, Z., Pakdel, F. & Aghazadeh, M. Serum Level of Interleukin 17 in Patients with Erosive and Non erosive Oral Lichen Planus. Journal of dental research, dental clinics, dental prospects 7, 91–94, https://doi.org/10.5681/joddd.2013.016 (2013).
Shaker, O. & Hassan, A. S. Possible role of interleukin-17 in the pathogenesis of lichen planus. The British journal of dermatology 166, 1367–1368, https://doi.org/10.1111/j.1365-2133.2011.10793.x (2012).
Shen, Z. et al. Expression of Foxp3 and interleukin-17 in lichen planus lesions with emphasis on difference in oral and cutaneous variants. Archives of dermatological research 306, 441–446, https://doi.org/10.1007/s00403-013-1429-3 (2014).
Xie, S., Ding, L., Xiong, Z. & Zhu, S. Implications of Th1 and Th17 cells in pathogenesis of oral lichen planus. Journal of Huazhong University of Science and Technology. Medical sciences = Hua zhong ke ji da xue xue bao. Yi xue Ying De wen ban = Huazhong keji daxue xuebao. Yixue Yingdewen ban 32, 451–457, https://doi.org/10.1007/s11596-012-0078-7 (2012).
Guglani, L. & Khader, S. A. Th17 cytokines in mucosal immunity and inflammation. Current opinion in HIV and AIDS 5, 120–127, https://doi.org/10.1097/COH.0b013e328335c2f6 (2010).
Gadenne, A. S. et al. T-cell lines derived from lesional skin of lichen planus patients contain a distinctive population of T-cell receptor gamma delta-bearing cells. The Journal of investigative dermatology 103, 347–351 (1994).
Hu, J.-Y. et al. Increasing CCL5/CCR5 on CD4+ T cells in peripheral blood of oral lichen planus. Cytokine 62, 141–145, https://doi.org/10.1016/j.cyto.2013.01.020 (2013).
Iijima, W. et al. Infiltrating CD8+ T cells in oral lichen planus predominantly express CCR5 and CXCR3 and carry respective chemokine ligands RANTES/CCL5 and IP-10/CXCL10 in their cytolytic granules: a potential self-recruiting mechanism. The American journal of pathology 163, 261–268, https://doi.org/10.1016/S0002-9440(10)63649-8 (2003).
Sugerman, P. B. et al. The pathogenesis of oral lichen planus. Critical reviews in oral biology and medicine: an official publication of the American Association of Oral Biologists 13, 350–365 (2002).
Mittler, R. S. et al. Anti-CD137 antibodies in the treatment of autoimmune disease and cancer. Immunologic research 29, 197–208, https://doi.org/10.1385/IR:29:1-3:197 (2004).
Wen, T., Bukczynski, J. & Watts, T. H. 4-1BB ligand-mediated costimulation of human T cells induces CD4 and CD8 T cell expansion, cytokine production, and the development of cytolytic effector function. Journal of immunology (Baltimore, Md.: 1950) 168, 4897–4906 (2002).
Wolfl, M. et al. Activation-induced expression of CD137 permits detection, isolation, and expansion of the full repertoire of CD8+ T cells responding to antigen without requiring knowledge of epitope specificities. Blood 110, 201–210, https://doi.org/10.1182/blood-2006-11-056168 (2007).
Litjens, N. H. R., Wit, E. A., de, Baan, C. C. & Betjes, M. G. H. Activation-induced CD137 is a fast assay for identification and multi-parameter flow cytometric analysis of alloreactive T cells. Clinical and experimental immunology 174, 179–191, https://doi.org/10.1111/cei.12152 (2013).
Forsberg, M. H. et al. CD137 Plays Both Pathogenic and Protective Roles in Type 1 Diabetes Development in NOD Mice. Journal of immunology (Baltimore, Md.: 1950) 198, 3857–3868, https://doi.org/10.4049/jimmunol.1601851 (2017).
Shao, H. et al. Anti-CD137 mAb treatment inhibits experimental autoimmune uveitis by limiting expansion and increasing apoptotic death of uveitogenic T cells. Investigative ophthalmology & visual science 46, 596–603, https://doi.org/10.1167/iovs.04-0835 (2005).
Sun, Y. et al. Costimulatory molecule-targeted antibody therapy of a spontaneous autoimmune disease. Nature medicine 8, 1405–1413, https://doi.org/10.1038/nm796 (2002).
Pfütze, M., Niedermeier, A., Hertl, M. & Eming, R. Introducing a novel Autoimmune Bullous Skin Disorder Intensity Score (ABSIS) in pemphigus. European journal of dermatology: EJD 17, 4–11, https://doi.org/10.1684/ejd.2007.0090 (2007).
Möbs, C. et al. Birch pollen immunotherapy results in long-term loss of Bet v 1-specific TH2 responses, transient TR1 activation, and synthesis of IgE-blocking antibodies. The Journal of allergy and clinical immunology 130, 1108–1116.e6, https://doi.org/10.1016/j.jaci.2012.07.056 (2012).
Navazesh, M. Methods for collecting saliva. Annals of the New York Academy of Sciences 694, 72–77 (1993).
Acknowledgements
We thank Elke Hermann for excellent technical assistance. The study was funded by a grant of the Universitätsklinikum Gießen-Marburg (UKGM 05/2014 M.R.) and, in part, by the German Research Foundation (FOR 2497 PEGASUS to R.E. and M.H.).
Author information
Authors and Affiliations
Contributions
R.C. principal investigator, conduction of all clinical procedures (therapy, biopsy, assessment of clinical parameters) in patients, manuscript writing and editing, revising the manuscript. R.P. conduction of immunological analyses, data analysis, manuscript writing and figure editing, extensive work in revising the manuscript and statistical analysis. J.S. contacted and supervised patients, conducted the follow-ups, introduced data, preliminary analyses. T.S. supervised the immunohistochemical procedures, conducted all histomorphometrical and immunological analyses, manuscript editing. R.S. performed immunohistochemical procedures. A.B. measurement of lesion sizes with the ImageJ. software. T.A. data check, patient recrution. A.S. analyses and data check-lesions sizes, manuscript editing. R.E. data check-laboratory procedures, manuscript editing. B.G. performed all statistical analyses. M.H. protocol planning, principal investigator, manuscript editing. N.A. protocol planning, principal investigator, manuscript editing
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Cosgarea, R., Pollmann, R., Sharif, J. et al. Photodynamic therapy in oral lichen planus: A prospective case-controlled pilot study. Sci Rep 10, 1667 (2020). https://doi.org/10.1038/s41598-020-58548-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-020-58548-9
This article is cited by
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.
