Abstract
Mitochondria behave as functional and structural hubs for innate defense against intracellular infection. While the mitochondrial membrane serves as a platform for the assembly of signaling complexes activated by intracellular infection, various danger molecules derived from impaired mitochondria activate innate signaling pathways. Using methionyl-tRNA formyl transferase (MTFMT)-deficient cells, which exhibit impaired mitochondrial activity, we examined the role of mitochondrial integrity in regulating innate defense against infection. Since MTFMT functions at the early steps of mitochondrial translation, its loss was expected to cause defects in mitochondrial activity. Under transient MTFMT gene silencing conditions, we observed shortened mitochondria along with reduced activity. MTFMT-silenced cells were more susceptible to intracellular infection, as examined by infection with RNA viruses and the intracellular bacterium Shigella flexneri. In support of this observation, MTFMT-silenced cells possessed lowered basal NF-κB activity, which remained low after S. flexneri infection. In addition, the mitochondrial accumulation of evolutionarily conserved signaling intermediate in Toll pathway (ECSIT), an adaptor protein for NF-κB activation, was significantly decreased in MTFMT-silenced cells, explaining the reduced NF-κB activity observed in these cells. Since impaired mitochondria likely release mitochondrial molecules, we evaluated the contribution of mitochondrial N-formyl peptides to the regulation of bacterial infection. Transient transfection of mitochondrial-derived N-formyl peptides favored S. flexneri infection, which was accompanied by enhanced bacterial survival, but did not affect host cell viability. However, transient transfection of mitochondrial-derived N-formyl peptides did not affect basal NF-κB activity. Altogether, these data suggest that the integrity of mitochondria is essential to their proper function in protecting against infection, as intact mitochondria not only block the release of danger molecules but also serve as signaling hubs for the downstream NF-κB pathway.
Similar content being viewed by others
Introduction
As the mitochondrion, one of the largest subcellular organelles, orchestrates a variety of cellular processes, congenital or acquired mitochondrial defects participate in the development of several diseases1. When examining parts of the eukaryotic cell, the extent to which the cellular immune response is activated often correlates with mitochondrial activity2. Such activity can be determined by the following properties: mitochondrial morphology, which is controlled by fusion and fission processes; mitochondrial number, which is regulated through mitochondrial biogenesis and degradation; and mitochondrial compositional changes, which are caused by the leakage of mitochondrial molecules3,4,5. Changes in these properties at the molecular level alter the susceptibility of cells under pathophysiological conditions; therefore, understanding mitochondrial behavior is crucial to studying the development of various diseases at the organism level.
How the regulation of immune responses is associated with mitochondrial activity has been widely studied in different ways. Furthermore, the correlation of immune response regulation with mitochondrial structural integrity is an attractive subject due to the formation of an immune signalosome on the mitochondrial membrane. Mitochondrial antiviral-signaling protein (MAVS), a representative adaptor molecule on the mitochondrial membrane, serves as a signaling hub that links the activated cytosolic receptor retinoic acid-inducible gene I (RIG-I)/melanoma differentiation-associated protein 5 (MDA-5) with the downstream signaling complex for IRF and NF-κB activation6,7,8,9. Similarly, ECSIT, another type of cytosolic adaptor protein functioning in mitochondria, binds TNF receptor-associated factor 6 (TRAF6), which mediates IKK activation and NF-κB target gene expression10. On the mitochondrial membrane, ECSIT is also known to physically interact with MAVS, which leads to the activation of NF-κB- and IRF3/7-dependent gene expression11.
Occasionally, disruption of the mitochondria induces the release of mitochondrial damage-associated molecular patterns (DAMPs), which can lead to the activation of innate immune responses5. Mitochondrial DNA induces an inflammatory response by binding not only TLR9, a membrane surface receptor12, but also cytosolic NOD-like receptor pyrin domain-containing protein 3 (NLRP3) with the aid of mitochondrial reactive oxygen species (ROS)13. Similarly, N-formyl peptides synthesized in the mitochondria alert the immune system by binding formyl peptide receptor (FPR)14,15. However, whether these mitochondrial molecules inhibit pathogens or the host remains controversial.
Because mitochondria account for a considerable proportion of the volume of eukaryotic cells, it is not surprising that the regulation of cellular processes is highly dependent on the mitochondrial status. Based on the importance of mitochondrial structural integrity, we questioned the extent to which mitochondrial defects affect cellular susceptibility to pathogenic infection. In this study, we introduced a mitochondrial defect by altering the gene expression of methionyl-tRNA formyltransferase (MTFMT). MTFMT is a key mitochondrial protein during the mitochondrial translational process that adds a formyl group onto methionyl-tRNA to produce the mitochondrial-specific translational initiator tRNAfMet16. Inappropriate MTFMT activity not only causes imbalance in the mitochondrial proteome but also influences the maintenance of mitochondria. Furthermore, mutations in the MTFMT gene have been associated with progressive neurodegenerative disorders, such as Leigh syndrome17,18. At the cellular level, fibroblasts obtained from Leigh syndrome patients exhibit decreased levels of tRNAfMet and impaired mitochondrial translational efficiency, which eventually leads to abnormal assembly of the mitochondrial OXPHOS complex17. Interestingly, overexpression of MTFMT had a dominant negative effect on the assembly of this complex, suggesting that MTFMT-mediated regulation of the translational initiation step is critical for the functional activity of mitochondria19.
In this study, using MTFMT-deficient cells with defective mitochondria under basal conditions, the significance of mitochondrial integrity in regulating the innate defense against infection was elucidated.
Results
MTFMT deficiency induces mitochondrial impairments
Mitochondria continuously undergo fusion and fission processes to properly respond to different cellular environments4. When cells become stressed, which induces mitochondrial damage, the mitochondrial quality control system is turned on, immediately activating the fission process to segregate unhealthy mitochondria from groups of healthy mitochondria (Supplementary Fig. S1). To examine whether a transient deficiency of MTFMT induces mitochondrial damage, we measured mitochondrial morphological parameters, such as length and mass, using a macro for mitochondrial network analysis (MiNA) to evaluate confocal microscopy images of mitochondria through an ImageJ plug-in20. Compared to control small interfering RNA (siRNA)-transfected cells (N = 459; mitochondrial length M = 11.34; SD = 2.24), MTFMT-deficient cells (N = 424; M = 10.20; SD = 1.46) possessed significantly shorter mitochondria (Fig. 1a). Similarly, the mitochondrial mass was reduced in MTFMT-deficient cells (N = 424; mitochondrial mass M = 5,470; SD = 1525.04) compared to that observed in control cells (N = 459; M = 6,194; SD = 1,475.22) (Fig. 1a). Knockdown levels of MTFMT protein were separately confirmed using an immunoblotting assay (Supplementary Fig. S2). We also measured the functionality of mitochondria based on their membrane potential, which can be directly assessed by determining the ratio of an aggregated form of JC-1 dye trapped in healthy mitochondria relative to the monomeric form of JC-1 outside mitochondria. The ratio value was reduced by 30% when MTFMT expression was silenced (Fig. 1b), indicating that the integrity of the mitochondria was impaired when normal levels of MTFMT expression were not maintained. FCCP is a potent mitochondrial uncoupler that dissipates mitochondrial membrane potential by augmenting proton permeability across the mitochondrial inner membrane. Although the addition of FCCP reduced the mitochondrial membrane potential, MTFMT silencing did not lead to a further decrease in mitochondrial membrane potential (Supplementary Fig. S3a). In addition, levels of mitochondrial ROS, products of an abnormal operation of the mitochondrial electron transport chain (ETC) system, were similarly elevated in MTFMT-silenced cells (Fig. 1b). As a control, we observed the levels of mitochondrial ROS increased by the addition of FCCP in dose-dependent manner (Supplementary Fig. S3b).
Next, the functionality of mitochondria was assessed by measuring the cellular oxygen consumption rate (OCR). Following the sequential addition of oligomycin, FCCP, and rotenone/antimycin A, which target mitochondrial electron transport chains, the OCR values of control- or MTFMT-silenced cells were measured using Seahorse XFe Analyzers. In every step with added chemical, MTFMT-silenced cells behaved similarly to control cells, but with relatively lower OCR value (Fig. 1c). The results showed that in MTFMT-silenced cells, the basal and the maximal respiratory capacities, representing OCR values taken before oligomycin treatment and after FCCP treatment, respectively, were significantly decreased (Fig. 1d). In addition, the ATP production capacity of MTFMT-silenced cells, measured by ATP-linked respiration (OCROligomycin − OCRFCCP), was also significantly reduced (Fig. 1d). The cellular concentrations of ATP were also separately measured to support the above results (Supplementary Fig. S3c and d). These results suggest both structural and functional alterations of mitochondria occurred in MTFMT-silenced cells. Since MTFMT functions during mitochondrial translation processes, we suspected that the general mitochondrial translation efficiency may have been altered. To test this hypothesis, the steady-state levels of mitochondrial proteins were examined (Fig. 1e). We selected voltage-dependent anion-selective channel 1 (VDAC1) as a chromosomal DNA-encoded mitochondrial protein and MT-CO2 as a mitochondrial DNA-encoded mitochondrial protein. However, the levels of neither protein differed between the control- and MTFMT-silenced cells, indicating that although MTFMT functions during mitochondrial translation, its transient deficiency does not markedly affect translational efficiency.
MTFMT deficiency weakens the cellular response against pathogenic infections
As a primary target organelle and central hub for innate immunity, mitochondria are known to mediate cellular host responses upon both virus and bacterial infection21. Since we observed altered mitochondrial structure and function in MTFMT-deficient cells, we wondered whether the cellular response to intracellular infection was similarly altered. To this end, we infected HeLa cells with RNA viruses, including influenza A virus, Sendai virus, or Newcastle disease virus, the host response to which depends on cytosolic RIG-I-MAVS signaling pathways in mitochondria. MTFMT-silenced cells exhibited a weakened cellular response against viral infections, as judged by lower RNA expression levels of type I IFN (Fig. 2a–c) and decreased protein secretion (Fig. 2d–f) compared to that observed in control cells. IRF-3, a key regulator of type I IFN gene expression, was also less activated upon viral infections in MTFMT-silenced cells (Fig. 2g). In agreement with the cellular response against infection, the amounts of intracellular virus, measured by viral proteins, were significantly higher in MTFMT-silenced cells at 24 h post infections (Fig. 2h and i). However, in contrast to IFNβ, the production of IL-6 upon viral infection was not significantly different between the control- and MTFMT-silenced cells (Supplementary Fig. S7).
In addition to cellular responses against intracellular viral infection, increasing evidence also suggests that mitochondria play crucial roles during the cellular response against bacterial infection. Therefore, we also tested the effect of MTFMT deficiency during bacterial infection, using a Shigella flexneri infection system. S. flexneri is known to infect and replicate within the cytoplasm of epithelial cells22, and the number of replicating intracellular S. flexneri can be quantified using a gentamicin protection assay (Fig. 3a). S. flexneri-infected host cells were chased with gentamicin-containing media for the indicated times, and cell lysates were then plated on agar plates containing Congo red. The obtained colony numbers indicate the number of bacteria in proliferative and healthy states within the infected cells. To assess the initial bacterial invasion efficiency, bacteria-infected HeLa cells were chased with gentamicin-containing media for 1 h. An approximately two-fold increase in the number of intracellular bacteria during the very early stage of infection was detected in MTFMT-silenced cells compared to that observed in the control cells (Fig. 3b, left). Since cellular toxicity was not significantly altered by MTFMT silencing during the first hour of infection (Fig. 3b, right), we concluded that MTFMT deficiency increases the susceptibility of cells to S. flexneri infection.
Next, we measured the kinetics of intracellular S. flexneri proliferation under normal and MTFMT-deficient conditions. To this end, S. flexneri-infected cells were cultured in gentamicin-containing medium for an additional 4 to 24 h, and proliferating intracellular bacteria were counted using the gentamicin protection assay. In the control siRNA-transfected cells, the number of intracellular S. flexneri increased consistently over time, and proliferating intracellular bacteria were detected even after 24 h of infection (Fig. 3c, left). In contrast, MTFMT-silenced cells showed a different kinetics pattern of intracellular S. flexneri proliferation. During the early stage of infection, more proliferating bacteria were detected in MTFMT-silenced cells than in the control cells. However, the number of proliferating intracellular S. flexneri plateaued approximately 8 h after infection and then decreased (Fig. 3c, left). Consequently, substantially fewer intracellular S. flexneri were detected in MTFMT-silenced cells than in control cells at the later stage of infection (Fig. 3c, right). To determine whether MTFMT deficiency along with mitochondrial alterations leads to massive cell death at the later stage of infection, which may explain the peculiar kinetics of intracellular bacteria within, we next examined the occurrence of cell death. Under the non-infection conditions, programmed cell death accompanied by cytochrome C release was not observed in either the control or MTFMT-deficient cells (Supplementary Fig. S8a). Even throughout the entire period of infection, live cell numbers were not significantly different between control- and MTFMT-silenced cells (Supplementary Fig. S8b). These results indicate that MTFMT deficiency has a dual function in which pathogens and the host are favored during the early and later stages of infection, respectively.
MTFMT deficiency results in decreased basal NF-κB activity
To gain insight into how MTFMT deficiency attenuates cellular immune responses during the early phase of infection, we performed a genome-wide transcriptome profiling assay. HeLa cells transfected with control or MTFMT siRNA were subsequently infected with S. flexneri for 4 h, after which RNA sequencing was performed for both infected and non-infected cells (Fig. 4a). By pairwise comparison of control and MTFMT siRNA-transfected and uninfected cells, 85 genes were identified as differentially expressed genes (DEGs) (fold-change ≥ 2, p-value ≤ 0.05) (Fig. 4b). Among these genes, the expression of approximately 71.8% (61 genes) was downregulated in MTFMT-silenced cells, with a maximum reduction of tenfold observed compared to the expression measured in control cells (Fig. 4b). The expression of these genes was similarly reduced in bacteria-infected MTFMT-silenced cells (Fig. 4c). The most interesting finding regarding these downregulated genes was their biological relationships with TNF signaling, NF-κB signaling, papillomavirus infection, and RIG-I-like receptor signaling pathways according to KEGG pathway enrichment analysis of DEGs (Fig. 4d)23. The expression of groups of genes involved in TNF-mediated NF-κB signaling (CCL5, TRAF1, BIRC3, ICAM1 and JAG1) and the RIG-I-like receptor signaling pathway (DDX58 and ISG15) were separately validated by real-time quantitative PCR (Fig. 4e). Another subset of genes (IL-6 and TNFα) that were not included among the DEGs shown in Fig. 4a, despite being known as NF-κB-responsive genes, were also examined for their mRNA expression level (Supplementary Fig. S9).
Among the identified DEGs, the reduced expression of NF-κB target genes was of particular interest. Since the basal and infection-induced expression levels of those NF-κB target genes were low in MTFMT-silenced cells, and the NF-κB signaling pathway is a well-characterized central player that controls the host response against intracellular infection24, we hypothesized that MTFMT-silenced cells have intrinsically lower basal NF-κB activity. The low levels of basal NF-κB activity may explain the reduced viral and bacterial responses, especially during an early phase of infections, in MTFMT-silenced cells. To test this hypothesis, we assessed NF-κB activity by measuring the active portion of total p65, an active NF-κB component, in the nuclear fraction. Under basal conditions, slightly reduced amounts of p65 were observed in the nuclear fraction of MTFMT-silenced cells. In control cells, S. flexneri infection induced the translocation of p65 from the cytoplasm to the nucleus. In contrast, in MTFMT-deficient cells, the nuclear translocation of p65 was significantly inhibited until 90 min after infection (Fig. 4f and Supplementary Fig. S11). However, IκBα degradation was not clearly observed upon S. flexneri infection in our experimental setting (Supplementary Fig. S12). The activity of the NF-κB signaling pathway was separately tested using an NF-κB-responsive luciferase reporter construct, the activity of which was verified in control experiments (Supplementary Fig. S13). Using a luciferase reporter assay, reduced NF-κB activity in MTFMT-silenced cells was separately confirmed (Fig. 4g). These results suggest that MTFMT-silenced cells with defective mitochondria possess decreased NF-κB activity under basal conditions, which may explain their attenuated cellular responses against intracellular infection during the early stage of infection.
Recruitment of the NF-κB-activating complex ECSIT to the mitochondrial membrane under basal conditions is reduced in MTFMT-deficient cells
To understand the molecular mechanisms associated with the reduced basal NF-κB activity in untreated MTFMT-silenced cells, we hypothesized that signaling complex formation on the mitochondrial membrane may be altered in cells lacking MTFMT expression. The detection of basal levels of NF-κB activity in control cells (Fig. 4f) suggests that spontaneous NF-κB signaling complex formation may occur in unstimulated cells. As a possible candidate molecule that activates NF-κB under basal conditions, we evaluated ECSIT, which interacts with TRAF6 on mitochondria10. When ECSIT expression was silenced in unstimulated cells, basal levels of NF-κB activity were reduced, confirming that ECSIT plays a role in the activation of basal NF-κB (Fig. 5a). In agreement with the observed basal NF-κB activity, the basal expression level of CCL5, a target gene of NF-κB, was similarly reduced in ECSIT-silenced cells (Fig. 5b), suggesting that ECSIT plays a role in the activation of basal NF-κB-mediated signaling pathways. Using confocal microscopy, we then observed the endogenous localization of ECSIT protein (Supplementary Fig. S14). When mitochondria were co-stained with MitoTracker, substantial amounts of ECSIT protein overlapped with areas harboring mitochondria in control cells (Fig. 5c). Although ECSIT has been reported to be recruited to mitochondria upon TLR activation in macrophages10, we observed that substantial amounts of ECSIT were already located at mitochondria under basal conditions (Supplementary Fig. S15). In contrast, those areas showing overlap between ECSIT and mitochondria decreased in MTFMT-silenced cells under basal conditions (Fig. 5c,d). Statistical analysis of the differences in ECSIT- and mitochondrial staining intensity demonstrated that the correlation score was significantly reduced in MTFMT-silenced cells. Based on these observations, we postulate that mitochondrial defects in MTFMT-deficient cells may prevent the stable recruitment of ECSIT to mitochondria, which inhibits the efficient activation of the NF-κB signaling pathway under basal conditions.
Cytosolic N-formyl peptides promote infection independent of the NF-κB pathway
In addition to reduced NF-κB/ECSIT formation on mitochondria, we explored additional effects caused by altered mitochondrial integrity. One hallmark of impaired mitochondria is a leakage of their contents, including mitochondrial DNA and peptides. Since we observed mitochondrial alterations in MTFMT-deficient cells, we wondered whether mitochondrial-derived DNA or peptides could be released from the impaired mitochondria. However, the amounts of detected cytosolic mtDNA were not significantly different (Supplementary Fig. S16). To measure mitochondrial peptides, we used a double-sandwich ELISA kit designed to detect N-formylmethionine (fMet) in serum. In this assay, a fMet-specific antibody, which is prebound to a reaction plate, can capture fMet-containing products (N-formyl peptide) in the sample up to 1,000 pg/ml (Fig. 6a). First, the mitochondrial and cytosolic fractions were separately harvested by differential centrifugation from HeLa cell lysates and then assayed for the presence of N-formyl peptides. In a test using a mitochondrial lysate (from 7.5 to 30 μg total), a positive correlation between the quantity of the lysates and fMet-reactive signal was observed (Fig. 6b). On average, 54.9 ± 23.3 pg of fMet-reactive signal per μg of mitochondrial lysate was detected. We next used four-fold excess amounts of cytosolic lysates (from 30 to 120 μg total) to detect any fMet-reactive signal. Although much less than that observed for mitochondrial lysates, significant levels of fMet-reactive signal (6.43 ± 2.4 pg/μg) were detected in the cytosolic fraction (Fig. 6b). Since this finding indicates that N-formyl peptides may be present in the cytoplasm, we next examined whether the fMet-reactive signal could be altered when mitochondria were disrupted by UV irradiation. Upon UV irradiation, where a clear cytosolic release of mitochondrial cytochrome C was observed, increased levels of fMet-reactive signal were detected (Fig. 6c). Therefore, using this assay, we measured fMet-reactive signal from the cytosolic fraction of MTFMT-silenced cells (Fig. 6d). From the repeated experiments, we clearly observed significantly higher levels of fMet-reactive signal in MTFMA-silenced cells compared to that observed in control HeLa cells. These results suggest that mitochondrial formyl peptide may be released from mitochondria in MTFMT-silenced cells, although the mechanism associated with this release remains unclear.
Next, we assessed whether such mitochondrial-derived N-formyl peptide plays any roles during the host defense response against infection inside cells. To directly address this question, cells were transiently transfected with synthesized N-formyl peptides, and the effect of cytosolic N-formyl peptides on the defense response was assessed after S. flexneri infection. In this assay, through peptide transfection, we attempted to mimic MTFMT-silenced basal cell conditions. We used four different N-formyl peptides, where each sequence was derived from one of the mitochondrial proteins ND6, ND4, COXI, or Cyto b (Fig. 7a). Each control peptide had the same amino acid sequence, except for the absence of a formyl group on the first methionine residue. The transfection efficiency and stability of the peptides inside cells was examined using R-phycoerythrin (R-PE) transfection (Fig. 7b). The transfection of R-PE alone did not dramatically alter cell viability. However, the bacterial infection of control- or formyl peptide-transfected cells caused cell death at a later stage of infection (data not shown). Since peptide transfection along with bacterial infection was not observed to have a cytotoxic effect during the early stage of infection (Fig. 7c), we examined the regulatory effects of cytosolic N-formyl peptides during this early period in infection.
When individual N-formyl peptides were transfected, their effects on intracellular bacterial survival were marginal, with the exception of the COXI-derived N-formyl peptide (Fig. 7d). However, the effect on bacterial survival was most significant when a mixture of COXI- and ND6-derived N-formyl peptides was used, following which an average bacterial survival rate of more than 60% was observed compared to that of control peptide-transfected cells (Fig. 7e and f). Finally, we examined whether cytosolic N-formyl peptides directly control basal NF-κB activity. However, basal NF-κB activity was not significantly altered by the transfection of either control or formyl peptides alone (Supplementary Fig. S19). Furthermore, when S. flexneri cells were pre-incubated with N-formyl peptides before infection, their invasive capacity and virulence were much stronger (Fig. 8a and b). These data indicate that mitochondrial-derived N-formyl peptides directly favor bacteria but not through regulating the host defense response mediated by the NF-κB signaling pathway.
Discussion
In this study, we investigated the role of mitochondrial integrity in the defense against infection. Taking advantage of MTFMT-deficient cells that have both structurally and functionally impaired mitochondria but relatively intact mitochondria translation potential, we propose that mitochondrial integrity has dual functions: it is required for the proper assembly of signaling complexes, observed in this study by the NF-κB-activating ECSIT on mitochondria, and the blockage of mitochondrial DAMPs, observed in this study as mitochondrial N-formyl peptides, likely released from impaired mitochondria (Fig. 8c).
On the mitochondrial membrane, a signaling complex activates NF-κB or IRF assembly upon intracellular infection. One of the best-studied adaptor molecules on mitochondria is MAVS. RNA virus-infection triggers RIG-I activation through a conformational change, after which activated RIG-I moves into mitochondria to bind its adaptor protein MAVS. Since MAVS is a transmembrane protein, it forms a signaling complex on mitochondria and consequentially transmits the activating signal to downstream components. In contrast, ECSIT which functions as an adaptor protein in the Toll/IL-1 receptor-mediated signaling pathway, is primarily located in the cytoplasm25. However, upon ligand binding, TRAF6 ubiquitinates ECSIT for signal transmission, and their interaction can be detected on mitochondria10. The NF-κB pathway is known to function downstream of ECSIT. In this study, we observed that (1) MTFMT deficiency attenuates immunity-related signaling pathways, such as the NF-κB pathway; and (2) the mitochondrial accumulation of ECIST diminishes when mitochondrial structure and function is altered by MTFMT deficiency. Indeed, ECSIT has recently been shown to mediate a physical connection between RIG-I and MAVS on the mitochondria upon viral infection11. Since RIG-I-like receptor-signaling pathways are one of the affected KEGG pathways in our transcriptome analysis (Fig. 4d), we speculate that the interaction between RIG-I and MAVS could also be attenuated by MTFMT deficiency. In this case, MTFMT deficiency appears to inhibit upstream of MAVS, because “basal” expression and accumulation of MAVS on mitochondria was not significantly altered in MTFMT-deficient cells (Supplementary Fig. S20).
In this study, we tested the effects of cytosolic formyl peptides in response to infection. The mitochondrion is an intrinsically non-self organelle26 harboring many danger molecules that function during defense responses against infection by directly or indirectly stimulating innate immune responses5,27. Mitochondrial N-formyl peptides are structurally and functionally similar to bacterial formyl peptides. The binding of N-formyl peptides to FPRs in the plasma membrane leads to changes in calcium flux and MAPK pathway activation28. Consequent gene expression leads to the recruitment of immune cells around the site of infection or injury, which explains how N-formyl peptides act as chemoattractants29,30. The release of mitochondrial-derived molecules, which is typically accompanied by the breakdown of mitochondrial integrity, is a warning sign of danger5,27. The release of cytochrome c protein from mitochondria into the cytoplasm indicates a specific type of cell death, apoptosis. Furthermore, the release of mitochondrial peptides during the mitochondrial unfolded protein response (mtUPR) turns on the cellular stress response31. The mtUPR induces the accumulation of mitochondrial ROS and the cleavage and subsequent release of mitochondrial proteins. In C. elegans, the mitochondrial proteases LONP-1 and CLPP-1 participate in the cleavage process during the mtUPR32,33, and the resultant cleaved peptides are released into the cytoplasm through the peptide exporter HAF-134. Consequently, ATFS-1, a major transcription factor, translocates to the nucleus, where it regulates the expression of stress-responsive genes33. The presence of mitochondrial-derived peptides has also been reported in the cytosol of S. cerevisiae35. In this study, we mimicked the cytosolic formyl peptide by transfection and assessed its role in the regulation of bacterial infection. Currently, the mechanism of this process remains unknown. However, we demonstrated that pre-existing mitochondrial N-formyl peptide favors bacterial survival.
In this study, we used four different types of synthetic peptides with methyl or formyl groups attached to their N-terminus. Each amino acid sequence was derived from mitochondrial proteins, which are translated inside of the mitochondrial matrix and not by the cytosolic translation machinery. Although 13 proteins can be synthesized in the mitochondria, only a subset of mitochondrial N-formyl peptides were effective. We chose ND6, ND4, and COXI because they were previously reported to show high agonistic activity against FPR1 and FPR2 based on their capacity to increase intracellular calcium flux36. We also tested the Cyto b peptide based on its ability to induce β-hexosaminidase release and chemotaxis in HL-60 cells37. Although all the peptides used in this study possessed an N-formyl methionine residue at their N-terminus, each peptide had a different effect (Fig. 5), suggesting that the formyl group itself is not sufficient to enhance bacterial virulence, although it is required. It will be of further interest to establish effective peptide parameters, such as peptide length, amino acid composition or order to tailor this effect.
In summary, mitochondrial integrity is crucial in mediating the defense response against infection. Healthy mitochondria exhibit dual functions by providing a physical platform for the stable assembly of signaling complexes and preventing the leakage of unwanted danger molecules from the mitochondria to the cytosol. The results of our study confirm that mitochondria are central organelles that regulate the immune response to infection and demonstrates the importance of maintaining mitochondrial health.
Materials and methods
Cell culture and transfection
HeLa cells were cultured in Dulbecco’s modified Eagle’s medium (DMEM; Lonza, cat. #12-604F, Walkersville, MD, USA) supplemented with 10% fetal bovine serum (FBS; Welgene, cat. #S001-01, Gyeongsan, Republic of Korea). For plasmid transfection, plasmid DNA (1 µg/35-mm dish) was mixed with Effectene reagent (Qiagen, cat. #301425, Valencia, CA, USA) and added to a dish in which cells had been seeded 12 h before. The cell medium was replaced with fresh complete medium after 6 h. siRNA oligonucleotides against human MTFMT (5′-CCACAAACAGUCACAAAUATT-3′ and 5′-UAUUUGUGACUGUUUGUGGTT-3′), human ECSIT (5′-AUUGAUGUCAAACUCGUAGTT-3′ and 5′-CUACGAGUUUGACAUCAAUTT-3′), human TRAF6 (5′-GCGCUGUGCAAACUAUAUATT-3′ and 5′-UAUAUAGUUUGCACAGCGCTT-3′) and control oligonucleotides were purchased from GenePharma (Shanghai, China). For siRNA transfection, siRNA (87.5 pmol/35-mm dish) was mixed with Lipofectamine 2000 reagent (Invitrogen, cat. #11668019, Carlsbad, CA, USA) and added to a dish containing cells. The cell medium was replaced with fresh DMEM containing 5% FBS after 10–12 h.
Measurement of mitochondrial length and mass
For measurements mitochondrial morphological parameters, fluorescence images of mitochondria were obtained by confocal microscopy (FLUOVIEW FV3000; Olympus, Tokyo, Japan). Each image that contained only one cell was turned into a binary image (black/white) and subsequently analyzed using a ImageJ macro called MiNA. This plug-in automatically measures the volume and length of mitochondria based on white pixels.
Mitochondrial stress assay
siRNA-transfected cells were trypsinized and recounted for reseeding in an XF96 cell culture microplate (Agilent, cat. #102416-100, Santa Clara, CA, USA) 36 h before the assay. XF base medium (Agilent, cat. #102353-100) was supplemented with 1 mM pyruvate, 2 mM glutamine, and 10 mM glucose, and the pH was adjusted to 7.4 immediately before the assay. Each mitochondrial inhibitor (Agilent, cat. #103015-100) was dissolved in assay medium (at the following concentrations: 100 µM oligomycin, 100 µM FCCP, and 50 µM rotenone/antimycin A) and loaded onto an XFe96 sensor cartridge (Agilent, cat. #102416-100). After incubating in a non-CO2 incubator for 1 h, the microplate and sensor cartridge were loaded onto a Seahorse XFe96 analyzer, and the assay was performed. Each parameter was automatically calculated by the Seahorse XF Mito Stress Test Report Generator.
Cell fractionation
For nuclear/cytosolic fractionation, cells were lysed with sucrose buffer [10 mM Tris–HCl (pH 8.0), 320 mM sucrose, 3 mM CaCl2, 2 mM MgOAc, 0.1 mM EDTA, and 0.5% NP-40] and divided into cytosolic (supernatant) and nuclear (pellet) fractions by centrifugation at 2,400 rpm for 5 min at 4 °C. For mitochondrial/cytosolic fractionation, cells were lysed with mitochondrial isolation buffer [10 mM Tris–HCl (pH 7.5), 320 mM sucrose, and 1 mM EDTA], and the supernatant was obtained by centrifugation at 1,000 × g for 10 min at 4 °C. After one more round of centrifugation at 11,000 rpm for 15 min at 4 °C, the cytosolic (supernatant) and mitochondrial (pellet) fractions were obtained.
Luminescent ATP detection assay
After the detachment of HeLa cells from tissue-culture plates by trypsinization, the cells were counted using an automated cell counter (CellDrop Cell Counters; DeNovix, Wilmington, DE, USA) to collect 4 × 105 cells. A cell pellet was obtained by centrifugation, and the cells were subsequently resuspended in 1 ml of PBS. Then, the cells were collected by centrifugation and lysed with 1 × Passive lysis buffer (Promega, cat. #E1941, Madison, WI, USA) in a vertical microtube rotator for 15 min at 4 °C. The supernatant was separated from cell debris by centrifugation at 13,000 rpm for 5 min and then assayed to determine the cellular ATP concentration using a Luminescent ATP detection assay kit (Abcam, cat. # ab113849, Cambridge, UK).
Bacterial strain and gentamicin protection assay
Shigella flexneri (2457 T) was a kind gift from Dr. Jae-Ouk Kim (International Vaccine Institute, Seoul, Korea). One day before infection, colonies were inoculated and incubated in 5 ml of tryptic soy broth (TSB) overnight. On the day of infection, the bacterial broth was diluted 1:100 in fresh TSB and incubated at 37 °C in a shaking incubator at 2,400 rpm until the OD value reached 0.6–0.8. After determining the bacterial dose, the bacterial pellet was obtained by centrifugation at 3,400 rpm for 10 min and then resuspended in 500 µl of PBS. The bacterial suspension was then added to a dish in which the cell medium had been replaced with fresh complete medium before infection. For the bacterial invasion assays, cells with the added bacterial suspension were centrifuged at room temperature at 1,800 rpm for 10 min and then incubated at 37 °C. After 30 min of incubation, the cells were washed three times with cold PBS and cultured in fresh complete medium containing 50 µg/ml gentamicin for 1 h. Cell pellets were then obtained by trypsinization, after which the pelleted cells were lysed, diluted in 0.1% Triton X-100 and spread onto TSB agar plates containing Congo red (Serva, cat. #27215.01, Heidelberg, Germany) to reconstitute intracellular bacteria. For the bacterial survival assay, infected cells were incubated in gentamicin-containing medium for 24 h.
Viral infection
For viral infection assays, the cell medium was replaced with serum-free medium containing 10 TCID50/ml of influenza A virus (A/PR8/1934(H1N1)), 300 TCID50/ml of Sendai virus, or 15 TCID50/ml of Newcastle disease virus (NDV, La Sota). After 3 h of incubation at 37 °C, the medium was replaced with fresh DMEM containing 10% FBS, and cells were harvested for RNA extraction at various time points.
Human IFNβ and IL-6 ELISA
HeLa cells were seeded at 2 × 105 cells/well in six well tissue culture plate. Twelve hours after cell seeding, siRNA was transfected into cells with Lipofectamine 2000 reagent (Invitrogen, cat. #11668019). Forty-eight hours after siRNA transfection, the cell medium was replaced with serum-free medium containing each virus. After 3 h of incubation, the medium was replaced with fresh DMEM containing 10% FBS. The supernatants of virus-infected cells were collected at 12 h post infection and used to quantify the concentrations of human IFNβ and IL-6 using a Human IFNβ Quantikine ELISA kit (R&D Systems, cat. #DIFNB0, Minneapolis, MN, USA) and a Human IL-6 Quantikine ELISA kit (R&D Systems, cat. #D6050), respectively.
Dual-luciferase reporter assay
HeLa cells were cotransfected with siRNA and luciferase reporter plasmids (pLuc-NF-κB with pRenilla-GAPDH) with Lipofectamine 3000 reagent (Invitrogen, #L3000015). The cell medium was replaced with fresh DMEM containing 10% FBS after 6 h, and a dual-luciferase reporter assay was performed according to the manufacturer’s instructions (Promega, #E1960).
fMet ELISA and CLIA
For measurements of intracellular levels of formyl peptide, two ELISA kits were used: fMet ELISA (MyBioSource, cat. # MBS265039, San Diego, CA, USA) and fMet CLIA (Elabscience, cat. # E-CL-H0950, Houston, TX, USA). Cytosolic or mitochondrial fractions were quantified by Bradford assay. The measurement of fMet in the cellular lysates was conducted according to the manufacturer’s instructions. Briefly, appropriate amounts of sample were loaded into fMet-antibody-precoated 96-well plates and incubated for 90 min at 37 °C. After washing with wash buffer supplied by the manufacturer, biotinylated a fMet-antibody was added into the plate and incubated for 60 min at 37 °C. After washing, an avidin-conjugated solution was added and incubated for 30 min at 37 °C. After the final round of washing, color reagent was added, and the plate was incubated until a color change appeared (typically within 10 min). When the chromogenic reaction was completed, the OD value was read at 450 nm with an ELISA reader. For CLIA, after the final round of washing, luminol substrate was added, and relative light unit (RLU) values were determined using a luminescence microplate reader.
Peptide transfection
Mitochondrial N-formyl peptides or control unformylated peptides were synthesized and purchased from GenScript (Piscataway, NJ, USA). Each peptide was dissolved in DMSO and stored at − 20 °C until use. For peptide transfection, the peptide was mixed with PULSin reagent (Polyplus Transfection, cat. #501-04, Illkirch-Graffenstaden, France) and added to a dish in which the cell medium had been replaced with fresh serum-free DMEM before transfection. The cell medium was replaced with fresh complete medium after 2 h.
Immunoblotting and immunofluorescence staining
Cell lysates were quantified by Bradford assay. According to the detected protein size, SDS-PAGE gels at various percentages (8–13.5%) were used to separate proteins. For immunoblotting and immunofluorescence, antibodies against β-actin (Bioss, cat. #BS-0061R, Woburn, MA, USA), GAPDH (Millipore; cat. #MAB374, Burlington, MA, USA or Santa Cruz; cat. #sc-47724, Dallas, TX, USA), VDAC1 (Santa Cruz, cat. #sc-8828), MT-CO2 (Life Technologies, cat. #A6404, Carlsbad, CA, USA), p65 (Santa Cruz, cat. #sc-372 or sc-8008), phosphor-IRF3 (Cell Signaling, cat. #4947S, Danvers, MA, USA), ECSIT (Abcam, cat. #ab21288), MAVS (Santa Cruz, cat. #sc-166583), RIG-I (Santa Cruz, cat. #sc-376845), NDV HN (Santa Cruz, cat. #sc-53562), influenza A virus NP (Abcam, cat. #ab128193), TOM20 (Santa cruz, cat. #sc-17764) and HDAC1 (Santa Cruz, cat. #sc-6298) were used. For immunofluorescence staining, cells were seeded on cover glass that had been coated with poly-D-lysine. Then, the cells were fixed with 4% paraformaldehyde, permeabilized with 0.2% Triton X-100 and blocked with 1% BSA. An Alexa Fluor 488-conjugated secondary antibody (Invitrogen, cat. #A11017) was used in this study. To stain mitochondria, cells were incubated with 100–400 nM MitoTracker Deep Red (Invitrogen, cat. #M22426) in serum-free DMEM for 30 min. DAPI solution (Invitrogen, cat. #R37606) was used to visualize nuclei.
Flow cytometry analysis
To measure mitochondrial membrane potential and mitochondrial ROS concentrations, cells were incubated with complete media containing 2.5 µM JC-1 dye (Thermo Fisher, cat. #T3168, Waltham, MA, USA) and HBSS (Gibco, cat. #14025-092, Carlsbad, CA, USA) containing 1–5 µM MitoSOX (Invitrogen, cat. #M36008), respectively. After a 30 min incubation at 37 °C in an incubator, the cells were harvested with FACS buffer (2% FBS in phosphate-buffered saline) and analyzed with a flow cytometer (BD Biosciences, San Jose, CA, USA).
RNA isolation, quantitative real-time PCR and RNA sequencing
Total RNA was extracted from cultured cells using RNAiso Plus (Takara, cat. #9109, Kusatsu, Japan). cDNA synthesis was conducted using 500 ng of RNA with the ImProm-II Reverse Transcription System (Promega, cat. #A3803). To measure mRNA expression levels, quantitative PCR and real-time PCR were performed with a typical thermal cycler and a StepOnePlus Real-Time PCR system (Applied Biosystems, Waltham, MA, USA), respectively. RNA sequencing was performed with the Illumina NextSeq platform using a Library prep kit (TruSeq Stranded mRNA Sample Preparation kit; LAS Incorporated, Gimpo, Republic of Korea).
References
Herst, P. M., Rowe, M. R., Carson, G. M. & Berridge, M. V. Functional mitochondria in health and disease. Front. Endocrinol. (Lausanne) 8, 296. https://doi.org/10.3389/fendo.2017.00296 (2017).
West, A. P., Shadel, G. S. & Ghosh, S. Mitochondria in innate immune responses. Nat. Rev. Immunol. 11, 389–402. https://doi.org/10.1038/nri2975 (2011).
Youle, R. J. & Narendra, D. P. Mechanisms of mitophagy. Nat. Rev. Mol. Cell Biol. 12, 9–14. https://doi.org/10.1038/nrm3028 (2011).
Youle, R. J. & van der Bliek, A. M. Mitochondrial fission, fusion, and stress. Science 337, 1062–1065. https://doi.org/10.1126/science.1219855 (2012).
Krysko, D. V. et al. Emerging role of damage-associated molecular patterns derived from mitochondria in inflammation. Trends Immunol. 32, 157–164. https://doi.org/10.1016/j.it.2011.01.005 (2011).
Seth, R. B., Sun, L., Ea, C. K. & Chen, Z. J. Identification and characterization of MAVS, a mitochondrial antiviral signaling protein that activates NF-kappaB and IRF 3. Cell 122, 669–682. https://doi.org/10.1016/j.cell.2005.08.012 (2005).
Meylan, E. et al. Cardif is an adaptor protein in the RIG-I antiviral pathway and is targeted by hepatitis C virus. Nature 437, 1167–1172. https://doi.org/10.1038/nature04193 (2005).
Xu, L. G. et al. VISA is an adapter protein required for virus-triggered IFN-beta signaling. Mol. Cell 19, 727–740. https://doi.org/10.1016/j.molcel.2005.08.014 (2005).
Kawai, T. et al. IPS-1, an adaptor triggering RIG-I- and Mda5-mediated type I interferon induction. Nat. Immunol. 6, 981–988. https://doi.org/10.1038/ni1243 (2005).
West, A. P. et al. TLR signalling augments macrophage bactericidal activity through mitochondrial ROS. Nature 472, 476–480. https://doi.org/10.1038/nature09973 (2011).
Lei, C. Q. et al. ECSIT bridges RIG-I-like receptors to VISA in signaling events of innate antiviral responses. J. Innate Immun. 7, 153–164. https://doi.org/10.1159/000365971 (2015).
Zhang, Q. et al. Circulating mitochondrial DAMPs cause inflammatory responses to injury. Nature 464, 104–107. https://doi.org/10.1038/nature08780 (2010).
Shimada, K. et al. Oxidized mitochondrial DNA activates the NLRP3 inflammasome during apoptosis. Immunity 36, 401–414. https://doi.org/10.1016/j.immuni.2012.01.009 (2012).
Le, Y., Murphy, P. M. & Wang, J. M. Formyl-peptide receptors revisited. Trends Immunol. 23, 541–548 (2002).
Raoof, M., Zhang, Q., Itagaki, K. & Hauser, C. J. Mitochondrial peptides are potent immune activators that activate human neutrophils via FPR-1. J Trauma 68, 1328–1332. https://doi.org/10.1097/TA.0b013e3181dcd28d (2010) ((discussion 1332-1324)).
Takeuchi, N. et al. Mammalian mitochondrial methionyl-tRNA transformylase from bovine liver. Purification, characterization, and gene structure. J. Biol. Chem. 273, 15085–15090. https://doi.org/10.1074/jbc.273.24.15085 (1998).
Tucker, E. J. et al. Mutations in MTFMT underlie a human disorder of formylation causing impaired mitochondrial translation. Cell Metab. 14, 428–434. https://doi.org/10.1016/j.cmet.2011.07.010 (2011).
Haack, T. B. et al. Phenotypic spectrum of eleven patients and five novel MTFMT mutations identified by exome sequencing and candidate gene screening. Mol. Genet. Metab. 111, 342–352. https://doi.org/10.1016/j.ymgme.2013.12.010 (2014).
Hinttala, R. et al. An N-terminal formyl methionine on COX 1 is required for the assembly of cytochrome c oxidase. Hum. Mol. Genet. 24, 4103–4113. https://doi.org/10.1093/hmg/ddv149 (2015).
Valente, A. J., Maddalena, L. A., Robb, E. L., Moradi, F. & Stuart, J. A. A simple ImageJ macro tool for analyzing mitochondrial network morphology in mammalian cell culture. Acta Histochem. 119, 315–326. https://doi.org/10.1016/j.acthis.2017.03.001 (2017).
Tiku, V., Tan, M. W. & Dikic, I. Mitochondrial functions in infection and immunity. Trends Cell Biol. 30, 263–275. https://doi.org/10.1016/j.tcb.2020.01.006 (2020).
Carayol, N. & Tran Van Nhieu, G. The inside story of Shigella invasion of intestinal epithelial cells. Cold Spring Harb. Perspect. Med. 3, 016717. https://doi.org/10.1101/cshperspect.a016717 (2013).
Kanehisa, M. & Goto, S. KEGG: Kyoto encyclopedia of genes and genomes. Nucleic Acids Res. 28, 27–30. https://doi.org/10.1093/nar/28.1.27 (2000).
Philpott, D. J., Yamaoka, S., Israel, A. & Sansonetti, P. J. Invasive Shigella flexneri activates NF-kappa B through a lipopolysaccharide-dependent innate intracellular response and leads to IL-8 expression in epithelial cells. J. Immunol. 165, 903–914. https://doi.org/10.4049/jimmunol.165.2.903 (2000).
Kopp, E. et al. ECSIT is an evolutionarily conserved intermediate in the Toll/IL-1 signal transduction pathway. Genes Dev. 13, 2059–2071. https://doi.org/10.1101/gad.13.16.2059 (1999).
Gray, M. W., Burger, G. & Lang, B. F. The origin and early evolution of mitochondria. Genome Biol 2, 1018. https://doi.org/10.1186/gb-2001-2-6-reviews1018 (2001).
Nakahira, K., Hisata, S. & Choi, A. M. The roles of mitochondrial damage-associated molecular patterns in diseases. Antioxid. Redox Signal 23, 1329–1350. https://doi.org/10.1089/ars.2015.6407 (2015).
Ye, R. D. et al. International Union of Basic and Clinical Pharmacology. LXXIII. Nomenclature for the formyl peptide receptor (FPR) family. Pharmacol. Rev. 61, 119–161. https://doi.org/10.1124/pr.109.001578 (2009).
Schiffmann, E., Corcoran, B. A. & Wahl, S. M. N-formylmethionyl peptides as chemoattractants for leucocytes. Proc. Natl. Acad. Sci. USA 72, 1059–1062. https://doi.org/10.1073/pnas.72.3.1059 (1975).
Carp, H. Mitochondrial N-formylmethionyl proteins as chemoattractants for neutrophils. J. Exp. Med. 155, 264–275. https://doi.org/10.1084/jem.155.1.264 (1982).
Jovaisaite, V., Mouchiroud, L. & Auwerx, J. The mitochondrial unfolded protein response, a conserved stress response pathway with implications in health and disease. J. Exp. Biol. 217, 137–143. https://doi.org/10.1242/jeb.090738 (2014).
Haynes, C. M., Petrova, K., Benedetti, C., Yang, Y. & Ron, D. ClpP mediates activation of a mitochondrial unfolded protein response in C. elegans. Dev. Cell 13, 467–480. https://doi.org/10.1016/j.devcel.2007.07.016 (2007).
Nargund, A. M., Pellegrino, M. W., Fiorese, C. J., Baker, B. M. & Haynes, C. M. Mitochondrial import efficiency of ATFS-1 regulates mitochondrial UPR activation. Science 337, 587–590. https://doi.org/10.1126/science.1223560 (2012).
Haynes, C. M., Yang, Y., Blais, S. P., Neubert, T. A. & Ron, D. The matrix peptide exporter HAF-1 signals a mitochondrial UPR by activating the transcription factor ZC376.7 in C. elegans. Mol. Cell 37, 529–540. https://doi.org/10.1016/j.molcel.2010.01.015 (2010).
35Kim, J. M. et al. Formyl-methionine as an N-degron of a eukaryotic N-end rule pathway. Science 362 https://doi.org/10.1126/science.aat0174 (2018).
Rabiet, M. J., Huet, E. & Boulay, F. Human mitochondria-derived N-formylated peptides are novel agonists equally active on FPR and FPRL1, while Listeria monocytogenes-derived peptides preferentially activate FPR. Eur. J. Immunol. 35, 2486–2495. https://doi.org/10.1002/eji.200526338 (2005).
Marutani, T. et al. Mitochondrial protein-derived cryptides: Are endogenous N-formylated peptides including mitocryptide-2 components of mitochondrial damage-associated molecular patterns?. Biopolymers 106, 580–587. https://doi.org/10.1002/bip.22788 (2016).
Acknowledgements
We thank Dr. Jae-Ouk Kim at the International Vaccine Institute (Seoul, Korea) for offering S. flexneri (2457 T) and members of the Yoo laboratory for helpful discussion. This work was supported by a grant from the National Research Foundation of Korea (NRF) funded by the Korea government (Ministry of Science and ICT) (no. NRF-2017R1A5A1015366).
Author information
Authors and Affiliations
Contributions
J.-H.S., C.-S.H. and J.Y. conceived the study. J.-H.S. and J.Y. designed the experiments, analyzed the data and wrote the manuscript. J.-H.S. performed the experiments.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Seo, JH., Hwang, CS. & Yoo, JY. MTFMT deficiency correlates with reduced mitochondrial integrity and enhanced host susceptibility to intracellular infection. Sci Rep 10, 11183 (2020). https://doi.org/10.1038/s41598-020-68053-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-020-68053-8
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.