Abstract
In multiple sclerosis (MS), alterations of the gut microbiota lead to inflammation. However, the role of other microbiomes in the body in MS has not been fully elucidated. In a pilot case-controlled study, we carried out simultaneous characterization of faecal and oral microbiota and conducted an in-depth analysis of bacterial alterations associated with MS. Using 16S rRNA sequencing and metabolic inference tools, we compared the oral/faecal microbiota and bacterial metabolism pathways in French MS patients (n = 14) and healthy volunteers (HV, n = 21). A classification model based on metabolite flux balance was established and validated in an independent German cohort (MS n = 12, HV n = 38). Our analysis revealed decreases in diversity indices and oral/faecal compartmentalization, the depletion of commensal bacteria (Aggregatibacter and Streptococcus in saliva and Coprobacter and Roseburia in faeces) and enrichment of inflammation-associated bacteria in MS patients (Leptotrichia and Fusobacterium in saliva and Enterobacteriaceae and Actinomyces in faeces). Several microbial pathways were also altered (the polyamine pathway and remodelling of bacterial surface antigens and energetic metabolism) while flux balance analysis revealed associated alterations in metabolite production in MS (nitrogen and nucleoside). Based on this analysis, we identified a specific oral metabolite signature in MS patients, that could discriminate MS patients from HV and rheumatoid arthritis patients. This signature allowed us to create and validate a discrimination model on an independent cohort, which reached a specificity of 92%. Overall, the oral and faecal microbiomes were altered in MS patients. This pilot study highlights the need to study the oral microbiota and oral health implications in patients with autoimmune diseases on a larger scale and suggests that knowledge of the salivary microbiome could help guide the identification of new pathogenic mechanisms associated with the microbiota in MS patients.
Similar content being viewed by others
Introduction
With more than 10 trillion bacteria populating the human skin, gut and airway, the microbiome harbours a symbiotic relationship with its human host. A very precise equilibrium is maintained between the microbiota and the host immune system, which must tolerate commensal flora while initiating appropriate inflammatory responses towards potential pathogens1. To maintain this balance, evolution favoured members of human the microbiota with immune-stimulating traits, often referred to as proinflammatory bacteria, as well as bacteria with regulatory properties, which are known as regulatory bacteria. Long-term perturbations of this balance can lead to a pathological state2. In this context, dysbiosis of the microbiome has been associated with many inflammatory diseases. As a major part of the microbiota resides within the gut, initial reports examined diseases affecting the gut such as inflammatory bowel disease3,4, and coeliac disease5,6. Inflammatory diseases affecting other organs including the skin, such as acne7, atopic dermatitis8 and psoriasis9, have also been shown to be associated with both skin and gut microbiome. In addition to the gut, oral dysbiosis has been observed in a variety of conditions, including oral periodontitis10 as well as systemic diseases such as systemic erythematosus lupus11 and IgA vasculitis12 and in organ specific diseases like rheumatoid arthritis (RA)13 and Alzheimer disease14, where Porphyromonas gingivalis seems to be actively involved. More recently, other inflammatory diseases such as multiple sclerosis (MS), an inflammatory disease of the central nervous system, have exhibited changes in microbiota density or composition.
The faecal microbiota has been extensively studied in MS patients and exhibits traits that can be interpreted as moderate dysbiosis15,16,17. Several animal studies have shown that the gut microbiome can actively participate in disease physiopathology. Indeed, studies on experimental autoimmune encephalomyelitis (EAE), a murine model of MS, have revealed that gut microbiota plays a role in demyelinating diseases. Indeed, disease induction in germ-free mice resulted in milder symptoms18, associated with decreased proinflammatory cytokine production19. Consistent with this, faecal transplantation from MS patients to germ-free mice (genetically modified to spontaneously develop EAE)20 resulted in a dramatic increase in spontaneous EAE incidence; this result was reproduced using the classical MOG35-55 peptide-induced EAE model21. However, while the faecal microbiome has been extensively studied, whether the oral microbiome is impacted by or contributes to MS, including both the microbial composition and functional aspects, has not been determined. Indeed, very few studies have considered these factors22,23,24. Preliminary works have reported the presence of particular bacteria or fungi in the oral and nasal mucosa, including a trend towards a higher frequency of Candida spp25 and Staphylococcus aureus virulence markers26,27 in MS. Overall, the fact that the oral microbiota has already been associated with several other inflammatory diseases and the proximity of the latter to the tonsils, the dental nerves, and the deep cervical lymph nodes makes it an interesting candidate in the context of a CNS inflammatory disease mediated by peripherally educated immune cells. In this pilot study we explored broad aspects of the microbiota and were able to obtain initial answers to these questions. In the present study, we investigated the changes in the microbiota of relapsing–remitting (RR) MS patients in both the oral and gut compartments compared to healthy volunteers (HVs) (Fig. 1). Our aim was to study the oral and faecal microbiota both separately and jointly and we treated them as interconnected compartments. On the basis of 16S rRNA sequencing results, we reported that both the oral and faecal microbial communities, as well as their interplay, are altered in MS. While alterations found in faecal microbiota are in line with the current literature, oral microbiota alterations appear to be more pronounced, as suggested by the diversity analyses. We further identified a specific signature in oral microbiota-derived metabolite and altered microbial gene expressions. We used these data to generate a discrimination model, which we then validated in an independent cohort.
Results
The abundance of bacterial genera in the in salivary and gut microbiota from MS patients is altered
As summarized in the workflow in Fig. 1B, we first compared the relative abundance of bacterial genera found in RRMS to that in HV samples from individuals. Basic quality controls performed on the sequencing products revealed high-quality reads and a sequencing depth above 10K dereplicated reads for all samples. In addition, blank sequencing controls revealed an absence of bacterial contamination. Visual inspection via alpha rarefaction analysis revealed that all the samples had reached a diversity plateau, suggesting that the sampling effort was sufficient to capture most of the microbial diversity present in our dataset. We identified 108 individual genera in the salivary samples and 236 in the faecal samples (Tables S1 and S2). In the saliva of RRMS patients (Fig. 2A), 13 genera were present at a mean relative abundance > 1%, and these genera made up almost 92% of the entire microbiota. In HV saliva, 14 genera were also present at a 1% relative abundance or greater, and these genera made up 89% of the total microbiota. Significant reductions in relative abundance (Table S1) of two of these bacteria (Streptococcus, Aggregatibacter) were observed between the RRMS and HV cohorts, and two bacteria (Fusobacterium, Leptotrichia) had significantly increased abundance or tended to be more present in the RRMS cohort (FDR = 0.08 and FDR = 0.04, respectively). Furthermore, the relative abundances of three genera (Catonella, Dialister, Paludibacteraceae-F0058) were significantly lower in the RRMS group than in the HV group while that of four others were increased (Mobiluncus, Cryptobacterium, Howardella and Lactobacillus). In addition, linear discriminant analysis (LDA) revealed that Cryptobacterium was associated with RRMS while Streptococcus and unclassified members of the families Burkholderiaceae and Pasteurellaceae were associated with HV (Fig. S1A).
Examination of the gut microbiota (Fig. 2B) revealed no modification of general diversity (Fig. S2), but 28 genera were present in RRMS patients with a mean relative abundance > 1% and these genera accounted for 74% of the total microbiota. In the HV group, 24 genera had a relative abundance > 1.0% and they comprised 73% of the total microbiota. A comparison of the mean relative abundance values revealed that Oscillospiraceae UCG-002 and Roseburia abundances were significantly lower in the RRMS group than in the HV groups (Table S2). There were 20 genera with lower abundances in RRMS samples than in HV samples (Intestinibacter, Escherichia-Shigella, Ruminococcaceae-UBA1819, Varibaculum, Actinomyces, Eisenbergiella, Hungatella, Corynebacterium, Gemella, Peptoniphilus, Rothia, Puniceicoccaceae member, Fusobacterium, Paludicola, Solobacterium, Acetanaerobacterium, Papillibacter, Clostridium, Peptostreptococcus and Lachnospiraceae-GCA-900066755), and the abundances of ten genera were decreased (Oscillospiraceae_UCG-002, Roseburia, two Eubacterium members, Lachnospiraceae_UCG-001, Coprobacter, Staphylococcus and three Prevotellaceae members). These results largely overlap with the results of the LDA analysis of the gut microbiota (Fig. S1B). Moreover, the abundance of Akkermansia tended to increase in patients with RRMS (mean 1% in HV versus 2.6% in RRMS). Overall, no bacterial genera existing in either the oral and faecal samples were altered, although the relative abundance of Fusobacterium tended to increase in both compartments (false discovery rate (FDR) = 0.08 in saliva and FDR < 0.05 in faeces).
A dysbiotic state and decreased microbial oral diversity were observed in RRMS patients
A comparison of the oral bacterial diversity between our RRMS cohort and the HV cohort revealed a trend towards a decrease in specific richness (Fig. 3A) and a significant decrease in the Shannon index (Fig. 3B) compared to that of the HV cohort. Additionally, β-diversity analysis by permutational multivariate analysis of variance (PERMANOVA, Fig. 3C) indicated that the composition of the oral microbiota of RRMS patients differed from that of the control group. Interestingly, we observed that the Shannon index significantly increased with age in HVs, but not in RRMS patients (Fig. 3D). Taken together, these data reveal the dysbiotic state of the oral microbiota in patients with RRMS. We also detected signs of faecal dysbiosis (PERMANOVA, p < 0.05) but there was no significant association between the α-diversity indices and disease status (Fig. S2).
There is more similarity between the oral and faecal compartments in MS patients than HV
Using paired faecal and saliva samples from 11 RRMS patients and 11 HV, we identified specific correlations between the two compartments in the RRMS and HV groups. In the healthy group (Fig. 4A), 21 significant correlations were found between the oral and faecal compartments, which is consistent with good compartmentalization; 13 of these correlations were positive (Fig. 4A, red squares) and 8 were negative (Fig. 4A, blue squares). Interestingly, Eubacterium nodatum and Bifidobacterium were positively correlated with each other in the oral and faecal compartments. The other bacteria that were strongly correlated between both compartments included oral Bifidobacterium and faecal Alloprevotella. Negative correlations were found between oral Eubacterium nodatum and faecal Alloprevotella, oral Dialister and faecal Enterococcaceae RF39 and oral Staphylococcus and faecal Streptococcus. Intriguingly, all these correlations were absent in the RRMS group and new correlations appeared, suggesting a different dynamic within the oral and intestinal interplay (Fig. 4B). Indeed, in the RRMS group, 24 significant correlations were detected between the gut and saliva, 13 of which were positive correlations; of these correlations the most significant corresponded to oral and faecal Enterococcaceae RF39, two different clostridia species, oral Peptococcus with faecal Haemophilus and Veillonella. The remaining 11 correlations were negative correlations mainly including oral Dialister and faecal Clostridia UCG014. When all the individual samples from the HV and RRMS groups were pooled (Fig. 4C), 28 (11.3%) genera were shared between the two compartments in the HV group whereas 47 (17.4%) were shared in the RRMS group. This difference was confirmed at the individual level by comparing the mean percentage of shared genera in each group via the Wilcoxon test (p < 0.05). As both the proportions of oral-specific and faecal-specific genera decreased in RRMS patients, it seems that faecal residents can colonize the oral cavity and vice versa. Taken together, these results suggest that compartmentalization tends to breakdown in MS.
Alterations in bacterial genes in MS
As directly measuring the gene content using 16S rRNA sequence data is not possible, we used the Phylogenetic Investigation of Communities by Reconstruction of Unobserved States (PICRUSt228) algorithm to perform functional enrichment analysis by inferring gene content based on the microbiota data. The obtained gene copy numbers were then grouped into conserved families that share common biological functions such as enzymes (identified by EC numbers) or by bacterial Metacyc pathways (https://metacyc.org/). In the oral compartment, we identified six highly significant enzymatic pathways (Fig. 5A) and five metabolic pathways (Fig. 5B) that differed significantly between the RRMS and HV samples. We found a decrease in the malate dehydrogenase (EC1.1.1.37) level in patients with RRMS; malate dehydrogenase is a key enzyme of the Krebs cycle. In contrast, we detected an increase in holoacyl carrier protein synthase (EC:2.7.8.7), which is involved in fatty acid biosynthesis pathways. We also found that the acetylene degradation pathway (Metacyc P161-PWY, which produces acetate, increased and that of CENTFERM, which produces butyrate, decreased, suggesting a shift from butyrate production in HVs to acetate production in RRMS patients. Other alterations in the saliva of RRMS patients included a decreased abundance of families involved in stress responses such as nitrite reductase (nrfA, EC:1.7.2.2) and 3′-nucleosidase (EC:3.1.3.6). Finally, the UDP-N-acetyl-d-glucosamine biosynthesis pathway, which is important for bacterial surface glycoprotein synthesis, was increased (Metacyc UDPNAGSYN) in RRMS while GDP-mannose biosynthesis (Metacyc PWY-5659) and norspermidine biosynthesis (Metacyc PWY-6562 were decreased.
Examination of faecal samples revealed six inferred enzymatic pathways (Fig. 5C) and six Metacyc pathways (Fig. 5D) that differed significantly between the HV and RRMS samples. Increases in HycI peptidase (EC:3.4.23.51), which is involved in hydrogenase-3 maturation and has pH resistance properties29; and CDP-ribitol r-phosphotransferase (EC:2.7.8.14), which catalyses the production of teichoic acid, a gram-positive cell membrane component, were observed. There was also detection of amino acid-related pathways including phosphohistidine-phosphotransferase (EC:2.7.1.69), l-lysine biosynthesis II (Metacyc PWY-2941), and l-glutamate degradation (Metacyc PWY-5088). Pathways involved in mycothiol synthesis, decaprenyl phosphate biosynthesis and sulfoglycolysis pathways (Metacyc PWY1G-0, PWY-6383, and PWY-7446, respectively) were also more abundant in RRMS. Spermidine synthase (speE, EC:2.5.1.16), which catalyzes polyamine spermidine production and flavin biosynthesis (Metacyc RIBOSYN2) were significantly less abundant in the gut compartment of RRMS patients.
To evaluate the robustness of the PICRUSt2 algorithm generated utilizing our data, we performed quantitative PCR to validate two different targets of interest, one in the oral compartment (nrfA, EC:1.7.2.2) and one in the faecal compartment (speE, EC:2.5.1.16). We showed that these two targets had decreased gene copy numbers in the RRMS group, as predicted by the PICRUSt2 algorithm (Fig. S3).
Microbiota-derived metabolites inference can be utilized to discriminate MS patients from HVs and RA patients
As microbiota-derived metabolites can have important effects on host responses, we used the flux balance analysis (FBA) algorithm to predict metabolite availability. Globally, 80 to greater than 90% of the total microbiota were reconstituted for each community model for each patient (Fig. S4). Metabolite bioavailability indices were inferred by converting boundary reactions, whose fluxes correspond to secreted or consumed metabolites according to the community model, into the fold-change of the reactional fluxes between HVs and RRMSs. In saliva (Fig. 6A), several metabolites, including d-lactate, ammonium, nitrate, palmitic acid, and nucleic acids including adenosine, deoxyadenosine, and cytidine were predicted to be over-produced in RRMS samples. In contrast, several metabolites including myoinositol, fructose, oxaloacetate, aminopentanoate and deoxycytidine exhibited decreased bioavailability. The LDA showed comparable results (Fig. S1C).
In the faecal microbiota (Fig. 6B), the predicted bioavailability of a distinct set of metabolites was affected. Formaldehyde and glycolaldehyde, methanol, 4-aminobutanoate, nicotinamide mononucleotide, the amino-acids l-aspartate and l-isoleucine, and the nucleoside cytosine showed increased bioavailability in RRMS samples. Decreased bioavailabilities of the nucleosides inosine and deoxyinosine; the Krebs cycle intermediates citrate and oxoglutarate, and the sugars d-glucarate, d-galactonate, and glucose-6-phosphate were observed, confirmed by LDA (Fig. S1 D).
To determine whether microbiota-derived metabolites could be utilized to discriminate between controls and RRMS patients, we performed t-distributed stochastic neighbour embedding (t-SNE) variable reduction, and the projection arising from oral microbiota-derived metabolites (Fig. 6A, t-SNE plot) better discriminated disease status than arising from faecal microbiota-derived metabolites (Fig. 6B, t-SNE plot). Interestingly, the signature of the oral microbiota-derived metabolites of RRMS patients appeared to be distinct from that observed in rheumatoid arthritis (RA), as shown in Fig. 6C,D. Indeed, most oral metabolites whose levels are altered in RA (Fig. 6C) are different from those altered in MS and the bioavailability of only palmitic acid was increased in both diseases. Discrimination between MS and RA patients on the basis of oral metabolites is represented on the t-SNE reduction in Fig. 6D. We therefore decided to use oral microbiota-derived metabolites to develop a classification model based on logistic regression with automatic variable stepwise selection (Akaike's information criterion minimization). The model identified deoxyadenosine (p = 0.009), hypoxanthine (p = 0.06) and glycine (p = 0.09) as the best classifiers according to our training dataset, giving an area under the receiver operating characteristic curve (AUC) of 0.91 (Fig. 7A). To validate this model, we used an independent German cohort23. We inferred the microbiota-derived metabolites of the 38 HVs and the 12 treatment-free RRMS patients. This achieved an AUC of 0.80 (Fig. 7B) consistent with the possibility that RRMS patients can be distinguished from HVs according to their oral metabolite content. To ascertain the predictive ability of our metabolite model, we measured the levels of the most discriminating metabolite, deoxyadenosine, in saliva samples by mass spectrometry. The level of this metabolite, which was predicted to increase in the RRMS group was indeed increased according to direct measurement (Fig. 7C), thus substantiating our FBA model.
Discussion
In this study, we identified a dysbiotic state in both the oral and faecal microbiota of MS patients compared to HVs. Among the oral microbiota, five genera (Dialister, Aggregatibacter, Catonella, Streptococcus, and Paludibacteriaceae-F0058) had a decreased relative abundance in the MS cohort. Interestingly, the first three genera have also been shown to be associated with periodontal diseases10. In contrast, several proinflammatory bacteria and potential pathogens, such as Fusobacterium and Leptotrichia had an increased abundance in the MS oral microbiota. Despite a potential leverage effect due to enrichment in individuals older than 60 years in the control group as shown in Fig. 3, we observed an interesting age-dependent increase in Shannon diversity in the HV cohort but not in the MS cohort. Age-related increases in gut microbiome diversity have been reported30,31 and could reflect an increase in diet complexity and nutrients. Dysbiosis of the oral microbiome in MS patients has been previously described. In a longitudinal study of oral swabs23, there were significant increases in the relative abundance of Campylobacter, Haemophilus and Neisseria. In a second study24, DNA sequencing of cultured bacterial isolates from oral swabs by PCR revealed that Staphylococcus, Actinomyces, Fusobacterium, Bacteroides, Porphyromonas, Prevotella, Veillonella and Propionibacterium were significantly more abundant in the MS group than in the control group, while Lactobacillus and Peptostreptococcus were more prevalent in the HV group. Together these studies confirm that oral dysbiosis is a feature of MS similar to other neurodegenerative diseases. The contribution of the reported oral dysbiosis to the disease remains to be addressed. Even though our cohort of patients was diagnosed relatively early in the course of the disease and exhibited only mild symptoms, we cannot rule out the possibility that some of these alterations could be attributed to difficulties in maintaining oral health due to muscle and coordination issues, which are common symptoms of MS. Potential causality and direct contribution of the oral microbiome to the disease should be further evaluated experimentally and through Mendelian randomization analysis.
With respect to the gut microbiota, we found similar types of alterations oriented towards a proinflammatory environment. Indeed, the abundances of several of the major short-chain fatty acid (SFCA) producers were decreased (Prevotella and Roseburia). In addition, the abundance of Fusobacterium increased in the gut as it did in the saliva. Finally, the Enterobacteriaceae family (including Escherichia, Shigella, Enterobacter and others) exhibited a large increase in abundance in the MS group (up to 2.5% of their total microbiota, or a 450% increase in the MS group) while the abundance of this group was close to zero in the HV group. Our results regarding faecal microbiota are consistent with the current literature, including the recently published study in Cell by the iMSMS consortium17. That study, as several others, have shown a tendency towards a decreased abundance of Faecalibacterium and an increase of Akkermansia abundance in MS. Similarly, our findings of a decreased abundance of the genus Roseburia have been previously described32, as were the increases in the abundance of Actinomyces33, Hungatella34 and different genera of Ruminococcus34.
We compared the microbiota compositions in the oral and faecal samples and found a high degree of compartmentalization with only a quarter of all the reported genera capable of living in both regions, consistent with microbiomes having location-specific compositions. However, there were more shared genera in MS patients than in HVs, suggesting a loss of compartmentalization during MS. Whether the exchange between the two compartments is bidirectional, or how transmission occurs (circulation, digestion, faecal–oral route) remains to be determined.
Among the metabolites, oral ammonium, which is a potent neurotoxic compound, was more common in the oral cavity of MS patients. On the other hand, myoinositol and deoxycytidine showed decreased bioavailability in MS patients. Myoinositol is an important cell messenger and osmolyte in the nervous system. Deoxycytidine is a hypomethylating agent, that has promising protective effects and is capable of improving the course of EAE35. Analysis of bacterial gene family content also revealed alterations in microbiota pathways. Indeed, the activity of malate dehydrogenase, which is a limiting factor in the TCA cycle, was decreased. Compensation seemed to occur by increasing lactic acid fermentation. Moreover, although the TCA cycle slowed, citrate did not accumulate but instead may have been used for fatty acid biosynthesis as suggested by the increase in the abundance of holo-acyl-carrier synthase.
The reorganization of bacterial species also affects bacterial pathways and metabolite availability in the gut. Indeed, our models predicted a large increase in the production of methanol and formaldehyde, and a decreased availability of inosine and deoxyinosine. Although best known for its cancerogenic properties, formaldehyde was also reported to play a role in neurological disorders36. Conversely, inosine was shown to improve cognitive function and to decrease neuroinflammation in ageing rats37. Strikingly, HycI peptidase, an enzyme from Escherichia coli that acts as a pH resistance factor (pH 2–2.5)29, was more abundant in MS. As the acidity of the stomach represents a major barrier between the oral and faecal compartments, increased activity of this enzyme play a role in the decompartmentalization between the gut and oral cavity observed in MS. Interestingly, the abundance of Actinomyces genus, along with several Actinomycetales compounds increased in the gut of MS patients. Notably, there is a peptide from Actinomyces can mimic collagen type IV α3127–148 and become a source of autoimmunity, thus leading to anti-glomerular basement membrane disease in HLA DRB1*15:01 humanized mice38. A significant decrease in spermidine synthase by the gut microbiota, as well as a decrease in components of the norspermidine biosynthesis pathway in the saliva was observed. Spermidine is a polyamide involved in cell proliferation, and has regulatory properties39.
Finally, our analysis suggested that the predicted levels of microbiota-derived metabolites can be used to discriminate between MS and HV. This result was validated using an independent cohort of swab samples. Despite differences in bacterial abundances between swabs and saliva samples, as observed by Kaan et al.40, the corresponding metabolites produced appeared convergent. The discriminant metabolites can be used as a surrogate biomarker for monitoring the efficacy of therapeutic intervention. Moreover, the MS metabolite signature is distinct from that of RA. This indicates a specific MS oral signature and not just an inflammatory signature in a wider sense. However, whether these alterations are causative or a consequence of the disease remains unknown. Several ongoing clinical trials that include modulation of the microbiome should help answer these questions. Moreover, several studies suggest that periodontal pathogens can trigger neuroinflammation41. In an EAE model, the induction of experimental periodontitis exacerbated the symptoms of neuroinflammation and faecal microbiota transplantation from these mice also aggravated the disease42.
Taken together, our results confirm the microbiota alterations in both oral and faecal compartments in MS patients. We identified relevant bacteria and microbiota-derived metabolites, that could favor a proinflammatory microenvironment. This also highlights the fact that the oral health MS patients should be monitored. Moreover, we identified several microbial pathways shared with human metabolism in both the saliva and gut. Using a modest sample size and three explicative variables in our classification model, we were able to show that oral microbiome-derived metabolites can be utilized to discriminate between MS patients and HVs. Metagenomic and metabolomic studies will be very informative to validate the results of this pilot study on the oral microbiota.
Conclusions
This pilot study confirmed the feasibility and relevance of studying not only the faecal microbiome but also the oral microbiome in multiple sclerosis patients. The present study offers compelling insights into the dynamics of the microbiota in MS, as well as several bacterial pathways possibly that could impact human immunology. In this detailed analysis, we identified relevant metabolites and pathways that need to be further investigated for their possible implications in this disease and for their therapeutic potentials. This feasibility study on oral signature in MS patients must be evaluated and reproduced using larger datasets.
Materials and methods
Patient samples
Participants were recruited at the MS Center (CRC-SEP Pays de La Loire) and samples were stored in a biocollection facility of Nantes University Hospital (ABM PFS13-003 “Collection sclérose en plaques”). All participants in the current study provided their informed consent for the analysis of their samples. Relapsing–remitting (RR) MS patients were recruited based on the revised McDonald criteria43 at the Nantes University Hospital and sampled during hospitalization. Patients with primary progressive multiple sclerosis (PPMS) and other neurological diseases or disorders (neuromyelitis optica spectrum disease (NMO-SD), clinically isolated syndrome not reaching McDonald criteria), or patients receiving antibody-based immunotherapy treatments or disease-modifying treatment (DMT) were excluded. Healthy volunteers (HVs) were recruited from among medical staff in the same hospital department. All participants had European ancestry. Patients who were obese, had a history of veganism or were using probiotics were also excluded. The exclusion criteria also included viral infection or the use of antibiotics drugs in the past three months. Overall, 34 saliva samples (21 HV, 14 RRMS) and 23 faecal samples (11 HV, 12 RRMS) were included in the microbiota analysis (Fig. 1). The groups were matched for age, sex, and smoking status. Five RRMS patients received intravenous corticosteroids (Solumedrol) at a dose of 1 g per day 1 to 3 days prior to saliva and faeces sampling. The MS patients included in the oral microbiota characterization had a mean disease duration of 3.17 years, a mean expanded disability status scale (EDSS) score of 1.9, and 11/14 of them were experiencing relapse at the time of sampling (Fig. 1A). Overall, the MS patients included for faecal microbiota analysis had a mean disease duration of 1.6 years and a mean EDSS of 1.2, and 11/12 of them were experiencing relapse at the time of sampling.
16S rRNA sequencing
DNA was extracted from 700 µL of saliva and 250 mg of stool using the QIAamp PowerFecal Pro DNA Kit from QIAGEN (Qiagen Inc., Venlo, The Netherlands). DNA spectrometry quality controls were used and all DNA samples had OD260:OD280 ratios greater than 1.8. 16S rRNA genes were amplified using the V4 553F and 805R primers via the classical two-step PCR approach, and paired-end sequencing of the PCR products was performed by a Miseq illumina system. Appropriate negative controls were included as sequencing blanks to assess bacterial contamination. Basic processing of the raw data was performed by the University of Illinois at Chicago Research Informatics Core (UICRIC, Chicago, IL, USA). Most of the quality control checks in the pipeline used were pass/fail, rather than comparison to a threshold. Read pair without merging, merging read without beginning or ending with the primers and chimera were excluded. Sequence trimming used cutadapt to remove ambiguous nucleotides, primer sequences, and trimmed was based on a quality threshold of p = 0.01. Reads that lacked either primer sequence, identified with a maximum mismatch of 10%, or were less than 225 bp were discarded.
Pipeline analysis of the microbiota
The raw demultiplexed paired-end reads were merged using PEAR software44. First quality control and trimming were performed using Cutadapt45. Taxonomy amplicon sequencing variants were obtained from the QIIME2 DADA2 analysis pipeline using a naive Bayesian model trained on the SILVA 16S database46,47. Differentially abundant taxa at the genus level were evaluated using nonparametric Wilcoxon tests corrected for permutation-based false discovery rate (FDR) as well as linear discriminant analysis (LDA) using the LEfSe tool48, which was developed by the Huttenhower Laboratory (https://huttenhower.sph.harvard.edu). Diversity indices were evaluated based on the Shannon index and specific richness while β-diversity and overall dysbiosis status were evaluated through PERMANOVA49 applied to a Bray–Curtis dissimilarity matrix, and represented using principal coordinates analysis (PCoA).
Metagenomic gene content and pathway enrichment data were obtained using the PICRUSt2 pipeline28 based on inferred unobserved traits. Microbiota-derived metabolites were evaluated using custom in silico community flux balance analysis (FBA) based on the cobra python library50. Briefly, FBA is used to calculate reaction fluxes from genome-scale reconstruction models by minimization of an objective function. Outputs corresponding to boundary reactions provide insights into the metabolites that are consumed or produced by the considered organism or community. For each individual, the most prevalent taxa were selected and their metabolomic reconstitution models were retrieved from the Virtual Metabolic Human platform (https://www.vmh.life). All available reconstruction models were constructed for the genera representing more than 1% of the total genera in at least one individual. Models were weighted according to the relative abundance of the individual taxa in each individual and merged into a unique model representing a microbiome reconstitution. Output boundary reactions were considered to infer microbiome-derived metabolite content. The boundary reaction fluxes, corresponding to the produced and consumed metabolites were subsequently transformed into a bioavailability index consisting of the fold change between the MS and HV samples.
t-SNE dimensional reductions were performed on both taxonomy (at the genus level) and metabolic fluxes to observe the discrimination power of each of the two levels of resolution in the faecal and oral samples. Finally, we created a discrimination model based on logistic regression analysis of the microbiome-derived metabolites and tested it on an oral microbiome analysis of an independent set of individuals, performed at Kiel University (Kiel, Germany) using 16S rRNA23. Briefly, taxonomic tables were gathered for 38 HV and 12 MS patients free of any DMT. As above, metabolic reconstructions were performed using FBA and the boundary reaction fluxes were used to assess the reproducibility of our discrimination model. Similarly, we investigated the specificity of the oral microbiome-derived signature found in MS by comparing our data to data from rheumatoid arthritis (RA) patients, by collecting raw 16S rRNA reads from previously published data51 involving saliva samples from 22 HV and 28 RA patients. The raw 16S rRNA reads were processed as previously described and a community FBA model was established. The resulting fluxes were corrected for batch effects, merged with the reactional fluxes previously obtained for the MS patients and presented on a t-SNE dimensional reduction plot.
Quantitative PCR
Quantitative PCR (qPCR) was performed to quantify spermidine synthase (speE, EC: 2.5.1.16) and nitrite reductase (nrfA, EC: 1.7.2.2) gene expression. The gene sequences expressed by different bacterial genera were aligned via Clustalo (https://www.ebi.ac.uk/Tools/msa/clustalo) and degenerate primer pairs were generated from the resulting consensus sequence using PrimerBlast (https://www.ncbi.nlm.nih.gov/tools/primer-blast/); we ensured the exclusion of human sequences to ensure high specificity. For each target gene, we used two endogenous controls, one universal 16S rRNA primer pair and one primer pairs specific for the 16S rRNA of a bacterial genus, which exhibited low variability between individuals (Table S3). For faecal speE, we used universal 16S rRNA primers 341S and 518R and primers specific for Bacteroides. For oral nrfA, we used the universal 16S rRNA primers 341S and 518R and primers specific for Veillonella. All primers were validated on a pool of all samples and showed high specificity for the targets and amplification efficacies between 90 and 110%. Quantitative PCR was performed on the same DNA as used for microbiome profiling: In total 11 RRMS and 18 HV samples were used for oral nrfA quantification while 11 HV and 12 RRMS samples were used for faecal speE quantification. PCR was carried out using QuantStudio 3 Real-time PCR system. For each target, relative levels were determined using the delta-delta CT method.
Mass spectrometry
Salivary levels of deoxyadenosine were determined by liquid chromatography-tandem mass spectrometry (MS) on a Xevo® Triple-Quadrupole mass spectrometer with an electrospray ionization interface equipped with an Acquity H-Class® UPLC™ device (Waters Corporation, Milford, MA, USA). All solvents used were LC–MS grade and purchased from Biosolve (Valkenswaard, Netherlands), and standard compounds and internal standards (IS) were obtained from Sigma Aldrich (Saint-Quentin Fallavier, France). Individual deoxyadenosine stock solutions were prepared at 10 mmol/L in ultrapure water. A solution of labeled [13C10,15N5]-adenosine (25 µmol/L) was prepared in water containing 3 g/L bovine serum albumin (IS solution). The standard solutions and saliva samples (50 µL) were then extracted with 150 µL of acetonitrile and 50 µL of the IS solution. The samples were mixed and centrifuged at 10,000×g and 10 °C for 10 min to remove the precipitate proteins. The supernatants were dried under a gentle stream of nitrogen (45 °C) and dissolved in 100 µL of acetonitrile. The samples were injected onto an Acquity BEH-Amide column held at 60 °C, after which the compounds were separated. The target compounds were detected by mass spectrometer with an electrospray ionization operating in positive ion mode.
Statistical analyses
Basic clinical variables were compared using the nonparametric Wilcoxon and McNemar tests. We investigated α-diversity (specific richness and Shannon index) and β-diversity (based on Bray–Curtis dissimilarity matrix) indices. Changes in α-diversity indices (Shannon index and specific diversity) were evaluated using Wilcoxon tests, and changes in β-diversity were tested through PERMANOVA using 1000 permutations and applied to the Bray–Curtis dissimilarity matrix. All diversity indices were obtained and processed using the Vegan R package v2.5-7. At the taxonomic and metabolite levels, fluctuations in relative abundances for each identified genus were tested using Wilcoxon tests corrected for permutation-based FDR. The discriminative power of taxa and metabolites was evaluated using t-SNE representations and logistic regression was performed using stepwise variable selection of the oral microbiota-derived metabolite fluxes to create the discrimination model. Gut and oral microbiota comparisons were made using Spearman correlation indices and the significance level was investigated using the Wilcoxon signed-rank test.
Ethics approval and consent to participate
The relevant institutional review boards/ethics committees approved the protocol: Agence de Biomédecine (ABM PFS13-003 Collection sclérose en plaques). All donors provided written informed consent in compliance with the Declaration of Helsinki.
Data availability
The data set generated and analyzed for the current study is available in the European read archive repository (https://www.ebi.ac.uk/ena/browser/home) under the accession number PRJEB53481. Anonymized metadata will be available on reasonable demand to laureline.berthelot@inserm.fr.
References
Jiao, Y., Wu, L., Huntington, N. D. & Zhang, X. Crosstalk between gut microbiota and innate immunity and its implication in autoimmune diseases. Front. Immunol. https://doi.org/10.3389/fimmu.2020.00282 (2020).
Duan, Y. et al. Inflammatory links between high fat diets and diseases. Front. Immunol. 9, 2649. https://doi.org/10.3389/fimmu.2018.02649 (2018).
Beeken, W. L. & Kanich, R. E. Microbial flora of the upper small bowel in Crohn’s disease. Gastroenterology 65(3), 390–397 (1973).
Tamboli, C. P., Neut, C., Desreumaux, P. & Colombel, J. F. Dysbiosis in inflammatory bowel disease. Gut 53(1), 1–4 (2004).
Marasco, G. et al. Gut microbiota and celiac disease. Dig. Dis. Sci. 61(6), 1461–1472. https://doi.org/10.1007/s10620-015-4020-2 (2016).
Prizont, R., Hersh, T. & Floch, M. H. Jejunal bacterial flora in chronic small bowel disease. I. Celiac disease. II. Regional enteritis. Am. J. Clin. Nutr. 23(12), 1602–1607. https://doi.org/10.1093/ajcn/23.12.1602 (1970).
Lee, Y. B., Byun, E. J. & Kim, H. S. Potential role of the microbiome in acne: A comprehensive review. J. Clin. Med. 8(7), 987. https://doi.org/10.3390/jcm8070987 (2019).
Lee, S.-Y., Lee, E., Park, Y. M. & Hong, S.-J. Microbiome in the gut–skin axis in atopic dermatitis. Allergy Asthma Immunol. Res. 10(4), 354–362. https://doi.org/10.4168/aair.2018.10.4.354 (2018).
Chen, L. et al. Skin and gut microbiome in psoriasis: Gaining insight into the pathophysiology of it and finding novel therapeutic strategies. Front. Microbiol. 11, 3201. https://doi.org/10.3389/fmicb.2020.589726 (2020).
Chen, C. et al. Oral microbiota of periodontal health and disease and their changes after nonsurgical periodontal therapy. ISME J. 12(5), 1210–1224. https://doi.org/10.1038/s41396-017-0037-1 (2018).
Li, B.-Z. et al. Dysbiosis of oral microbiota is associated with systemic lupus erythematosus. Arch. Oral Biol. 113, 104708. https://doi.org/10.1016/j.archoralbio.2020.104708 (2020).
Chen, B. et al. Oral microbiota dysbiosis and its association with Henoch–Schönlein Purpura in children. Int. Immunopharmacol. 65, 295–302. https://doi.org/10.1016/j.intimp.2018.10.017 (2018).
Perricone, C. et al. Porphyromonas gingivalis and rheumatoid arthritis. Curr. Opin. Rheumatol. 31(5), 517–524. https://doi.org/10.1097/BOR.0000000000000638 (2019).
Dominy, S. S. et al. Porphyromonas gingivalis in Alzheimer’s disease brains: Evidence for disease causation and treatment with small-molecule inhibitors. Sci. Adv. 5(1), eaau3333. https://doi.org/10.1126/sciadv.aau3333 (2019).
Boussamet, L., Rajoka, M. S. R. & Berthelot, L. Microbiota, IgA and multiple sclerosis. Microorganisms 10(3), 3. https://doi.org/10.3390/microorganisms10030617 (2022).
Boziki, M. K. et al. Microbiome in multiple sclerosis: Where are we, what we know and do not know. Brain Sci. https://doi.org/10.3390/brainsci10040234 (2020).
iMSMS Consortium, iMSMS Consortium. Gut microbiome of multiple sclerosis patients and paired household healthy controls reveal associations with disease risk and course. Cell 185(19), 3467–348616. https://doi.org/10.1016/j.cell.2022.08.021 (2022).
Goverman, J. et al. Transgenic mice that express a myelin basic protein-specific T cell receptor develop spontaneous autoimmunity. Cell 72(4), 551–560. https://doi.org/10.1016/0092-8674(93)90074-Z (1993).
Lee, Y. K., Menezes, J. S., Umesaki, Y. & Mazmanian, S. K. Proinflammatory T-cell responses to gut microbiota promote experimental autoimmune encephalomyelitis. Proc. Natl. Acad. Sci. USA 108(Suppl 1), 4615–4622. https://doi.org/10.1073/pnas.1000082107 (2011).
Berer, K. et al. Gut microbiota from multiple sclerosis patients enables spontaneous autoimmune encephalomyelitis in mice. Proc. Natl. Acad. Sci. 114(40), 10719–10724. https://doi.org/10.1073/pnas.1711233114 (2017).
Cekanaviciute, E. et al. Gut bacteria from multiple sclerosis patients modulate human T cells and exacerbate symptoms in mouse models. Proc. Natl. Acad. Sci. 114(40), 10713–10718. https://doi.org/10.1073/pnas.1711235114 (2017).
Boullerne, A. I. et al. Deep DNA metagenomic sequencing reveals oral microbiome divergence between monozygotic twins discordant for multiple sclerosis severity. J. Neuroimmunol. 343, 577237. https://doi.org/10.1016/j.jneuroim.2020.577237 (2020).
Troci, A. et al. B-cell-depletion reverses dysbiosis of the microbiome in multiple sclerosis patients. Sci. Rep. 12(1), 1. https://doi.org/10.1038/s41598-022-07336-8 (2022).
Zangeneh, Z., Abdi-Ali, A., Khamooshian, K., Alvandi, A. & Abiri, R. Bacterial variation in the oral microbiota in multiple sclerosis patients. PLoS One 16(11), e0260384. https://doi.org/10.1371/journal.pone.0260384 (2021).
da Cunha, E. T. S. et al. Oral colonization by Candida species in patients with multiple sclerosis. Mycopathologia 185(6), 983–991. https://doi.org/10.1007/s11046-020-00486-1 (2020).
Javid, S. et al. Frequency of superantigen encoding genes of Staphylococcus aureus isolates collected from multiple sclerosis (MS) patients and nasal carriers. Microb. Pathog. https://doi.org/10.1016/j.micpath.2018.12.010 (2019).
Pakbaz, Z., Sahraian, M. A., Sabzi, S., Mahmoodi, M. & Pourmand, M. R. Prevalence of sea, seb, sec, sed, and tsst-1 genes of Staphylococcus aureus in nasal carriage and their association with multiple sclerosis. Germs 7(4), 171–177. https://doi.org/10.18683/germs.2017.1123 (2017).
Douglas, G. M. et al. PICRUSt2 for prediction of metagenome functions. Nat. Biotechnol. 38(6), 6. https://doi.org/10.1038/s41587-020-0548-6 (2020).
Noguchi, K., Riggins, D. P., Eldahan, K. C., Kitko, R. D. & Slonczewski, J. L. Hydrogenase-3 contributes to anaerobic acid resistance of Escherichia coli. PLoS One 5(4), e10132. https://doi.org/10.1371/journal.pone.0010132 (2010).
de la Cuesta-Zuluaga, J. et al. Age- and sex-dependent patterns of gut microbial diversity in human adults. mSystems 4(4), e00261-19. https://doi.org/10.1128/mSystems.00261-19 (2019).
Odamaki, T. et al. Age-related changes in gut microbiota composition from newborn to centenarian: A cross-sectional study. BMC Microbiol. 16(1), 90. https://doi.org/10.1186/s12866-016-0708-5 (2016).
Reynders, T. et al. Gut microbiome variation is associated to Multiple Sclerosis phenotypic subtypes. Ann. Clin. Transl. Neurol. 7(4), 406–419. https://doi.org/10.1002/acn3.51004 (2020).
Forbes, J. D. et al. A comparative study of the gut microbiota in immune-mediated inflammatory diseases—Does a common dysbiosis exist?. Microbiome 6(1), 221. https://doi.org/10.1186/s40168-018-0603-4 (2018).
Navarro-López, V. et al. Gut microbiota as a potential predictive biomarker in relapsing-remitting multiple sclerosis. Genes 13(5), 930. https://doi.org/10.3390/genes13050930 (2022).
Mangano, K. et al. Hypomethylating agent 5-aza-2′-deoxycytidine (DAC) ameliorates multiple sclerosis in mouse models. J. Cell. Physiol. 229(12), 1918–1925. https://doi.org/10.1002/jcp.24641 (2014).
Rana, I., Rieswijk, L., Steinmaus, C. & Zhang, L. Formaldehyde and brain disorders: A meta-analysis and bioinformatics approach. Neurotox. Res. 39(3), 924–948. https://doi.org/10.1007/s12640-020-00320-y (2021).
Ruhal, P. & Dhingra, D. Inosine improves cognitive function and decreases aging-induced oxidative stress and neuroinflammation in aged female rats. Inflammopharmacology 26(5), 1317–1329. https://doi.org/10.1007/s10787-018-0476-y (2018).
Gu, Q.-H. et al. Experimental antiglomerular basement membrane GN induced by a peptide from actinomyces. J. Am. Soc. Nephrol. 31(6), 1282–1295. https://doi.org/10.1681/ASN.2019060619 (2020).
Freitag, K. et al. Spermidine reduces neuroinflammation and soluble amyloid beta in an Alzheimer’s disease mouse model. J. Neuroinflamm. 19(1), 172. https://doi.org/10.1186/s12974-022-02534-7 (2022).
Kaan, A. M. et al. Comparability of microbiota of swabbed and spit saliva. Eur. J. Oral Sci. 130(2), e12858. https://doi.org/10.1111/eos.12858 (2022).
Li, X., Kiprowska, M., Kansara, T., Kansara, P. & Li, P. Neuroinflammation: A distal consequence of periodontitis. J. Dent. Res. 101(12), 1441–1449. https://doi.org/10.1177/00220345221102084 (2022).
Zhou, L.-J. et al. Oral pathobionts promote MS-like symptoms in mice. J. Dent. Res. 102(2), 217–226. https://doi.org/10.1177/00220345221128202 (2023).
Thompson, A. J. et al. Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria. Lancet Neurol. 17(2), 162–173. https://doi.org/10.1016/S1474-4422(17)30470-2 (2018).
Zhang, J., Kobert, K., Flouri, T. & Stamatakis, A. PEAR: A fast and accurate Illumina Paired-End reAd mergeR. Bioinformatics 30(5), 614–620. https://doi.org/10.1093/bioinformatics/btt593 (2014).
Martin, M. Cutadapt removes adapter sequences from high-throughput sequencing reads. EMBnet J. 17(1), 1. https://doi.org/10.14806/ej.17.1.200 (2011).
Bolyen, E. et al. Reproducible, interactive, scalable and extensible microbiome data science using QIIME 2. Nat. Biotechnol. 37(8), 8. https://doi.org/10.1038/s41587-019-0209-9 (2019).
Callahan, B. J. et al. DADA2: High-resolution sample inference from Illumina amplicon data. Nat. Methods 13(7), 7. https://doi.org/10.1038/nmeth.3869 (2016).
Segata, N. et al. Metagenomic biomarker discovery and explanation. Genome Biol. 12(6), R60. https://doi.org/10.1186/gb-2011-12-6-r60 (2011).
Anderson, M. J. Permutational multivariate analysis of variance (PERMANOVA). In Wiley StatsRef: Statistics Reference Online 1–15 (Wiley, 2017). https://doi.org/10.1002/9781118445112.stat07841.
Ebrahim, A., Lerman, J. A., Palsson, B. O. & Hyduke, D. R. COBRApy: COnstraints-based reconstruction and analysis for Python. BMC Syst. Biol. 7(1), 74. https://doi.org/10.1186/1752-0509-7-74 (2013).
Tong, Y. et al. Oral microbiota perturbations are linked to high risk for rheumatoid arthritis. Front. Cell. Infect. Microbiol. 9, 475. https://doi.org/10.3389/fcimb.2019.00475 (2020).
Acknowledgements
We want to thank Dr Mikaël Croyal from the core facility SFR Bonamy, Nantes for his contribution in analysis. We also thank Dr Martin Morin his help on quantitative PCR. Bioinformatics analysis in the project described was performed by the UIC Research Informatics Core, supported in part by NCATS through Grant UL1TR002003. This work has been carried out thanks to the support of the LabEx IGO project (n° ANR-11-LABX0016-01) funded by the “Investissements d’Avenir” French Government program, managed by the French National Research Agency (ANR).
Funding
This study was supported by Inserm, Nantes Université, Région Pays de la Loire grant LOIRE-TIMES (L. Berthelot), ARSEP (French Fondation for research on multiple sclerosis) and NotreSclérose association. This study was also supported by Merit grant I01BX002625 (D.L.F) and Research Career Scientist award IK6BX004852 (D.L.F) from the Department of Veterans Affairs.
Author information
Authors and Affiliations
Contributions
L Berthelot, L Boussamet, EM, DAL, DLF designed the study. L. Boussamet, EM, CM, AG, DM, MD, DLF, and L Berthelot performed analysis and/or interpretation of data. L. Boussamet, L. Berthelot and LDF drafted the manuscript. ED, SW, CB, KHS, ABN, SS, DAL, L Berthelot and DLF revised the manuscript critically for important intellectual content. All authors approved this version of the manuscript.
Corresponding authors
Ethics declarations
Competing interests
E. Montassier received consulting fees from Sanofi, MSD, BMS. DA Laplaud received consulting fees and board membership fees from Alexion, Actelion, BMS, Biogen, Genzyme, Sanofi, Merck-Serono, Novartis, Roche. S. Wiertlewski received consulting and board membership fees Biogen, Genzyme, Novartis, Merck-Serono, Alexion Pharma, Roche, Sanofi. DL Feinstein has a provisional patent filed USPTO application # US 17/715,187. The work was supported in part by Research Career Scientist grant # 14S-RCS-003 from the US Department of Veterans Affairs (DL Feinstein). L Boussamet, L Berthelot, C Mathe, A Garcia, E Dugast, S Shah, J Morille, AB Nicot, N Vince, M Gourdel, D Masson, C Bang and K Sturner do not have competing interest.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Boussamet, L., Montassier, E., Mathé, C. et al. Investigating the metabolite signature of an altered oral microbiota as a discriminant factor for multiple sclerosis: a pilot study. Sci Rep 14, 7786 (2024). https://doi.org/10.1038/s41598-024-57949-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-024-57949-4
Keywords
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.