Abstract
The current study was designed to investigate the effect of abstinence in combination with environmental enrichment (EE) on cardiac and renal toxicity induced by 2 weeks of ketamine self-administration (SA) in rodents. In Experiment 1, one group of rats underwent ketamine SA for 14 days. In Experiment 2, the animals completed 2 weeks of ketamine SA followed by 2 and 4 weeks of abstinence. In Experiment 3, animals underwent 14 days of ketamine SA and 4 weeks of abstinence in which isolated environment (IE) and EE was introduced. The corresponding control groups were included for each experiment. Two weeks of ketamine SA caused significant increases in organ weight, Apoptosis Stimulating Fragment/Kidney Injury Molecule-1 and apoptotic level of heart and kidney. The extended length of withdrawal from ketamine SA partially reduced toxicity on the heart and kidney. Finally, introduction of EE during the period of abstinence greatly promoted the effect of abstinence on ketamine-induced cardiac and renal toxicity. The interactive effect of EE and abstinence was promising to promote the recovery of cardiac and renal toxicity of ketamine.
Similar content being viewed by others
Introduction
Ketamine is a non-competitive N-methyl-D-aspartate (NMDA) receptor antagonist which has been primarily used as a dissociative anesthetic in human and veterinary medicine1,2. In the past decade, there is a reported increase in the non-medical and unauthorized use of ketamine worldwide3,4,5,6,7,8,9. Ketamine use causes neurological and psychological impairment10,11,12. Newly accumulating data also indicate that ketamine abuse causes deleterious effects on various organs in the peripheral system13,14,15. For example, long-term ketamine treatment induces toxicity in the kidney, liver, bladder and heart of mice and rabbits16,17,18,19,20. It has been suggestd that mitochondrial dysfunction is associated with ketamine-induced hepatotoxcity21,22,23,24. Alterations in epithelial cell-to-cell adhesion and cell coupling in the proximal kidney is hypothesized to underline ketamine-induced renal toxicity25. However, there is little information on therapeutic interventions of ketamine-induced functional and morphological damage in multiple organs.
Enriched environment (EE) is a combination of physical and psychological stimulation, which provides animals with multiple sensory, cognitive and motor interactions with the environment26. It has been shown that EE has beneficial effects on brain development, cognitive functions and the rate of recovery from neural injury26,27,28,29,30,31. Furthermore, EE introduced during cocaine abstinence significantly reduces cue- and stress-induced cocaine self-administration in rats when compare to the non EE conditions32,33. Additionally, mice housed under the EE condition during abstinence also exhibited blunted conditioned place preference to cocaine compared with those housed under a standard condition34. EE is associated with a low level of stress in response to drug cues during abstinence which may attenuate drug-seeking behavior33,35,36. Moreover, EE also diminishes drug cue-elicited dopaminergic activity in the mesocorticolimbic circuitry during abstinence whereas isolated environment (IE) stimulates nigrostriatal dopaminergic transmission37. The increased cue-induced neural activity has been associated with drug relapse38,39. Thus, combination of EE and abstinence may produce a better treatment outcome for drug dependence than abstinence intervention alone.
The main purpose of this study was to determine whether EE during abstinence from ketamine treatment would attenuate chronic ketamine-induced toxicity in a rodent model of ketamine self-administration. Self-administration (SA) is one of the most relevant animal models to mimic human voluntary drug taking behavior40. To the best of our knowledge, the potential toxic effects on the heart and kidney exerted by ketamine have not been explored in the animal model of ketamine SA. Ketamine-induced peripheral toxicity was reported in animals non-contingently treated with ketamine for weeks or months16,17,20. It remains unknown as to what extent cardiac and renal damage would be produced following ketamine SA. Given the evidence of the beneficial effect of the combination of EE and abstinence on drugs of abuse in animals, it was worth determining whether abstinence in conjunction with EE would improve the recovery of cardiac and renal toxicity induced by ketamine SA.
Results
Cardiac and renal toxicity induced by ketamine SA
Animals were allowed to self-administer ketamine through a choice of an active or inactive hole. Once the active hole was selected, the reinforcer (ketamine infusion) was delivered. A two-way ANOVA with repeated measurement indicated that the responses in the active hole were significantly higher than those in the inactive holes (F(1,223) = 1636.917, p < 0.01; Fig. 1A). The number of infusions per session was stable across 14 days of ketamine SA within each group (F(13,223) = 0.970, p = 0.670; Fig. 1B). There was no significant difference in the number of ketamine infusions between the Ketamine SA groups in different experiments.
The effects of ketamine SA on hypertrophy of the rat heart and kidney.
(A) The number of responses in the active (closed circle) and inactive (open circle) holes across 14 days of ketamine SA. (B) The number of infusions per session. (C) The heart weight and body weight ratio (HW/BW) of the control (left) and the Ketamine SA (right) groups. (D) The kidney weight and body weight ratio (KW/BW) of the control (left) and the Ketamine SA (right) groups. Data are expressed as mean ± SEM. * *p < 0.01 HW: heart weight; KW: kidney weight; BW: body weight.
Independent t-test revealed that both the heart weight/body ratio (HW/BW) and kidney weight/body weight ratio (KW/BW) were significantly higher in the Ketamine SA group than in the corresponding control group (HW/BW: p = 0.009; KW/BW: p < 0.01; Fig. 1C,D). Ketamine SA produced toxicity on the heart. The H&E staining results revealed that normal myocardial cells were arranged regularly (Fig. 2A). In contrast, myocardial cells were arranged irregularly and the nuclei seemed to be distorted and varied in size in the Ketamine SA group (Fig. 2B). Moreover, ketamine SA significantly increased the level of apoptosis stimulating fragment (FAS) level determined by optical density, compared with the corresponding control group (p < 0.01; Fig. 2C–E). Finally, TUNEL staining results indicated that the percentage of apoptotic cell number per unit area in the heart was significantly higher in the Ketamine SA group than that in the corresponding control group (p < 0.01; Fig. 2F–H).
The effects of ketamine SA on morphological alterations and toxicity of the heart.
(A,B) Representative images of H&E staining for a Saline and a Ketamine SA rat. Arrow represents the irregular arrangement of myocardial cells (C,D) Representative images of IHC staining for a saline and a ketamine SA rat. Arrow represents a cell with positive expression of FAS. (E) The level of FAS for the saline (left) and the Ketamine SA (right) groups. (F,G) Representative TUNEL staining images for a saline and a ketamine SA rat. Arrow represents an apoptotic cell. (H) TUNEL + cells (%) for saline (left) and ketamine SA (right) groups. Data are expressed as mean ± SEM. ** p < 0.01 FAS: apoptosis stimulating fragment; SA: self-administration; TUNEL: Terminal deoxynucleotidyl transferase-mediated dUTP nick end-labeling staining. The FAS level was defined as the average integral optical density.
Ketamine SA exerted toxicity on kidney. The H&E staining results showed that the Ketamine SA group had a greater infiltration of mononuclear cells and tubular atrophy, compared with the corresponding control group (Fig. 3A,B). Moreover, tubules appeared to be distorted and blocked (Fig. 3A,B). Independent t-test revealed that the level of Kidney Injury Molecule-1 (KIM-1) was significantly increased in the Ketamine SA group, compared with the corresponding control group (p < 0.01; Fig. 3C–E). Lastly, ketamine SA produced a significant increase in the number of TUNEL + cells in kidney, relative to the corresponding control group (p < 0.01; Fig. 3F–H).
Effects of ketamine SA on morphological alterations and toxicity of the kidney.
(A,B) Representative images of H&E staining for a saline and a ketamine SA rat. Arrow represents tubular atrophy. (C,D) Representative images of IHC staining for a saline and a ketamine SA rat. Arrow represents a cell with positive expression of KIM-1. (E) KIM-1 levels for saline (left) and ketamine SA (right) groups (F,G) Representive TUNEL staining images for a saline (left) and a ketamine SA (right) rat. (H) TUNEL + cells (%) for saline (left) and ketamine SA (right) groups. Arrow represents an apoptotic cell. Data are expressed as mean ± SEM. ** p < 0.01. SA: self-administration; KIM-1: kidney injury molecule 1; TUNEL: Terminal deoxynucleotidyl transferase-mediated dUTP nick end-labeling staining. The KIM-1 level was defined as the average integral optical density.
Effect of the duration of abstinence on cardiac and renal toxicity induced by ketamine SA
To determine whether ketamine-induced toxicity was long-lasting, cardiac and renal toxicity was examined in rats with different length of abstinence (0, 2, 4 weeks) from ketamine SA. There were a total of 6 groups including no abstinence (Ketamine SA), 2 (Ketamine SA + 2 W) and 4 (Ketamine SA + 4 W) weeks of abstinence. And three additional groups were used as their corresponding controls (Saline, Saline + 2 W, Saline + 4 W). As indicated before, there was no difference in ketamine intake among the ketamine SA groups (F(2,335) = 1.717, p = 0.199).
A two-way ANOVA analysis revealed that there was a significant Drug (ketamine vs. saline) effect on HW/BW ratio (F(1,41) = 31.855, p < 0.01). The effect of abstinence failed to reach significant (F(2,41) = 3.081, p = 0.06). Post-hoc tests revealed that the HW/BW ratio in the Ketamine SA, Ketamine SA + 2 W and Ketamine SA + 4 W groups was significantly higher than that of their corresponding control groups (Ketamine SA: p = 0.001; Ketamine SA + 2 W: p = 0.015; Ketamine SA + 4 W: p = 0.003; Fig. 4A; Table 1). The HW/BW ratio for the Ketamine SA group was not significantly different from that for either the Ketamine SA + 2w (p = 0.523) or Ketamine SA + 4 W group (p = 0.095; Fig. 4A; Table 1). Furthermore, a two-way ANOVA revealed a significant drug and abstinence effect on the level of FAS and apoptosis (FAS/Drug: F(1,79) = 287.178 p < 0.01; FAS/Abstinence: F(2, 79) = 20.871, p < 0.01; Apoptosis/Drug: F(1,55) = 163.830, p < 0.01; Apoptosis/Abstinence: F(2,55) = 31.473, p < 0.01; Fig. 4H–U; Table 1). Post hoc tests showed that the Ketamine SA, Ketamine SA + 2 W and Ketamine SA + 4 W groups showed a significantly higher level of FAS than their corresponding control groups (Ketamine SA: p < 0.01; Ketamine SA + 2 W: p < 0.01; Ketamine SA + 4 W: p < 0.01; Fig. 4I–N; Table 1). The similar pattern was found for the level of apoptosis (Ketamine SA: p < 0.01; Ketamine SA + 2 W: p < 0.01; Ketamine SA + 4 W: p < 0.01; Fig. 4P–U; Table 1).The level of FAS was significantly lowered following 2 and 4 weeks of abstinence, relative to the Ketamine SA group (p < 0.01; Fig. 4J,L,N; Table 1). The similar pattern was also found for the level of apoptosis (p < 0.01; Fig. 4Q,S,U). Additionally, animals in the Ketamine + 4 W group showed a significantly lower level of FAS and apoptosis than those in the Ketamine + 2 W group (p < 0.01; Fig. 4L,N; Fig. 4S,U; Table 1).
Effects of the duration of abstinence on cardiac toxicity induced by ketamine SA.
(A) The heart and body weight ratio of Ketamine SA, Ketamine SA + 2 W and Ketamine SA + 4 W groups and their corresponding control (Saline, Saline + 2 W, Saline + 4 W) groups (B–G). Representative images of H&E staining for a Saline, a Ketamine SA, a Saline + 2 W, a Ketamine + 2 W, a Saline + 4 W and a Ketamine SA + 4 W rat. Arrow represents irregular arrangement of myocardial cell. (H) FAS levels of ketamine SA, ketamine SA + 2 W and ketamine SA + 4 W groups and their corresponding control (Saline, Saline + 2 W, Saline + 4 W) groups. (I–N) Representative images of IHC staining for a Saline, a Ketamine SA, a Saline + 2 W, a Ketamine + 2 W, a Saline + 4 W and a Ketamine SA + 4 W rat. Arrow represents a cell with positive expression of FAS. (O) TUNEL + cells (%) of the Ketamine SA, Ketamine SA + 2 W and Ketamine SA + 4 W groups and their corresponding control (Saline, Saline + 2 W, Saline + 4 W) groups (P–U) Representative images of TUNEL staining for a Saline, a Ketamine SA, a Saline + 2 W, a Ketamine + 2 W, a Saline + 4 W and a Ketamine SA + 4 W rat. Arrow represents an apoptotic cell. Data are expressed as mean ± SEM. FAS: apoptosis stimulating fragment; TUNEL: Terminal deoxynucleotidyl transferase-mediated dUTP nick end-labeling staining; SA: self-administration; W: week; HW: heart weight; BW: body weight.
A two-way ANOVA indicated a significant effect of drug (saline vs. ketamine) and abstinence (0, 2, 4 weeks) on KW/BW (Drug: F(1,41) = 120.423, p < 0.01; Abstinence: F(1,41) = 7.853, p = 0.002; Fig. 5A; Table 1). Post-hoc tests revealed that the KW/BW ratio for the Ketamine SA, Ketamine SA + 2 W and Ketamine SA + 4 W groups was significantly higher than that for their corresponding control group (Ketamine SA: p < 0.01; Ketamine SA + 2 W: p < 0.01; Ketamine SA + 4 W: p < 0.01; Fig. 5A; Table 1). The KW/BW ratio of the Ketamine SA + 2 W group was not significantly different from the Ketamine SA group (p = 0.461), whereas the ratio for the Ketamine SA + 4 W group was significantly lower than the Ketamine SA group (p < 0.01; Fig. 5A; Table 1). A two-way ANOVA showed that there was a significant effect of drug and abstinence in the level of KIM-1 and apoptosis (KIM-1/Drug: F(1,79) = 153.126, p < 0.01; KIM-1/Abstinenence: F(2,79) = 34.078, p < 0.01; Apoptosis/Drug: F(1,55) = 153.424, p < 0.01; Apoptosis/Abstinence: F(2,55) = 11.757, p < 0.01; Fig. 5H,O; Table 1). The changes in KW/BW, KIM-1 and apoptosis of kidney were similar to heart. However, significant differences in the level of KIM-1 and renal cell apoptosis were evident between Ketamine SA + 2 W and Ketamine SA + 4 W group (KIM-1: p < 0.01; Apoptosis: p = 0.01; Fig. 5L,N,S,U; Table 1).
Effects of the duration of abstinence on renal toxicity induced by ketamine SA.
(A) The kidney and body weight ratio of the Ketamine SA, Ketamine SA + 2 W and Ketamine SA + 4 W groups and their corresponding control (Saline, Saline + 2 W, Saline + 4 W) groups (B–G). Representative images of H&E staining for a Saline, a Ketamine SA, a Saline + 2 W, a Ketamine + 2 W, a Saline + 4 W and a Ketamine SA + 4 W rat. Arrow represents tubular enlargement and edema (H) KIM-1 levels of the Ketamine SA, Ketamine SA + 2 W and Ketamine SA + 4 W groups and their corresponding control (Saline, Saline + 2 W, Saline + 4 W) groups. (I–N) Representative images of IHC staining for a Saline, a Ketamine SA, a Saline + 2 W, a Ketamine + 2 W, a Saline + 4 W and a Ketamine SA + 4 W rat. Arrow represents a cell with positive expression of KIM-1. (O) TUNEL + cells (%) of the Ketamine SA, Ketamine SA + 2 W and Ketamine SA + 4 W groups and their corresponding control (P–U). Representative images of TUNEL staining for a Saline, a Ketamine SA, a Saline + 2 W, a Ketamine + 2 W, a Saline + 4 W and a Ketamine SA + 4 W rat. Arrow represents an apoptotic cell. Data are expressed as mean ± SEM. KIM-1: Kidney Injury Molecule 1; TUNEL: Terminal deoxynucleotidyl transferase-mediated dUTP nick end-labeling staining; SA: self-administration; W: week; KW: kidney weight; BW: body weight.
Effects of EE abstinence on the recovery of cardiac and renal toxicity induced by ketamine SA
To determine whether EE would attenuate toxicity induced by ketamine SA, we introduced the EE and IE housing condition during the 4-weeks of abstinence following ketamine SA. Controls were saline treated animals housed in either the EE or IE condition. The number of infusions per session did not significantly differ between the EE and IE group.
A two-way ANOVA major effect of Drug (saline vs. ketamine) was found in both HW/BW (F(1,23) = 123.139, p < 0.01) and KW/BW (F(1,23) = 209.747, p < 0.01) ratio. The effect of Condition (IE vs. EE) was significant in the HW/BW ratio ((F(1,23) = 5.471, p = 0.029), but not in the KW/BW ratio (F(1,23) = 1.569, p = 0.224); Fig. 6A and 7A; Table 2). Post-hoc tests revealed that both the Ketamine SA + IE and Ketamine SA + EE group exhibited a significantly higher HW/BW ratio than their corresponding control group (Ketamine SA + IE: p < 0.01; Ketamine SA + EE: p < 0.01; Fig. 6B–E). There was also a significant difference in HW/BW and KW/BW between Ketamine SA + IE and Ketamine SA + EE group (HW/BW: p = 0.051; KW/BW: p = 0.046; Fig. 6C,E and 7C,E). For the level FAS, the was a significant effect of Drug (F(1,51) = 25.437, p < 0.01), but not Condition (F(1,51) = 2.030, p = 0.161). For the level of KIM-1, there was a significant effect of both Drug and Condition (Drug: F(1,51) = 78.337, p < 0.01; Condition: F(1,51) = 15.792, p < 0.01; Fig. 6F and 7F; Table 2). Post-hoc tests showed that the EE condition significantly decreased the level of FAS and KIM-1, compared with the IE condition (FAS: p = 0.045; KIM-1: p < 0.01; Fig. 6H,J and Fig. 7H,J). However, animals undergoing either the EE or IE abstinence still exhibited a significantly higher level of FAS and KIM-1 than their corresponding control ones (p < 0.01). The degree of apoptosis in the heart and kidney was also significantly different for the factor of Drug and Condition (Heart/Drug: F(1, 47) = 49.202, p < 0.01; Heart/Condition: F(1, 47) = 25.103, p < 0.01; Kidney/Drug: F(1, 47) = 8.400, p = 0.006; Kidney/Condition: F(1, 47) = 9.449, p = 0.004; Fig. 6K and 7K; Table 2). Similarly, the apoptotic level of the heart and kidney was significantly decreased by EE abstinence, relative to IE abstinence (p < 0.01). However, either EE or IE abstinence group exerted a significant increase in apoptosis of the heart and kidney, compared with their corresponding control group (p < 0.01).
Effects of EE and IE in combination with abstinence on the recovery from ketamine-induced cardiac toxicity.
(A) The heart and body weight ratio of the Ketamine SA + IE, Ketamine SA + EE groups and the corresponding control (Saline + IE, Saline + EE) groups (B–E). Representative images of H&E staining for a Saline + IE, a Ketamine SA + IE, a Saline + EE and a Ketamine SA + EE rat. Arrow represents irregular arrangement of myocardial cells. (F) FAS levels of the Ketamine SA + IE, Ketamine SA + EE groups and the corresponding control (Saline + IE, Saline + EE) groups. (G–J). Representative images of IHC staining for a Saline + IE, a Ketamine SA + IE, a Saline + EE and a Ketamine SA + EE rat. Arrow represents a cell with positive expression of FAS. (K) TUNEL + cells (%) of the Ketamine SA + IE, Ketamine SA + EE groups and the corresponding control (Saline + IE, Saline + EE) groups (L–O). Representative images of TUNEL staining for a Saline + IE, a Ketamine SA + IE, a Saline + EE and a Ketamine SA + EE rat. Arrow represents an apoptotic cell. Data are expressed as mean ± SEM. FAS: apoptosis stimulating fragment; TUNEL: Terminal deoxynucleotidyl transferase-mediated dUTP nick end-labeling staining; IE: isolated environment; EE: enriched environment; HW: heart weight; BW: body weight.
Effects of EE and IE in combination with abstinence on the recovery from ketamine-induced renal toxicity.
(A) The kidney and body weight ratio of the Ketamine SA + IE, Ketamine SA + EE groups and the corresponding control (Saline + IE, Saline + EE) groups (B–E). Representative images of H&E staining for a Saline + IE, a Ketamine SA + IE, a Saline + EE and a Ketamine SA + EE rat. Arrow represents tubular edema. (F) KIM-1 levels of Ketamine SA + IE, Ketamine SA + EE groups and the corresponding control (Saline + IE, Saline + EE) groups (G–J). Representive images of IHC staining for a Saline + IE, a Ketamine SA + IE, a Saline + EE and a Ketamine SA + EE rat. Arrow represents a cell with positive expression of KIM-1. (K) KIM-1 levels of Ketamine SA + IE, Ketamine SA + EE groups and the corresponding control (Saline + IE, Saline + EE) groups. (I) TUNEL + cells (%) of Ketamine SA + IE, Ketamine SA + EE groups and the corresponding control (Saline + IE, Saline + EE) groups (L, M, N, O) Representive images of TUNEL staining for a Saline + IE, a Ketamine SA + IE, a Saline + EE and a Ketamine SA + EE rat. Arrow represents an apoptotic cell. Data are expressed as mean ± SEM. KIM-1: Kidney Injury Molecule 1; TUNEL: Terminal deoxynucleotidyl transferase-mediated dUTP nick end-labeling staining; IE: isolated environment; EE: enriched environment; KW: kidney weight; BW: body weight.
Discussion
This study was the first to investigate the effect of EE on the cardiac and renal toxicity caused by ketamine SA in rats. Two weeks of ketamine SA caused profound cardiac and renal damage, which was attenuated following 2 or 4 weeks of abstinence. Importantly, a combination of EE with abstinence produced a better effect on amelioration of ketamine-induced damages to the heart and kidney.
Our data demonstrated that ketamine SA caused dysfunction of the heart and kidney as evidenced by the significant increase in the levels of FAS and KIM-1, which is consistent with previous studies using non-contingent treatment16,17,20. Thus, ketamine SA may be a relevant animal of peripheral toxicity observed in human ketamine users. This model may help understand the molecular mechanisms underlying ketamine-induced toxicity. Clinical studies suggest that early intervention may produce transient and partial recovery in chronic ketamine users14. However, some damages can be irreversible14. It has not been tested whether prolonged abstinence could indeed produce greater recovery of organ injury from ketamine use. In the current study, two different periods of abstinence were used to assess the effect of abstinence on the cardiac and renal toxicity induced by ketamine SA. Both 2 and 4 weeks of abstinence lead to partial recovery from ketamine-induced toxicity with 4 weeks of abstinence showing a greater effect. This implies that some aspects of ketamine-induced peripheral toxicity may be irreversible, similar to the reports on human ketamine users13,14,15. One interesting finding from our study is that combination of EE and abstinence showed a greater effect on recovery from ketamine-induced peripheral toxicity. EE introduced during abstinence has been repeatedly shown to prevent cue- and stress-induced drug seeking behavior in animals, which is associated with reduced activity of brain circuitry involving in drug-induced reinstatement32,37,41. The duration of 4 weeks was chosen, due to the fact that 4 weeks of abstinence was not sufficient to produce a full recovery from ketamine-induced cardiac and renal toxicity. Our results showed that EE abstinence significantly reduced cardiac and renal toxicity, relative to the IE group. However, the level of FAS, KIM-1 and apoptosis in the EE abstinence group were still significantly higher than in the paired control animals. These results suggest that the combination of EE and abstinence greatly promoted the recovery from cardiac and renal damage induced by ketamine SA, but were not sufficient to produce a full recovery. It remains unknown whether a longer duration of EE and abstinence combination would produce better treatment outcomes, even a full recovery of ketamine-induced cardiac and renal toxicity.
One potential molecular mechanism underlying the effects of EE on peripheral toxicity is the reduced oxidative stress. It has been widely studied and documented that oxidative stress plays a critical role in drug-induced apoptosis of the heart and kidney42,43,44. Oxidative stress is known to trigger activation of a number of signaling pathways mediated by reactive oxygen species (ROSs), which subsequently activate nuclear factor-κB (NF-κB). Activation of NF-κB results in the promotion of renal damage, including interstitial fibrosis and inflammation44. Moreover, altered ROS levels could directly enhance the loss of epithelial properties, which is evident in animals treated with ketamine17. It is likely that oxidative stress could be a major contributor to the cardiac and renal impairment associated with ketamine SA. EE has been demonstrated to lower expressions of biomarkers of oxidative damage and produce anti-oxidative effects in rats with chronic cerebral hypoperfusion45. Pre-clinical and clinical data suggested that cognitive and physical stimulation, which is a key component of EE, lowers peripheral oxidative stress46. Interestingly, combined treatment of antioxidants and behavioral enrichment also reduce the levels of oxidative damage and improve the antioxidant reserve systems in the aging canine brain47. Taken together, it is possible that ketamine-induced oxidative damage, indicated by cardiac and renal toxicity, can be effectively attenuated by the intervention of EE during the abstinence period.
Differences in housing conditions might have profound impact on the well-being of animals48,49. For example, EE reduces heart rate and increases activity, compared with single-housing condition50. IE animals gained weight more rapidly than EE ones51,52,53. Furthermore, rats singly housed in super-enriched cages show better sleep, more exploration and greater relative weights of the thymus gland and spleen compared to single housed rats without the EE condition49. Rats housed in the EE condition exhibit a less body weight gain and increased physical activity51,54. Also, a larger and more complex EE condition positively correlates with higher muscle strength in rats and rabbits54,55. Cage enrichment significantly reduces the heart rate and the systolic blood pressure in male rats, but not female rats56,57. Social and physical enrichment can induce a longer duration of sleep in rats, compared with a solely social enrichment49. It is likely that EE can improve the general well-being of rodents and, ultimately, enhance the recovery of organ dysfunction following ketamine SA.
Some limitations of the present study should be considered. Only male rats were used in the current study. Earlier studies have shown that the effects of EE overall generally appeared to be greater for males than for females58. For example, females are less responsive to the positive effects of EE and more vulnerable to retinal ischemia in social isolation59. Since gender differences have been implicated as a major variable of the response to the effect of drugs of abuse and treatment outcomes60,61,62, it would be necessary to investigate the effect of EE in female rats in the future. Secondly, it would be interesting to see whether a longer duration of EE in combination with abstinence would produce the beneficial effect to a greater extent.
Ketamine SA exerted profound cardiac and renal toxicity, which can be alleviated, but not fully recovered by abstinence. Combination of EE and abstinence could greatly promote the recovery from cardiac and renal impairment. It should be noted that clinical attempts to control the toxicity of ketamine have been relatively unsuccessful and follow-up care for life may even be needed15,63. This may reflect a greater need to include supplementary intervention into abstinence, in order to achieve more favorable treatment outcomes.
Methods
Animals
Male Sprague-Dawley rats, weighing approximately 300–350 at the beginning of the experiment (Zhejiang Academy of Medical Sciences, Hangzhou, Zhejiang, China), were used. The animals were housed in a temperature- and humidity-controlled room with a 12 h light/dark cycle (lights off at 07:00, on at 19:00). Food and water were abundant ad libitum. The experimental protocol was approved by an Institutional Review Committee for the use of Animal Subjects. All experiments were conducted in accordance with the guidelines of the Institutional Laboratory Animal Care and Use of Ningbo University.
Surgical procedures
The details of the surgical procedures were previously described in details64,65. After 7 days of acclimation, animals were anesthetized with a combination of ketamine HCl (50 mg/kg, i.m.) and xylazine (7.5 mg/kg, i.m.). Catheters were flushed daily with sterile saline containing heparin sodium (0.4%) and penicillin sodium to maintain catheter patency and prevent infection. There were a total of 98 animals used in the current studies and 50 animals completed ketamine SA. A total of 12 animals were excluded because of not acquiring ketamine SA (N = 4) or catheter failures (N = 8).
Ketamine SA
Following approximately 5 days of recovery from surgery, rats were trained to SA ketamine as described previously64,65. Briefly, a nose-poke response in the left (active) hole was immediately reinforced with an injection of 0.5 mg/kg/infusion ketamine. A nose-poke response in the right (inactive) hole was considered as an inactive response which had no programmed consequences. During the acquisition phase, the animals were allowed to self-administer ketamine (0.5 mg/kg/infusion) daily on a Fixed Ratio 1 (FR1) schedule for 4 hrs. After rats acquired stable ketamine SA behavior, animals were allowed 2 hrs daily to self-administer ketamine for 14 days. The experimental procedures are summarized in Fig. 8A.
Time line for experimental design.
IE: isolated environment; EE: enriched environment; W: week; D: days; H&E: Hematoxylin and Eosin Staining; IHC: Immunohistochemistry; TUNEL: Terminal deoxynucleotidyl transferase-mediated dUTP nick end-labeling staining.
Abstinence and housing environment
All animals were individually housed following surgery and throughout ketamine SA and saline infusion sessions. During abstinence (0, 2, or 4 weeks), rats in the IE group remained individually housed in their home cages (460 mm × 315 mm × 200 mm). IE rats were only handled briefly for scheduled bedding changes and had no visual contact with other rats housed in adjacent cages. Compared to IE, the EE group was housed together in a large plastic cage (930 mm × 615 mm × 245 mm) that contained four rats and contained bedding, two PVC pipes, two running wheels, building blocks and a number of small plastic toys. Each week, the toys were thoroughly washed and changed to maintain novelty. Saline control animals were also housed in either IE or EE condition for the same length of time as the ketamine SA groups. A cap was used to cover the catheters during the abstinence. And, catheters were flushed with heparin and saline with penisinin when necessary.
Tissue preparation and histological study
Hematoxylin and eosin (H&E) staining was carried out to determine morphological alterations in the heart and kidney. All rats were perfused with saline and paraformaldehyde through the heart within 24 hrs of fixation after the completion of the behavioral experiment. The heart and kidneys were removed and cut into an appropriate size for the tissue specimens and then placed in 4% paraformaldehyde to be fixed for 24 hrs. Subsequently, the specimens were placed in graded ethanol for dehydration, embedded in paraffin and cut at a thickness of 4–6 μm. The sections were deparaffinized, rehydrated and immersed in Mayer’s hematoxylin for 5–10 min. After being washed with deionized water, the sections were dipped in 0.1% acid water, immersed in 1% eosin for 5 min to develop the red color and washed with deionized water. Finally, the sections were run through an ascending alcohol series, cleared in xylene and mounted in Permount.
Immunohistochemical (IHC) study
According to the manufacturer’s instructions (Boshide, Wuhan, China), the heart and kidney sections were first dewaxed and rehydrated. The endogenous peroxidase activity was blocked with 3% hydrogen peroxidase for 10 min. Then the sections were incubated with goat serum blocking solution at room temperature for 20 min(m). The sections were then incubated with primary antibodies for Apoptosis Stimulating Fragment (FAS, Sigma, St. Louis, MO, USA) or Kidney Injury Molecule 1 (KIM-1, ABCAM, Cambridge, MA, USA), overnight at 4 °C. After being rinsed, the tissue sections were reacted with peroxidase-conjugated goat anti-rabbit IgG secondary antibodies at 37 °C for 30 min. Finally, all sections were dehydrated, cleared, mounted and visualized with a DAB-based colorimetric method and Image Pro Plus 6.0 analysis software (Media Cybernetics Inc., MD, USA). The IHC index was defined as the average integral optical density.
Terminal deoxynucleotidyl transferase-mediated dUTP nick end-labeling (TUNEL) staining
Apoptosis in the heart and kidney following ketamine SA was determined by TUNEL staining according to the manufacturer’s instructions (In Situ Cell Death Detection Kit, Roche, USA). The tissue sections of the heart and kidney were deparafinized and rehydrated. The samples were imaged using an Olympus CX31 microscope (Olympus, Tokyo, Japan) and analyzed in randomly selected five high power fields . TUNEL-positive cells showed dark buffy nuclei staining andTUNEL-negative cells had blue nuclei. The total number of TUNEL-positive cells per field was counted, using the software Image-Pro Plus 6.0 (Media Cybernetics Inc., MD, USA) and divided by the field area. The average apoptotic cell density was obtained from each experimental group.
Experimental procedures
Experiment 1: Cardiac and renal toxicity induced by ketamine SA
Two groups of animals were used in Experiment 1. One group of animals (Ketamine SA; N = 14) underwent ketamine SA for 14 days. The corresponding controls animals (N = 6) were also surgically prepared with jugular catheters. Each control animal received intravenous infusions of saline in the same temporal patterns as that self-administered ketamine. That is, the number of saline infusions and the duration between each saline infusion in the control group were the same as the average number and duration in ketamine SA group. The control group received the same number of training sessions as ketamine SA group, but because lever presses did not result in reinforcer delivery, they occurred only infrequently. The experimental procedures are summarized in Fig. 8A.
Experiment 2: Effect of abstinence on cardiac and renal toxicity induced by ketamine SA
Experiment 2 was carried out in the same manner as in Experiment 1, except for the inclusion of an abstinence period following the maintenance of ketamine SA. One groups of rats underwent ketamine SA alone (Ketamine SA; N = 8/group). Additional two groups completed ketamine SA, with abstinence duration of 2 (Ketamine SA + 2 W) and 4 (Ketamine SA + 4 W) weeks (N = 8/group) respectively. Three group of animals were used as the control (N = 6/group). The control animals received intravenous saline infusions in the same pattern as those self-administering ketamine described in Experiment 1. Two groups of control animals underwent either 2 or 4 weeks of abstinence. The experimental procedures are summarized in Fig. 8B.
Experiment 3: Effects of EE and IE abstinence on the recovery of cardiac and renal toxicity induced by ketamine SA
Four groups of animals were used in Experiment 3. Two groups of animals underwent 14 days of ketamine SA and 4 weeks of abstinence (N = 6/group). During the abstinence phase, one group was housed under the EE condition and the other was housed under the IE condition. Two group of animals were used as the control (N = 6/group). The control animals received intravenous saline infusions in the same pattern as those self-administering ketamine described in Experiment 1. During the abstinence phase, one control group was housed under the EE condition and the other control group was housed under the IE condition. The experimental procedures are summarized in Fig. 8C.
Drugs
The stock ketamine was purchased (0.1 g/2 ml, Gutian Pharmaceutical Company, Fujian, China) and dissolved in saline.
Statistical analysis
Independent t-tests were used to compare the effect of ketamine SA on cardiac and renal damage. A two-way ANOVA was used to test the effect of abstinence and housing conditions on cardiac and renal toxicity. A two-way ANOVA was used to examine SA performance. LSD post-hoc test was used when necessary. Changes were considered to be statistically significant when p < 0.05.
Additional Information
How to cite this article: Li, X. et al. Environmental enrichment and abstinence attenuate ketamine-induced cardiac and renal toxicity. Sci. Rep. 5, 11611; doi: 10.1038/srep11611 (2015).
References
Agarwal, A. et al. Ketamine for treatment of catheter related bladder discomfort: a prospective, randomized, placebo controlled and double blind study. Br J Anaesth. 96, 587–589 (2006).
Naguib, M., Adu-Gyamfi, Y., Absood, G. H., Farag, H. & Gyasi, H. K. Epidural ketamine for postoperative analgesia. Can Anaesth Soc J. 33, 16–21 (1986).
Chu, P. S. et al. The destruction of the lower urinary tract by ketamine abuse: a new syndrome? BJU international 102, 1616–1622 (2008).
Dillon, P., Copeland, J. & Jansen, K. Patterns of use and harms associated with non-medical ketamine use. Drug Alcohol Depend 69, 23–28 (2003).
Lua, A. C., Lin, H. R., Tseng, Y. T., Hu, A. R. & Yeh, P. C. Profiles of urine samples from participants at rave party in Taiwan: prevalence of ketamine and MDMA abuse. Forensic Sci Int. 136, 47–51 (2003).
Riley, S. C., James, C., Gregory, D., Dingle, H. & Cadger, M. Patterns of recreational drug use at dance events in Edinburgh, Scotland. Addiction 96, 1035–1047 (2001).
Topp, L., Breen, C., Kaye, S. & Darke, S. Adapting the Illicit Drug Reporting System (IDRS) to examine the feasibility of monitoring trends in the markets for ‘party drugs’. Drug Alcohol Depend 73, 189–197 (2004).
Zhao, C. et al. Drug abuse in China. Ann N Y Acad Sci. 1025, 439–445 (2004).
Global SMART Programme. Patterns and Trends of Amphetamine-Type Stimulants and Other Drugs: Challenges for Asia and the Pacific (ed. Justice Tettey ) 1–139 (Vienna, 2013).
Morgan, C. J., Muetzelfeldt, L. & Curran, H. V. Consequences of chronic ketamine self-administration upon neurocognitive function and psychological wellbeing: a 1-year longitudinal study. Addiction 105, 121–133 (2010).
Muetzelfeldt, L. et al. Journey through the K-hole: phenomenological aspects of ketamine use. Drug Alcohol Depend 95, 219–229 (2008).
Yiu-Cheung, C. Acute and chronic toxicity pattern in ketamine abusers in Hong Kong. J Med Toxicol. 8, 267–270 (2012).
Middela, S. & Pearce, I. Ketamine‐induced vesicopathy: a literature review. Int J Clin Pract. 65, 27–30 (2011).
Pappachan, J. M., Raj, B., Thomas, S. & Hanna, F. W. Multiorgan dysfunction related to chronic ketamine abuse. Proc (Bayl Univ Med Cent). 27, 223–225 (2014).
Shahani, R., Streutker, C., Dickson, B. & Stewart, R. J. Ketamine-associated ulcerative cystitis: a new clinical entity. Urology. 69, 810–812 (2007).
Chan, W. M., Liang, Y., Wai, M. S., Hung, A. S. & Yew, D. T. Cardiotoxicity induced in mice by long term ketamine and ketamine plus alcohol treatment. Toxicol Lett. 207, 191–196 (2011).
Li, Y. et al. Ketamine-induced ventricular structural, sympathetic and electrophysiological remodelling: pathological consequences and protective effects of metoprolol. Br J Pharmacol. 165, 1748–1756 (2012).
Tan, S. et al. Ketamine effects on the urogenital system--changes in the urinary bladder and sperm motility. Microsc Res Tech. 74, 1192–1198 (2011).
Wai, M. S., Chan, W. M., Zhang, A. Q., Wu, Y. & Yew, D. T. Long-term ketamine and ketamine plus alcohol treatments produced damages in liver and kidney. Hum Exp Toxicol. 31, 877–886 (2012).
Yeung, L. Y., Rudd, J. A., Lam, W. P., Mak, Y. T. & Yew, D. T. Mice are prone to kidney pathology after prolonged ketamine addiction. Toxicol Lett. 191, 275–278 (2009).
Chang, H. C., Chen, T. L. & Chen, R. M. Cytoskeleton interruption in human hepatoma HepG2 cells induced by ketamine occurs possibly through suppression of calcium mobilization and mitochondrial function. Drug Metab Dispos. 37, 24–31 (2009).
Kalkan, Y. et al. Hepatic effects of ketamine administration for 2 weeks in rats. 33, 32–40 (2013).
Lee, S. T., Wu, T. T., Yu, P. Y. & Chen, R. M. Apoptotic insults to human HepG2 cells induced by S-(+)-ketamine occurs through activation of a Bax-mitochondria-caspase protease pathway. Br J Anaesth. 102, 80–89 (2009).
Venâncio, C. et al. Chronic ketamine administration impairs mitochondrial complex I in the rat liver. Life sciences 93, 464–470 (2013).
Hills, C. E. et al. ‘Special k’ and a loss of cell-to-cell adhesion in proximal tubule-derived epithelial cells: modulation of the adherens junction complex by ketamine. PloS one. 8, e71819 (2013).
Nithianantharajah, J. & Hannan, A. J. Enriched environments, experience-dependent plasticity and disorders of the nervous system. Nat Rev Neurosci. 7, 697–709 (2006).
Dhanushkodi, A. & Shetty, A. K. Is exposure to enriched environment beneficial for functional post-lesional recovery in temporal lobe epilepsy? Neurosci Biobehav Rev. 32, 657–674 (2008).
Janssen, H. et al. Translating the use of an enriched environment poststroke from bench to bedside: study design and protocol used to test the feasibility of environmental enrichment on stroke patients in rehabilitation. Int J Stroke 7, 521–526 (2012).
Li, L. & Tang, B. L. Environmental enrichment and neurodegenerative diseases. Biochem Biophys Res Commun. 334, 293–297 (2005).
Miller, L. S., Colella, B., Mikulis, D., Maller, J. & Green, R. E. Environmental enrichment may protect against hippocampal atrophy in the chronic stages of traumatic brain injury. Front Hum Neurosci. 7, 506 (2013).
Woo, C. C. & Leon, M. Environmental enrichment as an effective treatment for autism: a randomized controlled trial. Behavioral neuroscience 127, 487–497 (2013).
Chauvet, C., Lardeux, V., Goldberg, S. R., Jaber, M. & Solinas, M. Environmental enrichment reduces cocaine seeking and reinstatement induced by cues and stress but not by cocaine. Neuropsychopharmacology 34, 2767–2778 (2009).
Thiel, K. J. et al. Environmental enrichment counters cocaine abstinence-induced stress and brain reactivity to cocaine cues but fails to prevent the incubation effect. Addiction biology 17, 365–377 (2012).
Chauvet, C., Lardeux, V., Jaber, M. & Solinas, M. Brain regions associated with the reversal of cocaine conditioned place preference by environmental enrichment. Neuroscience 184, 88–96 (2011).
Solinas, M., Thiriet, N., El Rawas, R., Lardeux, V. & Jaber, M. Environmental enrichment during early stages of life reduces the behavioral, neurochemical and molecular effects of cocaine. Neuropsychopharmacology 34, 1102–1111 (2009).
Thiel, K. J., Engelhardt, B., Hood, L. E., Peartree, N. A. & Neisewander, J. L. The interactive effects of environmental enrichment and extinction interventions in attenuating cue-elicited cocaine-seeking behavior in rats. Pharmacol Biochem Behav. 97, 595–602, (2011).
Thiel, K. J., Pentkowski, N. S., Peartree, N. A., Painter, M. R. & Neisewander, J. L. Environmental living conditions introduced during forced abstinence alter cocaine-seeking behavior and Fos protein expression. Neuroscience 171, 1187–1196, (2010).
Bossert, J. M., Marchant, N. J., Calu, D. J. & Shaham, Y. The reinstatement model of drug relapse: recent neurobiological findings, emerging research topics and translational research. Psychopharmacology 229, 453–476 (2013).
Calu, D. J., Chen, Y. W., Kawa, A. B., Nair, S. G. & Shaham, Y. The use of the reinstatement model to study relapse to palatable food seeking during dieting. Neuropharmacology 76 Pt B, 395–406 (2014).
Bergman, J. & Paronis, C. A. Measuring the reinforcing strength of abused drugs. Molecular interventions 6, 273–283 (2006).
Solinas, M., Chauvet, C., Thiriet, N., El Rawas, R. & Jaber, M. Reversal of cocaine addiction by environmental enrichment. Proc Natl Acad Sci USA 105, 17145–17150 (2008).
Fiaschi, A. I. & Cerretani, D. Causes and effects of cellular oxidative stress as a result of MDMA abuse. Current pharmaceutical biotechnology 11, 444–452 (2010).
Valente, M. J., Carvalho, F., Bastos, M. D., de Pinho, P. G. & Carvalho, M. Contribution of oxidative metabolism to cocaine-induced liver and kidney damage. Curr Med Chem. 19, 560–566 (2012).
Rubattu, S. et al. Pathogenesis of chronic cardiorenal syndrome: is there a role for oxidative stress? International journal of molecular sciences 14, 23011–23032 (2013).
Cechetti, F. et al. Environmental enrichment prevents behavioral deficits and oxidative stress caused by chronic cerebral hypoperfusion in the rat. Life sciences. 91, 29–36 (2012).
Gomez-Cabrera, M. C., Domenech, E. & Vina, J. Moderate exercise is an antioxidant: upregulation of antioxidant genes by training. Free radical biology & medicine 44, 126–131 (2008).
Opii, W. O. et al. Proteomic identification of brain proteins in the canine model of human aging following a long-term treatment with antioxidants and a program of behavioral enrichment: relevance to Alzheimer’s disease. Neurobiology of aging. 29, 51–70 (2008).
Simpson, J. & Kelly, J. P. The impact of environmental enrichment in laboratory rats--behavioural and neurochemical aspects. Behavioural brain research 222, 246–264 (2011).
Abou-Ismail, U. A. & Mahboub, H. D. The effects of enriching laboratory cages using various physical structures on multiple measures of welfare in singly-housed rats. Lab Anim. 45, 145–153 (2011).
Sharp, J., Azar, T. & Lawson, D. Effects of a complex housing environment on heart rate and blood pressure of rats at rest and after stressful challenges. J Am Assoc Lab Anim Sci. 53, 52–60 (2014).
Fiala, B., Snow, F. M. & Greenough, W. T. “Impoverished” rats weigh more than “enriched” rats because they eat more. Developmental psychobiology 10, 537–541 (1977).
Lopak, V. & Eikelboom, R. Pair housing induced feeding suppression: individual housing not novelty. Physiology & behavior 71, 329–333 (2000).
Zaias, J., Queeney, T. J., Kelley, J. B., Zakharova, E. S. & Izenwasser, S. Social and physical environmental enrichment differentially affect growth and activity of preadolescent and adolescent male rats. J Am Assoc Lab Anim Sci. 47, 30–34 (2008).
Spangenberg, E. M., Augustsson, H., Dahlborn, K., Essen-Gustavsson, B. & Cvek, K. Housing-related activity in rats: effects on body weight, urinary corticosterone levels, muscle properties and performance. Lab Anim. 39, 45–57 (2005).
Buijs, S., Van Poucke, E., Van Dongen, S., Lens, L. & Tuyttens, F. A. Cage size and enrichment effects on the bone quality and fluctuating asymmetry of fattening rabbits. J Anim Sci. 90, 3568–3573 (2012).
Azar, T., Sharp, J. & Lawson, D. Heart rates of male and female Sprague-Dawley and spontaneously hypertensive rats housed singly or in groups. J Am Assoc Lab Anim Sci. 50, 175–184 (2011).
Sharp, J., Azar, T. & Lawson, D. Effects of a cage enrichment program on heart rate, blood pressure and activity of male sprague-dawley and spontaneously hypertensive rats monitored by radiotelemetry. Contemp Top Lab Anim Sci. 44, 32–40 (2005).
Elliott, B. M. & Grunberg, N. E. Effects of social and physical enrichment on open field activity differ in male and female Sprague-Dawley rats. Behavioural brain research 165, 187–196 (2005).
Kiss, P. et al. Gender-dependent effects of enriched environment and social isolation in ischemic retinal lesion in adult rats. Int J Mol Sci. 14, 16111–16123 (2013).
Perkins, H. W. Stress-motivated drinking in collegiate and postcollegiate young adulthood: life course and gender patterns. Journal of studies on alcohol 60, 219–227 (1999).
Gritz, E. R., Nielsen, I. R. & Brooks, L. A. Smoking cessation and gender: the influence of physiological, psychological and behavioral factors. J Am Med Womens Assoc. 51, 35–42 (1996).
Cepeda-Benito, A., Reynoso, J. T. & Erath, S. Meta-analysis of the efficacy of nicotine replacement therapy for smoking cessation: differences between men and women. J Consult Clin Psychol. 72, 712–722 (2004).
Selby, N. M., Anderson, J., Bungay, P., Chesterton, L. J. & Kolhe, N. V. Obstructive nephropathy and kidney injury associated with ketamine abuse. NDT plus 1, 310–312 (2008).
Zhao, C. et al. Chronic treatment with curcumin enhances methamphetamine locomotor sensitization and cue-induced reinstatement of methamphetamine self-administration. Pharmacol Biochem Behav. 102, 555–561 (2012).
Lu, X. et al. The effects of rearing condition on methamphetamine self-administration and cue-induced drug seeking. Drug Alcohol Depend 124, 288–298 (2012).
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China (U1132602), the National Key Technology R&D Program in the 12th Five-Year Plan of China (2012BAI01B07), K.C.Wong Magna Fund in Ningbo University, Zhejiang Provincial Key Laboratory of Pathophysiology (Ningbo University School of Medicine), the Program for Innovative Research Team in Ningbo City (2009B21002), Zhejiang Province Scientific Project of Medicine and Health Care (2011RCA033), Natural Science Foundation of Ningbo (2013A610254) and Ningbo Key Laboratory (2012A22001).
Author information
Authors and Affiliations
Contributions
L.L., J.P. and W.Z. designed the study and wrote the protocol. L.L., J.P., Z.W., T.P., G.L. and S.L. conducted the experiments. R.C. and Z.D. undertook the statistical analysis. L.L., W.S., D.Z. and Y.L. wrote the first draft of the manuscript. All authors reviewed the manuscript.
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Rights and permissions
This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
About this article
Cite this article
Li, X., Li, S., Zheng, W. et al. Environmental enrichment and abstinence attenuate ketamine-induced cardiac and renal toxicity. Sci Rep 5, 11611 (2015). https://doi.org/10.1038/srep11611
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/srep11611
This article is cited by
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.
