A brain-to-brain interface (BTBI) enabled a real-time transfer of behaviorally meaningful sensorimotor information between the brains of two rats. In this BTBI, an “encoder” rat performed sensorimotor tasks that required it to select from two choices of tactile or visual stimuli. While the encoder rat performed the task, samples of its cortical activity were transmitted to matching cortical areas of a “decoder” rat using intracortical microstimulation (ICMS). The decoder rat learned to make similar behavioral selections, guided solely by the information provided by the encoder rat's brain. These results demonstrated that a complex system was formed by coupling the animals' brains, suggesting that BTBIs can enable dyads or networks of animal's brains to exchange, process and store information and, hence, serve as the basis for studies of novel types of social interaction and for biological computing devices.
In his seminal study on information transfer between biological organisms, Ralph Hartley wrote that “in any given communication the sender mentally selects a particular symbol and by some bodily motion, as his vocal mechanism, causes the receiver to be directed to that particular symbol”1. Brain-machine interfaces (BMIs) have emerged as a new paradigm that allows brain-derived information to control artificial actuators2 and communicate the subject's motor intention to the outside world without the interference of the subject's body. For the past decade and a half, numerous studies have shown how brain-derived motor signals can be utilized to control the movements of a variety of mechanical, electronic and even virtual external devices3,4,5,6. Recently, intracortical microstimulation (ICMS) has been added to the classical BMI paradigm to allow artificial sensory feedback signals7,8, generated by these brain-controlled actuators, to be delivered back to the subject's brain simultaneously with the extraction of cortical motor commands9,10.
In the present study, we took the BMI approach to a new direction altogether and tested whether it could be employed to establish a new artificial communication channel between animals; one capable of transmitting behaviorally relevant sensorimotor information in real-time between two brains that, for all purposes, would from now on act together towards the fulfillment of a particular behavioral task. Previously, we have reported that specific motor11,12 and sensory parameters13,14 can be extracted from populations of cortical neurons using linear or nonlinear decoders in real-time. Here, we tested the hypothesis that a similar decoding performed by a “recipient brain” was sufficient to guide behavioral responses in sensorimotor tasks, therefore constituting a Brain-to-Brain Interface (BTBI)15 (Figure 1). To test this hypothesis, we conducted three experiments in which different patterns of cortical sensorimotor signals, coding a particular behavioral response, were recorded in one rat (heretofore named the “encoder” rat) and then transmitted directly to the brain of another animal (i.e. the “decoder” rat), via intra-cortical microstimulation (ICMS). All BTBI experiments described below were conducted in awake, behaving rats chronically implanted with cortical microelectrode arrays capable of both neuronal ensemble recordings and intracortical microstimulation16. We demonstrated that pairs of rats could cooperate through a BTBI to achieve a common behavioral goal.
In our training paradigm, animals learned basic elements of the tasks prior to participating in any BTBI experiments. First, prospective encoder rats were trained to respond to either tactile or visual stimuli until they reached 95% correct trials accuracy. Meanwhile, decoder rats were trained to become proficient while receiving ICMS as a stimulus. A train of ICMS pulses instructed the animal to select one of the levers/nose pokes, whereas a single ICMS pulse instructed a response to the other option. Decoder rats reached a 78.77% ± 2.1 correct trials performance level. After this preliminary training was completed, the animals were run in pairs, each one in a separate operant box.
The next phase of training began with the encoder rat performing ~10 trials of the motor or tactile task, which were used to construct a cortical ensemble template, i.e. the mean cortical neuronal activity for one of the responses. The increased firing rate associated with the right lever press was selected as the parameter extracted from the neuronal ensemble in the motor task. The increased firing rate associated with the “Narrow” trials was selected as the parameter extracted from the neuronal ensemble in the tactile task. A BTBI session followed in which ICMS trains applied to the cortex of the decoder rat reflected the difference between the template and single-trial neuronal ensemble rates produced by a sample of the encoder rat's M1 or S1 activity. ICMS duration (i.e. number of pulses delivered) was proportional to the difference between the sampled neuronal ensemble firing rate recorded during a given trial and the template normalized by the standard deviation. The time window for the analysis of neuronal activity and ICMS parameters was adjusted in each recording session to maximize the directional signal. The decoder rats reacted to ICMS patterns and not any other cues, as was evident from control experiments in which the performance of those rats dropped to chance level after the ICMS cable was disconnected from the stimulator. Furthermore, the encoder rat received feedback information describing the single trial performance of the decoder rat; each time the decoder rat responded correctly to the ICMS cue, the encoder rat received an additional reward (i.e. water).
In experiment 1 (Figure 1), encoder rats (N = 3) pressed one of two levers after an LED on top of the lever was turned on. While the rats did so, M1 neuronal activity was recorded, compared to the template and transformed into ICMS trains applied to M1 of the decoder rats (N = 4) who performed the same lever press task. As would be expected, the encoder rats performed better (95.87% ± 1.83 correct trials) (Figure 2 A) than the decoder rats (64.32 ± 1.1%; range: 60 – 72% correct trials; Binomial test: P < 0.05 in all sessions) (Figure 2 A and B). Yet, the performance of the decoder animals was above chance and highly significant. Indeed, in some experiments the decoder rat's performance using the BTBI was very close to the maximum performance obtained when ICMS was used alone in these animals (72% BTBI vs 78% ICMS alone, see above).
The primary factor that influenced the decoder rat's performance was the quality of spatial information extracted from the encoder rat's M1. The performance was high if the chosen neuronal ensemble accurately encoded left versus right presses (Figure 2 C and Figure 3 A–D). The higher the deviation from the template and hence the larger the duration of the ICMS (i.e. number of pulses delivered), the better was the decoder rat's performance (Figure 2 C and 3 B–D). For this first experiment, a total of 538 units and 110 multiunits were recorded from encoder rats. Sessions were comprised of 48.04 ± 1.5 trials. The response latency of the encoder rats was 20.06 ± 1.0 seconds, while decoder animals responded at 13.59 ± 0.5 seconds. Note that this difference reflects only the effect of both rats working as a dyad (see below for comparison of latencies during training and testing).
In addition to the neuronal transfer from the encoder to the decoder rats, feedback information, related to the decoder rats' performance, was sent back to the encoder animal. This feedback provided an additional reward to the encoder rat every time the decoder rat performed a trial correctly. Under these conditions, the encoder rats' response latency decreased after the decoder rat made an error (after correct response: 20.67 ± 1.665 seconds and after an incorrect response = 15.26 ± 2.031 seconds; Mann Whitney U = 13570; P < 0.0001). Furthermore, an analysis of the variation in Z-scores, demonstrated that the signal to noise ratio of the neural activity extracted from the encoder rat's M1 increased after the decoder rat committed an error (Chi Square = 4.08, df = 1; P = 0.0434). Thus, both the behavior and neuronal modulations of the encoder rat became dependent on the trial by trial behavioral performance of its dyad partner, the decoder rat.
In experiment 2, we tested whether a BTBI could enable a real-time transfer of tactile information between a pair of rats' brains (Figure 4). Encoder rats (N = 2) were trained to discriminate the diameter of an aperture width with their whiskers17. If the aperture was narrow, rats were required to nose poke on the left side of the chamber, otherwise they had to poke on the right side of the chamber. Decoder rats (N = 5) were trained to poke on the left water port (narrow aperture) in the presence of ICMS and on the right water port (wide aperture) in the absence of ICMS. Similar to experiment 1, the difference between the S1 neuronal ensemble activity, recorded while the encoder rat examined the aperture with its whiskers in each trial and an average template obtained previously, was utilized to create ICMS patterns applied to the decoder rat's S1. We named these ICMS patterns virtual narrow and virtual wide. A total of 120 units and 223 multiunits were recorded in experiment 2.
The BTBI accuracy for tactile information transfer was similar to that observed in experiment 1 (Figure 5 A–B). While encoder rats performed at 96.06 ± 1.14% correct, decoder animals performed somewhat worse but significantly above chance (Percent correct: 62.34 ± 0.59%, range 60 – 64.58%; Binomial test: P < 0.05 in all sessions) (Figure 5 A–B and Figure 6 A–D). In this second experiment, the response latency of encoder rats was 2.66 ± 0.1 seconds, while in decoders the latency was 2.68 ± 0.09 seconds.
To further demonstrate that the accuracy of the decoder rats' performance was based on the ICMS patterns, which in turn were triggered by larger number of spikes produced by S1 neuronal ensembles, we compared the fraction of Virtual Narrow choices with the number of ICMS pulses delivered to the decoder's S1 cortex. Increases in the number of ICMS pulses delivered to the decoder's S1 were associated with a higher fraction of Virtual Narrow choices (≤ 25 pulses: 0.3966 ± 0.04476 correct; >25 pulses: 0.5433 ± 0.02991 correct; Paired samples t-test = 2.321, df = 16, P = 0.0338) (see Figure 5 C and Figure 6 A–D ). Since ICMS patterns were directly derived, through a transfer function, from the neural ensemble activity recorded from the encoder animal's S1 cortex in each trial, this result demonstrates that the decoder rat's correct choices relied on the accuracy of the ICMS pattern in reproducing the number of action potentials generated by the real tactile stimulus information presented to the encoder rat. Feedback information, providing an additional reward to the encoder rat every time the decoder rat performed a trial correctly, also induced changes in the neural activity of the encoder rat. The encoder's latency of response was similar after correct and incorrect trials (After correct = 2.6 ± 0.1 secs; After incorrect = 2.7 ± 0.2 secs; Mann Whitney U = 19790, P = 0.49). However, similarly to the effects observed in experiment 1, the signal to noise ratio of neural activity in S1 also increased after an incorrect trial (Chi Square = 4.2, df = 1; P = 0.0404).
It could be argued that the results reported here could have been obtained if prerecorded signals from encoder rats had been used to guide the behavior of the decoder rats. Qualitative and quantitative observation of the behavior of the animals reveals that this is not at all the case. In both motor and tactile BTBI sessions we observed drastic changes in the behavior of encoder and decoder rats as soon as they started to work as part of a dyad. Both encoder and decoder animals either made quick attempts to respond earlier or, conversely, they reduced their response rate or even stopped performing according to the dyad behavior. Thus, response latencies during motor BTBI sessions were largely increased for encoder animals (encoder training: 14.77 ± 0.9 seconds; encoder BTBI session: 20.06 ± 1.0 seconds; t = 3.975, df = 1170, P < 0.0001) and decreased in decoder rats (decoder training: 16.29 ± 0.6 seconds; decoder BTBI sessions: 13.59 ± 0.5 seconds; t = 3.559, df = 1636, P = 0.0004). During the tactile BTBI sessions the responses latency was reduced in both encoder (encoder training: 5.40 ± 0.6 seconds; encoder BTBI sessions: 2.66 ± 0.1 seconds; Mann-Whitney U = 13960, P < 0.0001) and decoder animals (decoder training: 4.632 ± 0.6 seconds; decoder BTBI sessions: 2.68 ± 0.09 seconds; t = 4.638, df = 12, P = 0.0006) as they started to work as a dyad. Therefore, the dyad performance depended on the nature of the task performed jointly by the animal pair. Likely the increased latencies observed in the motor task reflect the fact that pressing a lever is a learned artificial behavior, while the exploratory nose poking necessary for the tactile task is part of the rats' natural behavioral repertoire. These overall changes in the dyad behavior, irrespective of their direction (e.g. increased or decreased latency), are a clear indicator that a fundamentally more complex system emerged from the operation of the BTBI; one which required considerable adaptation from the participant animals so that they could jointly perform the sensorimotor tasks.
As the ICMS cues were delivered to primary cortical areas that are commonly involved in processing motor and somatosensory information in intact animals, we further asked how the decoder rat's S1 cortex represented both real tactile stimuli, generated by mechanical stimulation of its own facial whiskers and ICMS signals representing the encoder rat's whisker stimulation, during operation of a BTBI. To measure this, we tested pairs of encoder and decoder rats during passive transmission of tactile information via a BTBI, while the whiskers of the encoder and decoder rats were mechanically stimulated. This experiment consisted of two parts: first, the encoder animal was lightly anesthetized and head fixed to an automated whisker stimulator that accurately reproduces the movement and speed at which the whiskers interact with the bars in the active tactile discrimination task (see Methods). The animal's S1 neural activity following each movement of the bars was analyzed in real time and delivered, as an ICMS pattern, to the decoder rat's S1. Meanwhile, the decoder rat remained in an open field in a different room while its S1 neural activity was recorded. After this phase was completed, the decoder animal was also lightly anesthetized and placed in the automated whisker stimulator. This allowed us to determine how the decoder rat's S1 neuronal sample, that responded via the BTBI to the tactile stimuli delivered to the encoder's whiskers, responded to tactile stimuli elicited by passive whisker stimulation of their own vibrissae.
Passive whisker stimulation, in either the encoder or decoder rats, induced significant firing modulations in the decoder rat's S1. These were characterized by clear increases of firing activity occurring immediately after the moving bars touched the whiskers of each animal (see Figure 7 A and B). These significant S1 neuronal responses occurred in 70.91% (39/55 multiunits) of the microwires implanted in the decoder rat's S1, which were used to deliver ICMS patterns through the BTBI and in 93.06% (67/72 multiunits) of the microwires from which S1 neuronal activity was recorded from decoder rats (see Figure 7 B and C). The magnitude of the S1 tactile responses elicited by mechanical stimulation of the decoder rat's facial whiskers was 4.82 ± 0.4 spikes/trial and the duration was 111.4 ± 11 ms. During the BTBI transmission, ICMS of the decoder's S1 induced a significant increase of S1 neurons firing activity lasting for 119.7 ± 20 ms. Due to the microstimulation artifact in the recordings, we focused our analysis on the firing activity increases occurring after the last pulse of microstimulation was transmitted (see red traces Figure 7 C).
Analysis of the data obtained during passive BTBI communication further demonstrated that S1 neurons in the decoder's brain responded differently for each of the virtual tactile stimuli. More than half of the S1 multiunits recorded presented differential firing rates for Virtual Wide and Virtual Narrow stimuli (28/44 = 63.64% multiunits). Also, the Virtual Narrow stimulus was characterized by higher neuronal response magnitudes (Virtual Narrow: 3.861 ± 0.6229 spikes/trial; Virtual Wide: 2.200 ± 1.079 spikes/trial; Wilcoxon sum of ranks = 197; P = 0.0182) and durations (Virtual Narrow: 102.7 ± 16.28 ms; Virtual Wide: 31.54 ± 14.85 ms; Wilcoxon sum of ranks = 200; P = 0.0074). To measure whether the differences in firing rates were due to discrimination or due to an ‘upstate' related to the repeated microstimulation, we also compared which S1 multiunits exhibited different firing rates for Virtual Narrow and Virtual Wide. From the total of S1 multiunits that displayed differences in firing rates for the discrimination period, we found that 35.7% (10/28 multiunits) had no significant differences in the baseline firing rate. Thus, more than one third of the S1 multiunits recorded showed no signs of an ‘upstate' in their baseline due to repeated microstimulation. This supports the hypothesis that after the decoder rats learned to use the BTBI, via ICMS cues, their S1 became capable of accurately representing, processing, storing and recalling information about both the tactile stimuli delivered to its own whiskers, as well as mechanical displacements of the encoders' facial vibrissae.
Finally, to further demonstrate the range of potential operation of our BTBI preparation, we tested whether a long-distance communication of a rat dyad, with the encoder rat performing the tactile discrimination task at the ELS-IINN (Natal, Brazil) and the decoder rat receiving patterns of microstimulation and responding at Duke University (Durham, USA), would be capable of performing the same task. For this, neural activity recorded from S1 of the encoder rat performing the tactile discrimination task was sent via an internet connection and delivered, as an ICMS pattern, to the decoder rat S1 (Figure 8). Even under these extreme conditions, the BTBI was also able to transfer in real-time behaviorally meaningful neuronal information. Although the mean time of data transmission observed in this long-distance BTBI was increased from 20 ms (during transmission in our Duke lab) to 232 ± 217.5 ms, a similar number of correct responses was found (short distance transmission: 62.34 ± 0.59%; long distance transmission: 62.25% ± 0.71) in 26.5 ± 0.5 trials in the decoder animals.
The present study demonstrates for the first time that tactile and motor information, extracted in real time from simultaneously recorded populations of cortical neurons from a rat's brain, can be transmitted directly into another subject's cortex through the utilization of a real-time BTBI. Operation of a BTBI by an encoder-decoder rat dyad allowed decoders to rely exclusively on neural patterns donated by encoders in order to reproduce the encoder's behavioral choice. ICMS patterns reflecting the number of action potentials recorded from either the encoder rat's M1 or S1 during a single trial were sufficient for decoder rats to repeatedly perform two different tasks, significantly above chance levels, in real-time. Interestingly, half of the number of pulses used to stimulate the decoder's M1 were sufficient to successfully deliver a message to the decoder's S1 cortex, suggesting that primary sensory cortical areas may have a lower threshold to operate a BTBI.
We also demonstrated that operation of a BTBI induced differential patterns of activation in the decoder rat's S1. Thus, the same S1 neurons that responded to the mechanical stimulation of the decoder rat's own whiskers were capable of representing information derived from stimulation of the encoder rat's whiskers via the BTBI.
Additionally, continuous operation of the BTBI also affected the behavior and neural activity of the encoder rat, which was able to reduce its response latency and increase the signal/noise ratio of its S1/M1 neuronal activity in response to an error by the decoder rat. As far as we can tell, these findings demonstrate for the first time that a direct channel for behavioral information exchange can be established between two animal's brains without the use of the animal's regular forms of communication. Essentially, our results indicate that animal brain dyads or even brain networks could allow animal groups to synchronize their behaviors following neuronal-based cues.
Successful BTBI operation required four simultaneous conditions to be present: first, the encoder animals had to achieve a very high level of performance in both tasks. As proof, only one successful BTBI session was obtained when the encoder rat's performance was below 80%. Second, recordings from the encoder's cortex had to yield stable neural ensemble activity which was highly correlated to the behavior that needs to be encoded by the BTBI. Note that successful BTBI operation was achieved using information collected from random ensembles of neurons dispersed within each cortical area. This finding indicates that information was not anatomically segregated either in S1 or in M1. Third, the midpoint of the sigmoid transfer function (which was set at the beginning of the session) had to closely match the midpoint of the neural function that represented the two stimuli/actions. We found that such a midpoint tended to be the same for each cortical region, suggesting that groups of neurons with similar physiological profiles were recorded in most cases. Fourth, our results showed that both encoder and decoder rats changed their behavior according to the dyad performance. This observation suggests that operation of a BTBI induces the establishment of a highly complex system, formed by a pair of interconnected brains. As such, this brain dyad behaved in a way that could not be predicted if only pre-recorded neural signals had been used for encoding purposes. We speculate that the description of the complex system generated by the dyad transferring information and collaborating in real time, will reveal fundamental properties about the neural basis of communication and social interactions18,19.
Although we have shown accurate transfer of brain-derived motor and sensory information through a BTBI, it remains to be explained how the brain simultaneously integrates information generated by direct ICMS and by natural stimuli (e.g. real whisker stimulation). Previous studies in rhesus monkeys have shown that the brain is able to decode highly complex ICMS patterns in a single trial7. Specifically, it has been shown that a brain-machine-brain control loop allows for continuous update of information in the S1 cortex, while a monkey explores a virtual tactile stimulus. The effects of a neuroprosthetic's operation on cortical neuronal responses have also been studied in the representation of the rat forelimb sensorimotor cortex, where it was shown that information flow can be altered by S1 microstimulation20,21,22. Lastly, a recent study has shown that the ability to use a BMI is mediated by the striatum in mice4. Altogether, this body of evidence supports the notion that continuous use of ICMS to deliver information to the brain is associated with plastic changes in neuronal ensemble responses in cortical and subcortical regions. The data obtained here during passive BTBI operation supports this conclusion by showing that as animals learned to use the microstimulation cues, differential patterns of S1 neuronal responses emerged for each of the virtual tactile stimuli. This finding is consistent with our previous observation that S1 neurons undergo significant functional plasticity during the period in which rats learn a tactile discrimination task23. Accordingly, our results further suggest that successful BTBI operation is fundamentally linked to the ability of S1 ensembles to undergo plastic reorganization in response to microstimulation patterns24.
Altogether, the results described here indicate that the channel capacity (amount and precision of information, bandwidth) and the dynamic properties of cortical neuronal ensembles are the two major determinants of the amount and quality of information that can be transferred between animal brains via a BTBI. Thus, beyond the neurobiological challenge of understanding how the brain integrates natural and virtual stimuli, a second class of problems directly related to the characteristics of the BTBI as a channel for information transfer must be addressed. In general terms, the BTBI can be described as a discrete noisy channel, meaning “a system whereby a sequence of choices from a finite set of elementary symbols S1; : : : ;Sn can be transmitted from one point to another ”25. The limit for the amount of information that can be transferred by unit of time (i.e. capacity)25 is currently unknown for a BTBI channel. In the tasks used here, the minimum and maximum inputs depended on the range of the firing rate in the neurons used, while the output depended mostly on the electrical microstimulation threshold of cortical ensembles in the decoder's brain. However, channel capacity can be increased while still using the rationale described in Figure 1 (neural data - transfer function – stimulation delivery). For example, it will be important to test in the future the effect of other types of inputs (e.g. larger neuronal ensembles; Local Field Potentials), transfer functions (e.g. exponential, linear, step functions) and outputs (e.g. one versus several pairs of microelectrodes used for ICMS, disposed in 2D or 3D cortical space, delivering photostimulation instead of electrical current) on the overall dyad performance. In this context, we expect that the use of newly introduced microelectrode cubes, created in our laboratory, that spread across 3D cortical space, to deliver spatiotemporal patterns of information from the encoder's brain to the decoder's will provide a significant increase in BTBI bandwidth, likely leading to a substantial improvement in the overall animal dyad performance.
Lastly, it is important to stress that the topology of BTBI does not need to be restricted to one encoder and one decoder subjects. Instead, we have already proposed that, in theory, channel accuracy can be increased if instead of a dyad a whole grid of multiple reciprocally interconnected brains are employed. Such a computing structure could define the first example of an organic computer capable of solving heuristic problems that would be deemed non-computable by a general Turing-machine. Future works will elucidate in detail the characteristics of this multi-brain system, its computational capabilities and how it compares to other non-Turing computational architectures26.
All animal procedures were performed in accordance with the National Research Council's Guide for the Care and Use of Laboratory Animals and were approved by the Duke University Institutional Animal Care and Use Committee. Long Evans rats weighing between 250–350 g were used in all experiments.
Motor brain-to-brain interface
The behavioral motor task consisted of a dark operant chamber equipped with two levers, one LED (Light Emitting Diode) above each lever and, on the opposite wall, a water reward port. Animals were trained to press one of two levers, cued by an LED turned on at the beginning of each trial. A correct choice opened the reward port and allowed brief access to water (300 ms). When animals reached stable performances above 80% correct choices they were assigned either to an encoder or decoder group. The operant chamber configuration remained similar in both the encoder and the decoder groups. Animals assigned to the encoder group were implanted with recording arrays of 32 microelectrodes in the primary motor cortex and after recovery resumed the initial training scheme. Animals assigned to the decoder group were implanted with arrays of 4 to 6 microstimulation electrodes in the primary motor cortex and were further trained to associate the presence of electrical microstimulation pulses with the correct lever press. Extra training followed, with a sequence of 60 to 100 pulses indicating a correct choice in the right lever while the absence of microstimulation pulses (1 pulse) indicated a correct left lever choice. During the electrical microstimulation training phase a trial started with a brief period of white noise, followed by the electrical microstimulation cue. Immediately after this cue both LEDs were turned on. If a correct choice was made the reward port would open and the animal was allowed a brief period of access to water (300 ms), otherwise both LEDs were turned off and the intertrial interval started.
When decoder animals reached stable performances above chance, brain-to-brain interface (BTBI) sessions with motor activity were performed. These sessions were composed of three different phases: 1) identification of cells accurately encoding the motor action performed, 2) data collection for template trials during a rat-to-brain mode and, 3) brain-to-brain interface using real-time analysis followed by electrical microstimulation. There were no setup differences between the rat-to-brain mode and the brain-to-brain interface. The only difference between these two conditions was that in the rat-to-brain mode the patterns of microstimulation depended on the behavior of the encoder animal, while during the brain-to-brain interface mode the patterns of microstimulation depended solely on the neural activity of the encoder rat.
Neural activity was first studied in encoder animals performing the behavioral task to identify units that accurately encoded for the motor activity associated with each lever press. During the rat-to-brain mode the operant chambers remained as in the training phase, however the presence of a correct choice in the encoder operant chamber activated the pattern of electrical microstimulation cue corresponding to the same lever on the decoder animal operant chamber. A correct choice by the decoder rat was signaled by a tone and both encoder and decoder animals were allowed a brief period of access to water. The goal of this phase was to create a template trial based on the neural activity of the encoder rat pressing one of the levers in several trials.
During the brain-to-brain interface mode the number of action potentials in each trial was compared to the template trial and the Zscore of the difference between them was used to determine the number of pulses present in the pattern of microstimulation. A sigmoid function was used to transfer the Zscore value to the number of pulses present in the microstimulation pattern. A higher Zscore was associated with an increased number of pulses in the microstimulation cue (i.e. right lever) while a lower Zscore was associated with a decreased number of pulses in the microstimulation cue (e.g. left lever).
Active tactile brain-to-brain interface
Mildly water deprived animals were trained to perform a behavioral discrimination task as previously described17. Briefly, this task required animals to discriminate between a wide or narrow aperture in order to receive a water reward. The animal was placed in the behavioral box compartment where it waited for the central door to open and allow access to the second compartment, the inner chamber. After the animal entered the inner chamber, it had to pass through the variable width discrimination bars and then nose poke the center of the front wall. The nose poke in the inner chamber opened two water reward pokes located in the outer chamber from which the animal had to select one. The reward poke on the right corresponded to the wide aperture, whereas the poke on the left corresponded to the narrow aperture. As the animal chose from one of the reward pokes, the door separating the inner and outer chambers closed. Correct responses were rewarded by 50 μl water rewards. Incorrect responses were followed by immediate closing of the reward pokes. The percent of trials performed correctly was used as a measure of tactile discrimination.
Animals were then evenly assigned to encoder or decoder groups. Encoder animals (n = 2) were implanted with recording arrays of 32 microelectrodes in the right S1 and after recovery resumed the initial training scheme. Animals assigned to the decoder group were implanted with arrays of six microstimulation electrodes in the right S1 (n = 7). In six decoder animals, recording electrode arrays were also implanted either in the right (N = 1) or in the left S1 (N = 5). After recovering from surgery decoder animals were further trained to associate the presence of electrical microstimulation pulses with the correct lever press. Extensive training followed, with a sequence of 50 pulses indicating a correct choice in the left reward poke while the absence of microstimulation pulses (1 pulse) indicated a correct choice in the right reward poke. Decoder animals were required to identify the microstimulation cue and associate it with a behavioral response in one of the reward pokes. A brief tone indicated the beginning of the trial immediately followed by the microstimulation cue. After a period of 500 ms both reward pokes would open and the rat was required to make a response in one of the photo beams. A correct choice was followed by a brief tone and access to water. When decoder animals reached stable performances of > 65% correct trials for 3 consecutive sessions, tactile BTBI sessions began.
Neural activity was first studied in encoder animals performing the behavioral task to identify units that accurately encoded for the tactile stimuli associated with sampling the width between bars. During the rat-to-brain mode the operant chambers remained as in the training phase, however the microstimulation cue presented to the decoder animal always matched the stimulus presented to the encoder animal. After a correct response by the encoder rat, a brief tone followed by a microstimulation cue of 1 or 50 pulses was sent to the decoder animal and both reward ports in the second chamber would open. If the decoder rat accurately discriminated the microstimulation cue both rats were rewarded. During the brain-to-brain interface mode the neural activity of the encoder rat was analyzed from the moment that the rat broke the discrimination bars photo beam to the moment that the rat broke the photo beam in the center poke. The number of action potentials found in this interval was then counted and compared to the distribution of the Zscores relative to the spikes present in all the previous Wide trials. A Zscore was determined and transferred using a sigmoid function, into the number of pulses present in the pattern of microstimulation.
Passive tactile brain-to-brain interface
The encoder animal was anesthetized and remained head fixed in one room, while the decoder rat was in an open field in a different location with the neural activity also being recorded. The encoder rats' whiskers were then stimulated by a set of moving bars that accurately reproduce the dynamics observed in the active tactile width discrimination task14. The bars were set up for Wide or Narrow widths and, for each width, the head fixed animal was stimulated for approximately 6 minutes at 0.3 Hz. Neural activity was first analyzed in real time and units with clear whisker related activity were used for the session. To establish a baseline distribution; an initial group of 100 wide stimulus trials was recorded. Then the passive brain-to-brain interface mode started. The encoders' whiskers were stimulated by the moving aperture corresponding to a Wide stimulus. Meanwhile the number of action potentials recorded from the encoder animal was counted. The number of action potentials was compared to the distribution of action potentials found at the baseline at the beginning of the session and a Zscore was calculated. This Zscore was transferred into the number of pulses to be used in the microstimulation using a sigmoid function. The decoder rat then received the pattern of microstimulation derived from the sigmoid function. Immediately after the encoder animal had been passively stimulated with both Wide and Narrow widths, the decoder animal was anesthetized, head fixed and its whiskers were passively stimulated with the same Wide and Narrow stimuli as the encoder animal.
Surgery for microelectrode array implantation
Fixed or movable microelectrode bundles or arrays of electrodes were implanted in the M1 and S1 of rats. Craniotomies were made and arrays lowered at the following stereotaxic coordinates for each area: S1 [(AP) −3.0 mm, (ML), +5.5 mm (DV) −0.7 mm], M1 [(AP) +2.0 mm, (ML) +2.0 mm, (DV) −1.5 mm].
A Multineuronal Acquisition Processor (64 channels, Plexon Inc, Dallas, TX) was used to record neuronal spikes, as previously described27. Briefly, differentiated neural signals were amplified (20000–32,000×) and digitized at 40 kHz. Up to four single neurons per recording channel were sorted online (Sort client 2002, Plexon inc, Dallas, TX ). Online sorting was validated offline using Offline Sorter 2.8.8 (Plexon Inc, Dallas, TX).
Intracortical electrical microstimulation
Intracortical electrical microstimulation cues were generated by an electrical microstimulator (Master 8, AMPI, Jerusalem, Israel) controlled by custom Matlab script (Nattick, USA) receiving information from a Plexon system over the internet. Patterns of 1–100 (bipolar, biphasic, charge balanced; 200 μsec) pulses at 400 Hz (motor BTBI) or 250 Hz (tactile BTBI) were delivered to the cortical structures of interest (M1 and S1 respectively). Current intensity varied from 38–200 μA (motor BTBI) and 30–240 μA (tactile BTBI).
For both behavioral tasks the number of correct responses was used as a measure of behavioral performance. We also analyzed the animals' response latency as a measure of independency between the performance of each animal alone or in a dyad.
Neuronal data were processed and analyzed using Neuroexplorer (version 3.266, NEX Technologies) and custom scripts written in Matlab (7.9.0, Mathworks, Natick, MA). Statistical significance of neural responses was evaluated using a method based on cumulative-summed spike counts28,29. Comparisons of characteristics of neural responses for different conditions were performed using non-parametric tests (Mann-Whitney-Wilcoxon or Kruskal-Wallis). Signal-to-noise ratio of neural responses was calculated as the proportion of responses, occurring after a correct or incorrect decoder response, that presented Zscore absolute values above 0.3 standard deviations. This specific value was used because it corresponded to the midpoint of the sigmoid curve). Statistical significance was determined using a chi square test for proportions.
Hartley, R. V. L. Transmission of Information. Bell Technical Journal, 535–564 (1928).
Jackson, A. & Zimmermann, J. B. Neural interfaces for the brain and spinal cord-restoring motor function. Nat Rev Neurol 8, 690–699 (2012).
Ethier, C., Oby, E. R., Bauman, M. J. & Miller, L. E. Restoration of grasp following paralysis through brain-controlled stimulation of muscles. Nature 485, 368–371 (2012).
Koralek, A. C., Jin, X., Long, J. D., 2nd, Costa, R. M., Carmena, J. M. Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skills. Nature 483, 331–335 (2012).
Lebedev, M. A. et al. Future developments in brain-machine interface research. Clinics (Sao Paulo) 66 Suppl 1, 25–32 (2011).
Moritz, C. T., Perlmutter, S. I. & Fetz, E. E. Direct control of paralysed muscles by cortical neurons. Nature 456, 639–642 (2008).
O'Doherty, J. E., Lebedev, M. A., Li, Z. & Nicolelis, M. A. Virtual active touch using randomly patterned intracortical microstimulation. IEEE Trans Neural Syst Rehabil Eng 20, 85–93 (2012).
Venkatraman, S. & Carmena, J. M. Active sensing of target location encoded by cortical microstimulation. IEEE Trans Neural Syst Rehabil Eng 19, 317–324 (2011).
O'Doherty, J. E. et al. Active tactile exploration using a brain-machine-brain interface. Nature 479, 228–231 (2011).
Vato, A. et al. Shaping the dynamics of a bidirectional neural interface. PLoS Comput Biol 8, e1002578 (2012).
Chapin, J. K., Moxon, K. A., Markowitz, R. S. & Nicolelis, M. A. Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat. Neurosci. 2, 664–670 (1999).
Laubach, M., Wessberg, J. & Nicolelis, M. A. Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task. Nature 405, 567–571 (2000).
Ghazanfar, A. A., Stambaugh, C. R. & Nicolelis, M. A. Encoding of tactile stimulus location by somatosensory thalamocortical ensembles. J. Neurosci. 20, 3761–3775 (2000).
Krupa, D. J., Wiest, M. C., Shuler, M. G., Laubach, M. & Nicolelis, M. A. Layer-specific somatosensory cortical activation during active tactile discrimination. Science 304, 1989–1992 (2004).
Nicolelis, M. A. Beyond Boundaries: The New Neuroscience of Connecting Brains with Machines and How It Will Change Our Lives. (Times Books, 2010).
Fitzsimmons, N. A., Drake, W., Hanson, T. L., Lebedev, M. A. & Nicolelis, M. A. Primate reaching cued by multichannel spatiotemporal cortical microstimulation. J. Neurosci. 27, 5593–5602 (2007).
Krupa, D. J., Matell, M. S., Brisben, A. J., Oliveira, L. M. & Nicolelis, M. A. Behavioral properties of the trigeminal somatosensory system in rats performing whisker-dependent tactile discriminations. J. Neurosci. 21, 5752–5763 (2001).
Hasson, U., Ghazanfar, A. A., Galantucci, B., Garrod, S. & Keysers, C. Brain-to-brain coupling: a mechanism for creating and sharing a social world. Trends Cogn Sci 16, 114–121 (2012).
Mattout, J. Brain-computer interfaces: a neuroscience paradigm of social interaction? A matter of perspective. Front Hum Neurosci 6, 114 (2012).
Rebesco, J. M. & Miller, L. E. Stimulus-driven changes in sensorimotor behavior and neuronal functional connectivity application to brain-machine interfaces and neurorehabilitation. Prog. Brain Res. 192, 83–102 (2011).
Rebesco, J. M., Stevenson, I. H., Kording, K. P., Solla, S. A. & Miller, L. E. Rewiring neural interactions by micro-stimulation. Front Syst Neurosci 4 (2010).
Talwar, S. K. et al. Rat navigation guided by remote control. Nature 417, 37–38 (2002).
Wiest, M. C., Thomson, E., Pantoja, J. & Nicolelis, M. A. Changes in S1 neural responses during tactile discrimination learning. J. Neurophysiol. 104, 300–312 (2010).
Recanzone, G. H., Merzenich, M. M. & Dinse, H. R. Expansion of the cortical representation of a specific skin field in primary somatosensory cortex by intracortical microstimulation. Cereb. Cortex 2, 181–196 (1992).
Shannon, C. E. The Mathematical Theory of Communication. (University of Illinois Press, 1949).
Siegelmann, H. T. Computation beyond the turing limit. Science 268, 545–548 (1995).
Nicolelis, M., Stambaugh, C., Brisben, A. & Laubach, M. in Methods for Neural Ensemble Recordings (ed M. A. Nicolelis) 121–156 (CRC Press, 1999).
Gutierrez, R., Carmena, J. M., Nicolelis, M. A. & Simon, S. A. Orbitofrontal ensemble activity monitors licking and distinguishes among natural rewards. J. Neurophysiol. 95, 119–133 (2006).
Wiest, M. C., Bentley, N. & Nicolelis, M. A. Heterogeneous integration of bilateral whisker signals by neurons in primary somatosensory cortex of awake rats. J. Neurophysiol. 93, 2966–2973 (2005).
The authors would like to thank Jim Meloy for outstanding electrode manufacturing; Laura Oliveira, Susan Halkiotis and Edgard Moria for miscellaneous assistance and Eric Thomson and Hao Zhang for thoughtful comments on experiments and manuscript. This work was supported by NIH R01DE011451 and by a National Institute of Mental Health award DP1MH099903 to MALN; Fundação BIAL 199/12 and also by the Program for National Institutes of Science and Technology and the National Council for Scientific and Technological Development CNPq/MCTI/INCT-INCEMAQ 610009/2009-5; Financiadora de Estudos e Projetos FINEP 01.06.1092.00, Fundação de Amparo a Pesquisa do Rio Grande do Norte FAPERN 01/2011. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
The authors declare no competing financial interests.
About this article
Cite this article
Pais-Vieira, M., Lebedev, M., Kunicki, C. et al. A Brain-to-Brain Interface for Real-Time Sharing of Sensorimotor Information. Sci Rep 3, 1319 (2013). https://doi.org/10.1038/srep01319
Scientific Reports (2021)
Nature Biomedical Engineering (2021)
Scientific Reports (2020)