Operant boxes enable the application of complex behavioural paradigms to support circuit neuroscience and drug discovery research. However, commercial operant box systems are expensive and often not optimised for combining behaviour with neurophysiology. Here we introduce a fully open-source Python-based operant-box system in a 5-choice design (pyOS-5) that enables assessment of multiple cognitive and affective functions. It is optimized for fast turn-over between animals, and for testing of tethered mice for simultaneous physiological recordings or optogenetic manipulation. For reward delivery, we developed peristaltic and syringe pumps based on a stepper motor and 3D-printed parts. Tasks are specified using a Python-based syntax implemented on custom-designed printed circuit boards that are commercially available at low cost. We developed an open-source graphical user interface (GUI) and task definition scripts to conduct assays assessing operant learning, attention, impulsivity, working memory, or cognitive flexibility, alleviating the need for programming skills of the end user. All behavioural events are recorded with millisecond resolution, and TTL-outputs and -inputs allow straightforward integration with physiological recordings and closed-loop manipulations. This combination of features realizes a cost-effective, nose-poke-based operant box system that allows reliable circuit-neuroscience experiments investigating correlates of cognition and emotion in large cohorts of subjects.
Operant boxes are an important tool for pre-clinical drug discovery and biological psychiatry, enabling the use of well-controlled psychological tests that have been adapted for rodents from their human counterparts1,2. However, commercial operant box systems have several disadvantages. High cost constrains the ability to scale up cohort sizes and hence the efficient use of experimenter time. Their mechanical design is often not optimised for neurophysiology, for example they often feature relatively deep recesses for poke holes and reward receptacles, which are poorly suited for testing implanted and tethered animals. Box designs are also rarely optimized for rapid turn-over of animals, due to the use of metal grid floors and layouts that take significant amount of time to clean after testing.
We here introduce an open source Python-based operant-box system that realizes a versatile 5-choice layout (pyOS-5) and improves on current commercial systems, including reducing cost by ca. 80–85%, depending on the sourcing of individual parts. A 5-hole design was chosen because it allows the implementation of a wide variety of established tasks2,12,13,19 due to the large number of potential stimulus configurations and the low probability to obtain rewards by chance-level performance. Additionally, we designed a sound-insulating outer cubicle, peripheral circuit boards for operation, and low-cost peristaltic and syringe pumps for reward delivery. Complementing the hardware, we provide an open-source graphical user interface (GUI) specialised for running several tasks on the 5-choice setup and for automatically extracting commonly used behavioural metrics from the data. Within the emerging field of low-cost open-source operant box systems3,4,5,6 and software to control operant experiments7,8,9, our system is designed with a particular focus on the end-user, meeting five core demands: (1) Plug’n play set-up due to maximum integration of dedicated hardware and software components, (2) easy operation without requiring programming skills, (3) fast turn-over times between animals and direct extraction of both aggregated and millisecond time-resolved data, (4) optimal suitability of the box design, electronic interfaces, and software for simultaneous neurophysiological recordings and manipulations, and (5) low cost (well below < 1000 EUR per box) without any reliance on proprietary hardware or software.
The pyOS-5 setup builds on pyControl, an open source system for controlling behavioural experiments, documented in a separate publication10 and at https://pycontrol.readthedocs.io. Briefly, pyControl provides users with flexible Python based syntax for defining tasks, and hardware for constructing operant setups. pyControl hardware comprises a breakout board and peripheral devices. The breakout board interfaces an Arm Cortex based Pyboard microcontroller with a set of ports and connectors. Peripheral devices connect to the breakout board via standard network cables (RJ45, 8-pin ethernet) and are used to construct behavioural setups. Peripherals either have a dedicated printed circuit board (PCB) to control them (pump, speaker, optogenetic LED) or constitute a PCB themselves (poke-hole arrays). For the 5-choice box, we developed a PCB integrating 5 infra-red break-beam sensors and 5 stimulus LEDs, used for the nose-poke ports on the 5 choice wall (part number py.026, Supplementary Table 1). Other pyControl devices used in the setup include a single nose-poke board used for the reward receptacle, a stepper motor controller board for the reward delivery pump, a special connector (pass-through adaptor) to breakout lines for other peripherals like a house-light, fan, or camera, or for TTL-signaling lines, and an audio board to play auditory stimuli (see Supplementary Table 1 for all PCBs used, Fig. 1a for their design and principal wiring). An LED driver board to control implanted LEDs for optogenetic modulation may also be added (Fig. 1)11. All pyControl hardware used for pyOS-5 is commercially available through the Open-Ephys store (http://www.open-ephys.org/store) at low cost (ca. 500 EUR per box), with design files available in the pyControl hardware repository (https://github.com/pyControl).
Additionally, IR capable CCTV-cameras were used to monitor animal behaviour through a CCTV system (Hikivision DVR HYB 5MP DS-7208HUHI-K1, 8 channel; or AVEESA HD-116 Pro H.264 DVR, 16 channel, iCCTV, Manchester, UK; Fig. 2f). Cameras were powered either from the pyControl breakout board or through separate power supplies.
Open-source pumps for reward delivery
Use of liquid rewards requires accurate and reliable dispensing of small volumes of fluid. If commercially available peristaltic or syringe pumps were used, they would be a main cost driver during the acquisition of a custom-made operant box set-up. Solenoid valves can be used to deliver water rewards10,11, but are unsuitable for liquids with nutritional content as their remnants would lead to their rapid deterioration. Several solutions have been developed to deliver rewards in appetitively motivated rodent tasks, including pellet dispensers for sucrose pellets, dippers driven by solenoids (e.g. ENV-302R-S from Med Associates Inc., US), and syringe pumps (e.g. PHM-100A, Med Associates). Pellet dispensers and dippers have the advantage of imposing less effort for cleaning after testing but have the disadvantage of delivering only one size of reward, which is not useful for tasks like the 5-choice spatial working memory task (5CSWMT)12 or various probabilistic decision making tasks11 that use distinct reward sizes in different task phases. Pumps, by contrast, allow varying reward sizes but demand more cleaning at the end of the training day.
We developed pump designs that can all be driven by the same low-cost bipolar 2-phase 4-wire stepper motor (< 15 EUR; Supplementary Table 2), controlled by the same stepper motor driver board (py.022, Supplementary Table 1): two syringe pumps and a peristaltic pump (Fig. 2a–c; design files available at https://github.com/KaetzelLab/Operant-Box-Design-Files). The two syringe pumps differed in that one of them followed a classical design using solely metal parts (costing around 300 EUR including labour for machining), while the other incorporates 3D-printed parts for the complete frame except for the central metal jack and its coupling elements (lowering costs to ca. 65 EUR). The peristaltic pump solely deploys 3D-printed parts (Fig. 2a,b) screwed to the stepper motor, making it the most cost-effective (ca. 25 EUR including the motor).
We first investigated the precision of all three pumps when repetitively delivering approximately 20 µl of water, and compared this to a commercially available syringe pump used in operant box set-ups (PHM-100A, Med Associates). Dispensed water volumes were determined with a precision weighing balance (Quintix® 224-1S, Sartorius Lab Instruments GmbH, G). The custom-made syringe pumps did not appear to exceed their commercial counter-part in terms of variance of the delivered volumes, and the peristaltic pump showed the least variability of volumes dispensed over 15 deliveries (range of coefficients of variation across all pumps of one type (CV): peristaltic pumps, 2.5–6.0%; 3D-printed syringe pumps, 3.3–4.2%; metal syringe pumps: 9.0–11.4%; commercial metal syringe pumps: 11.1–13.9%; Supplementary Fig. 1).
To scrutinize this preliminary conclusion, we repeated the experiment with three different delivery volumes (20, 80 and 180 µl) and re-tested the delivered volumes of the two low-cost (3D-printed) pumps after a simulated 30 d operation with 6 sessions per day (24′000 individual deliveries, one performed every 3 s). With the exception of one peristaltic pump where the two volumes differed at the 180 µl volume (but not at lower volumes), no statistically significant differences in delivered volumes were detected, suggesting a reasonable temporal stability of the set delivery volumes over time (Fig. 2d). To quantify the qualitatively observed differences in the variability of individual delivery volumes between pumps (Supplementary Fig. 1, Fig. 2d), we converted every volume into the absolute value of its difference to the group mean across all pumps of each type. At all three delivery volumes, the average difference to the group mean observed at individual deliveries was lower with the peristaltic pump than with at least one of the metal-based syringe pumps; and likewise, the 3D-printed syringe pump was more precise than its metal counterparts at the low and medium volume (Fig. 2e–g). This performance of custom-made pumps opens the possibility for cost-effective reward delivery solutions that can be easily integrated into any operant system using low-cost microcontrollers.
Design of the 5-choice operant box
A 5-choice design (Fig. 3a) was chosen to take advantage of the many behavioural paradigms that have been implemented with this layout, including assays for attention, perseveration and motor impulsivity, using the classical 5-choice serial reaction time task13 or the related continuous performance test14,15, but also decision impulsivity16,17,18, rule-shift learning19, working memory12, and motivation2. The operant box can also be modified by replacing the 5-choice wall (plastic components and 5-poke PCB) with a different layout such as a 2 + 2 design11. The 5-choice wall also mounts a speaker for auditory stimulation (Fig. 3a; see Supplementary Video 1 for operant box assembly process).
We implemented a set of design considerations detailed in Table 1 (see also Fig. 3a–j). Design files for all plastic components of the operant box can be downloaded from https://github.com/KaetzelLab/Operant-Box-Design-Files. They were manufactured by CNC machining, laser cutting, or 3D printing, as indicated in the design files. The main Perspex and PVC components were fabricated in-house using CNC-machining and drilling. Perspex acrylic panels (5 mm white, Opal030 and Opal050) that served as light attenuators and spacers placed between the 5- and single-poke PCBs and the inner wall of the operant box were obtained from CutLaserCut (Camberwell, UK). A further spacer for the 5-poke PCB (preventing direct contact between LED and Opal-layer) were generated by 3D-printing. See Supplementary Video 1 and the Supplementary Construction Guide for illustrated step-by-step instructions.
Design of the outer box
The outer enclosure enables tight control over visual and auditory stimulation and background (Fig. 3g,h). The outside walls also mount PCBs and cabling to control the peripherals, the peristaltic pump and reward container (Fig. 3i,j), while the inner ceiling holds a CCTV camera to monitor behaviour online (Fig. 3k). 19 mm sealed MDF was used as wall material to provide basic sound insulation, but the size of the box also permits sound-absorbing material of 30–50 mm thickness to be applied to all six inner walls if needed. The box size was chosen to allow efficient use of lab space (e.g. permitting the stacking of 4 boxes above one another in racks; Fig. 3h), while also being high enough to provide flexibility for optical fibres or cables tethered to animals (Fig. 3d,e,g). Design drawings are available from https://github.com/KaetzelLab/Operant-Box-Design-Files.
Design of the graphical user interface
We developed a graphical user-interface (GUI, Fig. 4a,b; freely available from https://github.com/KaetzelLab/Operant-Box-Code) specifically for the pyOS-5 boxes. This GUI was created using Qt Designer (https://www.qt.io/) and inherits most of its key functions from the pyControl framework and its own generic GUI10. While the generic pyControl GUI10 is designed to provide maximum flexibility for controlling arbitrary behavioural assays, the pyOS-5 GUI is specialised for use with specific 5-choice based tasks, and provides dedicated functionality to extract task-specific performance measures for online monitoring and subsequent offline analysis. The behavioural hardware is compatible with both GUI’s, and both use the same Python-based task definition files, facilitating reproducibility and communication of task logic10. Both GUIs allow different subjects to be run on different task configurations in parallel, but the primary mechanism for this in the pyOS-5 GUI is specifying different task files for each subject, whereas the pyControl GUI primarily uses task variables for this.
We provide ready-to-use scripts for a wide range of behavioural tasks including all common training stages and challenge protocols of the 5-CSRTT13,19, the continuous performance test15, the 5-choice delayed-matching-to-position operant spatial working memory (5-CSWM) task12 and a 2-choice delayed-non-matching-to-position version of it, and a rule-shift task19 (available from https://github.com/KaetzelLab/Operant-Box-Code). One GUI window can control up to 8 boxes, and as many GUI windows as necessary can be opened and run in parallel in order to control large set-ups (we use a 24-box set-up, controlled from three GUI windows). In the pyOS-5 GUI all relevant task performance parameters are continuously updated to monitor animal behaviour online (Fig. 4b). At the end of a session, the final values of all parameters relevant for a given task paradigm can be directly and quickly exported as csv-file. In addition, a further results csv-file is generated that records every single event (e.g. nose-poke into a specific hole, delivered stimulus or reward) with its time-stamp to enable easy analysis of detailed trial-by-trial behaviour. This also allows the offline correlation of individual behavioural events with activity traces gained from simultaneous physiological measurements (e.g. miniscope imaging or electrophysiological recordings) during later analysis in a separate software (see below).
Animals and behavioural testing
All experiments were approved by the Federal Ethical Review Committee (Regierungsprädsidium Tübingen) of Baden-Württemberg (licence numbers TV1344 and 1399), performed in accordance to the German Animal Rights Law (Tierschutzgesetz) 2013 and are reported in accordance with the ARRIVE guidelines. Animals were group-housed (3–5 mice per cage) in Type II-Long individually ventilated cages (Greenline, Tecniplast, G), enriched with sawdust, sizzle-nest™, and cardboard houses (Datesand, UK), and subjected to a 13 h light/11 h dark cycle. Mice were kept under food-restriction at 85–95% of their average free-feeding weight which was measured over 3 d immediately prior to the start of food-restriction at the start of the behavioural training. Water was available ad libitum. In this manuscript, we present data from five cohorts that were subsequently used for other studies. Four cohorts were trained on the 5-CSRTT, and one on the 5-CSWM task (see below and Supplementary Fig. 2 for time lines of experiments). The first cohort of 18 male C57BL/6 J mice, aged 12–13 weeks at the beginning of training was used for initial testing and validation of the system (cohort 1). Secondly, two cohorts of 20 (cohort 2) and 37 (cohort 3), respectively, male B6.FVB(Cg)-Tg(Rbp4-cre)KL100Gsat/Mmucd (Rbp4-Cre) mice20 (maintained on a C57BL/6J background) were used to compare task acquisition on the pyOS-5 system with a commercial system. These were trained by the same experimenter and according to the same 5-CSRTT training schedule, starting at the age of 2–7 months, in either the pyOS-5 system (cohort 2) or an equivalent commercial nose-poke-based system (ENV-307A-CT with ENV-115C-A 5-choice wall; Med Associates, Inc., US; cohort 3). The remaining cohorts were used to assess compatibility of the system with optogenetic manipulations and physiological recordings. Four male C57BL/6J mice (cohort 4) were pre-trained in the 5-CSRTT, then transfected into the dorsal hippocampus (dHC) with an AAV8-vector containing either a CamKIIα-Jaws-GFP or a CamKIIα-ArchT-GFP construct (2 mice each; UNC vector core), implanted with an 200 µm diameter fibre-optic cannula (ThorLabs, UK) into the right dHC, and with two single polyimide-insulated tungsten wires (50 µm diameter, Wiretronic, USA) into the right prefrontal cortex (PFC, AP + 1.7–105 1.8 mm, ML + 0.25–0.35, 1.7–1.9 mm below pia) and dHC (AP −2 mm, ML + 1.5 mm, −1.3 mm below pia); a reference wire (120 μm) was implanted above the left frontal cortex, and a ground screw above the left cerebellum; implants were secured using self-adhesive resin cement (Breeze™ Pentron clinical, US). After two weeks of recovery on free food, mice commenced with 5-CSRTT training and were used for testing with a fibre-optic tether (200 µm core, ferrule-sleeve connector, Thorlabs, GB) and optogenetic modulation using continuous illumination at ~ 3.5 mW with either a 532 nm DPSS laser (for ArchT) or a 635 nm diode-laser (for Jaws; both CNI Lasers, CN). A separate cohort of 11 wild-type mice (cohort 5) was trained in the 5-CSWM task21, implanted with polyimide-insulated tungsten wires in the PFC and dHC (as described above) as well as into the ventral hippocampus (vHC; AP -3.1–3.2, ML 2.9–3.0, 3.4 mm or 3.8–3.9 mm below pia) and mediodorsal thalamus (MD; AP -1.2, ML 0.3, 2.7 below pia), in addition to frontal and cerebellar skull screws for reference and ground, respectively. After 2–4 weeks of recovery, training commenced. For the present paper the last four days of training without mounted headstage (Intan, US) and the subsequent first five days with mounted headstage are analysed, while further data from these animals, alongside more detailed methodical description of the surgery, behavioural training, and electrophysiological data acquisition are described elsewhere21,22.
5-choice-serial-reaction-time task (5-CSRTT)
The 5-CSRTT training protocol was identical to what we previously described (illustrated in Supplementary Fig. 2)23. In brief, after initiation of food-restriction, mice were accustomed to the reward (strawberry milk, Müllermilch™, G) in their home cage and in the operant box (2–3 exposures each). Then, mice were trained in a simplified operant cycle in which all holes of the 5-poke wall were illuminated for an unlimited time and the mouse could poke into any one of them to earn a 40 µl milk reward subsequently disposed from the illuminated receptacle (habituation training). If mice attained at least 30 rewards each in two consecutive sessions, they were moved to the 5-CSRTT. During this training, mice transitioned through five stages of increasing difficulty, based on reaching certain performance criteria in each stage (Supplementary Table 3). The difficulty of each stage was determined by the length of time the stimulus was presented (stimulus duration, SD) and the length of waiting time between the end of the previous trial and the stimulus presentation of the next trial (inter-trial-interval, ITI).
In the principle 5-CSRTT operant cycle, the ITI was initiated by the removal of the snout of the animal from the reward receptacle after collection of the reward or by the end of a time-out period (see below). The ITI was followed by the illumination of one hole of the 5-choice wall for the SD determined by the task stage. At the end of the SD, the light was turned off and the animal was allowed another 2 s (limited hold, LH) to poke into the previously indicated hole. If this hole was poked during the SD or LH period, this was counted as a correct response and rewarded by immediate delivery of 20 µl milk at the receptacle hole which was accompanied by its illumination, and followed by the initiation of a new ITI. If the animals either poked into any 5-choice hole during the ITI (premature response), poked into a non-illuminated hole (incorrect response) during the SD or limited-hold time, or failed to poke throughout the trial (omission), trials were not rewarded but instead terminated immediately with a 5 s time-out period during which the house light was turned off. The relative numbers of such response types were used as performance indicators measuring premature responding [%premature = 100 × (number of premature responses)/(number of trials)], sustained attention [accuracy = 100 × (number of correct responses)/(number of correct and incorrect responses combined)], and task participation [%omissions = 100 × (number of omissions)/(number of trials)]. In all stages and tests, sessions lasted 30 min and were performed once daily at the same time of day.
5-choice-spatial working memory task (5-CSWMT)
The training of cohort 5 in the 5-CSWMT is described in detail elsewhere21, as is comparable data from the same task acquired in commercial boxes12,24. Briefly, each trial of this delayed-matching-to-position (DMTP) spatial working memory assay consists of a sample phase (SP) during which the mice have to detect and poke an illuminated hole (as in the 5-CSRTT), a delay phase during which mice obtain a small reward from the receptacle (10 µl strawberry milk), and the choice phase (CP) during which mice are presented with two illuminated holes at the 5-choice wall (see illustration of task cycle in Supplementary Fig. 2). One of these two indicated holes is the one that was also illuminated in the prior SP and has to be poked again in the CP in order to obtain a large reward (60 µl). Incorrect responses or omissions in the SP or CP are followed by abortion of the trial in form of a 5 s time-out and a subsequent ITI. In contrast to the 5-CSRTT, the task is run with the house-light off in the default mode, and on during time-out periods. Animals were trained through multiple, increasingly more difficult stages (with parameters specified in Supplementary Table 4) and data presented here was obtained on the baseline stage 5, which has a maximum SD of 10 s in the SP and of 5 s in the CP, and a delay after the collection of the SP-reward of 2 s before the CP starts.
We here present data illustrating operant testing of untethered and tethered mice in a pyOS-5 set-up. Note that we already published 5-CSRTT data from a small pilot-cohort of eight mice that were trained up and tested in a prototype of the pyOS-5 boxes—that data demonstrated the relative selectivity of parametric test protocols that challenged either attention (reduction of SD, sound distraction) or impulsivity (fixed or variable increase of the ITI) and the responsiveness of these behaviours to atomoxetine10.
Behavioural validation in the 5-CSRTT
In this study, we first trained a larger cohort of 18 male C57BL/6J mice in the 5-CSRTT (see “Methods” for training schedule, and Fig. 5a and Supplementary Video 2 for an illustration of the task). As light levels and colour of 5-choice wall stimuli vary greatly between commercial systems (we have previously used defaults of 215 lx white light in one system (Campden Instruments Ltd.25) and 4 lx of yellow light in another (Med Associates Inc.19,23,24), we started with a high illumination of 280 lx of white light as measured in front of the poke-holes. We observed qualitatively that some animals would refrain from poking into the hole even when sitting right in front of them and that no training progress was evident over 4 days as assessed by repeated-measures (RM) ANOVA (Supplementary Fig. 3). Taking advantage of the exchangeability of the 5 mm Opal-spacer layer that is available in different transmissivity (CutLaserCut, GB) which can be further adjusted with tape, we reduced light output to 95 lx of either yellow or white light, and, on session 14, further to 65 lx white light, which was kept because of the observed performance increase (Supplementary Fig. 3; all animals trained on stage 1 throughout), and was used for all subsequent training and experiments in this and the other cohorts. Mice of this cohort required on average 26.5 days (range: 14–37 days) from the end of stage 1 until reaching criteria on the final stage 5 (baseline; Fig. 5b).
Once animals had achieved criterion on the baseline stage indicating stable performance, we conducted a widely used challenge in the task19,23,25,26,27 which demands high levels of sustained attention: shortening of the SD from 2 to 0.8 s. As predicted, this protocol led to a decrease of correct and an increase of incorrect responses, thereby causing a decrease in attentional accuracy (Fig. 5c–e). As we observed before10,19, also omissions and, mildly, premature responding increased in this paradigm, while response latency decreased (Fig. 5f–h). The absolute levels of baseline behaviour also illustrate that the pyOS-5 system allows animals to achieve high numbers of correct responses (112.2 ± 7.1, mean ± s.e.m.) and consequently total trials (161.9 ± 2.6) in 30 min, while omission rates remained relatively low for murine standards (26.4 ± 3.5% at baseline, Fig. 5c,f).
In order to quantitatively compare the achieved training performance between our and a commercial nose-poke-based system (Med Associates, Inc.) on the final 5-stage training protocol (without the initial changes in light levels done in cohort 1), we analysed training data of two cohorts (2 and 3) that were of the same genotype (Rbp4-Cre, phenotypically wildtype) and trained by the same experimenter according to the same 5-stage schedule (Supplementary Table 3). These cohorts were trained for a separate study which required surgery post training, but all mice had at least 42 training sessions without breaks of more than 2 d. Surgery was performed cage-wise, such that some animals were operated before completing all 5 training stages and some mice were excluded due to extremely slow progress in stage 1 (in commercial boxes only). This resulted in two mice from cohort 2 (trained in the pyOS-5 system, N = 20) and 18 mice from cohort 3 (trained in the commercial system, N = 37) contributing data to only a subset of training stages (2.6 ± 1.5, mean ± S.D., including habituation). As these mice were typically ones with slower training progress, the analysis of later training stages may be somewhat biased in favour of the commercial system where more mice were not trained until stage 5 continuously. Mice trained in the pyOS-5 system showed a higher number of achieved responses and hence rewards by day 3 of the habituation training and therefore moved to stage 1 of the 5-CSRTT significantly earlier, compared with mice trained in the commercial system (Fig. 5i,j). Conversely, they needed significantly longer to reach criterion on stage 3, while not differing significantly in the required time on the other four training stages (Fig. 5j). The sum of median training days across stages was 34 in pyOS-5 boxes and 37 in commercial boxes (not taking into account 7 mice trained in commercial boxes that did complete stage 1 within ≥ 26 [range: 26–55] sessions on that stage and all stages within ≥ 42 [range: 42–65] sessions in total; Fig. 5j).
Given that the three key variables accuracy, %omissions, and the absolute number of correct responses determine the transition between stages (Supplementary Table 3), we next investigated performance differences between cohorts 2 and 3 in those parameters measured at the beginning and end of each stage (average of two sessions each). Compared to animals trained in commercial boxes, mice trained in pyOS-5 boxes displayed significantly lower accuracy in the early 3 stages, but showed a lower omission rate throughout stages and a higher number of correct responses (i.e., obtained rewards) in the last 3 stages (Fig. 5k–m). This suggests, that it is mainly the slower improvement in accuracy over the training sessions that causes the slightly larger number of required training days in the pyOS-5 boxes on stage 3, while this system generally benefits a higher task participation. Hence, given that mice reach equal accuracy in stages 4 and 5 in pyOS-5 boxes, training may be faster, if the accuracy criterion in stage 3 is somewhat relaxed, in future studies.
Behavioural validation in the 5-CSRTT using tethered animals
Next, we qualitatively evaluated the possibility that animals that are implanted and tethered to an optical fibre can easily access the poke holes and reward receptacle (Fig. 6a, also showing the contrast to a commercial system; Supplementary Video 3). For additional validation of the suitability of the operant boxes for tethered mice, we trained four C57BL/6 mice in the 5-CSRTT, implanted them with a fibre-optic cannula, and trained them further after a period of recovery (cohort 4). Once the mice had reached stage 5 (baseline; Supplementary Table 3), they were trained for three further days untethered, and subsequently for a further four days tethered unilaterally to an optical fibre. We compared key performance variables like attentional accuracy and omissions as well as response and reward latencies (indicating attainable speed of movement in this case) in sessions 3 and 4 with tether (i.e. after a 2-day acclimation period with the tether) to the average performance during the last two days without a tether. Mice did not perform worse in the tethered mode compared to the untethered mode according to any of the variables, and even performed better in terms of accuracy (P < 0.05, paired t-test; Fig. 6b,c).
To further investigate the suitability of the pyOS-5 boxes for tethered animals, we conducted a similar analysis for a group of 11 wildtype mice that had been trained in the 5-CSWM task, implanted with depth electrodes, and were trained until the baseline stage (5, Supplementary Table 4) of the task. After at least four training sessions on this stage, these mice were trained for a further 5 d on this stage with a mounted headstage (Intan, 24 × 15.5 mm, ca. 1.3 g including custom-made connector) tethered with an SPI cable (Intan; Fig. 6d). Again we compared attention- and working memory-related performance variables and latencies after a 2-session acclimation period, comparing the average of sessions 3–5 with tether to the average of the last 3 session without a tether (Fig. 6e,f). Tethered mice performed as well as untethered mice and even showed higher working memory accuracy (Fig. 6e,f).
We scrutinized this conclusion further by analysing attentional accuracy and omissions, both measured in the sample phase (SP) over the time of the session (3 min time intervals, again using 3-session averages as before)—taking advantage of the fact that pyControl records every single behavioural event to allow such fine-grained analysis. While there was again no significant effect of tether, there was a significant effect of time on both variables and a tether-time interaction for SP omissions (P < 0.05; RM-ANOVA), mainly driven by higher omissions in the first interval in tethered animals (P = 0.01, Sidak-adjusted post-hoc test for simple main effects; Fig. 6g,h). This pattern suggests that the animals can move and respond unhindered enough in the boxes (Supplementary Video 3) so that even with such a large headstage, tethering does not speed up normal fatigue occurring across the session, but only demands an acclimation to the tether at the beginning of the session.
Integration of behavioural experimentation with electrophysiological recordings
In cohort 5, we further established and evaluated the suitability of the pyOS-5 system for integrated electrophysiological recordings during operant box tasks. This requires precise temporal alignment of electrophysiological recordings with set task states and behavioural events. To physically interface pyControl hardware with physiological recording systems, the breakout board has four standard BNC-connectors (Fig. 7a) which can be defined as digital outputs or inputs in the hardware definition-file (Fig. 7b). Used as outputs, these allow TTL-signals to be triggered from the task script, e.g. at the onset of a given state or behavioural event, and recorded as time-stamps by the electrophysiology acquisition system (Fig. 7a). (Note that more than 4 output lines can be generated by using break-out adapters, py.024, Supplementary Table 1.) As pyControl also records millisecond timestamps for all behavioural events, these can be aligned to physiology traces during offline analysis using the TTL pulses recorded alongside physiology data as a reference point. Figure 7 illustrates the alignment of local field potential recordings from three different brain regions (Fig. 7c) with TTL-based time-stamps recorded by the electrophysiological acquisition software (Open-EPhys; Fig. 7b), behavioural states determined by the task script (from the pyControl record; Fig. 7e) and the animal’s active responses (from the pyControl record; Fig. 7f) during 5 min of a 5-CSWMT session. Also note that no artefacts are evident in the electrophysiological recording as the animal enters choice-pokes or the reward receptacle (Fig. 7c,f; Supplementary Fig. 4). The high stability and quality of such recorded data is also demonstrated by its suitability to decode individual working memory-based choices on a trial-by-trial basis in the same cohort21.
Integration of behavioural experimentation with optogenetic stimulation
In cohort 4, we further evaluated the suitability of the pyOS-5 system for integrated optogenetic modulation during operant box tasks. To this end, TTL-outputs can be generated directly from within the pyControl task file to either switch a laser power supply directly (for continuous or simple pulsed stimulation) or trigger a pulse generator (for temporally more complex stimulation), at a specific point during a task cycle (Fig. 8a,b). In our pilot cohort of two ArchT- and two Jaws-transduced mice (for unilateral optogenetic inhibition of the dorsal hippocampus), we applied a sequence of 4 sessions on consecutive days, whereby no optical modulation was conducted in sessions 1 and 3 (termed baseline; tether only), optical modulation during the first 4 s of the ITI was conducted in session 2, and optical modulation during the first 2 s of the reward collection preceding the ITI in session 4. Qualitatively, ArchT-transduced mice showed a notable decrease of attentional accuracy and increase of premature responses especially in the session where modulation was applied during the ITI (Fig. 8c,d). The pattern of frequencies of each of the four response options (corrects, incorrects, prematures, omissions) differed significantly from baseline in each of the optical modulation conditions (Fig. 8e). Capitalizing on the fact that pyControl records every single behavioural event, we also analysed the distributions of response latencies and noted optically induced changes (Supplementary Fig. 5). While too preliminary to allow for any biological conclusions, this data exemplifies the integration of optogenetic modulation with operant behavioural testing with pyControl. Note that, although a laser was used here, a low cost, open source, LED driver module has also been developed for pyControl which has been used successfully in other studies11,28.
We developed a novel open-source 5-choice operant box system characterized by low cost, rapid turn-over between subjects, and compatibility with implanted and tethered animals for physiological manipulations and measurements. The first two features facilitate training and testing of large cohorts in demanding operant tasks, while the latter supports state-of-the-art circuit neuroscience experiments in such behavioural paradigms. In our hands, assembly costs were around 700 EUR per complete setup unit, including operant box, outer cubicle and all peripherals; however, costs may vary depending on the sourcing of the plastic components, labour costs for building the outer cubicles, and economies of scale.
The system is one of several recent efforts from different labs to broaden the access to affordable operant box systems and to standardize experimental parameters and task structures by sharing task files10. While a detailed comparison of pyControl with the alternative open-source systems BPod and Bonsai is provided in our companion manuscript10, it is worthwhile drawing comparisons here between pyOS-5 and other systems that are more specifically designed to support operant-box experiments3,4,5,6,8,9. We designed our system to be fit for the specific purpose of 5-choice-based operant tasks and accessible to users without programming skills, while retaining a fully open-source framework, eliminating reliance on proprietary software. These priorities set our system apart from other open-source systems that employ generic microcontrollers, like Arduino3,4 or RasberryPi4,5,6, or generic task-scripting software designed to maximize wide-ranging applicability7,8,9. Instead, pyOS-5 combines a microcontroller with dedicated custom PCBs specifically designed for controlling operant behavioural experiments. Apart from simplifying the setting up of the system, this design also has the advantage of providing multiple input and output ports (e.g., dedicated BNCs, but also breakout lines from RJ45 sockets) that provide easy integration with electro- or opto-physiological data acquisition, or external stimulation devices like lasers, LEDs, speakers, or other microcontrollers. The commercial availability of pyControl electronic components at low cost through the Open-Ephys platform (https://open-ephys.org/pycontrol) alleviates the hurdle of organizing their fabrication based on the open-source design files while retaining cost-effectiveness. A further advantage of this design is the direct integration with the control software, including a dedicated GUI and a suit of ready-to-use task scripts, not offered by most alternative open-source systems.
In contrast to the 2-poke design of other poke hole-based open-source boxes3,5, a 5-poke wall can be used to assess a wider range of cognitive functions2,12,13,19 (see “Methods”) with a variety of task designs. These can be further enhanced by the auditory stimulation integrated in pyOS-5. A key advantage of a 5-poke over a classical 2-poke (or 2-lever) design of operant boxes are the high number of possible response configurations and the low (20%) chance level of correct responding. This is critical, for example, when assessing sustained attention in the 5-CSRTT to demand a spatially broad focus of attention and to prevent a strategy of obtaining sufficient rewards just from near-chance level performance13. Similarly in the 5-CSWMT this allows presentation of a large number of different two-hole or multi-hole choice configurations in the choice phase to prevent mediation strategies of positioning the body in one side of the chamber to solve the task without memory (discussed in more detail elsewhere12,24). Therefore, the wide applicability of the 5-poke design to assess a considerable number of cognitive functions is the key source of versatility offered by the pyOS-5 boxes. Several alternative open-source systems use touchscreens to present visual stimuli and register the animal’s choices4,5,6. Touchscreens certainly offer the advantage of a wider range of cognitive tasks, especially those relying on the visual discrimination of shapes as opposed to just spatial position and illumination, and they may potentially be more aligned with human assays29,30. The pyOS-5 system, in contrast, may be useful, if the classical poke-hole design is favoured given its wide application in the field over the recent two decades, and if the easy integration with physiological manipulation or recording is desired. Also, a large number of boxes (in our case 24, but there is no significant limitation for adding more) can be run simultaneously from a standard PC, without being limited by computing power. In summary, pyOS-5 offers great versatility for behavioural paradigms that rely on the well-established 5-poke design.
As stated in “Methods”, all design files and code necessary to build and operate the pyOS-5 system are available on GitHub (https://github.com/KaetzelLab/Operant-Box-Code; https://github.com/KaetzelLab/Operant-Box-Design-Files). All relevant information on pyControl is available on a dedicated website (https://pycontrol.readthedocs.io). Source data for the behavioural experiments can be obtained from the corresponding author (DK) upon reasonable request.
Barch, D. M. et al. Selecting paradigms from cognitive neuroscience for translation into use in clinical trials: Proceedings of the third CNTRICS meeting. Schizophr. Bull. 35, 109–114 (2009).
Young, J. W. et al. GlyT-1 inhibition attenuates attentional but not learning or motivational deficits of the Sp4 hypomorphic mouse model relevant to psychiatric disorders. Neuropsychopharmacology 40, 2715–2726 (2015).
Devarakonda, K., Nguyen, K. P. & Kravitz, A. V. ROBucket: A low cost operant chamber based on the Arduino microcontroller. Behav. Res. Methods 48, 503–509 (2016).
O’Leary, J. D., O’Leary, O. F., Cryan, J. F. & Nolan, Y. M. A low-cost touchscreen operant chamber using a Raspberry PiTM. Behav. Res. Methods 50, 2523–2530 (2018).
Gurley, K. Two open source designs for a low-cost operant chamber using Raspberry PiTM. J. Exp. Anal. Behav. 111, 508–518 (2019).
Buscher, N. et al. Open-source raspberry Pi-based operant box for translational behavioral testing in rodents. J. Neurosci. Methods 342, 108761 (2020).
Lopes, G. et al. Bonsai: An event-based framework for processing and controlling data streams. Front. Neuroinform. 9, 13 (2015).
Bhagat, J., Wells, M. J., Harris, K. D., Carandini, M. & Burgess, C. P. Rigbox: An open-source toolbox for probing neurons and behavior. eNeuro 7, 4 (2020).
Kim, B. et al. Real-time experimental control using network-based parallel processing. Elife 8, e40231 (2019).
Akam, T. et al. pyControl: Open source, Python based, hardware and software for controlling behavioural neuroscience experiments. bioRxiv 2021.02.22.432227. https://doi.org/10.1101/2021.02.22.432227 (2021).
Akam, T. et al. The anterior cingulate cortex predicts future states to mediate model-based action selection. Neuron 109, 149 (2020).
Teutsch, J. & Kätzel, D. Operant assessment of DMTP spatial working memory in mice. Front. Behav. Neurosci. 13, 193 (2019).
Bari, A., Dalley, J. W. & Robbins, T. W. The application of the 5-choice serial reaction time task for the assessment of visual attentional processes and impulse control in rats. Nat. Protoc. 3, 759–767 (2008).
Young, J. W., Meves, J. M. & Geyer, M. A. Nicotinic agonist-induced improvement of vigilance in mice in the 5-choice continuous performance test. Behav. Brain Res. 240, 119–133 (2013).
Young, J. W., Light, G. A., Marston, H. M., Sharp, R. & Geyer, M. A. The 5-choice continuous performance test: evidence for a translational test of vigilance for mice. PLoS ONE 4, e4227 (2009).
Mitchell, S. H. Assessing delay discounting in mice. Curr. Protoc. Neurosci. (Eds. Board Jacqueline N, Crawley Al) 66, 8.30.1-8.30.12 (2014).
Rojas, G. R., Curry-Pochy, L. S., Chen, C. S., Heller, A. T. & Grissom, N. M. Sequential delay and probability discounting tasks in mice reveal anchoring effects partially attributable to decision noise. bioRxiv 2021.06.08.447620. https://doi.org/10.1101/2021.06.08.447620 (2021).
van Gaalen, M. M., van Koten, R., Schoffelmeer, A. N. M. & Vanderschuren, L. J. M. J. Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol. Psychiatry 60, 66–73 (2006).
Grimm, C. M. et al. Schizophrenia-related cognitive dysfunction in the Cyclin-D2 knockout mouse model of ventral hippocampal hyperactivity. Transl. Psychiatry 8, 212 (2018).
Gerfen, C. R., Paletzki, R. & Heintz, N. GENSAT BAC Cre-recombinase driver lines to study the functional organization of cerebral cortical and basal ganglia circuits. Neuron 80, 1368 (2013).
Strahnen, D. et al. Highly task-specific and distributed neural connectivity in working memory revealed by single-trial decoding in mice and humans. bioRxiv 2021.04.20.440621. https://doi.org/10.1101/2021.04.20.440621 (2021).
Strahnen, D., Kapanaiah, S. K. T., Bygrave, A. M. & Kätzel, D. Lack of redundancy between electrophysiological measures of long-range neuronal communication. BMC Biol. 19, 24 (2021).
van der Veen, B. et al. Control of impulsivity by Gi-protein signalling in layer-5 pyramidal neurons of the anterior cingulate cortex. Commun. Biol. 4, 1–16 (2021).
Kilonzo, K. et al. Delayed-matching-to-position working memory in mice relies on NMDA-receptors in prefrontal pyramidal cells. Sci. Rep. 11, 1–19 (2021).
Jendryka, M. et al. Pharmacokinetic and pharmacodynamic actions of clozapine-N-oxide, clozapine, and compound 21 in DREADD-based chemogenetics in mice. Sci. Rep. 9, 4522 (2019).
Koike, H. et al. Chemogenetic inactivation of dorsal anterior cingulate cortex neurons disrupts attentional behavior in mouse. Neuropsychopharmacology 41, 1014–1023 (2016).
Bygrave, A. M. et al. Knockout of NMDA-receptors from parvalbumin interneurons sensitizes to schizophrenia-related deficits induced by MK-801. Transl. Psychiatry 6, e778 (2016).
Blanco-Pozo, M., Akam, T. & Walton, M. Dopamine reports reward prediction errors, but does not update policy, during inference-guided choice. bioRxiv 2021.06.25.449995. https://doi.org/10.1101/2021.06.25.449995 (2021).
Horner, A. E. et al. The touchscreen operant platform for testing learning and memory in rats and mice. Nat. Protoc. 8, 1961–1984 (2013).
Oomen, C. A. et al. The touchscreen operant platform for testing working memory and pattern separation in rats and mice. Nat. Protoc. 8, 2006–2021 (2013).
We thank W. Rapp, H. Steeb, B. Folli and their colleagues (Ulm University mechanical workshop) for manufacturing the plastic components and outer cubicles as well as for providing digital technical drawings and animations of designs. We furthermore thank Dr. M. Kohl (University of Oxford) for advice on cubicle design. This study was funded by the Else-Kröner-Fresenius-Foundation/German-Scholars-Organization (Programme for Excellent Medical Scientists from Abroad, GSO/EKFS 12, to DK), the Junior-Professorship Programme of the Ministry of Arts and Science of Baden Württemberg (to DK), and the DFG (KA 4594/2-1, to DK).
Open Access funding enabled and organized by Projekt DEAL.
T.A. has a consulting contract with the Open Ephys Production Site, who sell assembled pyControl hardware. The other authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Video 1.
Supplementary Video 2.
Supplementary Video 3.
About this article
Cite this article
Kapanaiah, S.K.T., van der Veen, B., Strahnen, D. et al. A low-cost open-source 5-choice operant box system optimized for electrophysiology and optophysiology in mice. Sci Rep 11, 22279 (2021). https://doi.org/10.1038/s41598-021-01717-1
This article is cited by
Control of sustained attention and impulsivity by Gq-protein signalling in parvalbumin interneurons of the anterior cingulate cortex
Translational Psychiatry (2023)
Distinct contributions of GluA1-containing AMPA receptors of different hippocampal subfields to salience processing, memory and impulse control
Translational Psychiatry (2022)