Neurons in sensory systems often pool inputs over arrays of presynaptic cells, giving rise to functional subunits inside a neuron’s receptive field. The organization of these subunits provides a signature of the neuron’s presynaptic functional connectivity and determines how the neuron integrates sensory stimuli. Here we introduce the method of spiketriggered nonnegative matrix factorization for detecting the layout of subunits within a neuron’s receptive field. The method only requires the neuron’s spiking responses under finely structured sensory stimulation and is therefore applicable to large populations of simultaneously recorded neurons. Applied to recordings from ganglion cells in the salamander retina, the method retrieves the receptive fields of presynaptic bipolar cells, as verified by simultaneous bipolar and ganglion cell recordings. The identified subunit layouts allow improved predictions of ganglion cell responses to natural stimuli and reveal shared bipolar cell input into distinct types of ganglion cells.
Introduction
Sensory systems often display strong signal convergence, with individual neurons pooling information over arrays of presynaptic connections. The characteristics of this signal pooling determine how the neuron responds to sensory stimulation and what type of computational role the neuron plays in information processing. A computational framework for analyzing the relation between functional connectivity and stimulus encoding is given by models that structure a neuron’s receptive field into subunits, corresponding to the functionally relevant input channels. Such subunit models form the basis of our current understanding of, for example, retinal ganglion cell sensitivity to high spatial frequencies^{1, 2}, ganglion cell selectivity for specific types of motion signals^{3,4,5,6}, the emergence of orientation selectivity and phase invariance in primary visual cortex^{7,8,9,10,11,12,13}, and the processing of visual motion information along the cortical dorsal stream^{14,15,16}. In the retina, ganglion cell subunits arise from nonlinear integration of bipolar cell signals^{17,18,19,20,21,22}. Retinal subunit models have recently received increasing attention because they form the scaffold for specific computations performed by the retinal circuit^{23, 24} and because of their apparent importance for understanding the encoding of natural stimuli^{21, 25, 26}.
However, connecting subunit models to concrete neuronal circuitry is complicated by the lack of methods that allow identification of the subunits from neuronal recordings. While receptive fields can be conveniently identified with whitenoise stimulation and computation of the spiketriggered average^{27}, assessing the substructure within receptive fields has turned out to be a much harder problem. Efforts have therefore focused on fitting specifically constrained subunit models to data^{10, 28,29,30,31,32,33} or by otherwise enforcing localized subunits in the receptive field^{13, 34}. Furthermore, testing whether extracted subunits correspond to actual elements of the presynaptic circuitry provides an additional challenge, though progress can be made by comparing subunit characteristics with anatomical information^{29}. Thus, methods that detect subunits of receptive fields with minimal prior assumptions about their number, size, or shape and with a demonstrated relation to functional connections in a neuronal circuit are highly desirable.
To this end, we here introduce a new method that we term spiketriggered nonnegative matrix factorization (STNMF). The method identifies subunits in a way analogous to the identification of receptive fields through the spiketriggered average, that is, without the need to construct explicit models of the stimulusresponse relation or to a priori specify the size, shape, number, or nonlinearity of the subunits. Furthermore, application of the method to recordings of retinal ganglion cells retrieves actual receptive fields of presynaptic bipolar cells, thus providing a novel perspective on the functional connectivity and signal transmission between these successive neuronal layers.
Results
STNMF detects layouts of localized receptive field subunits
We developed STNMF as a method for extracting the receptive field substructure that results from nonlinear pooling of functionally relevant inputs. To illustrate and explore the method, we analyzed responses of ganglion cells that we recorded from isolated salamander retinas with extracellular microelectrode arrays. The method only requires recorded ganglion cell spike times under spatiotemporal whitenoise stimulation with fine spatial resolution. The core aspect is then to apply nonnegative matrix factorization (NMF) to the collection of those stimulus patterns in the whitenoise sequence that elicited spikes. NMF is a computational technique that is typically used to seek a decomposition of highdimensional data into a relatively small set of modules and corresponding weights so that the individual samples in the data set are approximated by weighted combinations of the modules. When the data set is represented as a matrix of sample number vs. elements per sample, the decomposition amounts to a factorization of this matrix into one matrix that holds the set of modules and another matrix that holds the weights. Importantly, in NMF, this factorization is obtained under the constraint that the elements of all or some of these matrices are nonnegative, which is known to facilitate the detection of sparse, partslike modules^{35}. This feature makes NMF attractive for trying to capture subunits, which can be viewed as the constituent parts of a receptive field. Intuitively, the modules derived by STNMF should capture the subunit decomposition of the receptive field because the spikeeliciting stimuli will have essential statistical structure imprinted on them by the subunits, such as correlations between pixel values, and the NMF method will make use of this structure to efficiently reconstruct these stimuli.
Concretely, we here proceeded as follows. For each analyzed ganglion cell, we extracted those 670ms segments from the whitenoise stimulus that preceded a spike. The collection of these spikeeliciting stimulus segments forms the spiketriggered stimulus ensemble, akin to common reversecorrelation analyses. For example, the average of all collected stimulus segments is the spiketriggered average (STA; Fig. 1a), a commonly used estimate of a cell’s spatiotemporal receptive field^{27}. To focus our analysis on the spatial structure of receptive fields, we collapsed each of the spiketriggered stimulus segments along the temporal dimension. We did so by computing an effective spiketriggered stimulus as the weighted average over time, where the weights were taken from the temporal profile of the cell’s STA (Supplementary Fig. 1). Thus, the effective spiketriggered stimulus is a spatial pattern that measures how well the contrast sequence at each pixel matched the preferred temporal stimulus profile of the cell before a spike occurred, which essentially is a measure of how strongly each pixel was stimulated within this spiketriggered stimulus.
We then decomposed the ensemble of effective spiketriggered stimuli into a set of modules and a set of weights by applying seminonnegative matrix factorization^{36} (semiNMF; Fig. 1a), a variant of NMF that is used here to implement the nonnegativity constraint only for the elements of the modules. The weights, on the other hand, as well as the stimulus patterns were not constrained. Stimuli, for example, were represented by their contrast values, that is, by their relative deviations from mean light intensity, which could be positive or negative. SemiNMF then seeks such weights and nonnegative modules that minimize the difference, in a leastsquares sense, between the spiketriggered stimuli and the reconstruction.
There is no analytical solution for the optimal modules and weights under the nonnegativity constraint. Instead, we here used a numerical, iterative procedure (see Methods). Starting with a set of modules that are initialized with random numbers, we alternate between finding the best corresponding weights while keeping the modules fixed (which amounts to solving a standard leastsquares problem) and optimizing the modules while keeping the weights fixed (which requires a complex, yet numerically tractable nonnegative leastsquares computation). In addition, to mitigate the risk of getting stuck in local minima during this iterative procedure, we periodically probe the effect of perturbing the current set of modules and weights by randomly deleting, duplicating, or splitting modules or adding noise (see Methods). This procedure eventually yields a stationary solution where no further improvements of modules and weights are found. The obtained final modules then indeed show structures that conform to the expectations for a layout of subunits. They are localized patterns of similar size that cover the ganglion cell’s receptive field in an orderly manner (Fig. 1a, b).
In the application of nonnegative matrix factorization, the number of considered modules must be specified before running the optimization procedure. This might suggest that this number needs to be individually optimized for each analyzed ganglion cell. However, we found that this is not the case. Instead, we can simply use a fixed number of modules, ideally somewhat larger than the expected number of subunits. As illustrated by a sample cell that was analyzed with 20 modules (Fig. 1b; see also Supplementary Fig. 2a, b for additional examples), it turns out that the method then yields modules of two types. Clearly, some of the modules show the localized structure expected for subunits, whereas the others look like noise. Indeed, when considering each of the modules as a spatial stimulus filter and relating the filter activation to the observed spiking activity in a histogram manner (Fig. 1c, see Methods), we found that the localized modules typically exert a strong effect on the cell’s activity. The noiselike patterns, on the other hand, are largely uncorrelated with the occurrence of spikes, showing that they capture the noise in the spiketriggered ensemble. To quantify the effect of a module on the spiking activity, we computed the difference between the maximum and the minimum value in these histograms and called this the output gain of the subunit. Furthermore, we quantified how localized each of the obtained modules was by computing a measure of the spatial autocorrelation, called Moran’s I (see Methods). Thus, out of the set of obtained modules, the relevant subunits could be extracted in an automated manner according to their output gain and their level of localization (Fig. 1d). All further analyses of this work proceeded in this automated manner; STNMF was applied with 20 modules, and subunits were identified as those modules whose spatial autocorrelation or output gain crossed certain thresholds (see Methods).
As an aside, let us note that the computed output gain (Fig. 1d) provides a weight of how relevant a given subunit is for activating the ganglion cell. This can be interpreted as a measure of connection strength of the subunit to the ganglion cell. The relative weighting of the different subunits should be reflected in how strongly they contribute to the receptive field. Indeed, we found that the receptive field can be well fitted by the set of obtained subunits and that the weights of the subunits in this fit closely resembled their output gain values (Supplementary Fig. 2c, d). The same structure of relative importance of the subunits is also reflected in the average weights of the corresponding modules in the nonnegative matrix factorization (Fig. 1a). The fact that these different measures of subunit contributions agree corroborates their interpretation as a measure of connection strength to the ganglion cell. This can be used, for example, to analyze the dependence of connection strength on the location of subunits within the receptive field, showing that the average subunit connection strength declined with distance from the receptive field center (Supplementary Fig. 2e). The weights of subunits will furthermore be important, as shown below, for combining the subunit signals into predictive models of ganglion cell activity.
A standard extension of the STA analysis for the case where multiple stimulus features are relevant is the method of spiketriggered covariance (STC) analysis^{37, 38}, which applies an eigenvalue analysis of the covariance matrix of the spiketriggered stimulus ensemble to detect relevant stimulus features. For comparison with the STNMF method, we therefore applied STC analysis to the ensemble of effective spiketriggered stimuli (Supplementary Fig. 3). The results indicate that (1) the STC analysis is more strongly impaired by the high dimensionality of the investigated stimulus space, allowing no clear separation between eigenvalues for relevant and nonrelevant stimulus features, and that (2) features extracted by the STC analysis are not localized subunits, but rather correspond to a Fourierlike decomposition of the receptive field. This underscores the importance of the nonnegativity constraint in the STNMF for the extraction of localized subunits.
STNMF robustly recovers true subunits of model neurons
To check whether the STNMF analysis can indeed recover a known subunit layout, we tested the method on a simulated ganglion cell. The model cell contained five subunits that each filtered the incoming spatial stimulus patterns and then applied a thresholdquadratic rectification, akin to spatial nonlinearities observed for retinal ganglion cells^{17}. The subunit signals were then summed by the ganglion cell (Fig. 2a). We here chose a subunit layout that contains considerable spatial overlap between the subunits, a scenario that is particularly challenging for subunit identification. Despite this overlap, we found that our approach faithfully recovered the true subunits of the model (Fig. 2b).
A subunit model requires that the subunit signals be combined in nonlinear manner; otherwise, the subunits would merge into a single filter and welldefined subunits would not exist. Yet, the exact shape of the subunit nonlinearity is not critical for subunit extraction with the STNMF method; for example, the subunits of the model were equally well identified when we replaced the thresholdquadratic rectification by a symmetric quadratic subunit nonlinearity (Supplementary Fig. 4). It is not surprising that the symmetric nonlinearity does not impede subunit identification because the subunits can contribute to the decomposition of the effective spiketriggered stimulus ensemble with either positive or negative weight (Fig. 1a). Note, though, that the average NMF weight of a subunit will now average out to near zero and therefore no longer provide a measure of connection strength of the subunit.
Because our described procedure begins with applying a single temporal filter to all spikeeliciting stimuli, one may wonder whether the approach fails when temporal filtering differs between the subunits. However, this is not the case as shown by analysis of a spatiotemporal model where each subunit was associated with a different temporal filter. This did not prevent the method from recovering the true subunits (Supplementary Fig. 5). The intuition behind this is that as long as there is some overlap between the individual temporal subunit filters and the temporal component of the cell’s STA, the effective spiketriggered stimuli will still reflect the spatial structure that is imposed by the subunits.
How robust is the subunit identification with respect to noise and to the amount of data available? To explore this, we first used the model of Fig. 2 and varied either the level of noise or the number of included spikes (Supplementary Fig. 6a–c). The former was done by replacing a fraction of the simulated spikes, chosen at random, with spikes at random times and the latter by successively including more simulated spikes in the analysis. We measured performance by computing the correlation between the true model subunits and the corresponding reconstructed modules. In addition, since the true subunits are characterized by a high spatial autocorrelation, we also measured performance by the average spatial correlation of the five most localized modules. This measure has the advantage that it can also be applied when the true subunits are not known. As expected, reconstruction of the subunits deteriorated with increasing noise, yet small levels of noise only had a relatively mild effect, and only once about half the spikes had been replaced did performance decline steeply. Similarly, the subunit reconstruction was fairly robust with respect to spike number; here, performance leveled off once about 1500 spikes were included. A similar qualitative dependence of subunit reconstruction on noise and spike number was observed in sample ganglion cells (Supplementary Fig. 6d–i), indicating again a certain robustness to noise and good reconstruction performance once several thousand spikes were included in the analysis. Moreover, inspecting the modules obtained under different levels of noise and spike numbers suggests that, when the method starts failing, it does so by first losing individual subunits while faithfully retaining other subunits.
Detected subunits match bipolar cell receptive fields
Given the reported role of bipolar cell inputs for nonlinear spatial integration by ganglion cells^{18,19,20,21}, we hypothesized that the subunits identified by the STNMF method from ganglion cell recordings corresponded to individual presynaptic bipolar cells. To check this hypothesis, we combined the multielectrode array recordings with simultaneous recordings from individual bipolar cells through sharp microelectrodes. Indeed, we often found that the bipolar cell receptive field closely matched one of the subunits from one or more ganglion cells (Fig. 3; see also Supplementary Fig. 7 for more examples).
We quantitatively evaluated the match of bipolar cell receptive fields and subunits by computing their overlap, defined as the relative shared area (see Methods). From a total of 17 recorded bipolar cells, we found 9 bipolar cells whose receptive field displayed a close match with at least one ganglion cell subunit, as shown by overlap values >0.5 and reaching up to 0.86. For other recorded bipolar cells, we found no matching subunits (Supplementary Fig. 7), consistent with the expectation that not all ganglion cells will be connected to a given nearby bipolar cell because of the multitude of bipolar and ganglion cell types.
To statistically evaluate these overlap values, we compared them to maximal overlap values from surrogate data sets, which we obtained by randomly rotating the receptive fields and randomly permuting their center positions for all ganglion cells whose receptive fields overlapped with a given bipolar cell (see Methods). This procedure showed that the experimentally observed maximal overlap values were significantly larger than the maximal overlap values that should be encountered by chance (p = 0.0068, Fisher’s combined probability test). Thus, the good match of bipolar cell receptive fields and ganglion cell subunits suggests that the subunits identified with the STNMF method indeed correspond to the receptive fields of individual presynaptic bipolar cells.
Subunit layouts help predict ganglion cell activity
Are the STNMFderived subunits relevant for understanding how the ganglion cells respond to visual stimuli? We studied this question by assessing the importance of the subunits for predicting the ganglion cell response to novel stimuli. We first considered “frozennoise” sections from the spatiotemporal whitenoise stimulation that were repeatedly inserted into the stimulus sequence. The frozennoise sections were not used for estimating the subunits and therefore provided a heldout test set. Temporal filtering was again taken care of by convolving the stimulus sequence of each pixel with the temporal component of the cell’s STA, analogous to the computation of the effective spiketriggered stimuli (Supplementary Fig. 1). We then compared a standard linearnonlinear (LN) model, where the spatial component of the STA was used as a stimulus filter, to a subunit model that contained multiple filters, corresponding to the identified subunits (Fig. 4a). In the subunit model, the filter outputs were rectified and then summed in a weighted manner. The weights were determined by the linear combination of subunits that best matched the receptive field. This means that the LN model and the subunit model gave approximately equal total weight to each stimulus pixel. For both models, a subsequent output nonlinearity, obtained from the nonrepeated sections of the whitenoise stimulus, transformed the resulting signals into a firing rate.
Compared to the LN model, we found that this simple approach of incorporating the subunits could already substantially improve the prediction of firing rates for the heldout spatiotemporal whitenoise segments, in particular when the LN model itself performed poorly (Fig. 4b, c). Intuitively, the superior performance of the subunit model results from the fact that pixel values will often cancel out toward zero over the entire receptive field, thus not allowing the LN model to predict spikes. Individual subunits, on the other hand, may still be strongly activated, leading to spiking responses both in the subunit model and in the experimental data.
One might hypothesize that the superior performance of the subunit model results primarily from inserting an intermediate rectification and not from including the layout of localized subunits. To test this hypothesis, we also set up a shuffled subunit model. The shuffled subunit model was obtained by taking the subunits of the subunit model and randomly permuting the pixel values at each spatial location across the subunits. Otherwise, the shuffled subunit model was treated and evaluated in the same way as the actual subunit model. Comparing performance of these two models showed that shuffling the subunits leads to substantially worse response predictions (Fig. 4c, right), indicating that, beyond the rectification before spatial summation, the actual subunit layout is important for response predictions under whitenoise stimulation.
To evaluate whether the subunit layout is also important for predicting responses to natural stimuli, we measured ganglion cell responses to briefly flashed natural photographs (Fig. 4d, e) and compared these to model predictions. We only considered the average spike count elicited by each image and could therefore omit temporal stimulus integration here. We furthermore dispensed with the output nonlinearities for this analysis and only aimed at predicting the rank order of the 300 applied images. This made the model comparison independent of how well the final output nonlinearity captures the neuronal sensitivity in this specific stimulus context. Thus, the only model parameters here were the receptive field for the LN model and the set of subunits for the subunit model, which were all obtained from the spatiotemporal whitenoise experiments. Similar to the results under whitenoise stimulation, we found that the subunit model clearly and systematically outperformed both the LN model as well as the shuffled subunit model (Fig. 4f), demonstrating the importance of the subunit layout for capturing the encoding of natural stimuli. Likewise, we found that the subunit model was also superior in capturing more subtle differences between images; it predicted response differences for slightly shifted presentations of the same natural images much better than the considered alternatives (Supplementary Fig. 8).
While these analyses showed that knowledge about the subunits can improve response predictions over the simple LN model, there is apparently still room for improvement, in particular, through optimizing the subunit nonlinearities and including feedback dynamics both on the level of subunits and on the global level after subunit integration. We here did not pursue these options further because our primary goal in this work was to investigate the potential of the STNMF method to extract subunits that are interpretable in terms of actual circuit elements. Yet, to check how the effect of including subunits relates to current stateoftheart approaches in analyzing nonlinear stimulus integration, we compared our results to the Nonlinear Input Model (NIM), which extends the Generalized Linear Model framework to include subunitlike nonlinear stimulus integration^{28}. In order to allow for a direct comparison with our subunit model and to cope with the high dimensionality of our stimulus space, we here used a reduced version of the NIM, with time integrated out like for the STNMF approach and no dependence of spiking probability on previous spikes. For this reduced NIM, we found that the obtained filters, unlike the subunits of the STNMF method, were not localized in space and that the response predictions for heldout white noise segments did not improve over the STNMFderived subunit model (Supplementary Fig. 9). Clearly, we have not explored the full potential of the NIM here, but the comparison at least indicates that subunits obtained by STNMF provide a competitive spatial layout for developing generative models of ganglion cell spiking.
Identification of shared input to different ganglion cells
The STNMF analysis does not require adjusting stimuli for the analysis of individual cells. We can therefore obtain subunits from many ganglion cells recorded simultaneously under spatiotemporal whitenoise stimulation and compare the layout of identified subunits for cells with overlapping receptive fields. This provides for the possibility to check whether ganglion cells of different identified functional types have matching subunit layouts, which would indicate that they share presynaptic inputs from the same bipolar cells. In our recordings from the salamander retina, two classes of ganglion cells could be readily identified (see Methods). Fast Off cells were characterized by their relatively small receptive fields, fast temporal filters and stereotypic spike autocorrelation, and their receptive fields were found to tile the retina (Fig. 5a). Directionselective (DS) ganglion cells were detected by their directional tuning for drifting gratings (see Methods), though the class of DS cells may contain DS cells of two different types^{39}.
The STNMF method allowed subunit identification in a highthroughput manner for each cell in these large populations, providing a dense map of bipolar cell inputs to fast Off cells (Fig. 5b), with about 8–10 identified subunits per cell (Fig. 5c). For both fast Off and DS cells, the sizes of identified subunits were densely clustered around 100 µm diameter (Fig. 5d). This matches previous measurements of bipolar cell receptive field sizes in the salamander retina^{40}, which had yielded diameters in the range of 50–150 µm, and is also comparable to typical salamander bipolar cell dendritic field sizes^{41}.
The dense sampling of analyzed ganglion cells allowed us to investigate the relative positioning of subunits for pairs of ganglion cells within and across the two cell classes. For pairs of both fast Off and DS cells as well as for mixed pairs, we found that the cells can display subsets of closely matching subunits (Fig. 5e). In order to analyze whether these matches indicate a systematic structure of the subunit inputs to multiple ganglion cells or whether they could simply be chance occurrences, we evaluated the overlap between all pairs of subunits from different ganglion cells in the same recordings. To do so, we computed the relative overlap of a subunit pair as the ratio between the shared area and the total area covered by the 1.5sigma contours of the subunits. We then compiled these values into histograms (Fig. 5f; leaving out subunit pairs with no overlap at all) and compared them to overlap distributions from randomized subunit layouts. The latter were obtained by repeatedly permuting the spatial positions of the ganglion cells at random, that is, for each ganglion cell, we spatially translated the subunit layout so that the receptive field center position of that cell was shifted to the receptive field center position of a randomly chosen ganglion cell of the same class in the same recording. This showed that the true ganglion cell layout yielded many more pairs of subunits with a large relative overlap than the randomly permuted ganglion cell layouts. Note that large subunit overlaps by chance were rare; the distributions obtained from the random permutations rapidly approached zero for increasing overlap values. Each of the actual overlap distributions, on the other hand, contained many pairs of subunits with overlap values >0.5, corresponding to several times the number of subunit pairs expected from chance (fast Off vs. fast Off: 69 actual pairs vs. 25 ± 5, mean ± SD, in the shuffle data; DS vs. DS: 6 vs. 1 ± 1; fast Off vs. DS: 49 vs. 11 ± 4). Thus, the STNMFderived subunits capture the systematic sharing of bipolar cell inputs by ganglion cells of the same type as well as across the two analyzed classes of ganglion cells. Furthermore, it is noteworthy that the strongly overlapping subunits of different ganglion cells were recovered from independent sets of spikes, providing further evidence that the identified subunits indeed correspond to specific circuit elements, namely presynaptic bipolar cells.
Discussion
We here demonstrated that STNMF can reveal the subunit structure of receptive fields (Figs. 1 and 2). An appealing aspect of the method is that the subunits naturally emerge from the analysis—much like the receptive field emerges from an STA analysis—without the need to guess a specific model structure that may be constrained in terms of subunit shape or subunit nonlinearity or that may require identical subunits arranged in an orderly layout. Moreover, we showed that the identified subunits match actual circuit elements, the receptive fields of presynaptic bipolar cells (Fig. 3). Thus STNMF provides a way to link structure and function in the neural circuit, for example, by using the inferred subunit layout as a basis for improved models of sensory encoding (Fig. 4). Finally, application of the method only requires recorded spike times under highresolution whitenoise stimulation and is therefore applicable to highthroughput analyses of populations of simultaneously recorded cells (Fig. 5), providing insight into the divergence and convergence of sensory information between subsequent processing layers.
Regarding bipolartoganglion cell connectivity, previous studies, based on current injections into bipolar cells^{42} as well as anatomybased circuit reconstructions^{43}, had suggested considerable diversity in the connectivity matrix between bipolar and ganglion cells. Here, on the other hand, the identified orderly sets of subunits within ganglion cell receptive fields suggest a rather high degree of specificity in the functional connectivity of individual ganglion cells. It seems likely that the identified subunits correspond to primary bipolar cell connections, which provide the major excitatory input under the applied stimulus, but that there may also be secondary connections, including polysynaptic connections^{42}, with other bipolar cells, which may have more modulatory effects or are invoked in other stimulus contexts. Furthermore, the functionally rather different types of fast Off and DS cells in the salamander retina appear to share inputs from the same bipolar cells. That such input sharing exists should be expected simply because of the larger number of ganglion cell types compared to bipolar cell types. Indeed, similar sharing was seen in anatomical investigations of mouse retina, with DS cells strongly connecting to the same bipolar cells as local edge detectors^{43}. Analyses of subunit sharing as presented here complement these connectivity studies by identifying common input from a functional perspective.
How does STNMF work? Essentially, the method detects correlation patterns in the set of spikeeliciting stimuli. Stimulus pixels within a subunit can more easily cancel each other’s effect on the activation of the ganglion cell than pixels from different subunits, and their contrast values will therefore be more strongly correlated for spikeeliciting stimuli to avoid this cancellation. These correlations are extracted and used by the NMF to find a basis for representing the spikeeliciting stimuli. Thus, the method, as introduced here, is restricted to stimuli with whitenoise statistics because correlated stimuli would bias the NMF to represent these prior stimulus correlations. Also, this shows that the nonlinear integration of subunit signals is essential because this nonlinearity creates the differences in the pixel correlations. Thus, the method would fail for cells with purely linear stimulus integration, and stronger nonlinearities (typically stronger rectification) will facilitate the subunit detection. Note also that the nonnegativity constraint on the modules prevents the method from identifying opposing contrast preference within the same subunit. Thus, the identified subunits may be thought of as receptive field centers of bipolar cells, but any bipolar cell receptive field surround would not be detected. A further limitation is the dependence on sufficient amounts of data. We here generally aimed for recording several thousands of spikes under the whitenoise stimulation to have enough statistics in the spiketriggered ensemble. A typical effect of insufficient data is the failure to detect all subunits so that parts of the receptive field remain uncovered by subunits. Owing to the data demand, potential future extensions of the method that may aim at analyzing full spatiotemporal subunits need to find ways to handle the resulting higher stimulus dimensionality. This may be facilitated by combining NMF with a factorization into sets of purely spatial and purely temporal modules, an approach that has recently been developed for decomposing neuronal population activity^{44}.
We tested the STNMF method on ganglion cell recordings from salamander retina, a system that allowed us to compare the extracted subunits with simultaneously recorded bipolar cell receptive fields. Yet, the method should also work similarly for mammalian retinas. In fact, we found in a proofofprinciple manner that application of STNMF to ganglion cell recordings from mouse retina also yields orderly layouts of localized subunits (Supplementary Fig. 10).
Moreover, nonlinear pooling of presynaptic signals is ubiquitous in sensory systems, and identifying underlying subunit structures is a common goal not only for the retina^{20, 21, 29, 34}, but also for thalamus^{28}, primary visual cortex^{10,11,12,13}, higher visual cortex areas^{14,15,16}, and the auditory system^{28, 45}. The STNMF method should be readily applicable to these different systems, as it does not require specific assumptions about the nonlinear interactions between subunits and does not rely on concomitant acquisition of anatomical information^{20, 46}. Note that the spatial stimulus dimension that was analyzed here could be replaced by other stimulus coordinates, along which neurons might be organized, such as spectral components of auditory stimuli.
Future applications of the STNMF method may lie in investigating neural coding as well as in analyzing neural circuits. For example, subunit models enhanced by further features, such as optimized subunit nonlinearities, inhibitory interactions, and/or adaptation or feedback dynamics both before and after spatial summation should provide a promising basis for the difficult task of modeling responses to general, natural stimuli^{26}. Using STNMF as a designated tool to first obtain the subunit layout with subsequent investigations of additional model features will facilitate parameter estimation for such enhanced models. For example, a previous exploration of a retinal subunit model with temporal filtering and feedback^{30}, which applied a global optimization approach for all model parameters, had to restrain the parameter space by enforcing identical shapes of subunits and restricting the analysis to a single spatial dimension by applying a stripelike stimulus layout. Prior identification of subunits by STNMF may considerably reduce the numbers of parameters in a subsequent model fit. Moreover, when subunit identification is performed in an online fashion during an experiment, probe stimuli could directly be targeted at individual subunits in order to examine local nonlinearities^{20, 29} as well as local adaptation features^{47, 48}.
Similar analyses might also be applied when a retina is not stimulated via its photoreceptors, but through optogenetic constructs inserted into bipolar cells^{49,50,51}, which is currently considered as a promising approach for vision restoration therapy when photoreceptors have degenerated. Subunit identification in such therapeutic models should aid analyses of how the optogenetic stimulation is processed by the retina and how it might be optimized to activate ganglion cells. Finally, largescale recordings from the retina may allow functional identification of a large set of different ganglion cell types^{52}, providing a basis for largescale analyses of functional connectivity, complementing highresolution measurements of receptive fields^{53} as well as anatomybased identification of connection patterns^{43, 54}.
Methods
Electrophysiology
Recordings were made in isolated retinas obtained from axolotl salamanders (Ambystoma mexicanum; pigmented wild type) of either sex. All experimental procedures conformed with institutional guidelines of the University Medical Center Göttingen. Multielectrode array (MEA) recordings of ganglion cell spiking activity were obtained as described previously^{55}. In brief, animals were killed after about 30 min dark adaptation, and both eyes were enucleated and hemisected to isolate the retina. The retina was placed onto a 252channel MEA in a recording chamber and superfused with oxygenated Ringer’s solution at room temperature (around 22 °C). A transparent dialysis membrane stretched across a plastic holder was placed on top of the retina to hold it in place during the recording. We also performed MEA recordings with retinas from adult wildtype mice (C57BL/6, 7–12 weeks old) of either sex as described previously^{56}. Here, retinas were superfused with oxygenated Ames’ medium, buffered with 22 mM NaHCO_{3}, heated to a constant temperature around 33–34 °C, and held in place by a coating of polydlysine on the array. Spikes were extracted by custommade software, based on a Gaussian mixture model and an expectationmaximization algorithm^{57}. Only wellsorted units with clear refractory period were used for further analysis.
Combined recordings of ganglion cells and bipolar cells from salamander retina were obtained by placing the retina onto a 60channel perforated MEA^{58}. The perforated MEAs contain small holes in between the electrodes, so that slight suction applied underneath the array held the retina tightly in place while allowing unrestricted access to the tissue with sharp microelectrodes from the top. Sharp microelectrodes, tipfilled with 4% Neurobiotin, dissolved in 0.1 M Tris buffer, and backfilled with 3 M KCl solution with impedance in the range of 100–300 MΩ, were inserted blindly into retinal cells. By monitoring through a 60× objective, the microelectrode was positioned at the photoreceptor surface of the retina roughly above a selected MEA recording site, which was chosen according to the observed ganglion cell spiking activity to maximize chances of recording pairs of bipolar and ganglion cells with overlapping receptive fields. The microelectrode was then inserted into the retina and advanced until a cell was impaled while monitoring the depth of the electrode tip in the tissue. After the recording, Neurobiotin was injected into the intracellularly recorded cell with current pulses (alternating blocks of several seconds of 1 Hz positive or negative pulses). The retina was fixated with 4% paraformaldehyde, processed further with Alexa Fluor 488 Streptavidin, and imaged under a confocal microscope to visualize the Neurobiotinfilled cell. Twodimensional images were obtained by a maximum projection in the x–z plane. To reduce blur, we applied the blinddeconvolution algorithm in Matlab (deconvblind), using an estimate of the pointspread function obtained by imaging fluorescent beads.
When cell staining and imaging were successful, the cell morphology was used to confirm that the intracellularly recorded cell was indeed a bipolar cell. Occasionally encountered amacrine cells were discarded for the present analysis. In some experiments, morphological reconstruction failed because the recorded cell was lost before dye injection or because the retina could not be removed from the perforated MEA in an intact manner^{58}. We then used additional criteria to identify bipolar cells. Bipolar cells were distinguished from photoreceptors by recording depth, by the receptive field size, and by the characteristic light responses of photoreceptors. Intracellularly recorded cells that were morphologically verified as photoreceptors showed stereotypical response traces to positive and negative contrast steps and receptive field sizes of 10–20 µm diameter. In some recordings, we also applied the AMPA/kainate antagonist CNQX at the end of the experiment to check that light responses were lost for putative Offtype bipolar cells, whereas photoreceptor light responses were insensitive to CNQX. To distinguish bipolar cells from amacrine cells, we applied depolarizing and hyperpolarizing current pulses into the recorded cell (50–500 pA, 500 ms duration, 2 s intervals) and checked that a robust activation of ganglion cells to positive current injection was observed^{59}.
Visual stimulation
Visual stimuli were controlled by custommade software, written in C+ + and using the OpenGL library, and displayed on a gammacorrected, monochromatic white OLED monitor (800 × 600 pixels, 60 Hz refresh rate). The monitor was projected onto the photoreceptor layer either through a telecentric lens above the retina (252electrode MEA recordings, pixel size 7.5 × 7.5 µm on the retina) or through the objective of an upright microscope with a beamsplitter inserted into the light path (combined bipolar cell and MEA recordings, pixel size 2.5 × 2.5 µm on the retina).
We optically stimulated the retina with spatiotemporal white noise, temporally updated at a rate of 30 Hz and spatially arranged in a checkerboard layout with stimulus pixels of 30 × 30 µm. For some bipolar cell recordings, the stimulus update rate was reduced to 10 or 15 Hz. The light intensity of each square was chosen independently from a binary distribution with 100% contrast and a mean light level of about 2.5 mW m^{−2}. In all analyses, stimuli were represented by their contrast values, so that the stimulus values for the bright and dark squares were +1 and −1, respectively. Typical recording durations with this stimulus were 60–180 min for standard MEA recordings and 60 min for combined bipolar/MEA recordings. For bipolar cell recordings, we also applied 10 min of stimulation with spatiotemporal white noise of 10 × 10 µm pixel size to evaluate receptive field size for small cells and distinguish bipolar cells from photoreceptors.
To stimulate the retina with natural images, we selected a set of 300 natural photographs from the McGill Calibrated Colour Image Database^{60}, displaying a wide range of natural scenes. Each image had a spatial resolution of 256 × 256 pixels, covering a total area of 1920 × 1920 µm on the retina. The provided RGBcolor values for each image were converted into greyscale by a weighted average of the three color channels with R:G:B = 30:59:11. Mean and standard deviation of the pixel values were normalized for each image by appropriately shifting and scaling the values so that the mean pixel intensity was equal to that of the spatiotemporal white noise, and the standard deviation was 50% of the mean intensity. Pixel values that then deviated from the mean by more than 100% in either direction were clipped to ensure that the maximal pixel values were within the physically available range of the display. To minimize the artefacts induced by this clipping, we selected images that had only few clipped pixels (not more than 0.1% of the pixels). Images were presented individually for 200 ms each in a pseudorandom sequence, with an interstimulusinterval of 800 ms, during which uniform illumination at the mean intensity was presented. For data analysis, we counted the number of spikes for each ganglion cell over a 300ms window following stimulus onset.
For experiments with shifted natural images, we further selected 10 images from the set of 300 images. Each image was presented with nine different center positions, arranged on a 3 × 3 square grid, with 90 µm between adjacent positions. Stimulation with the resulting 90 images and assessment of responses then occurred in the same way as for the set of 300 different natural images.
Receptive field analysis
From the response to the spatiotemporal whitenoise stimulus, we computed the STA for each recorded ganglion cell^{27}, taking into account stimulus sequences of 670 ms before each spike. We then decomposed the STA into a temporal filter and a spatial receptive field through singularvalue decomposition^{61}, using the toprank temporal and spatial components of the decomposition. Both temporal filter and receptive field were normalized to unit Euclidean norm so that the sum of squares of the filter elements equaled unity for both components. Receptive field sizes were estimated by fitting a twodimensional Gaussian function to the spatial receptive field and determining the effective diameter \(d = \sqrt {a \cdot b} \), where a and b are the major and minor axis of the 1.5sigma contour of the fitted Gaussian.
For bipolar cells, the same approach was used, except that the STA was replaced by the reverse correlation of the stimulus with the measured membrane potential. Specifically, we temporally binned the recorded membrane potential at the same rate as the stimulus update rate by computing the average potential over each bin. We then subtracted the mean from this sequence of membrane potentials and used the resulting values as weights for the preceding stimulus sequences. The weighted sum of the stimulus sequences then provided the spatiotemporal receptive field of the bipolar cell.
Celltype classification
We detected DS ganglion cells by analyzing the responses to drifting squarewave gratings (100% contrast, 600 µm spatial period, 450 µm s^{−1} velocity) moving in eight different directions for 6.67 s each, with the entire sequence repeated five times. From the average firing rate r _{ θ } for each direction θ (leaving out the first 1.33 s after stimulus onset), we computed a directionselectivity index (DSI) as the normalized vector sum, \({\rm{DSI}} = \left {\mathop {\sum}\nolimits_\theta {{r_\theta }\,{e^{i\theta }}} } \right/\mathop {\sum}\nolimits_\theta {{r_\theta }} \). Note that the definition of the DSI via the vector sum differs from the often applied measure that uses the response difference between preferred and null direction. We then determined DS cells as cells with a significantly large DSI and at least DSI > 0.25. Significance was here established by repeatedly shuffling the firing rates over all angles and trials 10,000 times for a given cell to obtain the distribution of DSI values under the null hypothesis that the firing rates are independent of the motion direction. A cell for which the DSI was larger than 95% of the DSI values obtained from the corresponding shuffled data was considered significantly direction selective.
Note that two types of DS ganglion cells have recently been found in the salamander retina^{39}, “standard DS cells” and “OMSDS cells”. The latter are characterized by their small receptive fields and by also being objectmotionsensitive (OMS), that is, their responses are (partly) suppressed under global motion^{4}. We here did not distinguish between these two types of DS cells, yet we generally find considerably more standard DS cells than OMSDS cells in our recordings^{39}, and the fairly large receptive field sizes of the DS cells in the present data (364 ± 73 µm, mean ± SD) also indicate that most of the analyzed DS cells are of the standard DS cell type.
Fast Off cells were identified by performing a cluster analysis of simultaneously recorded ganglion cells. To obtain the parameters for the cluster analysis, we performed principal component analysis on the set of all temporal filters as well as on all spiketrain autocorrelation functions. The latter were obtained also under spatiotemporal white noise, with a maximal lag of 60 ms and binned at 2ms resolution. Each cell was then described by four parameters, its receptive field size, the projections of its temporal filter on the first two principal components of all temporal filters, and the projection of its autocorrelation function on the first principal component of all autocorrelation functions. The variance of each parameter was normalized to unity. In this fourdimensional space, we performed spectral clustering^{62, 63} (details below) with typically around K = 10 clusters. We then identified fast Off cells as the elements of one of the clusters, which was characterized by always being strongly populated as well as by displaying the shortest peak times of the temporal filters, relatively small receptive fields, and a peak in the spiketrain autocorrelation at about 10 ms. When there was either apparent contamination of the fast Off cell cluster (identified by variability in the cell parameters and violations of tiling) or if fast Off cells were distributed over two or more clusters (identified by clusters with similar cell parameters and complementary tiling), cells were reclustered with an adjusted value K for the number of clusters. Note that the aim of the cluster analysis was not to determine the number or identity of all cell types, but simply to extract the single type of fast Off cells.
To perform the spectral clustering, we defined an adjacency matrix A, whose elements \({A_{ij}} = \exp \left( {  {{\left\ {{{\bf{X}}_i}  {{\bf{X}}_j}} \right\}^2}/{\sigma ^2}} \right)\) capture the pairwise Gaussian similarity between cells i and j, where X _{ i } and X _{ j } are the fourdimensional vectors of the two cells’ parameters and σ is a scale parameter. We then computed the normalized graph Laplacian matrix^{62} L = D ^{−1/2} AD ^{−1/2}, where D is the diagonal matrix with \({D_{ii}} = \mathop {\sum}\nolimits_j {{A_{ij}}} \), and extracted those K eigenvectors of L that had the largest eigenvalues. In the space that is spanned by these eigenvectors, clustering of data points that are connected by large similarity values is typically simpler than in the original parameter space^{62, 63}, and we applied kmeans clustering to obtain the final set of K clusters. To optimize the scale parameter σ for each recording, we used the suggested procedure^{62} of performing the clustering for a range of σvalues (here from 0.1 to 1.0 in steps of 0.005) and selecting the one that yielded the most compact clusters, corresponding to minimal total withincluster distances of the normalized representations of the X _{ i } in the space extracted by the eigenvector analysis.
Fast Off cells represented by far the largest homogeneous class of cells in our recordings (comprising up to half of the cells in some recordings). They were also the only class obtained from the clustering for which we observed receptive field tiling, consistent with previous classification analyses of ganglion cells in the salamander retina^{64, 65}, where these cells are referred to as “biphasic Off cells”. Thus, the present lack of a solid, reliable classification scheme for other ganglion cell types in the salamander retina led us to focus our celltype analyses on the fast Off and DS cells.
Spiketriggered nonnegative matrix factorization
For each recorded ganglion cell, we extracted the effective spiketriggered stimulus ensemble from the responses to the spatiotemporal whitenoise stimulation in the following way. For each of the N _{spikes} recorded spikes, we took the preceding 670ms stimulus sequence and computed a weighted average over time by using the cell’s temporal filter as a weight function. Concretely, we regarded the 670ms stimulus sequence (20 stimulus frames) of contrast values for each pixel as a vector (with values of +1 and −1 corresponding to dark and bright illumination of the pixel, respectively) and computed the scalar product with the corresponding vector from the 670mslong temporal filter. Doing this for every pixel yields an effective spatial pattern where each pixel value, which can be positive or negative, measures how well the contrast sequence at the corresponding pixel matched the preferred temporal contrast sequence of the cell. To reduce the analyzed spatial region to the neighborhood of the cell’s receptive field, we then only considered the minimal rectangular region in space that fully contained the threesigma contour of the fitted Gaussian function.
The spiketriggered stimuli form a matrix S = (s _{ ij }), where the index i = 1…N _{spikes} counts over all spikes and the index j = 1…N _{pixels} enumerates all stimulus pixels of the considered rectangular analysis window. We then apply seminonnegative matrix factorization^{36} to the matrix S, which aims at identifying a decomposition W ⋅ M that best approximates S under the constraint that the elements of the matrix M are all nonnegative. Here, M is a N _{modules} × N _{pixels} matrix, whose rows contain the modules of the decomposition, and W is a N _{spikes} × N _{modules} matrix, which contains the weights of each module for each spiketriggered stimulus. Placing a nonnegativity constraint only on M allows negative components in S and W so that stimuli can be represented by the positive or negative deviations from the mean light intensity (contrast), which here is the relevant parameter for driving the spiking activity.
In principle, there may be transformations of W and M (for example, linear scaling) that keep W ⋅ M fixed and do not affect the nonnegativity constraint, which would lead to multiple equivalent decompositions. To reduce the problem of nonunique solutions, we enforced a normalization of the matrix W by constraining each column of W to have unit Euclidean norm, and we applied a common sparsity constraint on the columns of M ^{66, 67}. Together, we thus sought to minimize, under the nonnegativity constraint on M and the normalization constraint on W, the objective function
where the M _{ i } are the columns of M, \({\left\ {\, \cdot \,} \right\_{\rm{F}}}\) is the Frobenius matrix norm, \({\left\ {\, \cdot \,} \right\_{\rm{1}}}\) is the l _{1}norm, and λ is a sparseness parameter, which was set to λ = 0.1 to obtain a reasonable tradeoff between sparseness and reconstruction error.
Solutions for this minimization problem can be found iteratively by alternating between optimizing W while keeping M fixed and vice versa. To start the algorithm, the elements of M were initialized with random numbers, drawn uniformly between zero and unity. The optimization of W is a conventional leastsquares problem, which can be solved analytically by multiplying S with the pseudoinverse of M. This is followed by a normalization of each column of W to unit Euclidean norm. The subsequent optimization of M, on the other hand, requires the numerical solution of a nonnegative leastsquares (NNLS) problem. Fortunately, there are computationally efficient algorithms available^{68, 69} that solve the NNLS problem iteratively by systematically probing the space of potential solutions along the boundaries that are defined by the nonnegativity constraint (active set method). We here based our implementation of the alternating optimization of W and M on the nonnegative matrix factorization Matlab toolbox by Li and Ngom^{70}.
The alternating optimization of the decomposition is known to rapidly converge to a stationary point where additional iterations do not further change the decomposition matrices^{68}. However, there is no guarantee that the obtained stationary point is optimal, that is, that it reflects a global minimum of the objective function. To reduce the impact of local minima of the objective function, we performed the following procedure: We ran the algorithm for a number of iterations, N _{iter}, and then defined the resulting matrix M as the current best solution M _{best} and assessed its performance by the residual of the reconstruction of S. We then inserted a perturbation of M _{best} (explained below) to obtain a new matrix M, which was used as the starting condition for another N _{iter} iterations. If, after these iterations, the newly resulting M provided an improvement in terms of the residual over M _{best}, M _{best} was updated to this new solution; otherwise the previous N _{iter} iterations and the perturbation were discarded. Then a new perturbation of the current M _{best} was applied, and the process was repeated for a total of N _{pert} perturbations. In addition, we repeated the entire procedure 100 times with different random initializations of M, and the solution with the smallest residual was selected. We found that, typically, many of the obtained 100 solutions had similarly small residuals and looked very similar or virtually identical, indicating that the chosen procedure successfully avoided erroneous solutions from local minima.
To perform a perturbation of the current best solution, we first identified putative localized subunits by computing for every module (that is, for every row of the matrix M _{best}) a measure of the spatial autocorrelation, called Moran’s I (see below), and selecting those modules with an autocorrelation value larger than a threshold value of 0.25. We then randomly selected one of the following manipulations, where “noise” always refers to random numbers, drawn uniformly between zero and unity: (1) replacing one randomly selected putative subunit by noise, (2) replacing one randomly selected nonlocalized module by a duplicate of a randomly selected putative subunit and then adding noise to both copies of the putative subunit, (3) splitting one randomly selected putative subunit into two halves, either vertically or horizontally, with the split occurring next to the pixel with the maximal value of the subunit, and substituting these two new modules for the original putative subunit and a randomly selected nonlocalized subunit, (4) reinitializing all nonlocalized modules with noise.
Inserting these perturbations was a crucial ingredient in avoiding local minima of the objective function and obtaining robust solutions. The concrete set of perturbations was chosen heuristically. For applying the STNMF method to different types of data, other types of perturbations may be useful for speeding up the method or for improving robustness. Similarly, the number of considered modules N _{modules}, the number of iterations N _{iter} between perturbations, and the total number of performed perturbations N _{pert} are parameters that are likely important for adjusting the method to the specifics of the data at hand, such as the dimensionality of the investigated stimulus space, the expected number of subunits, and the available amount of data. For the present analysis of salamander retinal ganglion cells, we applied N _{modules} = 20, N _{iter} = 20, and N _{pert} = 50, which we found to yield robust results in reasonable computation time. For analyzing data from simulated subunit models, we increased both N _{iter} and N _{pert} to 100, but only used a single run of the algorithm.
Evaluation of subunits
To identify subunits from the solution found for the module matrix M, we evaluated the localization of each module m (given by each of the rows of M, so that for the kth module m, the elements are given as m _{ i } = M _{ ki }) as well as its relation to the spiking activity of the neuron. The elements m _{ i }, i = 1, …, N _{pixels}, of each m correspond to different spatial locations within the analyzed region and can also be viewed as organized in a twodimensional N _{ x } × N _{ y } layout with N _{ x } ⋅ N _{ y } = N _{pixels}. The spatial autocorrelation of each m was calculated as Moran’s I, defined as: \(I = \frac{{{N_{pixels}}}}{{\mathop {\sum}\nolimits_i {\mathop {\sum}\nolimits_j {{w_{ij}}} } }}\frac{{\mathop {\sum}\nolimits_i {\mathop {\sum}\nolimits_j {{w_{ij}}} } \left( {{m_i}  \bar m} \right)\left( {{m_j}  \bar m} \right)}}{{\mathop {\sum}\nolimits_i {{{\left( {{m_i}  \bar m} \right)}^2}} }}\), where \(\bar m\) is the mean of the elements of m and the w _{ ij } are weights that equal unity whenever the spatial location of m _{ i } is adjacent to that of m _{ j } and zero otherwise. Values of I near zero are found for random distributions over space; localized modules generate values of I larger than zero and bounded by unity.
To relate the modules to the cell’s spiking activity, we interpreted each module as a spatial filter and then computed the nonlinearity that relates the activation of this filter to the evoked spike rate, that is, the average number of spikes elicited during the corresponding time bin of the response. To do so, the spatiotemporal whitenoise stimulus was again first convolved with the cell’s temporal filter. The resulting sequence of spatial stimuli was then filtered by computing the scalar product of the stimulus with the module to obtain a filter output. The filter output was binned into 40 bins in a way so that each bin contained the same number of data points in order to build a histogram of the dependence of the spike rate on the filter output. We displayed the nonlinearity by plotting the average filter output against the corresponding average spike rate for each bin. Finally, we quantified the relation between filter activation and evoked response by computing a gain value from this nonlinearity, which we defined as the difference between the maximal and the minimal spike rate in this histogram. To evaluate the gain of a module independently of the overall excitability of the cell, we also computed in the same way the gain for the spatial receptive field of the cell, obtained from the STA. The ratio of the module gain to the receptive field gain gave us the module’s normalized gain.
To automatically detect subunits from among the obtained modules, we applied criteria for both the spatial autocorrelation and the gain of the module. Specifically, we here defined subunits as those modules that had a Moran’s I of at least 0.25 or a normalized gain of at least 0.3.
Analysis of bipolar cellsubunit overlap
Identified ganglion cell subunits were compared to bipolar cell receptive fields based on the simultaneous recordings of ganglion cells and bipolar cells. We here recorded a total of 20 bipolar cells, three of which were excluded from further analysis because their receptive fields overlapped with two or fewer recorded ganglion cell receptive fields.
To quantify how well the identified ganglion cell subunits matched the receptive field of a simultaneously recorded bipolar cell (Fig. 3), we compared their contours as obtained from the 1.5sigma outlines of the fitted 2D Gaussians. We compared the area that was shared within the contours of the bipolar cell and of a subunit, A _{shared}, to the total area enclosed by the contours, which is given by A _{total} = A _{BC} + A _{subunit} − A _{shared}, where A _{BC} and A _{subunit} are the areas of the bipolar cell receptive field and of the subunit, respectively. The overlap was then computed as the ratio A _{shared}/A _{total}. The overlap yields values between zero and unity.
To test whether the encountered overlap values could arise by chance, we obtained the maximal overlap value for each bipolar cell recording and compared the set of these maximal overlap values from the actual data to maximal overlap values from surrogate data. Since the different bipolar cell recordings provided different numbers of recorded ganglion cells with overlapping receptive fields, we first assessed each bipolar cell recording separately by constructing separate surrogate data sets. For each bipolar cell recording, surrogate data were obtained by shuffling and rotating all ganglion cell receptive fields that overlapped with the bipolar cell receptive field (as determined by the 1.5sigma contours). Concretely, we created for each bipolar cell 1000 surrogate data sets by rotating each ganglion cell receptive field (and thereby the layout of subunits for that ganglion cell) by a random angle between 0 and 360° and by randomly permuting the receptive field center positions of the ganglion cells. We then determined the maximal overlap of the bipolar cell receptive field with any of the subunits of each surrogate data set and used the distribution of the 1000 maximal overlap values to determine the probability that a value larger than the observed maximal overlap value would be obtained by chance. Finally, the set of these probability values was tested for significance by Fisher’s combined probability test.
Analysis of subunit overlap in ganglion cell populations
To quantify how well individual subunits from different ganglion cells matched each other, we computed their relative overlap in the same way as for analyzing the match between subunits and bipolar cell receptive fields. Thus, the overlap is given by A _{shared}/(A _{1} + A _{2} − A _{shared}), where A _{1} and A _{2} are the areas within the 1.5sigma contours of the two subunits and A _{shared} is the shared area.
The analysis of subunit overlaps at the population level (Fig. 5) incorporates data from cells with a wide range of firing rates and noise levels. To, nonetheless, make this analysis robust against the occurrence of spurious subunits, we here included only subunits that robustly occurred in the analysis for different random initializations of the module matrix M. Concretely, we used Gaussian fits to compute the center points for all final subunits from all 100 runs with different initializations (see section on “Spiketriggered nonnegative matrix factorization”). We then took the subunits from the single best run and checked for each of these whether within a circle of 30µm radius around its center point there were subunit center points in at least 50 of the 100 runs. If that was the case, we defined a robust subunit as the pixelwise average of all the subunits with center points in this circle.
To compare the distribution of overlap values with chance level, we randomly permuted the receptive field center positions of the ganglion cells within each cell type and recording and then computed the overlap values between the correspondingly relocated subunits. This shuffling procedure was repeated 100 times to obtain mean values and standard deviations for the distribution of overlap values (Fig. 5).
Response predictions
To assess the relevance of the subunit layout for predicting ganglion cell responses, we compared a subunit model and a standard LN model for predicting responses to three different stimulus sets: (1) heldout spatiotemporal whitenoise sequences, which were repeatedly inserted as identical stimulus sequences (frozen noise) between longer, nonrepeated whitenoise segments; (2) a set of 300 briefly flashed natural images; and (3) shifted natural images that used brief flashes of the same image with slightly different spatial positioning (see “Visual stimulation”). For these model evaluations, the model parameters were generally obtained from the nonrepeated whitenoise segments so that the evaluations were performed on stimuli that were not used for obtaining parameters. Only in the analysis of natural images at slightly different positions, one parameter (the gain of the final output nonlinearity in each model) remained free and was fitted to the test data.
The spatiotemporal whitenoise sequences were first convolved with the cell’s temporal filter to yield a sequence of effective spatial images. For all stimuli, model predictions were constructed by first computing a filter signal, based on either the cell’s spatial receptive field (LN model) or based on the set of identified subunits (subunit model). For the LN model, the filter signal F _{LN} was simply obtained by filtering the images with the spatial receptive field, as retrieved from the spiketriggered average. For the subunit model, the images were first filtered by each subunit individually. These filter outputs were halfwave rectified and then summed in a weighted manner in order to obtain the filter signal F _{subunit}. Note that this halfwave rectification is likely not the correct or best subunit nonlinearity and was taken here for simplicity and for balancing the number of parameters in the different models, making the evaluation of the subunit model a conservative estimate of its ability to predict responses. Since our primary goal here was to evaluate whether using subunits can improve response predictions over linear spatial summation as in the LN model and not to optimize response predictions, we did not try fitting subunit nonlinearities to the data, but rather aimed at minimizing the number of model parameters. The weights for the summation of subunit signals were determined from a leastsquares fit of the receptive field by the subunits, so that individual image pixels had similar relevance for the LN model prediction and the subunit model prediction.
To turn F _{LN} and F _{subunit} into predictions for the frozen whitenoise sections, we computed nonlinearities for both models from the nonrepeated parts of the whitenoise stimulus. This was done by relating F _{LN} and F _{subunit} to the average evoked firing rate in a histogram manner, similar to the computation of the gain for the subunits (see “Evaluation of subunits”), using again 40 bins of the filter signals and computing the average filter signal and average firing rate for each bin. The histograms were then fitted with nonlinear functions of the form \(r(F) = {a_1} \cdot \ln \left( {1 + {e^{{a_2} \cdot \;\left( {F + {a_3}} \right)}}} \right)\) by optimizing the parameters a _{1}, a _{2}, and a _{3} according to a leastsquares criterion. The fitted functions were used to obtain response predictions for the frozennoise sections. To quantify model performance, we computed for each model the correlation coefficient R between prediction and measured firing rate and reported the explained variance R ^{2}.
The models can only be expected to explain such variations of the firing rate that correspond to a deterministic signal, whereas any noise in the estimated firing rates provides variance that is inaccessible (“unexplainable”) to the model. We checked to what extent noise in the estimated ganglion cell firing rate might limit the explained variance by computing the explainable variance^{26} for each cell. Concretely, we separated the responses to the frozen noise into even and odd trials, computed the firing rate profiles for each, and calculated the explained variance R ^{2} between them^{26}. This is a measure of the reliability of the structure in the PSTH, that is, a measure of the explainable variance, which a model may hope to capture. We found that this measure was generally close to unity (0.97 ± 0.04, mean ± SD, N = 28 cells), indicating that noise in the estimation of the ganglion cell firing rates is not a limiting factor here, as expected from the large number of repeats of the frozen noise (more than 200).
For the set of 300 natural images, we did not use a nonlinearity to turn F _{LN} and F _{subunit} into actual response predictions for the evoked spike count, but rather, we used F _{LN} and F _{subunit} directly to predict the rank order of the images in terms of their average spike count. This procedure just assumes that any nonlinear transformation of the filter signals is monotonic, yielding larger spike counts for larger filter signals. Not applying an output nonlinearity makes the model evaluation independent of the accuracy of estimating the nonlinearity, which is likely to be different for the image presentation as compared to the whitenoise stimulation because of the different stimulus dynamics and because of adaptation. Thus, we quantified model performance by computing Spearman’s rank correlation coefficient for the relation between the image order according to the model prediction and the image order according to the measured average spike counts.
For the shifted natural images, presented at nine different positions, we used a different approach because using only nine positions was insufficient to get good sampling for the rank correlation. Instead, we here applied a halfwave rectification to the filter signals F _{LN} and F _{subunit} in order to predict the actual spike count elicited by the nine positions. The slope of the linear part of the halfwave rectification was left as a free parameter for each model, which was optimized by minimizing the rootmeansquare (RMS) error. Model performance was then quantified for each cell and each image by the obtained RMS error values.
For comparison, we also assessed performance of a model where the subunits were scrambled (shuffled subunit model) by randomly permuting the pixel values between the different subunits. This shuffling was done for each image pixel separately so that each pixel was filtered with the same set of weights as for the original subunits, but in different compositions. After this subunit shuffling, the corresponding model was obtained and evaluated in the same way as the original subunit model.
For comparison with the NIM^{28} (Supplementary Fig. 9), we analyzed the ganglion cells recorded under spatiotemporal white noise. We based our analysis on the NIM Matlab toolbox (http://neurotheory.umd.edu/nimcode). However, since it was not practically possible to fit the full version of this model for the long recording durations and the highdimensional spatiotemporal stimuli of our data, we simplified the model fitting as follows: as for the application of the STNMF method, we integrated out time by convolving the stimulus sequence with the temporal filter of the analyzed cell, and we set the postspike filter in the model to zero. Thus, the only components to be optimized were the spatial subunits and their nonlinearities. We initialized the model with normally distributed random numbers for the subunits and thresholdlinear subunit nonlinearities. (We also tested exponential subunits with no difference in results.) The number of considered subunits was set for each cell to the number of subunits identified by the STNMF method. These simplifications allowed us to apply the parameter fitting of the NIM for the large stimulus space considered in our analysis and to directly compare model performance, as temporal binning remained constant for the different models. The parameters for model optimization and regularization were kept identical to the original NIM implementation. Yet, clearly, our analysis of this reduced and restricted model does not aim at a full evaluation of the NIM’s potential to identify subunits or predict ganglion cell responses.
Code availability
The computer code (in Matlab) used for applying the STNMF method to experimental as well as simulated data is available from https://github.com/gollischlab/STNMFanalysis.
Data availability
All relevant data are available from the authors upon request.
References
 1.
EnrothCugell, C. & Robson, J. G. The contrast sensitivity of retinal ganglion cells of the cat. J. Physiol. 187, 517–552 (1966).
 2.
Victor, J. D. & Shapley, R. M. The nonlinear pathway of Y ganglion cells in the cat retina. J. Gen. Physiol. 74, 671–689 (1979).
 3.
Münch, T. A. et al. Approach sensitivity in the retina processed by a multifunctional neural circuit. Nat. Neurosci. 12, 1308–1316 (2009).
 4.
Ölveczky, B. P., Baccus, S. A. & Meister, M. Segregation of object and background motion in the retina. Nature 423, 401–408 (2003).
 5.
Zhang, Y., Kim, I. J., Sanes, J. R. & Meister, M. The most numerous ganglion cell type of the mouse retina is a selective feature detector. Proc. Natl Acad. Sci. USA 109, E2391–2398 (2012).
 6.
Barlow, H. B. & Levick, W. R. The mechanism of directionally selective units in rabbit’s retina. J. Physiol. 178, 477–504 (1965).
 7.
Hubel, D. H. & Wiesel, T. N. Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex. J. Physiol. 160, 106–154 (1962).
 8.
Movshon, J. A., Thompson, I. D. & Tolhurst, D. J. Receptive field organization of complex cells in the cat’s striate cortex. J. Physiol. 283, 79–99 (1978).
 9.
Adelson, E. H. & Bergen, J. R. Spatiotemporal energy models for the perception of motion. J. Opt. Soc. Am. A. 2, 284–299 (1985).
 10.
Vintch, B., Movshon, J. A. & Simoncelli, E. P. A convolutional subunit model for neuronal responses in macaque V1. J. Neurosci. 35, 14829–14841 (2015).
 11.
Rust, N. C., Schwartz, O., Movshon, J. A. & Simoncelli, E. P. Spatiotemporal elements of macaque V1 receptive fields. Neuron 46, 945–956 (2005).
 12.
Fournier, J. et al. Hidden complexity of synaptic receptive fields in cat V1. J. Neurosci. 34, 5515–5528 (2014).
 13.
Lochmann, T., Blanche, T. J. & Butts, D. A. Construction of direction selectivity through local energy computations in primary visual cortex. PLoS ONE 8, e58666 (2013).
 14.
Nishimoto, S. & Gallant, J. L. A threedimensional spatiotemporal receptive field model explains responses of area MT neurons to naturalistic movies. J. Neurosci. 31, 14551–14564 (2011).
 15.
Pack, C. C., Conway, B. R., Born, R. T. & Livingstone, M. S. Spatiotemporal structure of nonlinear subunits in macaque visual cortex. J. Neurosci. 26, 893–907 (2006).
 16.
Rust, N. C., Mante, V., Simoncelli, E. P. & Movshon, J. A. How MT cells analyze the motion of visual patterns. Nat. Neurosci. 9, 1421–1431 (2006).
 17.
Bölinger, D. & Gollisch, T. Closedloop measurements of isoresponse stimuli reveal dynamic nonlinear stimulus integration in the retina. Neuron 73, 333–346 (2012).
 18.
Borghuis, B. G., Marvin, J. S., Looger, L. L. & Demb, J. B. Twophoton imaging of nonlinear glutamate release dynamics at bipolar cell synapses in the mouse retina. J. Neurosci. 33, 10972–10985 (2013).
 19.
Demb, J. B., Zaghloul, K., Haarsma, L. & Sterling, P. Bipolar cells contribute to nonlinear spatial summation in the brisktransient (Y) ganglion cell in mammalian retina. J. Neurosci. 21, 7447–7454 (2001).
 20.
Schwartz, G. W. et al. The spatial structure of a nonlinear receptive field. Nat. Neurosci. 15, 1572–1580 (2012).
 21.
Turner, M. H. & Rieke, F. Synaptic rectification controls nonlinear spatial integration of natural visual inputs. Neuron 90, 1257–1271 (2016).
 22.
Kuo, S. P., Schwartz, G. W. & Rieke, F. Nonlinear spatiotemporal integration by electrical and chemical synapses in the retina. Neuron 90, 320–332 (2016).
 23.
da Silveira, R. A. & Roska, B. Cell types, circuits, computation. Curr. Opin. Neurobiol. 21, 664–671 (2011).
 24.
Gollisch, T. & Meister, M. Eye smarter than scientists believed: neural computations in circuits of the retina. Neuron 65, 150–164 (2010).
 25.
Schwartz, G. & Rieke, F. Perspectives on: information and coding in mammalian sensory physiology: nonlinear spatial encoding by retinal ganglion cells: when 1 + 1 not equal 2. J. Gen. Physiol. 138, 283–290 (2011).
 26.
Heitman, A. et al. Testing pseudolinear models of responses to natural scenes in primate retina. Preprint at bioRxiv http://doi.org/10.1101/045336 (2016).
 27.
Chichilnisky, E. J. A simple white noise analysis of neuronal light responses. Network. 12, 199–213 (2001).
 28.
McFarland, J. M., Cui, Y. & Butts, D. A. Inferring nonlinear neuronal computation based on physiologically plausible inputs. PLoS Comput. Biol. 9, e1003143 (2013).
 29.
Freeman, J. et al. Mapping nonlinear receptive field structure in primate retina at single cone resolution. Elife 4, e05241 (2015).
 30.
Real, E., Asari, H., Gollisch, T. & Meister, M. Neural circuit inference from function to structure. Curr. Biol. 27, 189–198 (2017).
 31.
Theis, L., Chagas, A. M., Arnstein, D., Schwarz, C. & Bethge, M. Beyond GLMs: a generative mixture modeling approach to neural system identification. PLoS Comput. Biol. 9, e1003356 (2013).
 32.
McIntosh, L. T., Maheswaranathan, N., Nayebi, A., Ganguli, S. & Baccus, S. A. Deep learning models of the retinal response to natural scenes. Adv. Neural. Inf. Process. Syst. 29, 1361–1369 (2016).
 33.
Maheswaranathan, N., Baccus, S. A. & Ganguli, S. Inferring hidden structure in multilayered neural circuits. Preprint at bioRxiv https://doi.org/10.1101/120956 (2017)
 34.
Kaardal, J., Fitzgerald, J. D., Berry, M. J. 2nd & Sharpee, T. O. Identifying functional bases for multidimensional neural computations. Neural. Comput. 25, 1870–1890 (2013).
 35.
Lee, D. D. & Seung, H. S. Learning the parts of objects by nonnegative matrix factorization. Nature 401, 788–791 (1999).
 36.
Ding, C., Li, T. & Jordan, M. I. Convex and seminonnegative matrix factorizations. IEEE Trans. Pattern. Anal. Mach. Intell. 32, 45–55 (2010).
 37.
Schwartz, O., Pillow, J. W., Rust, N. C. & Simoncelli, E. P. Spiketriggered neural characterization. J. Vis. 6, 484–507 (2006).
 38.
Samengo, I. & Gollisch, T. Spiketriggered covariance: geometric proof, symmetry properties, and extension beyond Gaussian stimuli. J. Comput. Neurosci. 34, 137–161 (2013).
 39.
Kühn, N. K. & Gollisch, T. Joint encoding of object motion and motion direction in the salamander retina. J. Neurosci. 36, 12203–12216 (2016).
 40.
Baccus, S. A., Ölveczky, B. P., Manu, M. & Meister, M. A retinal circuit that computes object motion. J. Neurosci. 28, 6807–6817 (2008).
 41.
Wu, S. M., Gao, F. & Maple, B. R. Functional architecture of synapses in the inner retina: segregation of visual signals by stratification of bipolar cell axon terminals. J. Neurosci. 20, 4462–4470 (2000).
 42.
Asari, H. & Meister, M. The projective field of retinal bipolar cells and its modulation by visual context. Neuron 81, 641–652 (2014).
 43.
Helmstaedter, M. et al. Connectomic reconstruction of the inner plexiform layer in the mouse retina. Nature 500, 168–174 (2013).
 44.
Onken, A. et al. Using matrix and tensor factorizations for the singletrial analysis of population spike trains. PLoS Comput. Biol. 12, e1005189 (2016).
 45.
Young, E. D., Yu, J. J. & Reiss, L. A. Nonlinearities and the representation of auditory spectra. Int. Rev. Neurobiol. 70, 135–168 (2005).
 46.
Brown, S. P., He, S. & Masland, R. H. Receptive field microstructure and dendritic geometry of retinal ganglion cells. Neuron. 27, 371–383 (2000).
 47.
Brown, S. P. & Masland, R. H. Spatial scale and cellular substrate of contrast adaptation by retinal ganglion cells. Nat. Neurosci. 4, 44–51 (2001).
 48.
Garvert, M. M. & Gollisch, T. Local and global contrast adaptation in retinal ganglion cells. Neuron 77, 915–928 (2013).
 49.
Lagali, P. S. et al. Lightactivated channels targeted to ON bipolar cells restore visual function in retinal degeneration. Nat. Neurosci. 11, 667–675 (2008).
 50.
van Wyk, M., PieleckaFortuna, J., Löwel, S. & Kleinlogel, S. Restoring the ON switch in blind retinas: OptomGluR6, a nextgeneration, celltailored optogenetic tool. PLoS Biol. 13, e1002143 (2015).
 51.
Mace, E. et al. Targeting channelrhodopsin2 to ONbipolar cells with vitreally administered AAV restores ON and OFF visual responses in blind mice. Mol. Ther. 23, 7–16 (2015).
 52.
Baden, T. et al. The functional diversity of retinal ganglion cells in the mouse. Nature 529, 345–350 (2016).
 53.
Field, G. D. et al. Functional connectivity in the retina at the resolution of photoreceptors. Nature 467, 673–677 (2010).
 54.
Kim, J. S. et al. Spacetime wiring specificity supports direction selectivity in the retina. Nature 509, 331–336 (2014).
 55.
Liu, J. K. & Gollisch, T. Spiketriggered covariance analysis reveals phenomenological diversity of contrast adaptation in the retina. PLoS Comput. Biol. 11, e1004425 (2015).
 56.
Krishnamoorthy, V., Weick, M. & Gollisch, T. Sensitivity to image recurrence across eyemovementlike image transitions through local serial inhibition in the retina. Elife 6, e22431 (2017).
 57.
Pouzat, C., Mazor, O. & Laurent, G. Using noise signature to optimize spikesorting and to assess neuronal classification quality. J. Neurosci. Methods 122, 43–57 (2002).
 58.
Reinhard, K. et al. Stepbystep instructions for retina recordings with perforated multi electrode arrays. PLoS ONE 9, e106148 (2014).
 59.
Asari, H. & Meister, M. Divergence of visual channels in the inner retina. Nat. Neurosci. 15, 1581–1589 (2012).
 60.
Olmos, A. & Kingdom, F. A. A biologically inspired algorithm for the recovery of shading and reflectance images. Perception 33, 1463–1473 (2004).
 61.
Gauthier, J. L. et al. Receptive fields in primate retina are coordinated to sample visual space more uniformly. PLoS Biol. 7, e1000063 (2009).
 62.
Ng, A. Y., Jordan, M. I. & Weiss, Y. On spectral clustering: analysis and an algorithm. Adv. Neural. Inf. Process. Syst. 14, 849–856 (2002).
 63.
von Luxburg, U. A tutorial on spectral clustering. Stat. Comput. 17, 395–416 (2007).
 64.
Marre, O. et al. Mapping a complete neural population in the retina. J. Neurosci. 32, 14859–14873 (2012).
 65.
Segev, R., Puchalla, J. & Berry, M. J. 2nd Functional organization of ganglion cells in the salamander retina. J. Neurophysiol. 95, 2277–2292 (2006).
 66.
Eggert, J. & Körner, E. Sparse coding and NMF. Proc. IEEE Int. Joint Conf. Neural Netw. 4, 2529–2533 (2004).
 67.
Kim, H. & Park, H. Sparse nonnegative matrix factorization via alternating nonnegativityconstrained least squares for microarray data analysis. SIAM J. Matrix Anal. Appl. 23, 1495–1502 (2007).
 68.
Kim, H. & Park, H. Nonnegative matrix factorization based on alternating nonnegativity constrained least squares and active set method. SIAM J. Matrix Anal. Appl. 30, 713–730 (2008).
 69.
Van Benthem, M. H. & Keenan, M. R. Fast algorithm for the solution of largescale nonnegativityconstrained least squares problems. J. Chemometr. 18, 441–450 (2004).
 70.
Li, Y. & Ngom, A. The nonnegative matrix factorization toolbox for biological data mining. Source Code Biol. Med. 8, 10 (2013).
Acknowledgements
This work was supported by the European Union Seventh Framework Programme (FP7ICT2011.9.11) under grant agreement number 600954 (VISUALISE), by the Horizon 2020 Programme (H2020MSCAIF2014) under grant agreement number 659227 (STOMMAC), by the Deutsche Forschungsgemeinschaft (GO 1408/21 and Collaborative Research Center 889, C1). and by the European Research Council (ERC) under the European Union's Horizon 2020 research and innovation programme (grant agreement number 724822). We furthermore acknowledge support by the Open Access Publication Funds of Göttingen University.
Author information
Affiliations
Contributions
J.K.L. and T.G. designed the experiments and data analysis. J.K.L. conducted the ganglion cell recordings from salamander retina and performed the subunit analyses of recorded ganglion cells. H.M.S. conducted the combined recordings of bipolar cells and ganglion cells and performed analyses and imaging of bipolar cells. V.K. conducted ganglion cell recordings from mouse retina. M.H.K. assisted in the bipolar cell recordings and in data analysis. A.O., S.P., and T.G. provided computational tools and assisted in data analysis. J.K.L., A.O., and T.G. designed and analyzed the computational models. F.R. developed and applied the clustering analysis of ganglion cell types. J.K.L. and T.G. wrote the paper with inputs from all authors.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Liu, J.K., Schreyer, H.M., Onken, A. et al. Inference of neuronal functional circuitry with spiketriggered nonnegative matrix factorization. Nat Commun 8, 149 (2017). https://doi.org/10.1038/s41467017001569
Received:
Accepted:
Published:
Further reading

Toward the Next Generation of Retinal Neuroprosthesis: Visual Computation with Spikes
Engineering (2020)

Incorporating Latent Constraints to Enhance Inference of Network Structure
IEEE Transactions on Network Science and Engineering (2020)

New Features of Receptive Fields in Mouse Retina through Spiketriggered Covariance
Experimental Neurobiology (2020)

A Fast Multitasking Solution: NMFTheoretic Coclustering for Gear Fault Diagnosis under Variable Working Conditions
Chinese Journal of Mechanical Engineering (2020)

Reconstruction of natural visual scenes from neural spikes with deep neural networks
Neural Networks (2020)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.