Abstract
Empirical applications of the free-energy principle are not straightforward because they entail a commitment to a particular process theory, especially at the cellular and synaptic levels. Using a recently established reverse engineering technique, we confirm the quantitative predictions of the free-energy principle using in vitro networks of rat cortical neurons that perform causal inference. Upon receiving electrical stimuli—generated by mixing two hidden sources—neurons self-organised to selectively encode the two sources. Pharmacological up- and downregulation of network excitability disrupted the ensuing inference, consistent with changes in prior beliefs about hidden sources. As predicted, changes in effective synaptic connectivity reduced variational free energy, where the connection strengths encoded parameters of the generative model. In short, we show that variational free energy minimisation can quantitatively predict the self-organisation of neuronal networks, in terms of their responses and plasticity. These results demonstrate the applicability of the free-energy principle to in vitro neural networks and establish its predictive validity in this setting.
Similar content being viewed by others
Introduction
Elucidating the self-organising principles of biological neural networks is one of the most challenging questions in the natural sciences, and should prove useful for characterising impaired brain function and developing biologically inspired (i.e., biomimetic) artificial intelligence. According to the free-energy principle, perception, learning, and action—of all biological organisms—can be described as minimising variational free energy, as a tractable proxy for minimising the surprise (i.e., improbability) of sensory inputs1,2. By doing so, neuronal (and neural) networks are considered to perform variational Bayesian inference3. (Table 1 provides a glossary of technical terms used commonly in the free-energy principle and active inference literature). This inference follows from treating neuronal dynamics as a gradient flow on variational free energy, which can be read as a form of belief updating about the network’s external milieu. The free energy in question is a function of a generative model that expresses a hypothesis about how sensory data are generated from latent or hidden states. However, to apply the free-energy principle at the cellular and synaptic levels, it is necessary to identify the requisite generative model that explains neuronal dynamics (i.e., inference) and changes in synaptic efficacy (i.e., learning).
The activity of neurons has also been modelled with realistic spiking neuron models4,5,6 or reduced rate coding models7. Moreover, synaptic plasticity—that depends on the firing of pre- and postsynaptic neurons8,9,10,11,12—has been modelled as Hebbian-type plasticity rules13,14,15. Although a precise link between the equations that underwrite these models—derived from physiological phenomena—and the corresponding equations from the free-energy principle has not been fully established, we recently identified a formal equivalence between neural network dynamics and variational Bayesian inference16,17,18. Specifically, we reverse-engineered a class of biologically plausible cost functions—for canonical neural networks—and showed that the cost function can be cast as variational free energy, under a class of well-known partially observable Markov decision process (POMDP) models. This suggests that any (canonical) neural network, whose activity and plasticity minimise a common cost function, implicitly performs variational Bayesian inference and learning about external states. This ‘reverse engineering’ approach—guaranteed by formal equivalence—allows us, for the first time, to identify the implicit generative model from empirical neuronal activity. Further, it can precisely link quantities in biological neuronal networks with those in variational Bayesian inference. This enables an experimental validation of the free-energy principle, when applied to these kinds of canonical networks.
Having said this, the free-energy principle is sometimes considered to be experimentally irrefutable in the sense that it can describe any observed biological data19. However, when applying the free-energy principle to a particular system, one can examine its predictive validity by asking whether it can predict systemic responses18. This offers a formal avenue for validation and application of the free-energy principle. To establish predictive validity, one needs to monitor the long-term self-organisation of neuronal networks and compare their dynamics and architecture with theoretical predictions.
To pursue this kind of validation, we used a previously established microelectrode array (MEA) cell culture system for the long-term monitoring of the self-organisation of in vitro neural networks20,21. We have used this setup to investigate causal inference in cortical cells obtained from rat embryos22,23. Causal inference is a simple form of Bayesian inference; namely, inferring and disentangling multiple causes of sensory inputs in the sense of blind source separation24,25,26. Although blind source separation is essential to explain the cocktail party effect—the ability of partygoers to distinguish the speech of one speaker from others in a noisy room27,28—its precise neuronal mechanisms have yet to be elucidated. We previously demonstrated that, upon receiving sensory stimuli, some populations of neurons in in vitro neural networks self-organised (or learned) to infer hidden sources by responding specifically to distinct causes22. Subsequently, we showed that this sensory learning is consistent with variational free energy minimisation under a POMDP generative model23. These results—and related in vitro work29,30,31,32,33,34,35—speak to the tractability and stability of this neuronal system, making it an ideal tool for examining theoretical predictions in a precise and quantitative fashion.
In the present work, we attempted an experimental validation of the free-energy principle by showing that it predicts the quantitative self-organisation of in vitro neural networks using an established in vitro causal inference paradigm. Henceforth, we will refer to in vitro neural networks as neuronal networks and reserve the term neural network for an in silico model. We reverse-engineered an implicit generative model (including prior beliefs), under which a neuronal network operates. We subsequently demonstrated that the free-energy principle can predict the trajectory of synaptic strengths (i.e., learning curve) as well as neuronal responses after learning, based exclusively on empirical neuronal responses at the beginning of training.
Using pharmacological manipulations, we further examined whether the change in baseline excitability of in vitro networks was consistent with the change in prior beliefs about hidden states (i.e., the state prior), confirming that priors over hidden states are encoded by firing thresholds. These results demonstrate that the self-organisation of neuronal networks can be cast as Bayesian belief updating. This endorses the plausibility of the free-energy principle as an account of self-organisation in neural and neuronal networks. We conclude by discussing possible extensions of our reverse engineering approach to in vivo data.
Results
Equivalence between canonical neural networks and variational Bayes
First, we summarise the mathematical (or natural) equivalence between canonical neural networks and variational Bayesian inference, which enables one to apply the free-energy principle to predict empirical data. In this work, we adopted an experimental setup that could be formulated as a simple POMDP generative process that does not exhibit state transitions (Fig. 1a). Here, two binary hidden sources \(s={\left({s}_{1},{s}_{2}\right)}^{{{{{{\rm{T}}}}}}}\) were sampled at random from a prior categorical distribution \(D={\left({D}_{1},{D}_{0}\right)}^{{{{{{\rm{T}}}}}}}\) in a mutually independent manner, where \({D}_{1}\) and \({D}_{0}\) are prior expectations that satisfy \({D}_{1}+{D}_{0}=1\). Then, 32 sensory inputs \(o={\left({o}_{1},\ldots,{o}_{32}\right)}^{{{{{{\rm{T}}}}}}}\) were generated from \(s\) with a categorical distribution characterised by a mixing matrix \(A\). Each element of \(s\) and \(o\) took either a 1 (ON) or a 0 (OFF) state. The left stimuli group (\({o}_{1},\ldots,{o}_{16}\)) in Fig. 1a (left) took the value of source 1 with a 75% probability or the value of source 2 with a 25% probability. In contrast, the right group (\({o}_{17},\ldots,{o}_{32}\)) took the value of source 1 or 2 with a 25% or 75% probability, respectively. Analogous to the cocktail party effect27,28, this setup is formally homologous to the task of distinguishing the voices of speakers 1 (\({s}_{1}\)) and 2 (\({s}_{2}\)) based exclusively on mixed auditory inputs (\(o\)), and in the absence of supervision. Here, the mixing (a.k.a., likelihood) matrix (\(A\)) determines the mixing of the two voices, and the prior (\(D\)) corresponds to the frequency or probability of each speaker generating speech. Hence, neurons must unmix sensory inputs into hidden sources to perceive the underlying causes. Please refer to the Methods section ‘Generative process’ for the formal expression in terms of probability distributions.
In this work, we considered that in vitro neurons can be modelled as a canonical neural network comprising a single feed-forward layer of rate coding models (Fig. 1b, top left)16. We considered two distinct ensembles of neurons. Upon receiving sensory inputs \(o\), these neurons computed the weighted sum of sensory inputs weighted by a synaptic strength matrix W to generate a response (firing intensity) \(x={\left({x}_{1},{x}_{2}\right)}^{{{{{{\rm{T}}}}}}}\). This canonical neural network has a certain biological plausibility because it derives from realistic neuron models4,5,6 through some approximations17; further, its fixed point equips the rate coding model7 with the widely used sigmoid activation function, also known as a neurometric function36. We will show below that this canonical neural network is a plausible computational architecture for neuronal networks that receive sensory stimuli.
Previous work has identified a class of biologically plausible cost functions for canonical neural networks that underlie both neuronal responses and synaptic plasticity16,17. This cost function can be obtained by simply calculating the integral of the neural activity equation (Fig. 1b, middle left; see the Methods section ‘Canonical neural networks’ for details). The reconstructed neural network cost function L is biologically plausible because both neuronal responses and synaptic plasticity equations can be derived as a gradient descent on L. The ensuing synaptic plasticity rule has a biologically plausible form, comprising Hebbian plasticity13, accompanied by an activity-dependent homeostatic plasticity37 (Fig. 1b, bottom left).
Variational Bayesian inference casts belief updating as revising a prior belief to the corresponding (approximate) posterior belief based on a sequence of observations. The experimental setup considered here is expressed as a POMDP generative model38,39. The inversion of this model—via a gradient descent on variational free energy—corresponds to inference. In other words, the generative model generates sensory consequences from hidden causes (i.e., two sources), while model inversion (i.e., inference) maps from sensory consequences to hidden causes (Fig. 1a, right). Variational free energy F is specified by the sensory input and probabilistic beliefs about hidden states under a generative model. Minimisation of variational free energy, with respect to these beliefs, yields the posterior over hidden states \({{{{{{\bf{s}}}}}}}_{t}\) (Fig. 1b, top right) and parameters \({{{{{\bf{A}}}}}}\) (Fig. 1b, bottom right), realising Bayesian inference and learning, respectively. The explicit forms of posterior beliefs are described in the Methods section ‘Variational Bayesian inference’.
Crucially, previous work has shown that the neural network cost function L can be read as variational free energy F16,17. This equivalence allows us to identify the physiological implementation of variational Bayesian inference by establishing a one-to-one mapping between neural network quantities and the quantities in Bayesian inference, as summarised in Table 2. Namely, neural activity (\(x\)) of the canonical neural networks corresponds to the posterior expectation about the hidden states (\({{{{{\bf{s}}}}}}\)), synaptic strengths (\(W\)) correspond to the posterior expectation about the parameters (\({{{{{\bf{A}}}}}}\)), and firing threshold factors (\(\phi\)) correspond to the initial state prior (\(D\)). These mappings establish a formal relationship between a neural network formulation (Fig. 1b, left) and a variational Bayesian formulation (Fig. 1b, right). In summary, the neural activity and plasticity of canonical networks that minimise a common cost function perform variational Bayesian inference and learning, respectively.
This notion is essential because, by observing neuronal responses, we can reverse engineer the implicit generative model—under which the neuronal network operates—from empirical neuronal responses, to characterise the neuronal network in terms of Bayesian inference (Fig. 1c)18. Perhaps surprisingly, using the reverse engineering technique, if one can derive the neural activity equation from experimental data (Fig. 1c, steps 1,2), it is possible to identify the generative model that the biological system effectively employs (steps 3,4). This allows one to link empirical data to quantities in variational Bayesian inference. Subsequently, by computing the derivative of variational free energy under the generative model, one can derive the synaptic plasticity predicted theoretically (step 5). In short, if one has initial neuronal response data, one can predict how synaptic plasticity will unfold over time. This means that if the free-energy principle applies, it will predict the self-organisation of neuronal networks (step 6).
The virtue of the free-energy principle is that it lends an explainability to neuronal network dynamics and architectures, in terms of variational Bayesian inference. Given this generative model, the free-energy principle provides qualitative predictions of the dynamics and self-organisation of neuronal networks, under the given experimental environment. In other words, because neuronal responses and synaptic plasticity are expected to minimise variational free energy by exploiting the shortest path (i.e., a geodesic or path of least action) on the free energy landscape, this property in turn enables us to theoretically predict a plausible synaptic trajectory (i.e., activity-dependent plasticity).
In the remainder of this paper, we examine the plausibility of variational free energy minimisation as the mechanism underlying the self-organisation of neuronal networks. We will compare the empirical encoding of the sources of sensory inputs with a synthetic simulation of ideal Bayesian encoding, and investigate whether variational free energy minimisation can predict the neuronal responses and plasticity of in vitro networks.
Consistency between in vitro neural networks and variational Bayes
In this section, we verify some qualitative predictions of the free-energy principle when applied to our in vitro neural networks in terms of response selectivity (i.e., inference), plasticity (i.e., learning), and effects of pharmacological manipulations on inference and subsequent learning. Using our in vitro experimental setup20,21, cortical cells obtained from rat embryos were cultured on an MEA dish with 64 microelectrodes on its floor (Fig. 1a, left). Each electrode was used to deliver electrical stimuli and record the spiking response. After approximately 10 days in culture, the neurons self-organised into a network and exhibited spontaneous activity, with clear evoked responses to electrical stimuli. Neurons were stimulated with the above-constructed patterns of sensory inputs (see the preceding section), comprising 32 binary sensory inputs (o) that were generated from two sequences of independent binary hidden sources (s) in the manner of the POMDP generative model above (Fig. 1a, right). When a sensory input took the value of 1, an electrical pulse was delivered to the cultured neurons. The 32 stimulation electrodes were randomly distributed over 8 × 8 MEAs in advance and fixed over training. Evoked extracellular activity (i.e., the early neuronal response) was recorded from 64 MEA electrodes. Each session lasted 256 s, in which a 256-time-step sequence of random stimulations was delivered every second, followed by a 244-s resting period. The training comprised 100 sessions, each of which was an identical repetition of the 256 s-long random sequence.
Upon electrical simulation—generated by the mixture of the two hidden sources—our previous work showed the emergence of selective neuronal responses to either of the two sources22,23. Response intensity was defined as the number of spikes 10–30 ms after a stimulation (Fig. 2a) following the previous treatment22 (see Supplementary Fig. 1a for other electrodes). This is because a large number of spikes—induced by synaptic input—were observed during that period, while most directly evoked action potentials (which were not the subject of our analyses) occur within 10 ms after stimulation40. The recorded neuronal responses were categorised into source 1- and source 2-preferring and no-preference groups, depending on the average response intensity, conditioned upon the hidden source (Fig. 2b). Note that each electrode can record spiking responses from one or more neurons. Learning was quantified as the emergence of functional specialisation for recognising particular sources. The response intensity of the source 1-preferring neurons changed during the training period to exhibit a strong response selectivity to source 1 (Fig. 2c, left). These neurons self-organised to fire at a high level when source 1 was ON, but had a low response rate when source 1 was OFF. Similarly, source 2-preferring neurons self-organised to respond selectively to source 2 during training (Fig. 2c, right). These changes were inhibited by N-methyl-D-aspartate (NMDA) receptor antagonist, 2-amino-5-phosphonopentanoic acid (APV) to a certain degree (Fig. 2d), indicating that the observed self-organisation depends on NMDA-receptor-dependent plasticity. These results indicate the occurrence of blind source separation at a cellular level—through activity-dependent synaptic plasticity—supporting the theoretical notion that neural activity encodes the posterior belief (i.e., expectation) about hidden sources or states1,2.
Given the consistency between source-preferring neuronal responses and state posterior, one can then ask about the neuronal substrates for other quantities in variational Bayesian inference. In light of the above, we modelled neuronal networks using a canonical neural network, comprising a single feed-forward layer (Fig. 1b, top left). As noted above, this neural network acts as an ideal Bayesian observer, exhibiting Bayesian belief updating under a POMDP generative model (Fig. 1b, top right), where the firing threshold encodes a prior over initial states (Table 2)16,17. Thus, this in silico model can learn to detect hidden sources successfully when the implicit state prior matches that of the true generative process (in this case, \({D}_{1}=0.5\); Fig. 2e, middle). Conversely, both upregulation (\({D}_{1}=0.8\); Fig. 2e, right) and downregulation (\({D}_{1}=0.2\); Fig. 2e, left) of the state prior significantly disrupted this sensory learning (Fig. 2f). These simulations used the same empirical stimuli applied to neuronal networks. Hence, if this canonical neural network is an apt model for neuronal networks, the firing threshold (i.e., baseline excitability) of the neuronal network should encode the state prior, and changes in baseline excitability should disrupt the inference and ensuing sensory learning.
To examine this hypothesis, we asked whether pharmacological modulations of the baseline excitability of in vitro networks induce the same disruptions of inference as the alterations in the state prior in the in silico network. Pharmacological downregulation of gamma-aminobutyric acid (GABA)-ergic inputs (using a GABAA-receptor antagonist, bicuculline) or its upregulation (using a benzodiazepine receptor agonist, diazepam) altered the baseline excitability of neuronal networks. These substances were added to the culture medium before the training period and were therefore present over training. Average response levels were higher in bicuculline-treated cultures than in control cultures. Conversely, diazepam-treated cultures exhibited lower response levels, but retained sufficient responsiveness to analyse response specificity. Crucially, alterations in neuronal responses—and subsequent learning—were observed when we pharmacologically modulated the GABAergic input level (Fig. 2g). We observed that both hyper-excitability (Fig. 2g, right) and hypo-excitability (Fig. 2g, left) significantly suppressed the emergence of response specificity at the cellular level (Fig. 2h). This disruption of learning was observed both for source 1- and 2-preferring neuronal responses.
Effective synaptic connectivity analysis suggested that a certain amount of plasticity occurred even in the presence of bicuculline or diazepam (Supplementary Fig. 1b). The difference was observed in the specificity of connectivity emerging during the training period (Supplementary Fig. 1c). Here, the specificity was characterised with a gap in the contribution of a sensory electrode to sources 1- and 2-preferring units. While the specificity increased in all groups, it was significantly inhibited in the presence of bicuculline or diazepam.
Remarkably, our in silico model—under ideal Bayesian assumptions—could predict the effects of this GABAergic modulation on learning using a simple manipulation of the prior belief about hidden states (please compare Fig. 2e, f with Fig. 2g, h). This involved setting the prior expectations so that sensory causes were generally present (analogous to the GABAergic antagonist effect) or generally absent (analogous to the agonist effect). Physiologically, this corresponds to increasing and reducing the response intensity, respectively, which is consistent with the effects of these pharmacological manipulations on baseline activity. In terms of inference, this manipulation essentially prepares the network to expect the presence or absence of an object (i.e., a hidden source) prior to receiving sensory evidence. The key notion here is that this simple manipulation was sufficient to account for the failure of inference and subsequent learning, as evidenced by the absence of functional specialisation. Thus, changes in the prior (neuronal) representations of states provide a sufficient explanation for aberrant learning.
In summary, the emergence of response specificity observed under normal network excitability was disrupted by pharmacologically induced hyper- or hypo-excitability of the network. The canonical neural network (i.e., ideal Bayesian observer) predicted these empirical effects—of the agonist and antagonist—by reproducing the hypo-excitability (diazepam) condition, analogous to the prior belief that sources are OFF (‘nothing there’), or by the hyper-excitability (bicuculline) condition, analogous to the prior belief that sources are present (ON). In either case, in vitro and in silico networks failed to perform causal inference, supporting our claim that the failure can be attributed to a biased state prior, under which they operated. These results corroborate the theoretical prediction that the firing threshold is the neuronal substrate of the state prior16,17, validating the proposed equivalence at the cellular level. This further licences an interpretation of neuronal network dynamics in terms of Bayesian inference and learning.
The free-energy principle predicts learning in neuronal networks
In this section, we examine the predictive validity of the free-energy principle by asking whether its application to neuronal networks can predict their self-organisation. We considered that the neuronal responses of source 1- and source 2-encoding ensembles in each in vitro networks are represented by their averaged response intensity and refer to them as x1 and x2, where the offset was subtracted, and the value was normalised in the range between 0 and 1. We then modelled the neuronal responses of in vitro networks in the form of a canonical neural network and estimated the requisite synaptic strengths W (i.e., effective synaptic connectivity) by fitting empirical neuronal responses to the model (Fig. 3a; see the Methods section ‘Reverse engineering of generative models’ for details). Using these estimates, we depicted the trajectories (i.e., learning curves) evinced by subsequent neuronal responses.
First, we computed the synaptic strengths W that minimised the neural network cost function L using neuronal responses x. This corresponds to a conventional (model-based) connection strength estimation, where the W of the canonical neural network model was optimised to fit the empirical data (see Methods). We then plotted the trajectory of the estimated synaptic strengths on the landscape of variational free energy F (Fig. 3b, left). This landscape was characterised by the state prior (encoded by the firing threshold) estimated using empirical data from only the initial 10 sessions. According to the free-energy principle, synaptic plasticity occurs in a manner that descends on free energy gradients1,2. As predicted, we found that the trajectory of the empirically computed synaptic connectivity descended the free energy landscape (Fig. 3b, left; see also Supplementary Movie 1). This observation suggests that variational free energy minimisation is a plausible description of self-organisation or learning in neuronal networks.
Interestingly, the reverse engineering enables us to map empirically estimated synaptic strengths (W) to the posterior expectation (A) about parameter matrix A, to identify the generative model that the neuronal network employs (Table 2). The reconstructed posterior A precisely captured the characteristics of the true A in the external milieu, such that source 1 has a greater contribution to \(\left({o}_{1},\ldots,{o}_{16}\right)\), while source 2 to \(\left({o}_{17},\ldots,{o}_{32}\right)\) (Fig. 3c). An error between empirical and ideal (Bayesian) posteriors significantly decreased with sessions (Fig. 3d, left). The error was larger in bicuculline- or diazepam-treated condition, owing to biased inference and subsequent learning in these neuronal networks (Fig. 3d, right). These results support the theoretical notion that synaptic strengths encode the posterior expectation of the parameter1,2. As predicted, synaptic plasticity following the free energy gradient entailed a recapitulation of the generative process within the neuronal network architecture.
The observation that the empirical synaptic trajectory pursues a gradient descent on variational free energy implies that one can predict the subsequent learning in the absence of empirical constraints. Once the initial values of synaptic strengths are identified, the subsequent learning process can in principle be predicted using the free-energy principle, under the canonical neural network (i.e., generative) model.
To test this hypothesis, we predicted the neuronal responses (x) and synaptic plasticity (W) in sessions 11–100 using the neural network cost function L reconstructed based exclusively on the empirical responses in the initial 10 sessions (see the Methods section ‘Data prediction using the free-energy principle’ for details). As established above, this cost function is formally identical to variational free energy F under a class of POMDP generative models16,17. Thus, evaluating the responses and plasticity that minimise this cost function \(L\) (\(\equiv F\))—in the absence of data—furnishes a prediction of neuronal responses and plasticity under the free-energy principle.
We found that the predicted changes in connectivity matched the changes in empirically estimated effective synaptic connectivity (Fig. 3b, right). Specifically, we observed a strong correlation between the synaptic strengths estimated using neuronal data and the strengths predicted in the absence of data (Fig. 3e). The prediction error was less than 4%, up to the final session (Fig. 3f; n = 30 independent experiments). These results indicate that, based on initial conditions, the free-energy principle can predict the self-organisation of neuronal networks.
In addition to the synaptic trajectory, we confirmed that a minimisation of free energy can predict the underlying changes in neuronal responses (Fig. 3g). The predictions based only on initial conditions were consistent with observed responses. Specifically, the predicted responses were consistent with the observed responses at each time step (Fig. 3h, i). Quantitatively, we could predict more than 80% of the neuronal responses in session 100, based only on data from sessions 1–10 (Fig. 3j). These results suggest that the free-energy principle can predict both changes in synaptic efficacy and the time evolution of neuronal responses based only on initial data. Note that this is a highly nontrivial prediction, because synaptic efficacy shows activity-dependent changes and neuronal responses depend upon synaptic efficacy.
Another interesting observation was that when we varied the free energy landscape by manipulating the mixing matrix A in the stimulus generating process, empirical synaptic plasticity kept pursuing a gradient descent on the new variational free energy (Fig. 3k). This speaks to a generality of this physiological property. Here, we experimentally varied the mixing balance (A) of two sources between 0 and 50%, to train neuronal networks with the generated sensory stimuli (o), where 0% indicates an unmixed (i.e., easily separable) condition, while 50% indicates a uniformly mixed (i.e., inseparable) condition. Irrespective of various conditions (i.e., forms of generative process and prior beliefs), the reverse engineering could reconstruct generative models and predict subsequent self-organisations of neuronal networks (Supplementary Fig. 2; see also Supplementary Movie 1).
Finally, we observed that during the process of assimilating sensory information, neuronal networks significantly reduced their variational free energy (Fig. 3l). Here, variational free energy F for each session was calculated empirically by substituting the observed neuronal responses into the cost function L. As expected, an easier task (i.e., 0% mix condition) entailed a faster (i.e., greater) reduction of variational free energy. These results provide explicit empirical evidence that neuronal networks self-organise to minimise variational free energy.
In summary, we found that the trajectory of the empirically estimated effective synaptic connectivity is consistent with a slow gradient descent on variational free energy. Furthermore, we demonstrated that the free-energy principle can quantitatively predict sensory learning in neuronal networks in terms of both neuronal responses and plasticity. These results suggest that the self-organisation of the neuronal networks—in response to structured sensory input—is consistent with Bayesian belief updating and the minimisation of variational free energy. This endorses the plausibility of variational free energy minimisation as a rule underlying the dynamics and self-organisation of neuronal networks.
Discussion
The present work has addressed the predictive validity of the free-energy principle at the circuit level by delineating the functional specialisation and segregation in neuronal networks via free-energy minimisation. Identifying the characteristic functions of arbitrary neural networks is not straightforward. However, according to the complete class theorem41,42,43, any system that minimises a cost function under uncertainty can be viewed as Bayesian inference. In light of this, we showed that any neural network—whose activity and plasticity minimise a common cost function—can be cast as performing (variational) Bayesian inference16,17. Crucially, the existence of this equivalence enables the identification of a natural map from neuronal activity to a unique generative model (i.e., hypothesis about the external milieu), under which a biological system operates. This step is essential to link empirical data—which report the ‘internal’ circuit dynamics (i.e., physiological phenomena)—to the representation of the ‘external’ dynamics (i.e., functions or computations) that the circuit dynamics imply, in terms of variational Bayesian inference. Using this technique, we fitted stimulus-evoked responses of in vitro networks—comprising the cortical cells of rat embryos—to a canonical neural network and reverse engineered an POMDP generative model, apt to explain the empirical data. In other words, we were able to explain empirical responses as inferring the causes of stimuli, under an implicit generative or world model.
Furthermore, reverse engineering a generative model from observed responses specifies a well-defined synaptic plasticity rule. Using this rule, we showed that the self-organisation of in vitro networks follows a gradient descent on variational free energy under the (POMDP) generative model. In short, the virtues of reverse engineering are that: (i) when provided with empirical responses, it systematically identifies what hypothesis (i.e., generative model) the biological system employs to infer the external milieu. Moreover, (ii) it offers quantitative predictions about the subsequent self-organisation (i.e., learning) of the system that can be tested using data. This provides a useful tool for analysing and predicting electrophysiological and behavioural responses and elucidating the underlying computational and self-organisation principle.
Although numerous neural implementations of Bayesian inference have been proposed44,45,46, these approaches generally derive update rules from Bayesian cost functions without establishing the precise relationship between these update rules and the neural activity and plasticity of canonical neural networks. The reverse engineering approach differs conceptually by asking what Bayesian scheme could account for any given neuronal dynamics or neural network. By identifying the implicit inversion scheme—and requisite generative model—one can then lend any given network an interpretability and explainability. In the current application of this approach, we first consider a biologically plausible cost function for neural networks that explains both neural activity and synaptic plasticity. We then identify a particular generative model under which variational free energy is equivalent to the neural network cost function. In this regard, reverse engineering offers an objective procedure for explaining neural networks in terms of Bayesian inference. Further, the synaptic plasticity rule is derived as the gradient descent on the cost function that is determined by the integral of neural dynamics. Crucially, learning through this plasticity rule can be read, formally, as Bayesian belief updating under an appropriate generative model. Conversely, naive Hebbian plasticity rules—with an ad hoc functional form—correspond to Bayesian belief updating under a suboptimal generative model with biased prior beliefs, which cannot solve simple blind source separation problems16. As predicted, in vitro neural networks above failed to perform blind source separation, with changed baseline excitability and implicit priors. In short, the free-energy principle is necessary to determine the optimal balance between Hebbian and homeostatic plasticity that enables blind source separation by in vitro networks.
Previous work has established that ensembles of neurons encode posterior expectations47 and prediction errors48; however, other quantities in Bayesian inference—such as the state prior and parameter posterior—have yet to be fully investigated. The reverse engineering approach enables us to identify the structures, variables, and parameters of generative models from experimental data, which is essential for empirical applications of the free-energy principle. This is a notion referred to as computational phenotyping49; namely inferring the generative model—and in particular, the priors—that best explain empirical responses under ideal Bayesian assumptions. The reverse engineering naturally maps empirical (biological) quantities to quantities in variational Bayesian inference. Our empirical results suggest that neuronal responses encode the hidden state posterior (Fig. 2c), baseline excitability encodes the state prior (Fig. 2g), and synaptic efficacies encode the parameter posterior (Fig. 3c), as predicted theoretically (Table 2).
Having said this, because the free-energy principle can arguably describe any observed biological data by its construction19, showing the existence of such a mapping alone is insufficient as an empirical validation. Conversely, one can examine the predictive validity, which is a more delicate problem, by asking whether the free-energy principle can predict subsequent self-organisation without reference to empirical data. Such a generalisability on previously unseen (test) data comprises an essential aspect for empirical applications of the free-energy principle.
We demonstrated that, equipped with the initial conditions (i.e., generative model and implicit prior beliefs of the network) characterised by the experimental data, variational free energy minimisation can predict the subsequent self-organisation of in vitro neural networks, in terms of quantitative neuronal responses and plasticity. It further predicted their performance when spontaneously solving source separation problems, including their speed and accuracy. These results not only validate this application of the free-energy principle; they also speak to the neurophysiological plausibility of related theories of the brain50,51 and spiking neural network models that perform Bayesian inference44,45,46.
In essence, the free-energy principle constrains the relationship between neural activity and plasticity because both activity and plasticity follow a gradient descent on a common variational free energy, under ideal Bayesian assumptions. This property in turn enables precise characterisation of plausible self-organisation rules and quantitative prediction of subsequent neuronal activity and plasticity, under a canonical neural network (generative) model.
Our combined in vitro–in silico system showed that variation of the state prior (in silico model) is sufficient to reproduce the changes in neural excitability and inhibitions of sensory learning and inference observed in vitro. These results suggest that a neuronal networks’ excitability is normally tuned so that the ensemble behaviour is close to that of a Bayes optimal encoder under biological constraints. This is reminiscent of previous experimental observation that suggests that the activity of sensory areas encodes prior beliefs52.
These empirical data and complementary modelling results also explain the strong influence of prior beliefs on perception and causal inference—and the disruptive effects of drugs on perception in neuronal networks. Both synaptic plasticity and inference depend on convergent neuronal activity; therefore, aberrant inference will disrupt learning. Conversely, inference is not possible without the knowledge accumulated through experience (i.e., learning). Thus, inference is strongly linked to learning about contingencies that generate false inferences. Our findings demonstrate this association both mechanistically and mathematically, in terms of one simple rule that allows prior beliefs to underwrite inferences about hidden states.
Combining mathematical analyses with empirical observations revealed that baseline excitability is a circuit-level encoding of prior beliefs about hidden states. The notion that manipulating the state prior (encoded by neuronal excitability) disrupts inference and learning may explain the perceptual deficits produced by drugs that alter neuronal excitability, such as anxiolytics and psychedelics53. This may have profound implications for our understanding of how anxiolytics and psychedelics mediate their effects; namely, a direct effect on baseline activity can alter subsequent perceptual learning. Additionally, aberrant prior beliefs are a plausible cause of the hallucinations and delusions that constitute the positive symptoms of schizophrenia54,55. This suggests that, in principle, reverse engineering provides a formal avenue for estimating prior beliefs from empirical data—and for modelling the circuit mechanisms of psychiatric disorders (e.g., synaptopathy). Further, the reproduction of these phenomena in in vitro (and in vivo) networks furnishes the opportunity to elucidate the precise pharmacological, electrophysiological, and statistical mechanisms underlying Bayesian inference in the brain.
Importantly, although this paper focused on a comparison of in vitro data and theoretical prediction, the reverse engineering approach is applicable to characterising in vivo neuronal networks, in terms of their implicit generative model with prior beliefs. It can, in principle, be combined with electrophysiological, functional imaging, and behavioural data—and give predictions, if the learning process is continuously measured. Thus, the proposed approach for validating the free-energy principle can be applied to the neural activity data from any experiment that entails learning or self-organisation; irrespective of the species, brain region, task, or measurement technique. Even in the absence of learning, it can be applied, if one can make some theoretical predictions and compare them with experimental data. For accurate predictions, large-scale and continuous measurements of activity data at the population level from pre-learning to post-learning stages would be a prerequisite. In future work, we hope to test, empirically, whether the free-energy principle can quantitatively predict the perception, learning, and behaviour of various biological systems.
The generic mechanisms for acquiring generative models can be used to construct a neuromorphic hardware for universal applications56,57. Back-propagation is central in many current deep learning methods, but biologically implausible. This has led to various biologically plausible alternatives; e.g., refs. 58,59,60,61, some of which appeal to predictive coding formulations of variational free energy minimisation. The equivalence between neural networks and variational Bayes could be useful to establish biologically plausible learning algorithms, because Hebbian learning rules derived under this scheme are local (energy-based) algorithms. This is because the contribution to variational free energy as an extensive quantity can be evaluated locally. Such a biomimetic artificial intelligence—that implements the self-organising mechanisms of neuronal networks—could offer an alternative to conventional learning algorithms such as back-propagation, and to have the high data, computational, and energy efficiency of biological computation62,63. This makes it promising for the next-generation of artificial intelligence. In addition, the creation of biomimetic artificial intelligence may further our understanding of the brain.
In summary, complementary in vitro neural network recordings and in silico modelling suggest that variational free energy minimisation is an apt explanation for the dynamics and self-organisation of neuronal networks that assimilate sensory data. The reverse engineering approach provides a powerful tool for the mechanistic investigation of inference and learning, enabling the identification of generative models and the application of the free-energy principle. The observed sensory learning was consistent with Bayesian belief updating and the minimisation of variational free energy. Thus, variational free energy minimisation could qualitatively predict neuronal responses and plasticity of in vitro neural networks. These results highlight the validity of the free-energy principle as a rule underlying the self-organisation and learning of neuronal networks.
Methods
Generative process
The experimental paradigm established in previous work22 was employed. The blind source separation addressed in this work is an essential ability for biological organisms to identify hidden causes of sensory information, as considered in the cocktail party effect27,28. This deals with the separation of mixed sensory inputs into original hidden sources in the absence of supervision, which is a more complex problem than naive pattern separation tasks.
Two sequences of mutually independent hidden sources or states \({s}_{t}={({s}_{t}^{(1)},{s}_{t}^{(2)})}^{{{{{{\rm{T}}}}}}}\) generated 32 sensory stimuli \({o}_{t}={({o}_{t}^{(1)},\ldots,{o}_{t}^{(32)})}^{{{{{{\rm{T}}}}}}}\) through a stochastic mixture characterised by matrix A. Each source and observation took values of 1 (ON) or 0 (OFF) for each trial (or time) t. These stimuli were applied to in vitro neural networks as electrical pulses from 32 electrodes (Fig. 1a, left). In terms of the POMDP scheme38,39, this corresponds to the likelihood mapping A from two sources \({s}_{t}\) to 32 observations \({o}_{t}\) (Fig. 1a, right). The hidden sources \({s}_{t}\) were sampled from a categorical distribution \(P({s}_{t}^{\left(j\right)})={{{{{\rm{Cat}}}}}}({D}^{\left(j\right)})\). The state priors varied between 0 and 1, in keeping with \({D}_{1}^{\left(j\right)}+{D}_{0}^{\left(j\right)}=1\). The likelihood of \({o}_{t}^{\left(i\right)}\) is given in the form of a categorical distribution, \(P({o}_{t}^{\left(i\right)}|{s}_{t},A)={{{{{\rm{Cat}}}}}}({A}^{\left(i\right)})\), each element of which represents \(P({o}_{t}^{\left(i\right)}={j|}{s}_{t}^{\left(1\right)}=k,{s}_{t}^{\left(2\right)}=l,A)={A}_{{jkl}}^{\left(i\right)}\). Half of the electrodes (\(1\le i\le 16\)) conveyed the source 1 signal with a 75% probability or the source 2 signal with a 25% probability. Because each element of the \(A\) matrix represents the conditional probability that \({o}_{t }\) occurs given \({s}_{t }=({s}_{t }^{\left(1\right)},{s}_{t }^{\left(2\right)})\), this characteristic is expressed as \({A}_{1\cdot \cdot }^{(i)}=(P({o}_{t }^{(i)}=1|{s}_{t }=({{{{\mathrm{1,1}}}}})),\, P({o}_{t }^{(i)}=1|{s}_{t }=({{{{\mathrm{1,}}}}}\, 0)),\, P({o}_{t }^{(i)}=1|{s}_{t }=({{{{\mathrm{0,}}}}}\, 1)),\, P({o}_{t }^{(i)}=1|{s}_{t }=({{{{\mathrm{0,}}}}}\, 0)))=(1,\, 0.75,\, 0.25,\, 0)\). The remaining electrodes (\(17\le i\le 32\)) conveyed the source 1 or 2 signal with a 25% or 75% probability, respectively, \({A}_{1\cdot \cdot }^{\left(i\right)}=\left({{{{\mathrm{1,0.25,0.75,0}}}}}\right)\). The remaining elements of A were given by \({A}_{0\cdot \cdot }^{\left(i\right)}=1-{A}_{1\cdot \cdot }^{\left(i\right)}\). The prior distribution of A was given by the Dirichlet distribution \(P({A}^{\left(i\right)})={{{{{\rm{Dir}}}}}}\left({a}^{\left(i\right)}\right)\) with sufficient statistics a. Hence, the generative model was given as follows:
Here, \({o}_{1:t}:\!\!=\left\{{o}_{1},\ldots,\, {o}_{t}\right\}\) represents a sequence of observations, \(P\left(A\right)=\mathop{\prod }\nolimits_{i=1}^{32}P({A}^{(i)})\), \(P({s}_{\tau })=P({s}_{\tau }^{(1)})P({s}_{\tau }^{(2)})\), and \(P\left({o}_{\tau }|{s}_{\tau },A\right)=\mathop{\prod }\nolimits_{i=1}^{32}P({o}_{\tau }^{(i)}|{s}_{\tau },A)\) are prior distributions and likelihood that factorise16.
Variational Bayesian inference
We considered a Bayesian observer under the generative model in the form of the above POMPD and implemented variational message passing to derive the Bayes optimal encoding of hidden sources or states38,39. Under the mean-field approximation, the posterior beliefs about states and parameters were provided as follows:
Here, the posterior distributions of \({s}_{\tau }\) and \(A\) are given by categorical \(Q\left({s}_{\tau }\right)={{{{{\rm{Cat}}}}}}\left({{{{{{\bf{s}}}}}}}_{\tau }\right)\) and Dirichlet \(Q\left(A\right)={{{{{\rm{Dir}}}}}}\left({{{{{\bf{a}}}}}}\right)\) distributions, respectively. The bold case variables (e.g., \({{{{{{\bf{s}}}}}}}_{t}\)) denote the posterior beliefs about the corresponding italic case variables (e.g., \({s}_{t}\)), and \({{{{{\bf{a}}}}}}\) indicates the Dirichlet concentration parameter. Due to the factorial nature of the states, \({{{{{{\bf{s}}}}}}}_{t}\) and \({{{{{\bf{a}}}}}}\) are the outer products of submatrices (i.e., tensors): see ref. 16 for details.
Variational free energy—or equivalently, the negative of evidence lower bound (ELBO)3—is defined as an upper bound of sensory surprise \(F\left({o}_{1:t},Q\left({s}_{1:t},\, A\right)\right):\!\!={{{{{{\rm{E}}}}}}}_{Q\left({s}_{1:t},\, A\right)}\left[-{{{{{\rm{ln}}}}}}P\left({o}_{1:t},\, {s}_{1:t},\;A\right)+{{{{{\rm{ln}}}}}} \, Q\left({s}_{1:t},\;A\right)\right]\). Given the above-defined generative model and posterior beliefs, ensuing variational free energy of this system is given by:
up to an \({{{{{\mathscr{O}}}}}}\left({{{{{\rm{ln}}}}}}t\right)\) term. This \({{{{{\mathscr{O}}}}}}\left({{{{{\rm{ln}}}}}}t\right)\) corresponds to the parameter complexity expressed using the Kullback–Leibler divergence \({{{{{{\mathcal{D}}}}}}}_{{{{{{\rm{KL}}}}}}}\left[Q\left(A\right){||P}\left(A\right)\right]=\mathop{\sum }\nolimits_{i=1}^{32}\{\left({{{{{{\bf{a}}}}}}}^{\left(i\right)}-{a}^{\left(i\right)}\right)\cdot {{{{{\rm{ln}}}}}}\,{{{{{{\bf{A}}}}}}}^{\left(i\right)}-{{{{{\rm{ln}}}}}}{{{{{\mathcal{B}}}}}}\left({{{{{{\bf{a}}}}}}}^{\left(i\right)}\right)\}\) and is negligible when t is sufficiently large. Note that \(\cdot\) expresses the inner product operator, \({{{{{\rm{ln}}}}}}\,{{{{{{\bf{A}}}}}}}^{\left(i\right)}\) indicates the posterior expectation of \({{{{{\rm{ln}}}}}}\,{A}^{\left(i\right)}\), and \({{{{{\mathcal{B}}}}}}\left(\bullet \right)\) is the beta function. Inference and learning entail updating posterior expectations about hidden states and parameters, respectively, to minimise variational free energy. Solving the fixed point \(\partial F/\partial {{{{{{\bf{s}}}}}}}_{t}=0\) and \(\partial F/\partial {{{{{\bf{a}}}}}}=O\) yields the following analytic expression:
where \(\sigma \left(\bullet \right)\) is a softmax function, which corresponds to the sigmoid activation function, and \(\bigotimes\) expresses the outer product operator. From Eq. (5), the parameter posterior is given as \({{{{{\rm{ln}}}}}}\,{{{{{\bf{A}}}}}}=\psi \left({{{{{\bf{a}}}}}}\right)-\psi \left({{{{{{\bf{a}}}}}}}_{1\bullet }+{{{{{{\bf{a}}}}}}}_{0\bullet }\right)\) using the digamma function \(\psi \left(\bullet \right)={\varGamma }^{{\prime} }\left(\bullet \right)/\varGamma \left(\bullet \right)\). As Eqs. (2)–(5) adopted a simplified notation, please refer to ref. 16 for the detailed derivation taking into account the factorial nature of the states.
Canonical neural networks
The complete class theorem41,42,43 suggests that any neural network whose internal states minimise a common cost function can be read as performing Bayesian inference. However, the implicit Bayesian model that corresponds to any given cost function is a more complicated issue. Thus, we reverse engineered cost functions for canonical neural networks to identify the corresponding generative model16,17.
The neural response \({x}_{t}={\left({x}_{t1},{x}_{t2}\right)}^{{{{{{\rm{T}}}}}}}\) at time t upon receiving sensory inputs \({o}_{t}\) is modelled as the canonical neural network, which is expressed as the following ordinary differential equation:
where \({{{{{{\rm{sig}}}}}}}^{-1}\left({x}_{t}\right)\) indicates the leak current characterised by the inverse of sigmoid function (or equivalently, logit function), \(W\) denotes a 2 × 32 matrix of synaptic strengths, \(W{o}_{t}\) is the synaptic input, and \(h\) is a vector of the adaptive firing thresholds. We considered that \(W:\!\!={W}_{1}-{W}_{0}\) is the sum of excitatory (\({W}_{1}\)) and inhibitory (\({W}_{0}\)) synaptic strengths. The firing threshold is expressed as \(h:\!\!={h}_{1}-{h}_{0}\) using \({h}_{1}\) and \({h}_{0}\) that are functions of \({W}_{1}\) and \({W}_{0}\). This model derives from realistic neuron models4,5,6 through approximations17.
Without loss of generality, Eq. (6) can be derived as the gradient descent on a cost function L. Following previous work16,17, this cost function can be identified by taking the integral of the right-hand side of Eq. (6) with respect to \({x}_{t}\) (referred to as reverse engineering):
up to a negligible \({{{{{\mathcal{C}}}}}}\) term. The overline variable indicates one minus the variable, \(\overline{{x}_{t}}: \!\!=\vec{1}-{x}_{t}\), where \(\vec{1}:\!\!={\left(1,\ldots,1\right)}^{{{{{{\rm{T}}}}}}}\) is a vector of ones. Equation (7) ensures that the gradient descent on L with respect to \({x}_{t}\), \({\dot{x}}_{t}\propto -\partial L/\partial {x}_{t}\), provides Eq. (6). The \({{{{{\mathcal{C}}}}}}\) term is a function of \({W}_{1}\) and \({W}_{0}\), \({{{{{\mathcal{C}}}}}}{{{{{\mathscr{=}}}}}}{{{{{\mathcal{C}}}}}}\left({W}_{1},{W}_{0}\right)\), and usually considered to be smaller than order t, \({{{{{\mathcal{C}}}}}}={{{{{\mathcal{o}}}}}}\left(t\right)\)16\(.\)
The firing thresholds can be decomposed as \({h}_{1}={{{{{\rm{ln}}}}}}\overline{{\widehat{W}}_{1}}\vec{1}+{\phi }_{1}\) and \({h}_{0}={{{{{\rm{ln}}}}}}\overline{{\widehat{W}}_{0}}\vec{1}+{\phi }_{0}\), respectively, where \({\phi }_{1}\) and \({\phi }_{0}\) are the threshold factors, \({\widehat{W}}_{1}:\!\!={{{{{\rm{sig}}}}}}\left({W}_{1}\right)\) is the sigmoid function of \({W}_{1}\) in the elementwise sense, and \(\overline{{\widehat{W}}_{1}}\) indicates one minus \({\widehat{W}}_{1}\) in the elementwise sense. Subsequently, Eq. (7) can be transformed as follows:
We showed that this cost function L can be cast as variational free energy F under a class of POMPD generative models16,17. Equation (8) is asymptotically equivalent to variational free energy (Eq. (3)) under the generative model defined in Eq. (1), up to negligible \({{{{{\mathcal{O}}}}}}\left({{{{{\rm{ln}}}}}}t\right)\) and \({{{{{\mathcal{C}}}}}}\) terms. One-to-one correspondences between components of L and F can be observed. Specifically, the neural response \({x}_{t}\) encodes the state posterior \({{{{{{\bf{s}}}}}}}_{t}\), \(\left(\begin{array}{c}{x}_{\tau }\\ \overline{{x}_{\tau }}\end{array}\right)={{{{{{\bf{s}}}}}}}_{t}\); synaptic strengths W encode the parameter posterior \({{{{{\bf{A}}}}}}\), \({{{{{\rm{ln}}}}}}\left(\begin{array}{cc}{\widehat{W}}_{1} & \overline{{\widehat{W}}_{1}}\\ {\widehat{W}}_{0} & \overline{{\widehat{W}}_{0}}\end{array}\right)={{{{{\rm{ln}}}}}}{{{{{\bf{A}}}}}}\); and the threshold factor \(\phi\) encodes the state prior \(D\), \(\phi=\left(\begin{array}{c}{\phi }_{1}\\ {\phi }_{0}\end{array}\right)={{{{{\rm{ln}}}}}}D\), as summarised in Table 2. Hence, the neural network cost function is asymptotically equivalent to variational free energy for sufficiently large t. Further details, including the correspondence between the \({{{{{\mathcal{C}}}}}}\) term in Eq. (8) and the parameter complexity (\({{{{{\mathcal{O}}}}}}\left({{{{{\rm{ln}}}}}}t\right)\) term in Eq. (3)), are described in previous work16.
The virtue of this equivalence is that it links quantities in the neural network with those in the variational Bayes formation. Moreover, this suggests that a physiologically plausible synaptic plasticity (derived from L) enables the network to learn the parameter posterior in a self-organising or unsupervised manner16,17. Further, reverse-engineering can naturally derive variational Bayesian inference—under a particular mean-field approximation defined in Eq. 2—from a canonical neural network architecture. This representation of posterior beliefs is essential for the networks to encode rapidly changing hidden states (\({s}_{\tau }\)) and slow parameters (\(A\)) with neural activity (\(x\)) and synaptic strengths (\(W\)), respectively. In this setting, a mean field approximation implements a kind of adiabatic approximation, in which the separation of timescales between fast neuronal responses and slow learning is leveraged to increase the efficiency of inference. Please see ref. 16. for further discussion.
Simulations
In Fig. 2, simulations continued over \(T=25600\) time steps and used the empirical stimuli applied to in vitro neural networks. Synaptic strengths were initialised as values close to 0. Here, \({D}_{1}=0.5\) (Fig. 2e, centre) matched the true process that generates sensory stimuli. Either the upregulation (right, \({D}_{1}=0.8\)) or downregulation (left, \({D}_{1}=0.2\)) of the state prior disrupted inference and ensuing learning.
Cell culture
The dataset used for this work comprised data obtained from newly conducted experiments, and those originally used in the previous work22. All animal experiments were performed with the approval of the animal experiment ethics committee at the University of Tokyo (approval number C-12-02, KA-14-2) and according to the University of Tokyo guidelines for the care and use of laboratory animals. The procedure for preparing dissociated cultures of cortical neurons followed the procedures described in previous work22. Pregnant Wistar rats (Charles River Laboratories, Yokohama, Japan) were anaesthetised with isoflurane and immediately sacrificed. The cerebral cortex was removed from 19-day-old embryos (E19) and dissociated into single cells by treatment with 2.5% trypsin (Life Technologies, Carlsbad, CA, USA) at 37 °C for 20 min, followed by mechanical pipetting. Half a million dissociated cortical cells (a mixture of neurons and glial cells) were seeded on the centre of MEA dishes, where the surface of MEA was previously coated with polyethyleneimine (Sigma‒Aldrich, St. Louis, MO, USA) overnight. These cells were cultured in the CO2 incubator. Culture medium comprised Neurobasal Medium (Life Technologies) containing 2% B27 Supplement (Life Technologies), 2 mM GlutaMAX (Life Technologies), and 5–40 U/mL penicillin/streptomycin (Life Technologies). Half of the culture medium was changed once every second or third day. These cultures were recorded during the age of 18–83 days in vitro. During this stage, the spontaneous firing patterns of the neurons had reached a developmentally stable period64,65.
In this work, 21 independent cell cultures were used for the control condition to conduct 30 independent experiments, 6 were treated with bicuculline, 7 with diazepam, 9 with APV, 4 were trained under the 0% mix condition, and 4 under the 50% mix condition. Out of these samples, 7 in the control condition, 6 treated with bicuculline, and 7 with diazepam were obtained from newly conducted experiments, where their response intensities were 3.0 ± 1.1, 3.7 ± 1.9, and 2.3 ± 0.86 spike/trial, respectively (mean ± standard deviation). Other cultures were originally recorded for previous work22. The cell-culturing and experimental conditions in the previous work were essentially the same as those recorded for the present work. Note that the same cultures were used more than once for experiments with other stimulation pattern conditions, after at least one day interval. This is justified because the different stimulation patterns were independent of each other, and thus, learning history with other stimulation patterns did not affect the subsequent experiments22.
Pharmacological treatment
The excitability of cultured neurons was pharmacologically controlled. To block GABAA-receptor activity, bicuculline, a GABAA-receptor antagonist (Sigma‒Aldrich, St. Louis, MO, USA) was used. Bicuculline was adjusted to 10 mM using phosphate-buffered saline (PBS), and 10 µL was added to the culture medium to a final concentration of 50 µM. To upregulate GABAA-receptor activity, diazepam, a benzodiazepine receptor agonist (Sigma‒Aldrich) was used. Diazepam was adjusted to 100 µM using N,N-dimethylformamide (DMF), and 20 µL was added to the culture medium to a final concentration of 1 µM. After adding the solution to the medium, cultured neurons were placed in a CO2 incubator for 30 min, and stable activity of the neurons was confirmed before recording.
Electrophysiological experiments
Electrophysiological experiments were conducted using an MEA system (NF Corporation, Yokohama, Japan). This enabled extracellular recordings of evoked spikes from multiple sites immediately after electrical stimulation20,21. An MEA dish comprises 8×8 microelectrodes (50-µm square each) embedded on its centre, deployed on a grid with 250-µm microelectrodes separation. Recordings were conducted with a 25-kHz sampling frequency and band-pass filter of 100–2000 Hz. The data acquisition was conducted using LabVIEW version 2011. The spike sorting analysis suggested that an electrode was expected to record the activities from up to four neurons. Three-phasic extracellular potentials, as described in previous work20,21, were recorded from the majority of the electrodes.
The 32 stimulation electrodes were randomly distributed over 8×8 MEAs in advance and fixed over training. A biphasic pulse with a 1-V amplitude and 0.2-ms duration, which efficiently induces activity-dependent synaptic plasticity22, was used as a sensory stimulus. A session of training comprised a 256-time-step sequence of stimuli with 1-s intervals, followed by a 244-s resting period. We repeated this training for 100 sessions (approximately 14 h in total). All recordings and stimulation were conducted in a CO2 incubator.
Data preprocessing
For spike detection, the acquired signals were passed through a digital band-pass filter of 500‒2000 Hz after the removal of the saturated ranges and noises that were caused by electric potential variations associated with the switch from the stimulation circuit to the recording circuit. Subsequently, waveform valleys that fell below 4 times the standard deviation of the signal sequence of each electrode were detected as spikes. Note that for data obtained in the previous work22, waveform valleys that fell below 5 times the standard deviation were detected as spikes because of the difference in the noise level.
Irrespective of the presence or absence of bicuculline or diazepam, the peak of evoked response usually fell at 10–20 ms after each stimulus. Accordingly, we defined the intensity of the evoked response to the stimulus by the number of spikes generated until 10–30 ms after each stimulus. We referred to the evoked response at electrode i as \({r}_{{ti}}\) (spike/trial), using discrete time step (or trial) t. Only electrodes at which the all-session average of \({r}_{{ti}}\) was larger than 1 spike/trial were used for subsequent analyses.
The conditional expectation of evoked response \({r}_{{ti}}\)—when a certain source state \(\left({s}_{1},{s}_{2}\right)=\left({{{{\mathrm{1,1}}}}}\right),\, \left({{{{\mathrm{1,0}}}}}\right),\, \left({{{{\mathrm{0,1}}}}}\right),\, \left({{{{\mathrm{0,0}}}}}\right)\) is provided—is given as \({{{{{\rm{E}}}}}}\left[{r}_{{it}}|{s}_{1},{s}_{2}\right]:\!\!={{{{{\rm{E}}}}}}\left[{r}_{{ti}}|{s}_{t}=\left({s}_{1},{s}_{2}\right),\, 1\le t\le 256\right]\) (spike/trial). This \({{{{{\rm{E}}}}}}\left[{r}_{{it}}|{s}_{1},{s}_{2}\right]\) was computed for each session. Recorded neurons were categorised into three groups based on their preference to sources. We referred to a neuron (or electrode) as source 1-preferring when the all-session average of \({{{{{\rm{E}}}}}}\left[{r}_{{it}}|{{{{\mathrm{1,0}}}}}\right]-{{{{{\rm{E}}}}}}\left[{r}_{{it}}|{{{{\mathrm{0,1}}}}}\right]\) was larger than 0.5 spike/trial, as source 2-preferring when the all-session average of \({{{{{\rm{E}}}}}}\left[{r}_{{it}}|{{{{\mathrm{1,0}}}}}\right]-{{{{{\rm{E}}}}}}\left[{r}_{{it}}|{{{{\mathrm{0,1}}}}}\right]\) was smaller than –0.5 spike/trial, or no preference when otherwise. Note that the number of source 1-preferring, source 2-preferring, and no preference electrodes in each sample are 17.1 ± 7.0, 15.0 ± 7.0, and 11.5 ± 6.7, respectively (n = 30 samples under the control condition). Sources 1- and 2-preferring ensembles were quantitatively similar because the total contribution from sources 1 and 2 to stimuli \({o}_{t}\) was designed to be equivalent, owing to the symmetric structure of the \(A\) matrix. Under this setting, this similarity was conserved, irrespective of the details of the \(A\).
Our hypothesis23 was that the stimulus (o) obligatorily excites a subset of neurons in the network, while repeated exposure makes other neurons with appropriate connectivity learn that the patterns of responses are caused by ON or OFF of hidden sources (s). Thus, the recorded neuronal responses comprise the activity of neurons directly receiving the input and that of neurons encoding the sources. To identify functionally specialised neurons, we modelled recorded activity as a mixture of the response directly triggered by the stimulus and functionally specialised response to the sources. Most directly triggered responses occur within 10 ms of stimulation, and their number is largely invariant over time, while their latency varies in the range of a few hundred microseconds40. Conversely, functionally specialised responses emerge during training, and the majority occur 10–30 ms after stimulation. Thus, analysing the deviation of the number of spikes in this period enables the decomposition of the responses into stimulus- and source-specific components.
The empirical responses were represented as the averaged responses in each group. For subsequent analyses, we defined \({x}_{t1}\) as the ensemble average over source 1-preferring neurons and \({x}_{t2}\) as that over source 2-preferring neurons in each culture. For analytical tractability, we normalised the recorded neural response to ensure that it was within the range of \(0\le {x}_{t1},{x}_{t2}\le 1\), after subtracting the offset and trend.
Statistical tests
The two-sided Wilcoxon signed-rank test was used for paired comparisons. The two-sided Mann‒Whitney U test was used for unpaired comparisons.
Reverse engineering of generative models
In this section, we elaborate the procedure for estimating the threshold factor (\(\phi\)) and effective synaptic connectivity (\(W\)) from empirical data, to characterise the landscape of the neural network cost function \(L\) (\(\equiv F\)) and further derive the generative model that the biological system employs.
Assuming that the change in threshold factor was sufficiently slow relative to a short experimental period, the threshold factor \(\phi\) was estimated based on the mean response intensity of empirical data. Following the treatment established in previous work16,17, the constants are estimated for each culture using the empirical data as follows:
where \(\left\langle \cdot \right\rangle : \!\!=\frac{1}{t}\mathop{\sum }\nolimits_{\tau=1}^{t}\cdot\) indicates the average over time. Equation (9) was computed using data in the initial 10 sessions. Subsequently, the state prior \(D\) was reconstructed from the relationship \({{{{{\rm{ln}}}}}} \, D=\phi\) (Table 2). This \(D\) expresses the implicit perceptual bias of an in vitro network about hidden sources.
Synaptic plasticity rules conjugate to Eq. (6) are derived as the gradient descent on L16,17, which are asymptotically given as \({\dot{W}}_{1}\propto -\frac{1}{t}\frac{\partial L}{\partial {W}_{1}}=\left\langle {x}_{t}{o}_{t}^{{{{{{\rm{T}}}}}}}\right\rangle -\left\langle {x}_{t}{\vec{1}}{\,\!}^{{{{{{\rm{T}}}}}}}\right\rangle \odot {\widehat{W}}_{1}\) and \({\dot{W}}_{0}\propto -\frac{1}{t}\frac{\partial L}{\partial {W}_{0}}=\left\langle \overline{{x}_{t}}{o}_{t}^{{{{{\rm{T}}}}}}\right\rangle -\left\langle \overline{{x}_{t}}{\vec{1}}{\,\!}^{{{{{\rm{T}}}}}}\right\rangle \odot {\widehat{W}}_{0}\) in the limit of a large t, where \(\odot\) denotes the elementwise product (a.k.a., the Hadamard product). These rules comprise Hebbian plasticity accompanied with an activity-dependent homeostatic term, endorsing the biological plausibility of this class of cost functions. Solving the fixed point of these equations provides the following synaptic strengths:
where \(\oslash\) denotes the elementwise division operator. In this work, we refer to Eq. (10) as the empirically estimated effective synaptic connectivity, where \(W={W}_{1}-{W}_{0}\). This was estimated for each session, using empirical neuronal response data \({x}_{t}\). These synaptic strengths encode the posterior belief about the mixing matrix A (Table 2). Further details are provided in previous works16,17.
These empirically estimated parameters are sufficient to characterise the generative model that an in vitro neural network employs. Owing to the equivalence, the empirical variational free energy F for the in vitro network was computed by substituting empirical neuronal responses x and empirically estimated parameters \(W\) (Eq. (10)) and \(\phi\) (Eq. (9)) into the neural network cost function L (Eq. (8)): see Fig. 3l for its trajectory.
Data prediction using the free-energy principle
The virtues of the free-energy principle are that it offers the quantitative prediction of transitions (i.e., plasticity) of the neural responses and synaptic strengths in future, in the absence of empirical response data. We denote the predicted neural responses and synaptic strengths as \({x}_{t}^{P}\) and \({W}^{P}\), respectively, to distinguish them from the observed neural responses \({x}_{t}\) and empirically estimated synaptic strengths \(W\) defined above.
The predicted neural response is given as the fixed-point solution of Eq. (6):
where \({h}^{P}={{{{{\rm{ln}}}}}}\overline{{\widehat{W}}_{1}^{P}}\vec{1}-{{{{{\rm{ln}}}}}}\overline{{\widehat{W}}_{0}^{P}}\vec{1}+{\phi }_{1}-{\phi }_{0}\) denotes the adaptive firing threshold. Empirical \(\phi\) (Eq. (9)) estimated from data in the initial 10 sessions was used to characterise \({h}^{P}\). Here, predicted synaptic strength matrix \({W}^{P}\) was used instead of the empirically estimated \(W\). The predicted synaptic strengths are given as follows:
where \({W}^{P}:\!\!={W}_{1}^{P}-{W}_{0}^{P}\). Here, the predicted neural responses \({x}_{t}^{P}\) were employed to compute the outer products. The initial value of \({W}^{P}\) was computed using empirical response data in the first 10 sessions. By computing Eqs. (11) and (12), one can predict the subsequent self-organisation of neuronal networks in sessions 11–100, without reference to the observed neuronal responses.
We note that the reverse engineering approach provides three novel aspects compared to earlier work22,23. First, previous work assumed the form of the generative model and did not examine whether all elements of the generative model corresponded to biological entities at the circuit level. In the present work, we objectively reverse-engineered the generative model from empirical data and showed a one-to-one mapping between all the elements of the generative model and neural network entities. Second, previous work did not examine the impact of changing prior beliefs on Bayesian inference performed by in vitro neural networks. The present work analysed how Bayesian inference and free energy reduction changed when the prior belief and external environment were artificially manipulated and showed that the results were consistent with theoretical predictions. This work validated the predicted relationship between baseline excitability and prior beliefs about hidden states. Third, previous work did not investigate whether the free-energy principle can quantitatively predict the learning process of biological neural networks based exclusively on initial empirical data. This was demonstrated in the current work.
Reporting summary
Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.
Data availability
The neuronal response data are available at GitHub https://github.com/takuyaisomura/reverse_engineering. Source data are provided with this paper.
Code availability
The simulations and analyses were conducted using MATLAB version R2020a. The scripts are available at GitHub https://github.com/takuyaisomura/reverse_engineering66. The scripts are covered under the GNU General Public License v3.0.
References
Friston, K. J., Kilner, J. & Harrison, L. A free energy principle for the brain. J. Physiol. Paris 100, 70–87 (2006).
Friston, K. J. The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11, 127–138 (2010).
Blei, D. M., Kucukelbir, A. & McAuliffe, J. D. Variational inference: a review for statisticians. J. Am. Stat. Assoc. 112, 859–877 (2017).
Hodgkin, A. L. & Huxley, A. F. A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117, 500–544 (1952).
FitzHugh, R. Impulses and physiological states in theoretical models of nerve membrane. Biophys. J. 1, 445–466 (1961).
Nagumo, J., Arimoto, S. & Yoshizawa, S. An active pulse transmission line simulating nerve axon. Proc. IRE 50, 2061–2070 (1962).
Rosenblatt, F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65, 386–408 (1958).
Bliss, T. V. & Lømo, T. Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path. J. Physiol 232, 331–356 (1973).
Malenka, R. C. & Bear, M. F. LTP and LTD: an embarrassment of riches. Neuron 44, 5–21 (2004).
Markram, H., Lübke, J., Frotscher, M. & Sakmann, B. Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275, 213–215 (1997).
Bi, G. Q. & Poo, M. M. Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18, 10464–10472 (1998).
Butts, D. A., Kanold, P. O. & Shatz, C. J. A burst-based “Hebbian” learning rule at retinogeniculate synapses links retinal waves to activity-dependent refinement. PLoS Biol 5, e61 (2007).
Hebb, D. O. The Organization of Behavior: A Neuropsychological Theory (Wiley, New York, 1949).
Song, S., Miller, K. D. & Abbott, L. F. Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci. 3, 919–926 (2000).
Clopath, C., Büsing, L., Vasilaki, E. & Gerstner, W. Connectivity reflects coding: a model of voltage-based STDP with homeostasis. Nat. Neurosci. 13, 344–352 (2010).
Isomura, T. & Friston, K. J. Reverse-engineering neural networks to characterize their cost functions. Neural Comput. 32, 2085–2121 (2020).
Isomura, T., Shimazaki, H. & Friston, K. J. Canonical neural networks perform active inference. Commun. Biol. 5, 55 (2022).
Isomura, T. Active inference leads to Bayesian neurophysiology. Neurosci. Res. 175, 38–45 (2022).
Daunizeau, J. et al. Observing the observer (I): Meta-Bayesian models of learning and decision-making. PLoS One 5, e15554 (2010).
Jimbo, Y., Tateno, T. & Robinson, H. P. C. Simultaneous induction of pathway-specific potentiation and depression in networks of cortical neurons. Biophys. J. 76, 670–678 (1999).
Jimbo, Y., Kasai, N., Torimitsu, K., Tateno, T. & Robinson, H. P. C. A system for MEA-based multisite stimulation. IEEE Trans. Biomed. Eng. 50, 241–248 (2003).
Isomura, T., Kotani, K. & Jimbo, Y. Cultured cortical neurons can perform blind source separation according to the free-energy principle. PLoS Comput. Biol. 11, e1004643 (2015).
Isomura, T. & Friston, K. J. In vitro neural networks minimise variational free energy. Sci. Rep. 8, 16926 (2018).
Belouchrani, A., Abed-Meraim, K., Cardoso, J.-F. & Moulines, E. A blind source separation technique using second-order statistics. IEEE Trans. Signal Process 45, 434–444 (1997).
Cichocki, A., Zdunek, R., Phan, A. H. & Amari, S. I. Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation (John Wiley & Sons, 2009).
Comon, P. & Jutten, C. Handbook of Blind Source Separation: Independent Component Analysis and Applications (Academic Press, 2010).
Brown, G. D., Yamada, S. & Sejnowski, T. J. Independent component analysis at the neural cocktail party. Trends Neurosci. 24, 54–63 (2001).
Mesgarani, N. & Chang, E. F. Selective cortical representation of attended speaker in multi-talker speech perception. Nature 485, 233–236 (2012).
Ruaro, M. E., Bonifazi, P. & Torre, V. Toward the neurocomputer: image processing and pattern recognition with neuronal cultures. IEEE Trans. Biomed. Eng. 52, 371–383 (2005).
Chao, Z. C., Bakkum, D. J. & Potter, S. M. Shaping embodied neural networks for adaptive goal-directed behavior. PLoS Comput. Biol. 4, e1000042 (2008).
Feinerman, O., Rotem, A. & Moses, E. Reliable neuronal logic devices from patterned hippocampal cultures. Nat. Phys. 4, 967–973 (2008).
Johnson, H. A., Goel, A. & Buonomano, D. V. Neural dynamics of in vitro cortical networks reflects experienced temporal patterns. Nat. Neurosci. 13, 917–919 (2010).
Yuan, X. et al. Versatile live-cell activity analysis platform for characterization of neuronal dynamics at single-cell and network level. Nat. Commun. 11, 1–14 (2020).
Yada, Y., Yasuda, S. & Takahashi, H. Physical reservoir computing with FORCE learning in a living neuronal culture. Appl. Phys. Lett. 119, 173701 (2021).
Kagan, B. J. et al. In vitro neurons learn and exhibit sentience when embodied in a simulated game-world. Neuron 110, 1–18 (2022).
Newsome, W. T., Britten, K. H. & Movshon, J. A. Neuronal correlates of a perceptual decision. Nature 341, 52–54 (1989).
Turrigiano, G. G. & Nelson, S. B. Homeostatic plasticity in the developing nervous system. Nat. Rev. Neurosci. 5, 97–107 (2004).
Friston, K. J., FitzGerald, T., Rigoli, F., Schwartenbeck, P. & Pezzulo, G. Active inference and learning. Neurosci. Biobehav. Rev. 68, 862–879 (2016).
Friston, K. J., FitzGerald, T., Rigoli, F., Schwartenbeck, P. & Pezzulo, G. Active inference: A process theory. Neural Comput. 29, 1–49 (2017).
Bakkum, D. J., Chao, Z. C. & Potter, S. M. Long-term activity-dependent plasticity of action potential propagation delay and amplitude in cortical networks. PLoS ONE 3, e2088 (2008).
Wald, A. An essentially complete class of admissible decision functions. Ann. Math. Stat. 18, 549–555 (1947).
Brown, L. D. A complete class theorem for statistical problems with finite-sample spaces. Ann. Stat. 9, 1289–1300 (1981).
Berger, J. O. Statistical Decision Theory and Bayesian Analysis (Springer Science & Business Media, 2013).
Deneve, S. Bayesian spiking neurons II: learning. Neural Comput. 20, 118–145 (2008).
Kappel, D., Nessler, B. & Maass, W. STDP installs in winner-take-all circuits an online approximation to hidden Markov model learning. PLoS Comput. Biol. 10, e1003511 (2014).
Jimenez Rezende, D. & Gerstner, W. Stochastic variational learning in recurrent spiking networks. Front. Comput. Neurosci. 8, 38 (2014).
Funamizu, A., Kuhn, B. & Doya, K. Neural substrate of dynamic Bayesian inference in the cerebral cortex. Nat. Neurosci. 19, 1682–1689 (2016).
Torigoe, M. et al. Zebrafish capable of generating future state prediction error show improved active avoidance behavior in virtual reality. Nat. Commun. 12, 5712 (2021).
Schwartenbeck, P. & Friston, K. J. Computational phenotyping in psychiatry: a worked example. eNeuro 3, ENEURO.0049–16.2016 (2016).
George, D. & Hawkins, J. Towards a mathematical theory of cortical micro-circuits. PLoS Comput. Biol. 5, e1000532 (2009).
Doya, K. Canonical cortical circuits and the duality of Bayesian inference and optimal control. Curr. Opin. Behav. Sci. 41, 160–167 (2021).
Berkes, P., Orbán, G., Lengyel, M. & Fiser, J. Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science 331, 83–87 (2011).
Nour, M. M. & Carhart-Harris, R. L. Psychedelics and the science of self-experience. Br. J. Psychiatry 210, 177–179 (2017).
Fletcher, P. C. & Frith, C. D. Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia. Nat. Rev. Neurosci. 10, 48–58 (2009).
Friston, K. J., Stephan, K. E., Montague, R. & Dolan, R. J. Computational psychiatry: the brain as a phantastic organ. Lancet Psychiatry 1, 148–158 (2014).
Merolla, P. A. et al. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science 345, 668–673 (2014).
Roy, K., Jaiswal, A. & Panda, P. Towards spike-based machine intelligence with neuromorphic computing. Nature 575, 607–617 (2019).
Schiess, M., Urbanczik, R. & Senn, W. Somato-dendritic synaptic plasticity and error-backpropagation in active dendrites. PLoS Comput. Biol. 12, e1004638 (2016).
Whittington, J. C. & Bogacz, R. An approximation of the error backpropagation algorithm in a predictive coding network with local Hebbian synaptic plasticity. Neural Comput. 29, 1229–1262 (2017).
Whittington, J. C. & Bogacz, R. Theories of error back-propagation in the brain. Trends Cogn. Sci. 23, 235–250 (2019).
Hinton, G. The forward-forward algorithm: Some preliminary investigations. Preprint at arXiv arXiv:2212.13345 https://arxiv.org/abs/2212.13345 (2022).
Sengupta, B. & Friston, K. J. How robust are deep neural networks? Preprint at arXiv arXiv:1804.11313 https://arxiv.org/abs/1804.11313 (2018).
Sengupta, B., Stemmler, M. B. & Friston, K. J. Information and efficiency in the nervous system—a synthesis. PLoS Comput. Biol. 9, e1003157 (2013).
Kamioka, H., Maeda, E., Jimbo, Y., Robinson, H. P. C. & Kawana, A. Spontaneous periodic synchronized bursting during formation of mature patterns of connections in cortical cultures. Neurosci. Lett. 206, 109–112 (1996).
Tetzlaff, C., Okujeni, S., Egert, U., Wörgötter, F. & Butz, M. Self-organized criticality in developing neuronal networks. PLoS Comput. Biol. 6, e1001013 (2010).
Isomura, T. Experimental validation of the free-energy principle with in vitro neural networks [Code]. zenodo https://doi.org/10.5281/zenodo.8139515 (2023).
Forney, G. D. Codes on graphs: normal realizations. IEEE Trans. Info. Theory 47, 520–548 (2001).
Dauwels, J. On variational message passing on factor graphs. In 2007 IEEE International Symposium on Information Theory (IEEE, 2007).
Friston, K. J., Parr, T. & de Vries, B. D. The graphical brain: belief propagation and active inference. Netw. Neurosci. 1, 381–414 (2017).
Acknowledgements
We are grateful to Masafumi Oizumi, Asaki Kataoka, Daiki Sekizawa, and other members of the Oizumi laboratory for discussions. T.I. is supported by the Japan Society for the Promotion of Science (JSPS) KAKENHI Grant Numbers JP23H04973 and JP23H03465 and the Japan Science and Technology Agency (JST) CREST Grant Number JPMJCR22P1. K.J.F. is supported by funding for the Wellcome Centre for Human Neuroimaging (Ref: 205103/Z/16/Z), a Canada-UK Artificial Intelligence Initiative (Ref: ES/T01279X/1) and the European Union’s Horizon 2020 Framework Programme for Research and Innovation under the Specific Grant Agreement No. 945539 (Human Brain Project SGA3). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Author information
Authors and Affiliations
Contributions
Conceptualisation, T.I., K.K., Y.J. and K.J.F.; Designing and performing experiments and data analyses, T.I.; Writing—original draft, T.I. and K.J.F.; Writing—review & editing, T.I., K.K., Y.J. and K.J.F. All authors made substantial contributions to the conception, design and writing of the article. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Nature Communications thanks Steve Potter, and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. A peer review file is available.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Source data
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Isomura, T., Kotani, K., Jimbo, Y. et al. Experimental validation of the free-energy principle with in vitro neural networks. Nat Commun 14, 4547 (2023). https://doi.org/10.1038/s41467-023-40141-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467-023-40141-z
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.