Abstract
Assuming a steadystate condition within a cell, metabolic fluxes satisfy an underdetermined linear system of stoichiometric equations. Characterizing the space of fluxes that satisfy such equations along with given bounds (and possibly additional relevant constraints) is considered of utmost importance for the understanding of cellular metabolism. Extreme values for each individual flux can be computed with linear programming (as flux balance analysis), and their marginal distributions can be approximately computed with Monte Carlo sampling. Here we present an approximate analytic method for the latter task based on expectation propagation equations that does not involve sampling and can achieve much better predictions than other existing analytic methods. The method is iterative, and its computation time is dominated by one matrix inversion per iteration. With respect to sampling, we show through extensive simulation that it has some advantages including computation time, and the ability to efficiently fix empirically estimated distributions of fluxes.
Introduction
The metabolism of a cell entails a complex network of chemical reactions performed by thousands of enzymes that continuously process intake nutrients to allow for growth, replication, defence and other cellular tasks^{1}. Thanks to the new highthroughput techniques and comprehensive databases of chemical reactions, largescale reconstructions of organismwide metabolic networks are nowadays available. Such reconstructions are believed to be accurate from a topological and stoichiometric viewpoint (for example, the set of metabolites targeted by each enzyme, and their stoichiometric ratio). For the determination of reaction rates, largescale constraintbased approaches have been proposed^{2}. Typically, such methods assume a steadystate regime in the system where metabolite concentrations remain constant over time (massbalance condition). A second type of constraints limit the reaction velocities and their direction. In full generality, the topology of a metabolic network is described in terms of the chemical relations between the M metabolites and N reactions. In mathematical terms, we can define a M × N stoichiometric matrix S in which rows correspond to the stoichiometric coefficients of the corresponding metabolites in all reactions. A positive (resp. negative) S_{ij} term indicates that metabolite i is created (resp. consumed) by reaction j. Assuming massbalance and limited interval of variation for the different reactions, we can cast the problem in terms of finding the set of fluxes ν∈ compatible with the following linear system of constraints and inequalities:
where b∈ is the known set of intakes/uptakes, and the pair ν^{inf}, ν^{sup} represent the extremes of variability for the variables of our problem. Only in few cases, the extremes are experimentally accessible, in the remaining ones they are fixed to arbitrarily large values. It turns out that N≥M, and the system is typically underdetermined. As an example, the RECON1 model of Homo sapiens has N=2,469 fluxes (that is, variables) and M=1,587 metabolites (that is, equations). The massbalance constraints and the flux inequalities encoded in equations (1 and 2) define a convexbounded polytope, which constitutes the space of all feasible solutions of our metabolic system.
The most widely used technique to analyse fluxes in largescale metabolic reconstruction is flux balance analysis (FBA)^{3,4} where a linear objective function, typically the biomass or some biological proxy of it is introduced, and the problem reduces to find the subspace of the polytope, which optimizes the objective function. If this subspace consists in only one point, the problem can be efficiently solved using linear programming. FBA has been successfully applied in many metabolic models to predict specific phenotypes under specific growth condition (for example, bacteria in the exponential growth phase). However, if one is interested in describing more general growth conditions, or is interested in other fluxes than the biomass^{5}, different computational strategies must be envisaged^{6,7,8}.
As long as no prior knowledge is considered, each point of the polytope is an equally viable metabolic phenotype of the biological system under investigation. Therefore, being able to sample highdimensional polytopes becomes a theoretical problem with concrete practical applications. From a theoretical standpoint, the problem is known to be #Phard^{9} and thus an approximate solution to the problem must be sought. A first class of Monte Carlo–Markov chain sampling techniques available to analyse largedimensional polytopes was originally proposed three decades ago^{10} and falls under the name of HitandRun (HR)^{11}. Basically, it consists on iteratively collecting samples by choosing random directions from a starting point belonging to the polytope. Unfortunately, polytopes defined by largescale metabolic reconstructions are typically ill conditioned (that is, some direction of the space are far more elongated than others), and improved HR techniques to overcome this problem have been proposed^{12} and implemented in the context of metabolic modelling^{6,8,13}. Despite the fact that these dynamic sampling strategies are often referred as uniform random samplers, the uniformity of the sampling is guaranteed only in an asymptotic sense, and often establishing in practice how long a simulation should be run and how frequently the measurement should be taken for a given instance of the problem requires extensive preliminary simulations, which make their use very difficult under general conditions. Note, also that the problem of assessing how perturbations of network parameters affect the structure of the polytope is often of practical importance; for example, changing extremal flux values for studying growth rate curves or enzymopaties^{14}. In these situations, in principle, the convergence time of the algorithm should be established independently for each new value of the parameter. Another limitation of this class of sampling strategies is the difficulty of imposing other constraints^{15} such as the experimentally measured distribution profiles of specific subset of fluxes (typically biomass and/or intake/outtake of the network), a particularly timely issue given the recent breakthrough of metabolic measurements in single cell^{16}, although recent attempts in this direction exist^{17,18}.
Recently, alternative statistical methods based on message passing (MP) techniques (also known as cavity or Bethe approximation in the context of statistical mechanics)^{19} have been proposed^{7,20,21,22,23}, allowing for sampling of the polytope orders of magnitude faster than HR methods, under two main conditions: (i) the graphical structure of the graph must be a tree or, at least, locally tree like (that is, without short loops), (ii) the rows of the stoichiometric matrix S should be statistically uncorrelated. Unfortunately, neither assumption is really fulfilled by largescale metabolic reconstructions. To give an example, consider the rows of the stoichiometric matrix for E. colicore model^{24}. The rows corresponding to the adenosine–diphosphate and adenosine–triphosphate appear strongly correlated as both metabolites commonly appear in 11 reactions; the same apply for the intracellular water and hydrogen ion that have 10 reactions in common. For these reasons, MP methods suffer from all kind of convergence and accuracy problems.
In this work, we propose a new Bayesian inference strategy to analyse with unprecedented efficiency large dimensional polytopes. The use of a Bayesian framework allows us to map the original problem of sampling the feasible space of solutions of equations (1 and 2) into the inference problem of the joint distribution of metabolic fluxes. Linear and inequality constraints will be encoded within the likelihood and the prior probabilities that via Bayes theorem provide a model for the posterior . The goal of this work is to determine a tractable multivariate probability density able to accurately approximate the posterior even in the case of strongly rowcorrelated stoichiometric matrices. This strategy relies on an iterative and local refinement of the parameters of that falls into the class of expectation propagation (EP) algorithms. We report results of EP for representative stateoftheart models of metabolic networks in comparison with HR estimate, showing that EP can be used to compute marginals in a fraction of the computing time needed by HR. We also show how the technique can be efficiently adapted to incorporate the estimated growth rate of a population of Escherichia coli.
Results
Formulation of the problem
We are going to formulate an iterative strategy to solve the problem of finding a multivariate probability measure over the set of fluxes ν compatible with equations (1 and 2). For a vector of fluxes satisfying bounds 2, we can define a quadratic energy function E(ν) whose minimum(s) lies on the assignment of variables ν satisfying the stoichiometric constraints in equation (1):
We define the likelihood of observing b given a set of fluxes ν as a Boltzmann distribution:
where β is a positive parameter, the ‘inverse temperature’ in statistical physics jargon, that governs the penalty of whose configurations of fluxes that are far from the minimum of the energy. In a Bayesian perspective, one can consider the posterior probability of observing as:
where the prior
enforces the bounds over the allowed range of fluxes. The function is an indicator function that takes value 1 if ν_{n}∈[, ] and 0 otherwise. We finally obtain the following relation for the posterior:
and eventually we will investigate the β→∞ limit. Neglecting terms that do not depend on ν, the posterior takes the form of
where we have not explicitly reported the normalization constant. By marginalization of equation (7), one can determine the marginal posterior for each flux n∈{1, …, N}. However, performing this computation naively would require the calculation of a multiple integral that is in principle computationally very expensive and cannot be performed analytically in an efficient way.
A standard way of approximately computing is through sampling methods, such as the HR technique. The accuracy obtained with HR depends of course on the number of samples, and sampling accurately can be very time consuming. In the following, we develop an analytic approach to approximately compute marginal posteriors, which is able to achieve results as accurate as the HR sampling technique for a large number of sampled points in a fraction of the computing time. But first, we will describe as a warmup naive analytic method to approximately compute marginal distributions .
A nonadaptive approach
As a first approximation, one can think of replacing each exact prior ψ_{n}(ν_{n}) with a single Gaussian distribution , whose statistics, that is, the mean and the variance, are constrained to be equal to the one of ψ_{n}(ν_{n}). That is
We estimate the marginal posteriors from the distribution
Notice that in this approximation fluxes result unbounded. Marginals obtained by this strategy against the HR Monte Carlo estimate are shown in Fig. 1 (cyan line) for nine representative metabolic fluxes of one of the standard model for red blood cell^{25}. Marginals evaluated with this simple nonadaptive strategy differ significantly from the ones evaluated with the Monte Carlo sampling technique. In the following, we will show how we can overcome this limitation by choosing different values for the means a and the variances d in equation (10) making use of the EP algorithm.
Expectation propagation
EP^{26} is an efficient technique to approximate intractable (that is, impossible or impractical to compute analytically) posterior probabilities. EP was first introduced in the framework of statistical physics as an advanced meanfield method^{27,28} and further developed for Bayesian inference problems in the seminal work of Minka^{26}.
Let us consider the nth flux and its corresponding approximate prior φ_{n}(ν_{n}; a_{n}, d_{n}). We define a tilted distribution Q^{(n)} as
The important difference between the tilted distribution and the multivariate Gaussian is that all the intractable priors are approximated as Gaussian probability densities except for the nth prior, which is treated exactly. For this reason, we expect that this distribution will be more accurate than regarding the estimate of the statistics of flux n without significantly affecting the computation of expectations. Bearing in mind that it is a large number of exact priors (that is, the distributions ) that make the computation intractable and not a single one, we have introduced only one exact intractable prior in Q^{(n)}.
One way of determining the unknown parameters a_{n} and d_{n} of φ_{n}(ν_{n}; a_{n}, d_{n}) is to require that the multivariate Gaussian distribution is as close as possible to the auxiliary distribution . Intuitively, there are at least two possibilities to enforce this similarity: (i) matching the first and the second moments of the two distributions (ii) minimizing the Kullback–Leibler divergence ; these two methods coincide (see details in Supplementary Note 1). Thus, we aim at imposing the following moment matching conditions:
from which we get a relation for the parameters a_{n}, d_{n} that is explicitly reported in section 3.
EP consists in sequentially repeating this update step for all the other fluxes and iterate until we reach a numerical convergence. Further technical details about the convergence are reported in subsection 1. At the fixed point, we directly estimate the marginal posteriors , for n∈{1, …, N}, from marginalization of the tilted distribution Q^{(n)} that turns out to be a truncated Gaussian density in the interval [, ] (see Supplementary Note 2).
At difference from the nonadaptive approach, the EP algorithm determines the approximated prior density by trying to reproduce the effect that the true prior density has on variable ν_{n}, including the interaction of this term with the rest of the system. First, the information encoded in the stoichiometric matrix is surely encompassed in the computation of the means and the variances of the approximation since both the distributions Q^{(n)} and Q contain the exact expression of the likelihood. Second, the refinement of each prior also depends on the parameters of all the other fluxes.
As an example of the accuracy of this technique, we report in Fig. 1 (red line) the nine best marginals estimated by EP of the red blood cell against the results of HR Monte Carlo sampling. Figure 1 suggests that this technique leads to a significant improvement of the nonadaptive approximation as the plot shows a very good overlap between the distributions provided by HR and EP. The entire set of marginals and a comparison with a stateoftheart MP algorithm^{7} is reported in the Supplementary Fig. 2.
Numerical results for largescale metabolic networks
This section is devoted to compare the results of our algorithm against the outcomes of a stateoftheart HR Monte Carlo sampling technique on three representative models of metabolic networks, precisely the iJR904 (ref. 29), the CHOLnorm^{30} and the RECON1 (ref. 31) models for E. coli, the Cholinergic neuron and Homo sapiens organisms, respectively. In Supplementary Fig. 3, we report results for a larger set of models all selected from the Bigg models database^{32}.
Experiments are performed as follows. First, we preprocess the stoichiometric matrix of the model in order to remove all reactions involving metabolites that are only produced or only degraded^{33}.
After the preprocessing, we run HR and EP, both implemented on Matlab or as Matlab libraries, to the reduced model. Let us explain how the two methods work. Starting from a point lying on the polytope, HR iteratively chooses a random direction and collects new samples in that direction such that they also reside in the solution space. In this work, we use an optimized implementation of HR, called optGpSampler^{6}. Regarding the HR simulations, we set the number of sampled points to be equal to 10^{4} for an increasing number of explored configurations T from 10^{4} to 10^{7} in most of the cases; for some specific models, that is, very large networks having N ∼10^{3} reactions, we explore up to T ∼10^{9} points. Concerning the EP algorithm, we perform the same experiment setting the β parameter to be equal to 10^{10} for almost all models. In only one case (the RECON1 model), we encountered convergence problems and thus we decreased it to 10^{9}. Numerical convergence of EP depends on the refinement of parameters a and d or, more precisely, on the estimate of the marginal distributions of fluxes. At each iteration t, we compute an error ɛ, which measures how the approximate marginal distributions change in two consecutive iterations. Formally, we define the error as the maximum value of the sum of the differences (in absolute values) of the mean and second moment of the marginal distribution, that is
If ɛ^{t} is smaller than a predetermined target precision (we used 10^{−5}), the algorithm stops.
To quantitatively compare the two techniques, we report here the scatter plots of variances and means of the approximate marginals computed via HR and EP. Moreover, we estimate the degree of correlation among the two sets of parameters computing the Pearson productmoment correlation coefficient.
Notice that we cannot have access to the exact marginals and that we assume that the results obtained by HR are exact only asymptotically. Thus, our performances, both for the direct comparison of the means and variances and for the Pearson’s coefficient, should be considered accurate if they are approached by the Monte Carlo ones for an increasing number of explored points.
The three large subplots in Fig. 2 show the results for E. coli, C. neuron and Homo sapiens, respectively. For each organism, we report on the topleft panel the time spent by EP (straight line) and by HR (cyan points) and on the bottomleft panel the Pearson correlation coefficients. Both measures of time and correlation are plotted as functions of the number of configuration T obtained from the HR algorithm. As shown in these plots, we can notice that to reach a high correlation regime a very large number of explored configurations, employing a computing time that is always several orders of magnitude larger than the EP running time. This is particularly strinking in the case of the RECON1 model, for which we needed to run HR for about 20 days in order to reach results similar to the outcomes of EP, that converges in less than 1 h on the same machine.
To underline how EP seems to approach HR results in the asymptotic limit, we report in the rest of the subfigures the scatter plots of the means (top) and the variances (bottom) of the marginals. On the y axis, we plot the EP means (variances) against the HR means (variances) for an increasing number of explored configurations, as indicated in x axis. Results clearly show that as T grows, the points (both means and variances) are more and more aligned to the identity line: not only these measures are highly correlated for large T, but they assume very similar values. This is remarkably appreciable in the results for CHOLnorm model: for T=4 × 10^{4} the means of the scatter plots are quite unaligned but as T reaches 4 × 10^{7}, they almost lie on the identity line. In fact, means are poorly correlated for T=4 × 10^{4} while the Pearson correlation coefficient is close to 1 for T=4 × 10^{7}.
Study of E. coli metabolism for a constrained growth rate
The EP formalism can efficiently deal with a slightly modified version of problem of sampling metabolic networks. Suppose to have access to experimental measurements of the distribution of some fluxes under specific environmental conditions. We would like to embed this empirical knowledge in our algorithm, by matching the posterior distribution of the measured fluxes with the empirical measurements. Within the EP scheme, this task corresponds to matching the first two moments (mean and variance) of the posteriors with the one defined by the empirical measurements. With the inclusion of empirically established prior knowledge, we want to investigate how the experimental evidence is related to the metabolism at the level of reactions or, in other words, we want to determine how fluxes modify in order to reproduce the experiments. In this perspective, the EP scheme can easily accommodate additional constraints on the posteriors by modifying the EP update equations as outlined in Methods section.
We have tested this variant of EP algorithm on the iJR904 model of E. coli for a constrained growth rate. In fact, one of the few fluxes that are experimentally accessible is the biomass flux, often measured in terms of doubling per hour. As a matter of example, we decide to extract one of the growth rates reported in Fig. 3a of ref. 34; the profile labelled as Glc (P5ori) can be well fitted by a Gaussian probability density of mean 0.92 h^{−1} and variance 0.0324, h^{−2}. This curve represent singlecell measures of a population of bacteria living in the socalled minimal substrate whose main characteristics are in principle well caught by the iJR904 model. We fixed the bound on the glucose exchange flux EX_glc(e) such that the maximum allowed growth rate (about 2 h^{−1}) contained all experimental values in the profile labelled as Glc (P5ori) of Fig. 3a of ref. 34. This was easily computed by fixing the biomass flux to the desired value and minimizing the glucose exchange flux using FBA, and gies a the lower bound of the exchanged glucose flux of −43 mmol (g[DW])^{−1} h^{−1}.
We then apply EP algorithm to the modified iJR904 model in two different conditions. First, we do not impose any additional constraint and we run the original EP algorithm as described in the previous section. Then, as described in Methods section, we fix the marginal posterior of the biomass. We can now compare the means and the variances of all the other fluxes in the two cases and single out those fluxes that have been more affected by the empirical constraints on the growth rate. We report in Fig. 3 the plot of the ratio between the means (Fig. 3a) and the variances (Fig. 3b) in the unconstrained case and in the constrained case. In Fig. 3a, these ratios are plotted against the logarithm of the absolute value of the unconstrained means to differentiate those fluxes having means close to zero and all the other cases. The ratios of the variances are instead plotted as a function of the unconstrained variances in semilog scale. We can notice that apparently a large fraction of the fluxes have changed their marginal distribution in order to accommodate the fixed marginal for the biomass. We have reported the name of the reactions with the most significant changes; for instance, the marginal of the TKT2 reaction has reduced its mean of more than one third, while many reactions involving aspartate have significantly lowered their variances.
To underline the nontrivial results of EP algorithm in the constrained case, we apply again the standard EP algorithm to the iJR904 model when the lower bound and the upper bound of the biomass is fixed to the average value of the experimental profile. The comparison (not shown) between the two approaches suggests that the most relevant change concerns the EX_asp_L(e) flux as both the average value and the variance estimated in the second case are about two times the ones predicted by constrained EP. The distributions of most other fluxes remain do not considerably change. We underline that the different behaviour of the marginals in the two cases, even if not significant for most of the fluxes, was in principle unpredictable without the use of constrained EP; and we do not exclude that fixing other empirical profiles can lead to very different results. Likewise, it seems unlikely that the results computed with constrained EP could be obtained using unbiased samples as provided by standard HR implementations (see a discussion in Supplementary Note 6).
Discussion
In this work, we have shown how to study the space of feasible configurations of metabolic fluxes within a cell via an analytic description of the marginal probability distribution characterizing each flux. Such marginals are described as truncated Gaussian densities whose parameters are determined through an iterative and extremely efficient algorithm, the EP algorithm. We have compared our predictions against the estimates provided by HR sampling technique and results shown in Subsection 1 suggest a very good agreement between EP and HR for a large number of explored configurations, T. First of all, the direct comparison of the means and variances of EP versus HR reported in the scatter plots shows that the more we increment the HR points, the more the scatter points are aligned. Second, we see an increment of the correlation between EP and HR statistics for an increasing number of sampled points; correlations reach values very close to 1 for large values of T and for almost all the models we have considered. The most important point is that the computation times of EP, at high correlation regime, are always orders of magnitude lower than HR sampling times. This is extremely timesaving when we deal with very large networks, as the RECON1 model for Homo sapiens where the running time (in seconds) of EP is three order of magnitude smaller than HR. We underline that exact marginals are generally inaccessible and we cannot compare our results against a groundtruth; our measures well approximate ‘true’ distributions as long as the exactness of HR in the asymptotic limit is correct.
We have shown how to include empirical knowledge on distribution of fluxes on the EP algorithm without compromising the computing time. More precisely, we have investigated how fixing an experimental profile of the growth rate into the iJR904 model of E. coli affect nontrivially all other fluxes. This is a remarkable advantage of the EP algorithm with respect to other methods.
EP provides an analytic estimate of each single flux marginal, which relies on the optimization of two parameters, the mean and the variance of a Gaussian distribution. The formalism allows in principle more complicated parametrizations of posteriors to include other biological insights.
EP equations are extremely easy to derive and to implement, as the main loop can be written in few lines of Matlab code. The method is iterative, and the number of operations in each iteration scales as Θ(N^{3}), rendering EP extremely convenient in terms of computation time with respect to existing alternatives.
An shown in Fig. 2 in real cases, variances of the marginal distributions can span several orders of magnitude. This range of variability implies that also the variances of the approximation need to allow both very small and huge values. To cope with the numeric problems that may arise, we allow parameters d to vary in a finite range of values with the drawback of limiting the set of allowed Gaussian densities of the approximation. For instance, a flat distribution cannot be perfectly approximated through a Gaussian whose variance cannot be arbitrary large; in the opposite extreme, imposing a lower bound on variances prevents the approximation of posteriors that are too concentrated on a single point. Thus, this range needs to be reasonably designed in order to catch as many ‘true’ variances as possible. In this work, we have tried to impose a very large range of values, typically (10^{−50}, 10^{50}), to include as many distributions as possible without compromising the convergence of the algorithm. Moreover, the Gaussian profile itself is surely a limitation of the approximation as true marginals can have in principle arbitrary profiles.
EP performances are sensitive to the parameter β and equations become numerically unstable for too large β (for example, 10^{11}–10^{12}). On the other hand, β can be seen as the inversevariance of a Gaussian noise affecting the conservation laws. The nature of this noise could depend on localization properties on the cell and real thermal noise. In this case, an optimization of the free energy with respect to β can in principle lead to better predictions.
Methods
Update rule
The algorithm described in the EP section relies on local moves in which, at each step, we refine only the parameters of one single prior, minimizing the dissimilarity between the auxiliary tilted distribution Q^{(n)} and Q. The values of the mean and of the variance of φ_{n}(ν_{n}; a_{n}, d_{n}) are iteratively tuned in a way that the first and second moments of the two distributions match. The update rule for the parameters a_{n} and d_{n} of the Gaussian prior will be derived in details in the following section.
Let us express the auxiliary density Q^{(n)} in equation (12) as a standard multivariate Gaussian distribution times the exact prior of the nth flux as
where , D is a diagonal matrix with components D_{mm}= for m≠n and D_{nn}=0 (and of course nondiagonal terms D_{mk}=0 if m≠k). The covariance matrix and the mean vector satisfy:
Note that we are omitting for notational simplicity the dependence of D, Σ, on n. Equivalently
where . If we now exploit the moment matching condition in equation (13) (a detailed calculation of the moments of Q and Q^{(n)} expressed in standard form is reported in Supplementary Notes 2 and 3) we obtain an update equation for the mean and the variance:
Notice that the sequential update scheme described in the EP section requires the inversion of the matrix Σ^{−1} each time that we have to refine the parameters of flux n, leading to N inversions per iteration amounting to Θ(N^{4}) operations per iteration. We propose in Supplementary Note 4 a parallel update that needs only one matrix inversion per iteration, that is, Θ(N^{3}) operations per iteration.
Update equations for a constrained posterior
Let us assume to have access to experimental measures of the (marginal) posterior f(ν_{i}) for flux i. We aim at determining how the posteriors of other fluxes would modify to fit with the experimental results compared, for instance, to the unconstrained case. The socalled maximum entropy principle^{35} dictates that the most unconstrained distribution which is consistent with the experiment, prior distributions and flux conservation S ν=b, is simply
where β→∞ and g(ν_{i}) is the (exponential of the) function of unknown Lagrange multipliers that has to be determined in order for the constraint to be satisfied. In the particular case in which the posterior can be reasonably fitted by a Gaussian distribution , then it suffices to consider also a Gaussian with only two free parameters. The determination of a_{i}, d_{i} can be achieved by slightly modifying the EP update for flux i. Assuming as before that the prior of each flux n≠i can be approximated as a Gaussian profile φ_{n}(ν_{n}; a_{n}, d_{n}) of parameters a_{n} and d_{n}, also to be determined, we must impose that
where the distribution is the one in equation (10). Since both the lefthand side and the righthand side of equation (21) contain Gaussian distributions, the relations for a_{i} and d_{i} can be easily computed and take the form
This expression is exactly the same in equation (18) if we replace the mean and the variance of the tilted distribution with the experimental ones.
Technical details
The computations were performed on a Dell Poweredge server with 128 Gb of memory and 48 AMD Opteron CPUs clocked at 1.9 Ghz. No constraint have been placed on the number of CPU threads, allowing both EP and HR to parallelize their processes. We observed that EP used 2–3 cores, exclusively in the matrix inversion phase (which was timedominant), while HR employed a variable number of cores (around six or seven at some times). For this reason only, the order of magnitude of computing times of HR and EP are fairly comparable but they are sufficient to underline the differences between the two algorithms.
Code availability
An implementation of the algorithm presented in this work is publicly available at https://github.com/annapam/MetabolicEP.
Data availability
All data generated or analysed during this study are included in the manuscript and its Supplementary Information file.
Additional information
How to cite this article: Braunstein, A. et al. An analytic approximation of the feasible space of metabolic networks. Nat. Commun. 8, 14915 doi: 10.1038/ncomms14915 (2017).
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
 1
Nelson, D. L., Lehninger, A. L. & Cox, M. M. Lehninger Principles of Biochemistry Macmillan (2008).
 2
Palsson, B. Ø. Systems Biology: ConstraintBased Reconstruction and Analysis Cambridge University Press (2015).
 3
Varma, A. & Palsson, B. O. Metabolic flux balancing: basic concepts, scientific and practical use. Nat. Biotechnol. 12, 994–998 (1994).
 4
Kauffman, K. J., Prakash, P. & Edwards, J. S. Advances in flux balance analysis. Curr. Opin. Biotechnol. 14, 491–496 (2003).
 5
Suthers, P. F. et al. Metabolic flux elucidation for largescale models using 13c labeled isotopes. Metab. Eng. 9, 387–405 (2007).
 6
Megchelenbrink, W., Huynen, M. & Marchiori, E. optGpSampler: an improved tool for uniformly sampling the solutionspace of genomescale metabolic networks. PLoS ONE 9, e86587 (2014).
 7
Fernandezde CossioDiaz, J. & Mulet, R. Fast inference of illposed problems within a convex space. J. Stat. Mech. 2016, 073207 (2016).
 8
De Martino, D., Mori, M. & Parisi, V. Uniform sampling of steady states in metabolic networks: heterogeneous scales and rounding. PLoS ONE 10, e0122670 (2015).
 9
Dyer, M. E. & Frieze, A. M. On the complexity of computing the volume of a polyhedron. SIAM J. Comput. 17, 967–974 (1988).
 10
Smith, R. L. Efficient Monte Carlo procedures for generating points uniformly distributed over bounded regions. Oper. Res. 32, 1296–1308 (1984).
 11
Turchin, V. On the computation of multidimensional integrals by the MonteCarlo method. Theor. Probab. Appl. 16, 720–724 (1971).
 12
Smith David, R. L. & Kaufman, E. Direction choice for accelerated convergence in hitandrun sampling. Oper. Res. 46, 84–95 (1998).
 13
Schellenberger, J. et al. Quantitative prediction of cellular metabolism with constraintbased models: the cobra toolbox v2.0. Nat. Protoc. 6, 1290–1307 (2011).
 14
Price, N. D., Schellenberger, J. & Palsson, B. O. Uniform sampling of steadystate flux spaces: means to design experiments and to interpret enzymopathies. Biophys. J. 87, 2172–2186 (2004).
 15
Schellenberger, J. & Palsson, B. Ø. Use of randomized sampling for analysis of metabolic networks. J. Biol. Chem. 284, 5457–5461 (2009).
 16
TaheriAraghi, S. et al. Cellsize control and homeostasis in bacteria. Curr. Biol. 25, 385–391 (2015).
 17
De Martino, D., Figliuzzi, M., De Martino, A. & Marinari, E. A scalable algorithm to explore the Gibbs energy landscape of genomescale metabolic networks. PLoS. Comput. Biol. 8, e1002562 (2012).
 18
De Martino, D., Capuani, F. & De Martino., A. Growth against entropy in bacterial metabolism: the phenotypic tradeoff behind empirical growth rate distributions in E. coli. Preprint at https://arxiv.org/abs/1601.03243 (2016).
 19
Mezard, M. & Montanari, A. Information, Physics, and Computation Oxford University Press, Inc. (2009).
 20
Braunstein, A., Mulet, R. & Pagnani, A. Estimating the size of the solution space of metabolic networks. BMC Bioinformatics 9, 240 (2008).
 21
Braunstein, A., Mulet, R. & Pagnani, A. The space of feasible solutions in metabolic networks. J. Phys. Conf. Ser. 95, 012017 (2008).
 22
Massucci, F. A., FontClos, F., De Martino, A. & Castillo, I. P. A novel methodology to estimate metabolic flux distributions in constraintbased models. Metabolites 3, 838 (2013).
 23
FontClos, F., Massucci, F. A. & Castillo, I. P. A weighted beliefpropagation algorithm for estimating volumerelated properties of random polytopes. J. Stat. Mech. 2012, P11003 (2012).
 24
Orth, J. D., Palsson, B. Ø. & Fleming, R. M. T. Reconstruction and use of microbial metabolic networks: the core Escherichia coli metabolic model as an educational guide. EcoSal Plus 4, 10.2.1 (2010).
 25
Wiback, S. J., Famili, I., Greenberg, H. J. & Palsson, B. Ø. Monte Carlo sampling can be used to determine the size and shape of the steadystate flux space. J. Theor. Biol. 228, 437–447 (2004).
 26
Minka, T. P. in Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence 362–369Morgan Kaufmann Publishers Inc. (2001).
 27
Opper, M. & Winther, O. Gaussian processes for classification: meanfield algorithms. Neural. Comput. 12, 2655–2684 (2000).
 28
Opper, M. & Winther, O. Adaptive and selfaveraging ThoulessAndersonPalmer meanfield theory for probabilistic modeling. Phys. Rev. E 64, 056131 (2001).
 29
Reed, J. L., Vo, T. D., Schilling, C. H. & Palsson, B. O. An expanded genomescale model of Escherichia coli K12 (iJR904 GSM/GPR). Genome Biol. 4, R54 (2003).
 30
Lewis, N. E. et al. Largescale in silico modeling of metabolic interactions between cell types in the human brain. Nat. Biotechnol. 28, 1279–1285 (2010).
 31
Duarte, N. C. et al. Global reconstruction of the human metabolic network based on genomic and bibliomic data. Proc. Natl Acad. Sci. USA 104, 1777–1782 (2007).
 32
King, Z. A. et al. Bigg models: a platform for integrating, standardizing and sharing genomescale models. Nucleic Acids Res. 44, D515–D522 (2016).
 33
Henry, C. S. et al. Highthroughput generation, optimization and analysis of genomescale metabolic models. Nat. Biotechnol. 28, 977–982 (2010).
 34
Kennard, A. S. et al. Individuality and universality in the growthdivision laws of single E. coli cells. Phys. Rev. E 93, 012408 (2016).
 35
Jaynes, E. T. Information theory and statistical mechanics. Phys. Rev. 106, 620 (1957).
Acknowledgements
We warmly thank Andrea De Martino, Roberto Mulet, Jorge Fernández de Cossio and Eduardo Martinez Montes for interesting discussions. We acknowledge support from project SIBYL, financed by Fondazione CRT under the initiative ‘La ricerca dei Talenti’ and project ‘from cellulose to biofuel through Clostridium cellulovorans: an alternative biorefinery approach’ of University of Turin, financed by Compagnia di Sanpaolo.
Author information
Affiliations
Contributions
All authors contributed equally to this work.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Supplementary information
Supplementary Information
Supplementary figures, supplementary notes and supplementary references. (PDF 4511 kb)
Rights and permissions
This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
About this article
Cite this article
Braunstein, A., Muntoni, A. & Pagnani, A. An analytic approximation of the feasible space of metabolic networks. Nat Commun 8, 14915 (2017). https://doi.org/10.1038/ncomms14915
Received:
Accepted:
Published:
Further reading

Addressing uncertainty in genomescale metabolic model reconstruction and analysis
Genome Biology (2021)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.