Abstract
Bevacizumab (bvz) is a first choice anti-angiogenic drug in oncology and is primarily administered in combination with chemotherapy. It has been hypothesized that anti-angiogenic drugs enhance efficacy of cytotoxic drugs by “normalizing” abnormal tumor vessels and improving drug penetration. Nevertheless, the clinical relevance of this phenomenon is still unclear with several studies over recent years suggesting an opposing relationship. Herein, we sought to develop a new computational tool to interrogate anti-angiogenic drug scheduling with particular application in the setting of colorectal cancer (CRC). Specifically, we have employed a mathematical model of vascular tumour growth which interrogates the impact of anti-angiogenic treatment and chemotherapeutic treatment on tumour volume. Model predictions were validated using CRC xenografts which underwent treatment with a clinically relevant combinatorial anti-angiogenic regimen. Bayesian model selection revealed the most appropriate term for capturing the effect of treatments on the tumour size, and provided insights into a switch-like dependence of FOLFOX delivery on the tumour vasculature. Our experimental data and mathematical model suggest that delivering chemotherapy prior to bvz may be optimal in the colorectal cancer setting.
Similar content being viewed by others
Introduction
Solid tumours progress through two separable phases: avascular and vascular. In the avascular phase of tumour growth, nutrients and oxygen are delivered to tumour cells via diffusion processes alone from surrounding host capillaries. While in this phase, which can last for a period of several months or even years without causing any serious damage to the host, tumour growth is limited to just a few millimetres (1–2 mm1) and cell proliferation is balanced by cell death2. Subsequently, the tumour mass may reach a critical point of transition from the avascular to vascular phase and develop an intrinsic blood supply network (angiogenesis) which supports further growth and ultimately metastases. During this process, tumour cells secrete angiogenic factors such as vascular endothelial growth factor (VEGF) in response to diminished oxygen levels and the ‘angiogenic switch’ occurs. This ‘switch’ is further influenced by biophysical triggers including metabolic and mechanical stress2 as well as other endogenous pro and anti-angiogenic molecules.
Bevacizumab (bvz) is an anti-VEGF humanized monoclonal antibody that targets circulating VEGF and subsequently prevents binding of VEGF to its receptors3 thus inhibiting angiogenesis. In most oncology settings including colorectal4, breast5 and non-small cell lung cancer6 bvz shows activity only when combined with cytotoxic chemotherapy. Moreover, it has been hypothesized that anti-angiogenic drugs enhance efficacy of cytotoxic drugs by “normalizing” structurally and functionally abnormal tumor vessels, thereby reducing interstitial fluid pressure and improving drug penetration7. Nevertheless, the clinical relevance of this phenomenon is still unclear8 with several studies over recent years suggesting an opposing relationship, i.e., bvz leads to a sustained decrease in the delivery of biological agents or chemotherapy, when delivered within a combinatorial regimen9,10,11. It has thus been suggested that the tumor vessel effect of anti-angiogenics (delivered in a combinatorial regimen) is likely to be time, dose and even tumour type dependent11,12,13. Further studies are therefore required to unravel these effects in a tumour and treatment specific context.
Recently, computational models have emerged as powerful tools to support the appropriate optimization of cancer therapies. Moreover, the use of mathematical models to simulate vascular tumour growth and treatments has a long history including several studies which have successfully modelled vascular tumour growth and indeed validated model predictions using experimental data sets. Two mathematical modelling studies of particular relevance14,15 have considered the effects of chemotherapy and anti-angiogenesis treatments on vascular tumour growth. In15 it is argued that administering anti-angiogenesis treatment first allows for more effective delivery of chemotherapy via pruning of ‘low flow’ vessels. In addition, using a cellular automata model, Powathil et al. demonstrated that the cytotoxic effect of chemotherapy is dependent on several factors such as the timing of drug delivery, the time delay between drug doses, heterogeneities of the cell cycle, spatial distribution of the tumour and the surrounding microenvironment16,17. Notwithstanding these studies, widespread application of cellular automaton models is difficult due to their computational cost, which further renders a comprehensive Bayesian parameter estimation study unfeasible. Significant progress has been made by incorporating a refined two-compartmental model to capture bvz pharmacokinetic properties18 into a previously developed vascular tumour growth model19. This approach was based on the ordinary differential equation model of20. Furthermore, the model was fitted to experimental data from four different tumour types (breast, lung, colon, head and neck). One weakness of the study (as alluded to by the authors) was that the parameter fitting was performed only locally, and different parameter sets were used to fit to the control and bvz treatment cases.
Herein, we sought to further explore anti-angiogenic drug scheduling within the setting of CRC. To address this question experimentally, we employed the gold-standard HCT116 CRC xenograft model which underwent treatment with a paradigmatic folinic acid, fluorouracil and oxaliplatin (FOLFOX) chemotherapy + anti-VEGF (bvz) regimen commonly employed in the clinical management of metastatic colorectal cancer (mCRC). With respect to the computational aspect of this work, we expanded the mathematical model of18 and conducted an extensive Bayesian parameter fitting of this extended model. We fitted the model to time series CRC xenograft tumour volume data obtained from vehicle treated subjects, bvz monotherapy treated subjects, and FOLFOX monotherapy treatment subjects respectively. Based on parameters found by this fitting, we made model predictions regarding the combination treatment cases which were subsequently validated in pre-clinical models. Our joint experimental-computational approach as illustrated in Fig. 1, suggests that delivery of antiangiogenic therapy after chemotherapy may deliver optimal treatment results in the setting of colorectal cancer.
Results
Administering FOLFOX before bvz is optimal for reducing tumour burden in the theoretical model regardless of chosen chemotherapy function form
It is not clear which functional form the degradation of tumour volume via FOLFOX should take, therefore, we investigated two different physiologically feasible chemotherapy function forms. Figure 2 shows the numerical simulation results of the model defined in equations 5 and 6 of the methods section using the continuous chemotherapy function (defined in equation 7) which assumes chemotherapy delivery is dependent on the vasculature in a continuous manner while Fig. 3 show the results for the threshold chemotherapy function (defined in equation 8) which assumes chemotherapy delivery is dependent on the vasculature in a switch-like manner. These simulations represent an experimentally difficult to reproduce scenario – where the tumour volumes and their vasculature are perfectly controlled between different experimental setups. The parameters were chosen so that the reduction in tumour volume caused by bvz and FOLFOX chemotherapy is similar – which helped dissect the effect of the ordering of drug delivery. Though quantitatively the two chemotherapy terms give different results, we calculated qualitative similarities in their temporal evolution. Figures 2 and 3 both show that administering bvz first resulted in a significant reduction in the carrying capacity. In terms of biology, the model solutions suggested that a reduction in vessel density may hamper the effective delivery of FOLFOX. However, the model solutions also showed that if FOLFOX is administered first, the drug is delivered effectively, due to the relative abundance of vessels, and the tumour volume decreases immediately. Hence, these numerical simulations suggested that it is optimal to deliver bvz after FOLFOX. While these mathematical model simulations are useful for carrying out thought experiments, it should not supersede careful fitting of the model to real in vivo data. Moreover, we were not able to choose between the two chemotherapy functions as they both gave qualitatively similar behaviour. Therefore, in the next section we present our results of fitting the mathematical model to experimental data corresponding to Treatment Schedule 1 (TS1) where bvz is given 24hrs before chemotherapy.
The mathematical model can capture the qualitative and quantitative experimental data for monotherapies and predict the outcome of delivering bvz before FOLFOX
Figure 4(A) shows the average tumour volume (with standard error) as observed within HCT116 CRC xenograft TS1 studies. These data suggested that there was reduced benefit in administering bvz 24 hrs before FOLFOX. In fact the effects of FOLFOX appeared nullified by administering bvz first. This was consistent with the findings from our mathematical model (see previous section) and may be due to vasculature disruption which hampers FOLFOX penetration of the tumour. Unlike in the mathematical model results presented in the previous section, it was not possible to control the precise initial tumour volume experimentally when testing different drug treatments. This led to some variation in the average tumour volume evolution prior to treatment administration. However, this problem can be overcome by setting the initial tumour volume in the mathematical model equal to the first non-zero recorded experimental value which allowed us to compare the modelling simulations with the data in a direct way.
We performed an extensive fitting (see Methods for details) of the mathematical model to vehicle, bvz and FOLFOX xenograft data and then, using the parameter set which yielded the least squares error, we simulated the effect of combination therapy (TS1) whereby chemotherapy is given 24hrs after bvz and Treatment Schedule 2 (TS2) whereby chemotherapy is given 24hrs before bvz and displayed these results in Fig. 4(B). In Fig. 4(C) we also show a more detailed view of the HCT116 CRC xenograft tumour volume at 45 days (n = 6 mice remain at this time point). All treatments showed a reduction in both the mean and median tumour volumes although none of these are significant. We also show the predicted drug curves for TS1 and TS2 in Fig. 4(D) from the mathematical model. These curves were closely related to the experimental setup because the timing of treatments and dosages were taken directly from the corresponding experiments. In addition, we also simultaneously performed a model selection (see methods section for details) and found the mathematical model with the threshold chemotherapy response to be the most probable model of the data. This implies that the vasculature has a switch-like relationship with FOLFOX delivery. In other words, the model predicted that if the vasculature density is reduced sufficiently by bvz delivery, FOLFOX delivery becomes negligible.
In Supplemental Fig. 2(A) we show the final posterior distributions produced by the approximate Bayesian computation algorithm. These distributions [displayed on the diagonal of Supplemental Fig. 2(A)] indicate the most likely value of parameters for reproducing the data with broader distributions indicating less sensitive parameters and narrower distributions indicating more sensitive parameters. For example, the parameter BK21, the transfer rate of bvz from the peripheral compartment to central compartment, was particularly robust to change while the tumour growth rate, λ1, was particularly well constrained. We have also included the relative sensitivities as computed by inverting the covariance matrix of the final probability distribution as in21, see Supplemental Fig. 3(B) where it is shown that the growth constant was the most sensitive parameter. We can also derive relationships between the model parameters and these are displayed in the off-diagonal positions of Supplemental Fig. 2(A). It can be observed that a strong positive relationship existed between the vasculature recruitment rate, c, and d, the rate of endogenous inhibition of tumour vasculature. This was consistent with intuition because if the recruitment rate is smaller, then the inhibition rate will have to be smaller to compensate in order to reflect the data (and vice versa). A less intuitive relationship that was uncovered was the strong negative relationship between the bvz elimination rate, Bke, and the stimulator clearance rate, α. This relationship exists because if bvz is eliminated more rapidly, then more vasculature is required to deliver more bvz and this requires a reduced stimulator clearance rate.
Finally, in addition to reproducing the monotherapy cases and predicting the combination treatment cases the parameterised model can also be used to predict various further outcomes such as what would happen if treatment was stopped for a break of three weeks following combination treatments before resuming treatment (we show this case in Supplemental Fig. 4(A)) or how different dosages of bvz and FOLFOX impact the tumour reduction (see heatmaps in Supplemental Fig. 5). The model can also be used to predict responses if treatment commenced earlier or if other treatment strategies, such as administering two doses of FOLFOX followed by bvz or using different delays between treatments, as was studied in22.
The mathematical model captures the qualitative and quantitative experimental data for monotherapies and predicts the outcome of delivering FOLFOX before bvz
Figure 5(A) shows the average tumour volume with standard error computed from HCT116 CRC xenograft monotherapy and TS2 studies. As in Fig. 4(A), we can see that variation in the initial tumour volumes led to differences in the temporal evolution of the average tumours pre-treatment. In this case, this was exaggerated as treatment was not able to begin until day 37 and only 3 rounds of treatment were able to be performed before animals were euthanized. This was overcome in the model by again setting the tumour initial conditions and drug administration times appropriately.
As for the TS1 case, for the TS2 case we performed an extensive fitting of the mathematical model to the vehicle data, bvz data and FOLFOX data and then using the parameter set which yielded the least squares error we simulated the effect of combination therapy (TS1 and TS2) (Fig. 5(B)). In Fig. 5(C) we also show a more detailed view of the HCT116 CRC xenograft tumour volume at 56 days (n = 12 mice remain at this time point). As for TS1, all treatments showed a reduction in both the mean and median tumour volumes but this time we observed a statistically significant decrease in the tumour volume for TS2 (FOLFOX + bvz). We also show the predicted curves for TS1 and TS2 in Fig. 5(D). Furthermore, while fitting the model we simultaneously performed a model selection and found again the mathematical model with the thresholded chemotherapy response to be the most probable model of the data. This reinforces the hypothesis that the tumour vasculature dependent FOLFOX delivery displayed a threshold or in other words a switch-like response to bvz.
In Supplemental Fig. 2(B) we show the final posterior distributions produced by the approximate Bayesian computation algorithm. The relationships between parameters appeared unchanged compared to the TS1 fitting presented in the previous section, but some parameters have shifted, for example, the tumour growth rate appeared to be much larger. To investigate these differences in more detail, we also computed the distances (specifically the Kolmogorov-Smirnov statistic) between the final parameter distributions shown in Supplemental Fig. 2(A,B) and show these in Supplemental Fig. 3(A). This quantified which model parameters have changed the most between the two different experiments. As expected, the tumour growth rate, λ1, changed the most (this can be seen by simply comparing the tumour volume at the same time between the two different experiments). The computed distance also showed less obvious changes between experiments, such as the vasculature recruitment rate, c, and the half maximal concentration of vasculature for FOLFOX mediated degradation, α2. Thus the mathematical model allowed us to gain insights into the underlying biology across different experiments. As in the previous section, we also show the parameter sensitivities in Supplemental Fig. 3(C) and note that this parameterised model can now be used to make a number of additional predictions. To demonstrate this, we show the predicted tumour evolution following a three week break with no treatment before resuming treatment for another three weeks (shown in supplemental Fig. 4(B)). We note that in this case the long term evolution of the tumour with just FOLFOX treatment is very similar to the evolution of the tumour with FOLFOX + bvz (though the FOLFOX + bvz combination is still superior in reducing the tumour volume). This suggests that the FOLFOX was more potent in reducing tumour volume than bvz for this experiment. Finally, we also show the predicted tumour reduction for different doses of bvz and FOLFOX (displayed in Fig. 5(B)).
Functional interrogation of treatment sequencing effects reveals a complex time dependent response
While the mathematical model can provide insights into the macroscale evolution of the tumour, it does not provide detailed information on the tumour specific molecular effects of combinatorial treatment. As such, further biological assays were warranted. At the end of 4 weeks, animals were euthanized and tumours were excised and probed using markers of proliferation (Ki67), micro-vessel density (MVD) (CD31/PECAM1) and cell death (necrosis via H&E staining). Neither cell proliferation, death nor microvessel density were significantly different in tumours which underwent either TS1 or TS2 (Fig. 6(A,B)). However bvz monotherapy treated tumours in T1 displayed a small but significant increase (Fig. 6B) in proliferation after 4 weeks compared to vehicle treated tumours whereas bvz monotherapy treated tumours in T2 displayed a small but significant decrease (TS1 p = 0.0474, TS2 p = 0.024 N = 3 per group).
To further explore the efficacy of TS2 (which replicates a common clinical drug scheduling scenario whereby initial dose of bvz is given following chemotherapy) we performed additional early time-point contrast enhanced ultrasound (CEUS) and immunohistochemistry (IHC) studies. 5 animals per cohort were analysed for blood flow kinetics in the first 72 hrs after commencement of therapy. Figure 7(A,B) show average tumour blood flow in TS2 treated tumours at early time points. Tumours treated with FOLFOX alone showed no change in blood flow dynamics within the first 24 hour period in 3 out of 4 tumours (blood flow decreased in 1 out of 4 tumours at this time), but subsequently showed a slow decline in flow over the subsequent 48 hours in all 4 animals. Bvz monotherapy treated tumours showed a marked increase in blood flow in 3 out of 5 tumours with the remainder remaining stable, during the first 24 hr window suggesting normalization of the tumour blood network. However, blood flow subsequently returned to base line with a further decrease observed by 72 hrs (5 out of 5 tumours). Tumours treated with FOLFOX followed by bvz 24hrs later showed no change in blood flow dynamics in 4 out of 5 tumours (1 out of 5 had decreased blood flow) over the 72 hour analysis period. These data suggested a balance between the ostensible inhibitory effect of FOLFOX alone on tumour blood flow vs the early positive effect of bvz on tumour blood flow. Figure 7C shows representative CEUS images with limited blood flow within the tumour core in both FOLFOX monotherapy and bvz monotherapy treated animals after 72 hrs.
Following CEUS, mice were injected intravenously with H33342 fluorescent dye and humanely euthanized after 1 minute. This dye which circulates in the blood, stains nuclei of blood vessel endothelial cells, thus providing information about functional vasculature (fMVD). Figure 8(A) shows fMVD of tumours treated with vehicle, FOLFOX, bvz or FOLFOX followed by bvz. Tumours treated with either bvz or with FOLFOX + bvz showed a striking decrease in the fMVD (p = 0.01455 and p = 0.02432 respectively) while vehicle and FOLFOX treated tumours showed no change in the number of functional vessels. A significant decrease (p = 0.0274) in proliferation (Fig. 8(B)) was observed in tumours treated with FOLFOX after 72hrs.
Discussion
The main objective of this study was to investigate anti-angiogenic drug scheduling in the context of CRC. This was achieved by combining clinically relevant xenograft studies and computational modelling. Both approaches suggest that administering FOLFOX first may be optimal in this disease setting, with CRC xenograft data demonstrating that scheduling FOLFOX prior to bvz yields a 60.4% average reduction in tumour size compared with 36.3% when bvz is delivered prior to FOLFOX (p < 0.05). The computational model was further calibrated to xenograft data which was then used to make additional predictions regarding optimal combinations of drugs and how the tumour would evolve if treatment was interrupted for a break.
In this study we extended an ODE model describing vascular tumour growth under angiogenic signalling presented in18 to account for FOLFOX treatment. To this end, the pharmacokinetic properties of FOLFOX have been incorporated into the model and the combination therapy effect has been simulated for FOLFOX and bvz. One potential weakness of the 2016 study, alluded to by the authors, was the fact that the parameter fitting was performed only locally and different parameter sets were used to fit to the control and bvz treatment cases. Hence, we also extended the study to perform a comprehensive global fitting of the model using Bayesian parameter fitting techniques to two novel experimental data sets (producing normalised root squared mean errors of 0.38 and 0.24). This was made possible due to the economic computational cost of running our model, though we note that there have been recent advances in the simulation of more holistic cellular automaton models23. It may even be possible to calibrate such models with spatio-temporal data in the near future though it will require careful acquisition of three dimensional in vivo imaging data for effective calibration as discussed in24.
Across several major cancer indications, the most effective application of anti-VEGF therapy relies upon combination with cytotoxic drugs. Nevertheless, there is an ongoing debate about the underlying mechanisms involved. As mentioned, one long-held view is that anti-angiogenic therapies enhance efficacy of cytotoxic drugs by “normalizing” structurally and functionally abnormal tumor vessels, thereby reducing interstitial fluid pressure and improving drug penetration7. Nevertheless, several studies have also shown that bvz leads to a sustained decrease in the delivery of biological agents or chemotherapy9,10,11. Overall it seems likely that the tumour vessel effect of anti-angiogenics is likely to be a complex time, dose, tumour and even tumour vessel phenotype dependent11,12,13,25,26 phenomenon. Moreover, while the study of vascular tumour growth using mathematical models has been the subject of several papers27, the study of combinatorial anti-angiogenic regimens in this context, has received less attention. Combinatorial treatment regimens were applied to a simple cellular automaton model of glioblastoma in28 and the model was shown to reproduce qualitative aspects of pre-clinical and clinical data. However, only treatment parameters were studied, and other parameters were taken from previous studies. In our study we have inferred all parameters from experimental data. In15, it was suggested that the chemotherapy uptake could be enhanced by first delivering anti-vascular treatment to prune leaky vessels, ensuring maximal drug flow to the tumour. This was corroborated by a recent study in breast cancer which suggested that bvz should be delivered 2.2 days before chemotherapy in order to optimize tumour burden reduction22. Our modeling and experimental xenograft data suggest that the opposite treatment strategy (i.e., delivering chemotherapy first followed by bvz) may be optimal in the context of CRC.
Employing a gold-standard ectopic HCT-116 CRC xenograft model we successfully managed to ‘reverse translate’ a common clinical drug scheduling scenario whereby initial dose of bvz is delivered following chemotherapy (TS2). We have further employed this model to compare outcome when treatment sequence is reversed and bvz is delivered prior to chemotherapy (Figs 6 and 7). Notwithstanding inherent limitations of subcutaneous cell line xenograft models, we have nevertheless recapitulated mCRC clinical response to combinatorial treatment when FOLFOX is delivered prior to anti-VEGF showing a significantly increased anti-tumour response for the TS2 sequence. Thus, our computational predictions and experimental data suggest that FOLFOX delivered before bvz (TS2) may be most advantageous in the CRC setting.
As the enhanced TS2 response could not be explained at study termination (4 weeks of treatment) by analyses of fMVD, tumour cell proliferation or necrosis, we thus performed additional functional imaging (CEUS) and IHC analyses to further interrogate TS2 response mechanisms and establish early time point effects on blood flow, functional vessel and tumour cell proliferation. Initial early vessel normalization (24 h) with bvz monotherapy was as expected but we observed decreased flow over time (48–72 h) and reduced number of functional vessels at 1 week (vessel pruning). This ‘vascular normalization window’ and multi-modal normalization/subsequent pruning effect of anti-VEGF therapy which is time and dose dependent has previously been proposed (e.g.29). While there was no overall effect of FOLFOX monotherapy on the number of functional vessels after 1 week, we nevertheless observed a decrease in blood flow over early time-points with FOLFOX monotherapy (48–72 h). Both anti- and pro-angiogenic effects of 5-FU based chemotherapy have variously been observed across different tumour types30,31 and are therefore likely to be tumour and organ site dependent. However, when combined, FOLFOX + bvz appears to preserve blood flow at early time-points (24–72 hr) not withstanding an ostensible decrease in the number of functional vessels (vessel pruning) at week 1 as seen in the bvz monotherapy cohort. Further studies are required to fully understand the impact of chemotherapy and bvz on vessel function specifically within the context of CRC. Longitudinal functional and investigational imaging studies (e.g. positron emission tomography (PET), functional magnetic resonance imaging (MRI), multispectral fluorescence ultra-microscopy) in metastatic patients are specifically warranted.
The ODE model developed can now be implemented as a predictive tool for clinically relevant rodent studies, employing orthotopic and patient derived xenograft (PDX) models which better represent inter and intra-tumoural heterogeneity and molecular subtypes32. It is also possible that the response to different treatment sequences might further depend on CRC consensus molecular subtypes (CMS) having different stromal phenotypes33. This aspect could also be evaluated in PDX models representing CMS1–4 tumour subtypes. Ultimately, model predictions will require validation in relevant clinical studies such as the ongoing OBELICs trial, a Phase 3 study which seeks to optimize bvz scheduling in combination with chemotherapy in mCRC patients34.
In conclusion, our study demonstrates that mathematical models will continue to play an increasingly important role in unravelling and predicting complex combinatorial treatment scheduling effects across tumour types and specific drug combinations.
Methods
Computational Model
We used an ordinary differential equation model to capture the tumour volume changing in time in response to different drug treatment regimes. We adopted this approach because the data we have is primarily in the form of tumour volume time series and hence by saving the output from our ODE model at times corresponding to the experimentally measured tumour volumes, we could make a fair comparison between the model and data. The ODE model we used to simulate vascular tumour growth is defined in great detail in18 but we summarise here the key assumptions.
The mathematical model is governed by a pair of ordinary differential equations which reflect the interplay between tumour volume (V) and the vasculature or carrying capacity (K). The primary assumptions on which the model is built are the following. We assumed the tumour has spherical symmetry and that the diffusion process via which pro and anti-angiogenic factors are transported is in a quasi-stationary state. We also assumed that the concentration of the stimulator is a radially symmetric, continuously differentiable function and that the clearance rate of proangiogenic factors is a monotonically increasing function of drug concentration and it is always greater than the respective value in the absence of treatment. Finally, we assumed the change of drug concentration inside the tumour caused by the dysfunctional vasculature is governed by the proportionality to a bounded and decreasing function of tumour volume.
The initial basis of the model was developed by Hahnfeldt et al.20 and was refined in19, leading to the following two ODE system
where V stands for tumour volume, K for carrying capacity, I1(t) for bvz concentration and λ1, λ2, c, d, β, α and p, for parameters explained in Table 1. The terms in equation 1 reflect the Gompertzian growth of the tumour which depends on a time-dependent carrying capacity. The first term in equation 2 reflects the intrinsic loss rate which was assumed to be proportional to the carrying capacity. The second and third terms, reflecting stimulatory and inhibitory action induced by tumour cells respectively, were computed by applying a diffusion-consumption equation for the concentration of stimulators and inhibitors. The second term also reflects the suppressive effect of antiangiogenic treatment when bvz treatment is simulated. All coefficients are non-negative, except for the proportionality constant c where only positive values are allowed in order to preclude the biologically irrelevant behaviour of an untreated tumour with self-regressing carrying capacity.
In 2016, Argyri et al., a further refinement of this model was made to give the correct asymptotic behaviour in the limit of large doses of bvz. In this limit, the tumour returns to the prevascular volume (i.e., the tumour volume prior to the angiogenic switch) which we denote by V*, this leads to the system of equations
Note that the terms in equations 3 and 4 are the same as in equations 1 and 2 except that they have the prevascular volume subtracted from each terms. We began from this system of equations and extended it to consider the impact of FOLFOX treatment
While bvz directly impacts the vascular compartment, we made the additional assumption that FOLFOX directly impacts the tumour volume compartment – this is reflected in the second term of equation 5.
The pharmacokinetic properties of bvz and FOLFOX were modelled using a two compartment model with first order elimination which has been shown to be appropriate in previous studies35,36,37. We also made the assumption that there is no direct interaction between FOLFOX and bvz as was reported in38. Taking into account that the treatments are administered via the intravenous infusion, a zero order absorption assumption was made which reflects steady drug delivery into the patient’s or mouse’s systemic circulation. The central compartment represents blood and highly perfused tissues such as lungs, liver and kidneys and the volume of which is represented by the parameter Vc. The elimination of drugs is assumed to occur from the central compartment according to the first order transfer rate FKe for FOLFOX or BKe for bvz. This was assumed to be where most elimination takes place due to the function of the liver and kidneys. The outer compartment was taken to correspond to poorly perfused tissue. Since monitoring of the drug concentration at the anatomical region of interest is not feasible, the concentration of drug in plasma was assumed to reflect the concentration in the site of the target tissue. Hence, the equations characterising the central compartment are the ones which impact the computational vascular tumour growth model. We assumed the duration of infusion is the same for both drugs and we represent the duration time by parameter T. The dosages of bvz and FOLFOX are represented by D1 and D2 respectively. The time point of drug administration is represented by tD and varies depending on the treatment. While the infusion is taking place, i.e., t − tD ≤ T:
whereas in the post-infusion period, i.e., T < t − tD:
Where i = 1 represents bvz and i = 2 represents FOLFOX and the remaining variables are defined as
and
Further details on the pharmacokinetic properties of the two compartment model can be found in39 and parameters involved in the pharmacokinetic model are explained in Table 1.
We considered two different functional forms of f – the function which dictates the manner in which FOLFOX eradicates the tumour volume. The first way we modelled this is using the common form outlined in40, i.e.,
which is a second order reaction or bimolecular reaction form used in many mathematical biology applications. It can be interpreted as the rate of tumour degradation being proportional to the tumour volume and the vasculature compartment size. The exponents α1 and β1 provide further flexibility and allow the model to capture nonlinear dependencies of FOLFOX treatment on tumour volume or the carrying capacity. We hereby refer to it as the “Continuous model”. The second form we considered is given by the formula
Here, the rate of tumour degradation is linearly proportional to the volume of the tumour and nonlinearly proportional to the vasculature compartment in a saturating manner. In the limit of large p2, this sigmoidal function becomes switch-like. In other words, if the vasculature abundance is very low and underdeveloped there will be negligible delivery of FOLFOX while if the vasculature is very large in abundance there will be an upper limit on the amount of FOLFOX that can be delivered. We hereby refer to this model as the “Threshold model”.
Numerical simulation and parameter estimation
All numerical simulations were performed in Julia using the DifferentialEquations.jl package41 using the CVode backward differentiation formula solver42. It is worth noting that the numerical experiments concerning free tumour growth as well as tumour growth under intermittent drug treatments have been performed on a desktop computer with an Intel Xeon 2.5Ghz processor, 32GB RAM in Windows 7 with 64-bit operating system. Using this system, we used the BenchmarkTools.jl package in Julia to find the following benchmark statistics for the model. The average running time for sampling the model from the prior parameter distributions defined in Table 1 was 7.45 milliseconds and the median time was 5.68 milliseconds (based on 670 sample simulations).
We approached this problem with the aim of obtaining biologically plausible and testable predictions. Hence, rather than inferring a narrow range of parameter values, we aimed to analyse a wide range of the parameter space. The short run time of our chosen model framework allowed us to explore the parameter space thoroughly using Approximate Bayesian Computation (ABC) methods. In particular, we employed the ABC method outlined in43. This method allowed us to fit the model to the data, perform parameter sensitivity analysis and Bayesian model selection. In brief, ABC-SMC is a particle filter approach that starts by first generating N particles from the prior. We chose N equal to 10,000 throughout the paper. In the following iterations, the algorithm selects a particle from the obtained distribution, perturbs it, and then simulates the model using that parameter combination. If the obtained model data is sufficiently similar to the observed data that we are trying to fit, the parameter combination is accepted. As soon as N parameter combinations are accepted, these replace the prior, and the algorithm starts anew. As the number of iterations increases, the acceptance threshold approaches zero, such that the simulated data needs to be more and more similar to the observed data. As a summary statistic, we used a squared Euclidean distance metric on the tumour volume time series data (shown in Figs 4A and 5A) for the vehicle and two monotherapy data sets. I.e., we aimed to find the parameter set which fits all three sets of data simultaneously. With respect to model selection, we used the same approach as in43 in which a “model parameter” m ∈ {1, 2} was introduced as an additional discrete parameter. We then defined model-specific parameters as θ(1) = (λ1, λ2, c, α, d, Bk12, Bk21, Bke, Fk12, Fk21, Fke, KF, α1, β1) and θ(2) = (λ1, λ2, c, α, d, Bk12, Bk21, Bke, Fk12, Fk21, Fke, KF, α2, p1) for the continuous and threshold model respectively. To begin the model selection we sample a model indicator m from the prior distribution π(m) which we chose to be a discrete uniform prior distribution (i.e. both models are assumed to be equally likely at the beginning). For model m we then propose new particles by perturbing the particles from the previous population specific to m; this step is the same as in the parameter estimation algorithm. The weights for particles θ(m) are also calculated like in the parameter estimation algorithm for m. Hence parameter inference and model selection are done simultaneously.
Tumour cell culture
HCT-116-luc CRC cells were obtained from Caliper Life Sciences. Cells were grown in RPMI 1640 medium supplemented with 10% FBS, 2mM L-Glutamine, 100 U/mL penicillin and 100 μg/mL streptomycin. Cells were cultured at 37 °C in 5% CO2 and maintained in logarithmic growth by sub- culturing a minimum twice weekly.
CRC Xenograft Model
Animal experiments conformed to guidelines from Directive 2010/63/EU of the European Parliament on the protection of animals used for scientific purposes. Experiments were licensed and approved by the Department of Health and Children Dublin Ireland project license number B100/3654. Ethics protocols were also reviewed by University College Dublin Animal Research Ethics Committee under protocol number P12–27. 48 Balb Cnu/nu mice (Charles River Laboratories, UK) were subcutaneously implanted with 2 × 106 HCT116 cells in the right flank as previously described44 and tumours were allowed to grow until they reached 200 mm3. Subsequently, animals were divided into cohorts (n = 12) and treated with either vehicle (5% glucose and PBS) or the previously determined clinically relevant doses of bvz [10 mg/kg, IP once a week] and FOLFOX [Folinic acid 13.4 mg/kg, 5-FU: 40 mg/kg, Oxaliplatin: 2.4 mg/kg., IP once a week 24hrs after bvz] either alone or in combination for 4 weeks (see Supplemental Fig. 1(A,B) for treatment schedules). FOLFOX constituents for rodent studies were calculated according to45,46. 40 mg/kg 5-FU bolus equates to a plasma concentration of 35.8 mg/L while 2400 mg/m2 infusion for standard human (modified de Gramont standard protocol47) gives plasma concentration of 27.4 mg/L min – 43.2 mg/L max over the infusion. Oxaliplatin and Folinic acid do not interfere with the absorption or clearance 5-FU. Therefore dose of oxaliplatin and folinic acid were accordingly titred to mouse and in line with 5-FU dosing.
Tumour response was assessed by calliper measurement. At 4 weeks all animals were euthanized and tissue was collected for further immunohistochemical (IHC) analyses. All animal experiments were performed by authorized researchers in accordance with animal research guidelines (Health Products and Regulatory Authority, Ireland). Protocols were further approved by the Animal Research Ethics Committee (AREC) at University College Dublin. Animals were housed in groups, maintained on a 12 hr light/dark cycle, with access to food and water ad libitum.
Immunohistochemistry
End of study analyses
Paraffin-embedded, formalin-fixed tissue sections from HCT116-luc2 ectopic tumours taken after 4 weeks of both TS1 and TS2 therapy were stained with Hematoxylin and Eosin (H & E) in order to access percentage of tumour core necrosis. Anti-KI67 and anti-PECAM1/CD31 staining procedures were carried out to determine tumour cell proliferation and microvessel density respectively. In brief, tumour sections were deparaffinized with xylene and rehydrated according to standard histologic procedures. For epitope retrieval, sections were boiled for 20 min in 10 mM citrate buffer, pH 6.0. Sections were rinsed in phosphate buffered saline (PBS)-Tween 20 (0.1% v/v). Subsequently slides were processed according Lab vision Ultravision polymer detection system (Thermoscientific, UK) in conjunction with the Lab Vision Autostainer 360 following manufactures instructions. Sections were probed with rabbit anti-Ki-67 (Millipore, Billerica, MA), dilution 1:150;and rabbit anti-CD31 (Santa Cruz Biotechnology, Inc., Dallas, TX), dilution 1:75 in PBS for 1 hr. Positive signal was developed with diaminobenzidine (Life Sciences UK,) according to the manufacturer’s instructions for 10 mins Sections were counterstained with haematoxylin to visualize nuclei. For assessment of proliferation indices (percentage of KI-67- positive cells), fractions of labelled tumour cells were assessed in 10 microscopic high-power fields per section using x40 magnification and ImageJ software (National Institutes of Health, Bethesda, MD). Microvessel density based on criteria previously described (Leonard et al., 2008) was assessed.
Early time-point analyses
Functional microvessel density (fMVD): Frozen H33342 labelled tumours n = 5 taken after one week of TS2 therapy were sectioned (8 µm thick) on a cryostat at −20 C. Sections were allowed to dry in the open air and were then visualized using a Zeiss Axiovert fluorescent microscope with a 384 nm filter. fMVD was determined as previously described (Leonard et al., 2008). Briefly CD31 images were analyzed by applying a 15000 pixel2 grid over the image in Image J and counting the number of times positive vessels cross the grid.
Proliferation and Necrosis: Frozen tumours n = 3 taken after one week of TS2 therapy were sectioned (8 µm thick) on a cryostat at −20 C. Sections were then fixed in 10% formalin for 15 mins and washed with PBS. Sections were stained with Hematoxylin and Eosin (H&E) to assess percentage necrosis. Anti- Ki67 staining was carried out to determine tumour cell proliferation. Sections were probed with rabbit anti-Ki-67 (Millipore, Billerica, MA), dilution 1:150 using the Labvision Ultravision (Thermo scientific) polymer detection system.
Contrast Enhanced Ultrasound (CEUS)
20 Balb Cnu/nu mice (Charles River Laboratories, UK) were implanted with 2 × 106 HCT116 cells in the right flank (as described above) and tumours allowed to grow until they reached 200 mm3. 72hrs before treatment (TS2), high-frequency CEUS was performed on a dedicated small-animal, high-resolution imaging system (Vevo 770 VisualSonics, Amsterdam) with a 40-MHz transducer; All mice (n = 20) were thus imaged at baseline in 2D contrast mode.
Specifically, prior to the imaging session, mice were anesthetized with 2.0% isoflurane with 0.8 L/min oxygen and placed on a computer controlled heated platform set at 37 C. Warmed ultrasound gel was placed on the ectopic tumour. The probe (RMV 704B; VisualSonics, Inc.) was positioned so that the transducer imaged the centre of the tumour mass. The probe was then adjusted until the tumour was visible on the screen of the ultrasound unit within the focal zone. The parameters of the ultrasound system were set at 100% transmitted power, 10.00 × 10.00-mm field of view. To obtain contrast-enhanced images, a 50-μL bolus of contrast agent (MicroMarker; VisualSonics) containing approximately 1 × 108 microbubbles, was injected into the lateral tail vein via catheter and mechanical pump at a rate of 0.6 mL/min for 5 seconds. Imaging commenced 5 seconds prior to contrast injection to generate a “no contrast” baseline. The recording continued for 800 frames.
Animals were subsequently grouped into 4 cohorts of n = 5 and treated according to TS2 as described above. 24, 48 and 72 hrs after bvz animals underwent further 2D CE-US scans (Supplemental Fig. 1(C)) After 7 days of treatment animals were anaesthetized as described above. Subsequently, H33342 dye (40 mg /kg in PBS) was injected in the lateral tail vein with. The dye was allowed to circulate for 1 minute to fluorescently label all vessels. Animals were subsequently euthanized and tumours flash frozen in liquid nitrogen and stored at −80.
Change history
27 September 2018
A correction to this article has been published and is linked from the HTML and PDF versions of this paper. The error has been fixed in the paper.
References
Folkman, J. Tumor angiogenesis in women with node-positive breast cancer. Cancer J Sci Am 1, 106–108 (1995).
Carmeliet, P. & Jain, R. K. Angiogenesis in cancer and other diseases. Nature 407, 249–257 (2000).
Ferrara, N., Hillan, K. J., Gerber, H.-P. & Novotny, W. Discovery and development of bevacizumab, an anti-VEGF antibody for treating cancer. Nature reviews Drug discovery 3, 391–400 (2004).
Hurwitz, H. et al. Bevacizumab plus irinotecan, fluorouracil, and leucovorin for metastatic colorectal cancer. N Engl J Med 350, 2335–2342 (2004).
Miller, K. et al. Paclitaxel plus bevacizumab versus paclitaxel alone for metastatic breast cancer. New England Journal of Medicine 357, 2666–2676 (2007).
Sandler, A. et al. Paclitaxel–carboplatin alone or with bevacizumab for non–small-cell lung cancer. New England Journal of Medicine 355, 2542–2550 (2006).
Jain, R. K. Normalizing tumor vasculature with anti-angiogenic therapy: a new paradigm for combination therapy. Nat Med 7, 987–989 (2001).
Vasudev, N. S. & Reynolds, A. R. Anti-angiogenic therapy for cancer: current progress, unresolved questions and future directions. Angiogenesis 17, 471–494 (2014).
Van der Veldt, A. A. et al. Rapid decrease in delivery of chemotherapy to tumors after anti-VEGF therapy: implications for scheduling of anti-angiogenic drugs. Cancer Cell 21, 82–91 (2012).
Arjaans, M. et al. Bevacizumab-induced normalization of blood vessels in tumors hampers antibody uptake. Cancer Res 73, 3347–3355 (2013).
Heskamp, S. et al. Bevacizumab reduces tumor targeting of antiepidermal growth factor and anti-insulin-like growth factor 1 receptor antibodies. Int J Cancer 133, 307–314 (2013).
Huang, Y., Stylianopoulos, T., Duda, D. G., Fukumura, D. & Jain, R. K. Benefits of vascular normalization are dose and time dependent–letter. Cancer Res 73, 7144–7146 (2013).
Smith, N. R. et al. Tumor stromal architecture can define the intrinsic tumor response to VEGF-targeted therapy. Clin Cancer Res 19, 6943–6956 (2013).
Hinow, P. et al. A spatial model of tumor-host interaction: application of chemotherapy. Mathematical biosciences and engineering: MBE 6, 521 (2009).
Stephanou, A., McDougall, S. R., Anderson, A. R. & Chaplain, M. A. Mathematical modelling of flow in 2D and 3D vascular networks: applications to anti-angiogenic and chemotherapeutic drug strategies. Mathematical and Computer Modelling 41, 1137–1156 (2005).
Powathil, G. G., Adamson, D. J. & Chaplain, M. A. Towards predicting the response of a solid tumour to chemotherapy and radiotherapy treatments: clinical insights from a computational model. PLoS computational biology 9, e1003120 (2013).
Powathil, G. G., Gordon, K. E., Hill, L. A. & Chaplain, M. A. Modelling the effects of cell-cycle heterogeneity on the response of a solid tumour to chemotherapy: biological insights from a hybrid multiscale cellular automaton model. Journal of theoretical biology 308, 1–19 (2012).
Argyri, K. D., Dionysiou, D. D., Misichroni, F. D. & Stamatakos, G. S. Numerical simulation of vascular tumour growth under antiangiogenic treatment: addressing the paradigm of single-agent bevacizumab therapy with the use of experimental data. Biol Direct 11, 12 (2016).
Poleszczuk, J., Bodnar, M. & Foryś, U. New approach to modeling of antiangiogenic treatment on the basis of Hahnfeldt et al. model. Mathematical biosciences and engineering: MBE 8, 591–603 (2011).
Hahnfeldt, P., Panigrahy, D., Folkman, J. & Hlatky, L. Tumor development under angiogenic signaling. Cancer research 59, 4770–4775 (1999).
Erguler, K. & Stumpf, M. P. Practical limits for reverse engineering of dynamical systems: a statistical analysis of sensitivity and parameter inferability in systems biology models. Mol Biosyst 7, 1593–1602 (2011).
Mollard, S. et al. Model driven optimization of antiangiogenics + cytotoxics combination: application to breast cancer mice treated with bevacizumab + paclitaxel doublet leads to reduced tumor growth and fewer metastasis. Oncotarget 8, 23087 (2017).
Kang, G. et al. Colorectal tumour simulation using agent based modelling and high performance computing. Future Generation Computer Systems 67, 397–408 (2017).
Travasso, R. D., Corvera Poire, E., Castro, M., Rodriguez-Manzaneque, J. C. & Hernandez-Machado, A. Tumor angiogenesis and vascular patterning: a mathematical model. PLoS One 6, e19989 (2011).
Willett, C. G. et al. Direct evidence that the VEGF-specific antibody bevacizumab has antivascular effects in human rectal cancer. Nat Med 10, 145–147 (2004).
Chatterjee, S. et al. Transient antiangiogenic treatment improves delivery of cytotoxic compounds and therapeutic outcome in lung cancer. Cancer Res 74, 2816–2824 (2014).
Shi, J., Alagoz, O., Erenay, F. S. & Su, Q. A survey of optimization models on cancer chemotherapy treatment planning. Annals of Operations Research 221, 331–356 (2014).
Gevertz, J. L. Computational modeling of tumor response to vascular-targeting therapies—part I: validation. Computational and mathematical methods in medicine 2011, (2011).
Stylianopoulos, T. & Jain, R. K. Combining two strategies to improve perfusion and drug delivery in solid tumors. Proc Natl Acad Sci USA 110, 18632–18637 (2013).
Shaked, Y. et al. Rapid chemotherapy-induced acute endothelial progenitor cell mobilization: implications for antiangiogenic drugs as chemosensitizing agents. Cancer Cell 14, 263–273 (2008).
Fung, A. S., Lee, C., Yu, M. & Tannock, I. F. The effect of chemotherapeutic agents on tumor vasculature in subcutaneous and orthotopic human tumor xenografts. BMC Cancer 15, 112 (2015).
Byrne, A. T. et al. Interrogating open issues in cancer medicine with patient-derived xenografts. Nat Rev Cancer 17, 632 (2017).
Becht, E. et al. Immune and Stromal Classification of Colorectal Cancer Is Associated with Molecular Subtypes and Relevant for Precision Immunotherapy. Clin Cancer Res 22, 4057–4066 (2016).
Avallone, A. et al. A randomized phase 3 study on the optimization of the combination of bevacizumab with FOLFOX/OXXEL in the treatment of patients with metastatic colorectal cancer-OBELICS (Optimization of BEvacizumab scheduLIng within Chemotherapy Scheme). BMC Cancer 16, 69 (2016).
Wu, F., Tamhane, M. & Morris, M. E. Pharmacokinetics, lymph node uptake, and mechanistic PK model of near-infrared dye-labeled bevacizumab after IV and SC administration in mice. The AAPS journal 14, 252–261 (2012).
Kobuchi, S. et al. Semi-physiological pharmacokinetic-pharmacodynamic (PK-PD) modeling and simulation of 5-fluorouracil for thrombocytopenia in rats. Xenobiotica 45, 19–28 (2015).
Lu, J. F. et al. Clinical pharmacokinetics of bevacizumab in patients with solid tumors. Cancer Chemother Pharmacol 62, 779–786 (2008).
Saltz, L. B. et al. Bevacizumab in Combination With Oxaliplatin-Based Chemotherapy As First-Line Therapy in Metastatic Colorectal Cancer: A Randomized Phase III Study. Journal of Clinical Oncology 26, 2013–2019 (2008).
Hacker, M., Messer, W. S. & Bachmann, K. A. Pharmacology: Principles and Practice (Elsevier Science, 2009).
Enderling, H. & Chaplain, M. Mathematical modeling of tumor growth and treatment. Current pharmaceutical design 20, 4934–4940 (2014).
Rackauckas, C. & Nie, Q. Differential Equations. jl–A Performant and Feature-Rich Ecosystem for Solving Differential Equations in Julia. Journal of Open Research Software 5, (2017).
Hindmarsh, A. C. et al. SUNDIALS: Suite of nonlinear and differential/algebraic equation solvers. ACM Transactions on Mathematical Software (TOMS) 31, 363–396 (2005).
Toni, T., Welch, D., Strelkowa, N., Ipsen, A. & Stumpf, M. P. Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J R Soc Interface 6, 187–202 (2009).
Besenhard, M. O. et al. Modelling tumour cell proliferation from vascular structure using tissue decomposition into avascular elements. J Theor Biol 402, 129–143 (2016).
Jin, Y. et al. Pharmacokinetics and tissue distribution of 5-fluorouracil encapsulated by galactosylceramide liposomes in mice. Acta Pharmacol Sin 26, 250–256 (2005).
Joel, S. P. et al. Lack of pharmacokinetic interaction between 5-fluorouracil and oxaliplatin. Clin Pharmacol Ther 76, 45–54 (2004).
Maindrault-Goebel, F. et al. Oxaliplatin added to the simplified bimonthly leucovorin and 5-fluorouracil regimen as second-line therapy for metastatic colorectal cancer (FOLFOX6). GERCOR. Eur J Cancer 35, 1338–1342 (1999).
Acknowledgements
We would like to thank Dr Anna Matveeva for contributing art work to enhance Figure 1(A). This work was supported by the Seventh Framework Programme (FP7) under contract No. 278981 “ANGIOPREDICT”. A.T.B. is supported by Science Foundation Ireland under grant 13/CDA/2183 “COLOFORETELL”. J.H.M.P. is supported by Science Foundation Ireland under grants 13/IA/1881 and 14/IA/2582. A.T.B. and J.H.M.P. further receive funding from the European Commission funded Horizon 2020 Research and Innovation Programme under grant agreement No. 754923 “COLOSSUS”.
Author information
Authors and Affiliations
Contributions
A.T.B. and J.H.M.P. conceived of the study and oversaw study design. I.S.M., L.C., G.M. and N.H.A. contributed to the design and performance of experimental studies. A.B., M.S. G.K. designed and performed modelling experiments. I.S.M. and M.S. produced figures. All authors contributed to manuscript writing. All authors reviewed and approved manuscript prior to submission.
Corresponding author
Ethics declarations
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Sturrock, M., Miller, I.S., Kang, G. et al. Anti-angiogenic drug scheduling optimisation with application to colorectal cancer. Sci Rep 8, 11182 (2018). https://doi.org/10.1038/s41598-018-29318-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-018-29318-5
Keywords
This article is cited by
-
A Fokker–Planck feedback control framework for optimal personalized therapies in colon cancer-induced angiogenesis
Journal of Mathematical Biology (2022)
-
Prevalence of hypoxia and correlation with glycolytic metabolism and angiogenic biomarkers in metastatic colorectal carcinoma
European Journal of Nuclear Medicine and Molecular Imaging (2021)
-
System-based approaches as prognostic tools for glioblastoma
BMC Cancer (2019)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.