Introduction

Recent radiotherapy has evolved to use modulated radiation intensity and complex dose-delivery techniques such as intensity-modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT). These approaches provide a high level of dose conformity to the target tumour volume, preserving organs at risk1,2. Dose-rates used for external irradiation in radiotherapy (i.e., about 4 Gy/min)3 are much higher than brachytherapy (i.e., about 12 Gy/h or 50 cGy/h)4, however some modalities such as IMRT, MRI-linacs5 and Cyberknife6 need relatively long times to deliver the prescribed dose compared to previously used methods such as conformal therapy (3D-CRT)7. Recent clinical dose-rate studies indicate that cell recovery during irradiation (hereafter called sub-lethal damage repair: SLDR8,9) cannot be ignored, even for the case of high-dose-rate radiation therapy10.

Radiation-hit cells and non-hit cells co-exist during intensity modulated field exposures. Regarding this, in vitro experimental configurations containing in-field and out-of-field cells have been established11, and their biological effects have been previously studied11,12,13,14. Specifically, it was shown that using a 50% in-field and 50% out-of-field (half-field) irradiation as a simple model of modulated-field treatment, intercellular communication (IC) from cells in-field to cells out-of-field reduces survival of out-of-field cells11,15. This enhancement of cell death attributed to IC is referred to non-targeted effects or radiation-induced bystander effects16,17,18,19,20. In contrast, there are also several reports about signal-induced radio-resistance21,22,23, which can sometimes be observed in cells in-field under half-field irradiation in comparison with a uniform field exposure12,13. This radio-resistance is assumed to be attributed to the increase of DNA repair efficiency by rescue effects23. However, McGarry et al. showed that there was no statistically significant cell recovery of AGO-1522b cells during the delivery of a 9-field IMRT delivery in comparison to acute irradiation at 4 Gy/min1. This response contradicts what is expected from reported rescue effects. Thus, we are interested in elucidating the underlying mechanisms of modulated beam exposures via a comprehensive analysis of in vitro experiments combined with modelling approaches.

From the standpoint of modelling studies, the linear-quadratic (LQ) model24,25 has been generally accepted in the fields of radiation therapy and radiation biology26,27. However, more detailed models are needed to define mechanisms by considering effects due to microdosimetry and cell recovery by virtue of SLDR28,29,30,31. For example, the time factor in the microdosimetric-kinetic (MK) model28 represents the sub-lethal damage repair (SLDR) rate which can be deduced from a split-dose cell recovery curve30. Amongst many models developed by several researchers15,28,29,30,31,32,33, the “integrated microdosimetric-kinetic (IMK) model34,35 is suitable for analysing impact of IC for intensity-modulated fields and SLDR during irradiation. From in vitro experiments for modulated fields, we have also used this modelling approach to interpret the mechanisms of the radio-resistance.

Here, we focused on radio-sensitivity and dose-rate effects following exposure to intensity modulated fields. Using a simple geometry where 50% of the area of the cell culture flask is exposed, the in-field cell survival and out-of-field cell survival were quantified. Through this comprehensive study with in vitro experiments and modelling, we show the reduced importance of SLDR and presence of protective effects in irradiated healthy cells in modulated fields.

Materials and Methods

Cell culture

Experiments were performed using two human cell lines, the human skin fibroblast cell line, AGO1522, as a normal cell model, and the human prostate cancer cell line, DU145, as a tumour cell model. AGO1552 and DU145 cells were obtained from the Coriell Institute for Medical Research (Camden, NJ, USA) and Cancer Research UK, respectively. AGO1522 cells were grown in Eagle’s minimum essential medium supplemented with 20% fetal bovine serum (FBS) and 1% penicillin/streptomycin (p/s). DU145 cells were grown in RPMI-1640 with L-glutamine supplemented with 10% FBS, 1% p/s. These cell lines were maintained at 37 °C in a humidified atmosphere of 5% CO2.

Irradiation setup and planning

All irradiations in this study have been performed using a 225 kVp X-ray (Precision x-Ray) source at dose rates of 0.59 Gy/min or 0.18 Gy/min. The dose was delivered to either 50% of the area of T25 flask containing cells or 100% of the flask as previously reported11.

For the exposure of 50% cells in a culture flask, a T25 flask (Nunclon surface NUNC) was placed at the center of radiation beam, and half of the flask was shielded using a lead block (13.6 × 10.4 × 2.1 cm3 lead blocks MCP60-Mining & Chemical Products Ltd.). At the bottom of each flask, RTQA Gafchromic® film (Vertec Scientific Ltd.) was attached to monitor the dose boundaries. Schematic representations of the irradiation geometry and dose profile are illustrated in Fig. 1A,B. The dose profile was also checked by using the Monte Carlo simulation code, Particle and Heavy Ion Transport Code System (PHITS ver. 3.02)36.

Figure 1
figure 1

Study design for in vitro experiments with irradiation, Monte Carlo simulation and assumptions of the mathematical model: (A) illustrates the geometry of half-field irradiation, (B) is the dose profile compared between Gafchromic film and Monte Carlo simulation by PHITS ver. 3.0236, (C) is the temporal characteristics of dose delivered to cultured cells at different dose-rates and (D) represents the assumptions for modelling the signal range under half-field exposure, where AIF = 0.5 (gray area) and AOF = 0.5 (light gray area) are the fractions of in-field and out-of-field area in the modulated field, respectively. It is assumed that intercellular signals can cover the entire region of the flask for both cases of half and uniform-fields, based on previous experimental data14.

The cells were exposed by means of either a single-dose irradiation, a split-dose irradiation to evaluate sub-lethal damage repair (SLDR) or one of four different dose regimen for the dose-rate study. For split-dose experiments, a dose of 4 Gy split into two equal fractions was used with various inter-fraction times (0, 0.25, 0.5, 1, 2, 4, 24 and 48 h). We also compared four different dose plans equivalent to 0.59, 0.2, 0.1, 0.05 Gy/min, on average, for a total absorbed dose of 4 Gy. A temporal cell’s-eye view of dose-delivery is described in Fig. 1C.

Clonogenic survival assay

Cell survival was measured by means of a clonogenic assay as previously described11. Cells were plated and allowed to adhere overnight before irradiation. All exposures were performed at room temperature. The cells, after irradiation, were incubated for 10–14 days before staining with 0.5% crystal violet in 70% methanol.

Flow cytometric analysis of cell-cycle distribution

To understand changes in radio-sensitivity under half-field exposure, we also measured cell-cycle dynamics by using a co-culture system. Co-cultured cells were plated sub-confluently on glass slides and allowed to adhere overnight as previously reported37.

Less than 1 × 106 cells at 0, 6, 24, 72 h after irradiation were fixed with 70% ethanol (in 0.5 mL of PBS and 4.5 mL of 70% ethanol) and kept at 4 °C for at least 2 h. After centrifugation, the cells were suspended in 1 mL PBS. After centrifugation for 10 min at 300 g at 4 °C, ethanol was thoroughly removed (or decanted). Cells were then treated with 0.5 mL of PI staining solution (20 μg/mL PI, 20 μg/mL DNase-free RNase A, 0.1%v/v TritonX100) and kept in the dark at 37 °C for 15 min.

Model analysis and overview

A mathematical model was used to analyse the measured experimental data34,35. Cell survival considering DNA damage along the radiation track (so called DNA targeted effects: DNA-TEs) and Non-Targeted Effects (NTEs) was previously modelled using the IMK model34. In this study, the IMK model was modified so as to include the modulated radiation field shown in Fig. 1A. In this model, reparable lesions (potentially lethal lesion: PLL) are assumed to be DNA lesions with cell toxicity, which may transform into non-reparable lesions (lethal lesions: LLs) or be completely repaired28. Solving the kinetic equation for DNA lesions, cell surviving fraction can be calculated for both half-field (AIF = 0.5) and uniform-field (AIF = 1.0) cases, where AIF is the fraction of in-field area used in the experimental design (Fig. 1A).

Modelling of targeted effects (TEs)

The conventional MK model for continuous irradiation which considers discontinuous energy deposition to micrometre targets (or domains) is used for describing cell killing induced by DNA-TEs31,35, where multi-fractionated exposures to cell population with a dose-delivery time T (h) and N dose fractions are assumed. Based on previous modelling10,35, the cell surviving fraction for DNA-TEs ST can be given by:

$$\begin{array}{rcl}-\,\mathrm{ln}\,{S}_{{\rm{T}}} & = & {\sum }_{n=1}^{N}\,[({\alpha }_{0}\,+\,\gamma {\beta }_{0}){D}_{n}\Delta T\,+\,{\beta }_{0}{({D}_{n}\Delta T)}^{2}]\\ & & +2{\sum }_{n=1}^{N-1}\,{\sum }_{m=n+1}^{N}\,[{\beta }_{0}\langle {e}^{-(m-n)(a+c)\Delta T}\rangle {D}_{n}{D}_{m}]\Delta {T}^{2}.\end{array}$$
(1)

where ΔT is a sub-section of T defined by T = NΔT, Dn is dose delivered to cell population in the period of ΔT, α0 and β0 are the cell-specific coefficients for dose (Gy) and dose squared (Gy2), respectively; (a + c) is sum of constant rates for a PLL to transform into a LL and to be repaired (h−1), representing approximately SLDR due to the relation of (a + c) \(\cong \) c30,38; γ (Gy) is the microdosimetric quantity expressed by γ = yD/(ρπrd2); ρ and rd represent the density of liquid water (1.0 g/cm3) and radius of a domain39 (set as 0.5 μm in this study); yD is dose-mean lineal energy in keV/μm29.

Taking a limit of N to infinity, the surviving fraction for the continuous irradiation case, with a constant dose-rate \(\dot{D}\) (Gy/h), can be expressed by using the Lea-Catcheside time factor F as follows:

$$\begin{array}{c}-\,\mathrm{ln}\,{S}_{{\rm{T}}}=({\alpha }_{0}+\gamma {\beta }_{0})\dot{D}T+\frac{2{\beta }_{0}}{{(a+c)}^{2}{T}^{2}}[(a+c)T+{e}^{-(a+c)T}-1]{(\dot{D}T)}^{2}\\ \,\,\,\,=({\alpha }_{0}+\gamma {\beta }_{0})D+F{\beta }_{0}{D}^{2}\end{array}$$
(2)

where

$$F=\frac{2}{{(a+c)}^{2}{T}^{2}}[(a+c)T+{e}^{-(a+c)T}-1],$$
(3a)
$$D=\dot{D}T,$$
(3b)

where D is absorbed dose delivered to the cell population during the irradiation. In the model for DNA-targeted effects, (a + c) and β0 can be obtained from a split dose cell recovery curve, whilst α0 can be determined by fitting to the acute exposure cell survival curve.

Modelling of intercellular communication (IC)

The modelling of intercellular signalling between in-field and out-of-field cells is based on the IMK model, which incorporates the kinetics of signal concentration emitted from irradiated cells, DNA repair kinetics and cell survival34. In the case of the half-field exposures considered here (AIF = 0.5 as shown in Fig. 1A), we assume that the intercellular signals from in-field cells cover the entire out-of-field region (Fig. 1D), based on previous experimental data14. Concerning the time course of dose-delivery, the out-of-field surviving fraction appears to be independent of dose fractionation13. So here, we made the following assumptions for NTEs:

  1. (i)

    Targets of micron-order size, which trigger the release of intercellular signals, exist somewhere within a cell, for example, mitochondria40. Intercellular cell-killing signals are emitted from target-activated cells (hit cells), and interact with cells without any activated targets (non-hit cells) in the flask. (Fig. 1D). The mean number of targets activated for releasing IC signals per hit cell is defined as (\(({\alpha }_{{\rm{b}}}+\gamma {\beta }_{{\rm{b}}})D+{\beta }_{{\rm{b}}}{D}^{2}\)), where αb and βb are coefficients for D and D2 for NTEs, respectively.

  2. (ii)

    The probability of a given cell having an activated target for emitting NTE signals fh(D) follows Poisson statistics with the number of activated targets for NTEs, giving fh(D) = 1−\({e}^{-[({\alpha }_{{\rm{b}}}+\gamma {\beta }_{{\rm{b}}})D+{\beta }_{{\rm{b}}}{D}^{2}]}\)34, where D denotes cumulative absorbed dose. The probability of a cell having no activated targets can be deduced as 1−fh(D). fh(D) and fb(D) = \({e}^{-[({\alpha }_{{\rm{b}}}+\gamma {\beta }_{{\rm{b}}})D+{\beta }_{{\rm{b}}}{D}^{2}]}\). This is taken to be independent of dose fractionation according to the experimental data from split-dose irradiation12.

  3. (iii)

    To account for the generation of cell-killing signals, their decay and reaction with non-hit cells34,41, it is assumed that the yield of lethal lesions (LLs) in non-hit cells is proportional to the parameter δ34, which is determined empirically.

When delivering dose D (Gy) to the in-field region, the hit probability for in-field irradiated cells fh(D)IF is equal to \(1-{e}^{-({\alpha }_{{\rm{b}}}+{\gamma }_{{\rm{I}}{\rm{F}}}{\beta }_{{\rm{b}}}){D}_{{\rm{I}}{\rm{F}}}-{\beta }_{{\rm{b}}}{{D}_{{\rm{I}}{\rm{F}}}}^{2}}\). The mean number of LLs per cells induced by NTEs wNT, due to the effect of cell-killing signals from in-field area in the out-of-field area, can be expressed by using fh(D), fb(D) and δ as follows:

$${w}_{{\rm{NT}}}=\delta \,{f}_{{\rm{h}}}{(D)}_{{\rm{IF}}}\,{f}_{{\rm{b}}}{(D)}_{\ast }$$
(4)

where fb(D)* is the fraction of non-hit cells either in-field or out-of-field area (the symbol * stands for either in-field (IF) or out-of-field (OF)). Assuming Poisson statistics for the number of LLs per nucleus created by NTEs, the cell survival for NTEs can be expressed as

$$-\,{\rm{l}}{\rm{n}}\,{S}_{{\rm{N}}{\rm{T}}}=\delta [1-\,{e}^{-({\alpha }_{{\rm{b}}}+{\gamma }_{{\rm{I}}{\rm{F}}}{\beta }_{{\rm{b}}}){D}_{{\rm{I}}{\rm{F}}}-{\beta }_{{\rm{b}}}{{D}_{{\rm{I}}{\rm{F}}}}^{2}}]{e}^{-({\alpha }_{{\rm{b}}}+{\gamma }_{\ast }{\beta }_{{\rm{b}}}){D}_{\ast }-{\beta }_{{\rm{b}}}{{D}_{\ast }}^{2}}$$
(5)

where SNT is the surviving fraction of cells available for IC. The set of model parameters αb, βb and δ are cell-specific and can be determined from fits to the experimental out-of-field cell survival curves.

Cell surviving fraction considering TEs and NTE for modulated radiation fields

Here, we stochastically consider the fraction of cells with which intercellular signals react, and from which the integrated surviving fraction for TEs and NTEs is deduced.

Assuming that the interaction probability between sub-lesions (PLLs) in TEs and NTEs is very small34,42, the total number of LLs per nucleus considering TEs and NTEs (w) can be expressed by

$$w={w}_{{\rm{T}}}+{w}_{{\rm{NT}}}=-\,\mathrm{ln}\,{S}_{\ast }$$
(6)

where S* is the surviving fraction of cells either in-field (SIF) or out-of-field(SOF). In Eq. (6), it should be noted that the surviving fraction of cells for both half-field (AIF = 0.5) and uniform-field (AIF = 1.0) exposures is composed of the multiplication of survival for TEs and NTEs34,43.

Model application and estimation of cell survival

To determine the model parameters in the present model, we took 3 steps as follows: (i) calculation of yD values by Monte Carlo simulation, (ii) determination of SLDR rate (a + c) and β0 from a split-dose cell recovery curve, (iii) fitting of the model to dose-response curves to determine the rest of the model parameters via Markov chain Monte Carlo (MCMC). We then estimated the surviving fraction by using the obtained model parameters.

Monte carlo simulation to calculate y D value

We obtained yD values for 225 kVp X-rays by using two Monte Carlo simulation codes, PHITS36 and WLTrack44. The geometry is illustrated in Fig. 1A, which is validated by comparing the dose profile measured by Gafchromic film with that calculated by the PHITS simulation (Fig. 1B). The detail of geometry for calculating the yD value is summarized in Supplementary Information I (“Monte Carlo Simulation for yD Calculation”).

The calculated yD values were 4.393 ± 0.007 keV/μm for the in-field area and 4.769 ± 0.044 keV/μm for the out-of-field area. These values were converted to γ values and used as input parameters to describe the cell surviving fraction for each field area.

Deduction of SLDR Rate from split-dose cell recovery

According to previous reports of the MK model30, the formula to calculate the (a + c) value, that is approximately equivalent to SLDR, is given by

$$(a+c)=\frac{\mathop{\mathrm{lim}}\limits_{\tau \to 0}\frac{1}{S}\frac{{\rm{d}}S}{{\rm{d}}\tau }\,}{\mathrm{ln}\,\frac{S(\infty )}{S(0)}}$$
(7)

where τ is inter-fraction time (incubation time between two irradiations) in hours, S(0) and S(\(\infty \)) are surviving fractions S(\(\tau \)) taking the limits of exposure interval (\(\tau \,\to \,0,\,\tau \,\to \,\infty \)), respectively. In this study, the initial slope dS/dτ was determined from the experimental surviving fraction by taking the gradient from 0 to 0.25 h whilst S(∞) was defined by the averaged survival from 6 to 48 h. The β0 value can be also determined from the ratio of S(0) and S(\(\infty \))30 as expressed by:

$${\beta }_{0}\,=\,\frac{1}{2{D}_{1}{D}_{2}}\,\mathrm{ln}\,\frac{S(\infty )}{S(0)}$$
(8)

where D1 and D2 represent the first dose and second dose, respectively.

Using Eqs (7) and (8), the set of model parameters involved in cell recovery between fractionated doses θ = [β0, (a + c)] were deduced.

MCMC simulation

Using the obtained parameters of θ = [γ, β0, (a + c)], the rest of the cell-specific parameters in the IMK model θ = (α0, αb, βb, δ) were determined via a MCMC technique established previously10. The detail of the MCMC simulation is summarized in Supplementary Information II (“Markov chain Monte Carlo for Determining Model Parameters”). Particularly, it should be noted that the prior distribution of θ = (α0, αb, βb, δ) and the uncertainty for –ln S were set to follow a normal distribution.

By applying the cell survival formulae (Eqs (2), (5) and (6)) to experimental survival data after single-dose exposure (dose-response curve)13,14 in the MCMC simulation, we deduced the mean and standard deviation (s.d.) of the model parameters θ = (α0, αb, βb, δ).

Estimation of cell surviving fraction

By the use of the obtained model parameters θ = [α0, β0, (a + c), αb, βb, δ] and formulae of the IMK model (Eqs (1), (2), (5) and (6)), the surviving fraction for in-field and out-of-field cells for the cases of AIF = 0.5 and 1.0 were estimated.

The cell survival curves after single-dose exposure were described based on Eqs (2), (5) and (6), whilst the split-dose cell recovery curves, with two equal doses of 2 Gy, were described according to Eqs (1), (5) and (6). The fit quality for the fitting approach was checked by comparison with experimental survival obtained in this study and reference data13,14. As statistical measures, the coefficient of determination R2 and chi-square value were used, which are given by

$${R}^{2}={\rm{1}}-\frac{{\sum }_{i=1}^{n}\,{({\exp }_{i}-{{\rm{cal}}}_{i})}^{2}\,}{{\sum }_{i=1}^{n}\,{({\exp }_{i}- < \exp > )}^{2}},$$
(9a)
$${\chi }^{2}=\frac{1}{n}{\sum }_{i={\rm{1}}}^{n}\,\frac{{({\exp }_{i}-{{\rm{cal}}}_{i})}^{2}}{{\sigma }_{i\,\exp }^{2}}$$
(9b)

where expi is measured cell survival, cali is cell survival calculated by the present model and σexp is the standard deviation of measured cell survival.

To evaluate SLDR in a modulated field, we compared the model estimation (Eqs (1), (5) and (6)) and experimental results for fractionated exposures with a total dose of 4 Gy, delivered by the 4 regimens described in Fig. 1C. For the dose response in the split-dose experiments, we also compared the model prediction (Eqs (1), (5) and (6)) with the previous results reported by Ghita, et al.13. The R2 value (Eq. (9a)) was also used to check the fit quality of the cell recovery curve after fractionated irradiation and the dose response after a split-dose irradiation.

Results and Discussions

Split-dose cell recovery and dose-response curve

Split-dose and single-dose experiments were performed to determine the degree of SLDR and the model parameters. Figure 2 shows the cell recovery curve for survival measured by a split-dose experiment in which upper and lower panels are the results for AGO1522 and DU145, respectively. The symbols in Fig. 2 represent the experimental cell recovery. The survivals for the cases of τ = 0 and \(\infty \) (S(0) and S(\(\infty \))) and the initial slop of dS/dτ (dotted line in Fig. 2) for in-field cells under uniform-field (AIF = 1.0) (Fig. 2AI,BI) and in-field cells under half-field (AIF = 0.5) (Fig. 2AII,BII) were used for determining the (a + c) and the β0 values based on Eqs (7) and (8). The obtained values (a + c) and β0 values are summarized in Table 1.

Figure 2
figure 2

Split-dose cell recovery curves to determine sub-lethal damage repair (SLDR). Upper and lower panels are experimental cell recovery curve (symbols) and the model (solid line) for AGO1522 and DU145, respectively. Doses of 4 Gy were delivered using two equal fractions at various interfraction times (0, 0.25, 0.5, 1, 2, 4, 24, 48 h). The cell survivals of S(0), S(\(\infty \)) and the initial slope of cell recovery [\({\mathrm{lim}}_{\tau \to 0}(dS/d\tau )\)] were used to determine (a + c) and β0 values based on Eqs (7) and (8). The model parameters determined by the recovery curve are listed in Table 1.

Table 1 Model parameters for modulated and uniform radiation fields.

For AGO1522 cells, the (a + c) for modulated fields (AIF = 0.5) was 0.034 ± 0.062 (h−1), whilst that for uniform fields (AIF = 1.0) was 1.684 ± 0.911 (h−1). The value for uniform fields matches with the reported (a + c) value30,35. However, in AGO1522 cells exposed to a modulated field, the mean value is less than the uncertainty, which suggests no significant dose-rate dependency. The β0 value is also reduced together with the reduced (a + c) value, which in the IMK model implies that the probability of two PLLs interacting might decrease or that the number of initial PLL is reduced35. In contrast, experimental survival in DU145 cells exhibits the expected SLDR rates30,35, i.e., (a + c) = 2.509 ± 1.267 (h−1) for a modulated field (AIF = 0.5) and (a + c) = 1.506 ± 1.347 (h−1) for a uniform field (AIF = 1.0). Therefore a significant dose-rate dependence was observed for both radiation fields in DU145 cells. The comparison between in vitro data and the model suggests that the importance of SLDR in AGO1522 cells exposed to a modulated field is reduced relative to uniform field exposure. Finally, for both cell types there is no significant temporal dependence of out-of-field cell survival, suggesting that there is less impact of SLDR (DNA repair) on out-of-field cell-killing for both cell types (Fig. 2AIII,BIII).

The experimental dose responses for cell surviving fraction are shown in Fig. 3, where Fig. 3A,B are the dose-survival relationship in AGO1522 and DU145, respectively. In Fig. 3, blue closed diamond, red triangle and green open diamond represent the experimental survival for in-field cells under half-field (AIF = 0.5), out-of-field cells under half-field (AIF = 0.5) and in-field cells under uniform-field exposures (AIF = 1.0), respectively. As shown in Fig. 3, the cell viability under half-field exposure (AIF = 0.5) is higher than that under uniform-field exposure (AIF = 1.0). The smaller colonies measured after 10 Gy uniform-field exposure relative to those measured after half-field exposure are shown in Supplementary Information III (“Clonogenicity of In-Field Cells Under Modulated-Field Exposure”).

Figure 3
figure 3

Dose-response curve of cell survival after single-dose exposure. Blue closed diamond, red triangle and green open diamond represent the experimental survival of in-field cells for half-field, that of out-of-field cells for half-field (AIF = 0.5) and that of in-field cells for uniform-field (AIF = 1.0), respectively. The solid lines are the predicted curve based on DNA-TEs and IC (Eqs (2), (5), (6)), while the dotted lines are the model prediction considering DNA-TEs only (Eq. (2)). The parameters used are listed in Table 1. Experimental data for an exposure with AIF = 0 (100% shielded case) is shown as black open squares.

Based on these trends, we applied the parameter sets for DNA-TEs θ = (α0, βb, a + c) for each uniform-field (AIF = 1.0) and half-field (AIF = 0.5) exposure to fit full model parameter sets θ = (α0, βb, a + c, αb, βb, δ), which are summarized in Table 1. The predicted cell survival curves for single-dose irradiation are plotted as solid lines in Fig. 3, showing that the present model well reproduces the dose response curves for both in-field cells and the higher cell-killing of out-of-field cells at the same absorbed dose.

It should be noted that the low-energy photons scattered from the lead shielding have the potential to enhance the out-of-field cell death in half-field exposures. This impact of the scattered photons on clonogenicity was therefore evaluated before the modelling approach with IC. As shown in Supplementary Information V (“Estimation of Impact of Low-Energy Photons on Out-of-Field Cell Survival”), there is no significant impact of scattered photons, with lower energy, on cell survival curve. In contrast, in the Supplementary Information IV (“Verification of the IMK model for Intercellular Communication”), previous data which showed that the out-of-field cell survival increased when cells were treated with a nitric oxide (NO) inhibitor11 was well reproduced by the model prediction when IC was inhibited (δ = 0). From these results, it is clearly suggested that the decrease of out-of-field cell survival is attributed to signalling effects from in-field hit cells to out-of-field non-hits cells (cell killing induced by NO), which correspond to radiation-induced bystander effects16,17,18,19,20.

The reduction of radio-sensitivity for irradiated cells under modulated fields has been recently reported for the endpoints of cell survival45 and apoptosis46; so called rescue23 or protective effects47. Our in vitro survival data and the present model analysis (Fig. 3) are consistent with these recent reports22,23,45,46, showing a significant drop in the \({\beta }_{0}\) term and SLDR (Fig. 2 and (a + c) values in Table 1) when AGO1522 cells are exposed to modulated fields, leading to increased radio-resistance of irradiated in-field cells compared to uniformly exposed cells (Fig. 3).

Cell recovery during multi-fractionation

To evaluate the reduced importance of SLDR with half-field exposure, we next made a comparison of the model estimation with experimental data for the case of regimens delivered with 4 different dose-rates, i.e., 0.59 Gy/min, 0.20 Gy/min, 0.10 Gy/min and 0.05 Gy/min (Fig. 1C). Figure 4A,B show the comparison between the model estimation and experimental survival data. Blue circle, red triangle and green diamond in Fig. 4A,B represent the experimental data for in-field cells under half-field (AIF = 0.5), out-of-field cells under half-field (AIF = 0.5) and uniform-field exposed cells (AIF = 1.0), respectively. The mean value from the model estimation is described by solid line, and 95.4% confidence interval (CI) is shown by dotted line in Fig. 4. The 95.4% CI was calculated from the uncertainty deduced by the MCMC approach10.

Figure 4
figure 4

Dose-rate effects on cell survival. The temporal characteristics of the different averaged dose-rates are described in Fig. 1C. Blue, red, green symbols represent the experimental survival for in-field cells, out-of-field cells and uniformly exposed cells. The solid lines represent the mean survival estimated by using model parameters in Table 1, the model formulae of Eqs (1), (5) and (6). The dotted line indicates the 95.4% confidence interval (CI), which is calculated from the MCMC simulation.

From the experiments and modelling, whilst AGO1522 cells after uniform-field (AIF = 1.0) exposure exhibit significant cell recovery during dose-delivery, cells exposed to modulated fields see less SLDR and are more radio-resistant (Fig. 4A). In contrast, DU145 cells after uniform-field or half-field exposure exhibit similar recovery kinetics during dose-delivery (Fig. 4B).

To further validate the different SLDR rate and radio-sensitivity in AGO1522 cells (Figs 2A, 3A and 4A), we added the model predictions for the responses to split-dose irradiation. Figure 5 shows a comparison of AGO1522 cell survival curves estimated by the model (Eqs (1), (5) and (6), Table 1) and experiment data from Ghita et al.13. As shown in Fig. 5, the different sets of model parameters for half-field and uniform-field are able to reproduce the dose-response curves. This comparison confirms that the different radio-sensitivity created by modulated field results in lower β0 and (a + c) values for half-field relative to uniform-field exposures. The implications of this for clinical dose-delivery is summarized in the Supplementary Information VI (“Application to Clinical Dose-Delivery and Cell Survival Recovery”), where no statistically significant cell recovery of AGO1522 cells during irradiation using five different treatment modalities is reported.

Figure 5
figure 5

Estimation of cell survival after a split-dose exposure as a function of cumulative absorbed dose. (A) is for the case of half-field exposure and (B) is for the case of uniform-field, where blue, red, green symbols are the experimental survival for in-field, out-of-field and uniformly exposed cells, respectively. The experimental data were obtained from the previous report by Ghita, et al.13. The data were modelled using the same procedure used in Fig. 4.

Cause of protective effects under half-field exposure

The reason for the difference of in-field cell survival between half-field (AIF = 0.5) and uniform-field (AIF = 1.0) exposure is still unclear. To better understand the radio-resistance induced by “protective effects”, we attempted to reproduce the survival curve for in-field cells where AIF = 0.5 by using the set of model parameters for the uniform field and different response assumptions. Two sets of assumptions were considered: (i) live cells move from the out-of-field region to the in-field region during incubation after irradiation48, or (ii) the initial DNA damage yield is reduced under modulated irradiation, which is predicted from the model analysis of β0 values (Table 1)42. From these assumptions, we attempted to determine the processes leading to radio-resistance.

For cell migration, we assumed a fraction \({f}_{{\rm{move}}}\) of cells move between the in-field and out-of-field regions during incubation after irradiation, and those with no lethal DNA lesions contribute to the surviving fraction. Thus, the measured in-field surviving fraction considering the two cell populations can be given as,

$$S=(1-{f}_{{\rm{move}}})\,{S}_{{\rm{IF}}}+{f}_{{\rm{move}}}\,{S}_{{\rm{M}}},$$
(10)

where SIF is the surviving fraction for the in-field cells which were originally present during irradiation, SM is the surviving fraction for the surviving out-of-field cells which have migrated from the out-of-field area (SM = 1.0), and S is the total surviving fraction of the combined cell population. Applying the model (Eqs (2), (5), (6) and (10)) to the experimental in-field survival data, we obtained fmove = 0.096 ± 0.011 as shown in Fig. 6A. The model predicts that 9.55% of the surviving out-of-field cells migrate to the in-field area, giving rise to a roughly constant cell survival in high-dose range above about 6 Gy (blue dotted line in Fig. 6A). However, there is no experimental evidence for this, at least in vitro. For example, Butterworth, et al. performed clonogenic assays quantifying the out-of-field cell survival at high dose (35 Gy in-field dose) and indicated that there were no colonies surviving in the in-field region11. Overall, this suggests that migration is not a major factor in the induction of radio-resistance.

Figure 6
figure 6

Estimation of the protective effects induced by modulated irradiation. (A) Predicted cell survival considering cell migration, in which we assumed that some cells from the shielded population migrate into the in-field area. (B) Predicted cell survival considering a reduced the DNA damage yield under half-field exposure. The reduced DNA damage yield is incorporated into the IMK model by using the khalf/kuniform, where khalf is the number of PLLs per Gy for half-field and kuniform is that for uniform-field.

Next, we estimated the cell survival curve based on modifying the initial DNA damage yields. Previous DNA damage studies showed a smaller number of DNA lesions (detected by 53BP1 foci) after half-field exposure (AIF = 0.5) than the uniform-field exposure (AIF = 1.0)13,42. We incorporated this reduced DNA damage yield into the dose coefficients (α0, β0) in the DNA-TEs model35 according to the equation:

$${\alpha }_{0}=\frac{ak}{c}\,{\rm{and}}\,{\beta }_{0}=\frac{b{k}^{2}}{2c},$$
(11)

where a is the rate constant for a PLL to transform into a LL (h−1), b is the rate constant for two PLLs to interact and transform into a LL and c is the rate constant for PLL to be repaired. The experimental DNA damage yield ratio, i.e., 0.642 ± 0.110 (=khalf/kuniform)42 modifies the survival curve of the in-field irradiated cells to agree well with experimental data (blue solid line in Fig. 6B) with a smaller χ2 value than the model based on cell migration. Overall, as interpreted from the reduced β0 value (Table 1), we concluded that the reduced initial DNA damage induction due to IC might play a key role of inducing radio-resistance (protective effects) after modulated-field exposure.

DNA damage mediated cell-cycle effects

Finally, to test the impact of modulated fields on DNA damage mediated checkpoint inhibition, cell-cycle studies were performed. Figure 7 shows the dynamics of cell-cycle distribution (fractions of cells in G1, S and G2/M phases) after irradiation, where (A) is for AGO1522 cells and (B) is for DU145 cells.

Figure 7
figure 7

Cell-cycle kinetics after uniform and half field radiation exposure: (A) Measured cell-cycle changes after the exposure of AGO1522 cells, (B) for DU145 cells. Blue and red symbols represent the fractions of the in-field and out-of-field cells following half-field exposure (AIF = 0.5), whilst the green symbol represents uniformly irradiated cells (AIF = 1.0). * and ** indicate 5% and 1% significant differences from the previous cell-cycle fraction (i.e., 0 h and 6 h, 6 h and 24 h, 24 h and 72 h).

In the AGO1522 cells exposed to 4 Gy with uniform-field (AIF = 1.0) (green symbol in Fig. 7A), we observed a significant G2 block 6 h after irradiation and a cell accumulation at the G1 checkpoint 24 h after the irradiation. Under the half-field exposure (AIF = 0.5), the population of in-field cells maintains the original cell-cycle distribution until 6 h after irradiation (blue symbol in left panel of Fig. 7A). In contrast, the out-of-field AGO1522 cells exhibit an accumulation in the G1 phase, which might be related to the signal-induced cell-killing. DU145 cells exposed uniformly to 8 Gy are blocked in G2 6 h after irradiation with no G1 block observed up to 24 h after the irradiation (green symbol in Fig. 7B). This is because DU145 cells are p53 mutant49. However, the same (constant) cell-cycle dynamics were observed in the DU145 cells up to 6 h after irradiation in out-of-field populations.

Cell cycle checkpoints are intrinsically related to the degree of DNA damage induction after irradiation50,51. Thus, it is reasonable to assume that the stable cell-cycle distribution after half-field exposure (Fig. 7) results from the reduced DNA damage (Fig. 6B). We also suspected the involvement of NO in protective effects because of its involvement in out-of-field cell killing21. An additional cell-cycle study with 100 μM aminoguanidine (AG) as an inhibitor of NO was also performed, however AG, under the conditions tested, does not appear alter the cell-cycle distribution, as described in the Supplementary Information VII (“Cell-Cycle Study with AG Treatment for Modulated Radiation Field”). The scenario for cell responses in modulated fields is that: (i) there is a reduced initial induction of DNA damage, (ii) cell-cycle checkpoints are not activated due to the reduced DNA damage, and (iii) this reduced DNA damage leads to an increased radio-resistance (and apparent protective effects). However, DNA damage repair within 30 min after irradiation as well as the bystander cross talk have not been examined here, so further investigation of what causes the reduced DNA damage is necessary.

Conclusion

In this study, we evaluated the impact of modulated radiation fields on the radio-sensitivity and dose-rate effects in human skin fibroblast (AGO1522) and human prostate cancer (DU145) cells. From the in vitro experiments and the model analysis, modulated radiation exposures: (i) reduce the yield of PLLs and the importance of cell recovery (SLDR), and (ii) reduce the radio-sensitivity of in-field cells compared to conventional uniform exposures. These effects can be explained by the reduction of the DNA damage in the modulated field, which may also impact on cell-cycle distribution. However, the biological mechanisms governing this change in initial DNA damage remain unclear, so further studies are necessary to identify the underlying mechanisms.