Skip to main content

Thank you for visiting You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

The effects of recall errors and of selection bias in epidemiologic studies of mobile phone use and cancer risk


This paper examines the effects of systematic and random errors in recall and of selection bias in case–control studies of mobile phone use and cancer. These sensitivity analyses are based on Monte–Carlo computer simulations and were carried out within the INTERPHONE Study, an international collaborative case–control study in 13 countries. Recall error scenarios simulated plausible values of random and systematic, non-differential and differential recall errors in amount of mobile phone use reported by study subjects. Plausible values for the recall error were obtained from validation studies. Selection bias scenarios assumed varying selection probabilities for cases and controls, mobile phone users, and non-users. Where possible these selection probabilities were based on existing information from non-respondents in INTERPHONE. Simulations used exposure distributions based on existing INTERPHONE data and assumed varying levels of the true risk of brain cancer related to mobile phone use. Results suggest that random recall errors of plausible levels can lead to a large underestimation in the risk of brain cancer associated with mobile phone use. Random errors were found to have larger impact than plausible systematic errors. Differential errors in recall had very little additional impact in the presence of large random errors. Selection bias resulting from underselection of unexposed controls led to J-shaped exposure–response patterns, with risk apparently decreasing at low to moderate exposure levels. The present results, in conjunction with those of the validation studies conducted within the INTERPHONE study, will play an important role in the interpretation of existing and future case–control studies of mobile phone use and cancer risk, including the INTERPHONE study.


Over the last two decades, mobile telephones have come into widespread use in many countries throughout the world. The pervasive use of wireless telecommunications devices has raised concerns about the possible health effects of radio frequency fields used in mobile telephony. Recent reviews have concluded that although a number of biological effects of radio frequency fields have been identified, there is at present no clear evidence of adverse health effects (Cardis and Kilkenny, 1999; Elwood, 1999; IEGMP, 2000; British Medical Association, 2001; Krewski et al., 2001a, 2001b, 2006; AGNIR, 2003; Habash et al., 2003; Ahlbom et al., 2004; AFSSE, 2005; Sienkiewicz and Kowalczuk, 2005).

A primary concern with mobile telephones has been the possibility of an increased risk of cancers of the brain, acoustic nerve, and salivary glands, owing to the concentration of radio frequency fields in this area occurring through the use of mobile phones. Such concerns have spawned a series of epidemiological studies focusing on the association between mobile phone use and cancer risk (Rothman et al., 1996; Dreyer et al., 1999; Hardell et al., 1999, 2000, 2001, 2002a, 2002b, 2003a, 2003b, 2005, 2006; Muscat et al., 2000, 2002; Inskip et al., 2001; Johansen et al., 2001; Stang et al., 2001; Auvinen et al., 2002; Christensen et al., 2004, 2005; Lönn et al., 2004, 2005; Schoemaker et al., 2005; Hepworth et al., 2006; Schüz et al., 2006). These studies have used primarily the case–control approach, with assessment of exposure relying mainly on participants’ self-reports of phone use in personal interviews or postal questionnaires. Because the impact of radiofrequency exposure from mobile phones is expected to be small (if it exists) at the individual level, it is possible that biases in these studies could invalidate or complicate the interpretation of the results. Of particular concern are recall and selection biases.

Recall errors may arise from errors in an individual's reported history of use of mobile telephones, in particular from errors in the cumulative amount of phone use reported (Vrijheid et al., 2006). If such errors occur randomly, they usually bias risk estimates for dichotomous and continuous exposures and trend effects for ordered polytomous exposures towards the null (no effect). They also increase the uncertainty of risk estimates, making it more likely that real associations are not detected (Armstrong, 1998). However, for comparisons of exposure categories within polytomous exposures, bias can be in either direction (Dosemeci et al., 1990; Birkett, 1992; Dosemeci and Stewart, 1996; Armstrong, 1998). Systematic under- or overestimation of phone use leads to a bias of risk estimates upwards or downwards: if all subjects overestimate, measured relative risk estimates will be lower than the true relative risk, and vice versa. Differential recall errors in cases and controls may also lead to bias, the direction of which depends on the direction of the differences between cases and controls. A common example in epidemiological literature is one where differential recall bias occurs owing to under-reporting of exposure by control subjects or over-reporting by case subjects, producing spurious positive associations. Cases may reflect about potential causes of their disease and therefore may recall former exposures more accurately or even overestimate these exposures. Controls would tend to forget former exposures, particularly when the exposure was a long time ago. An additional possibility in brain cancer case–control studies is that cases may recall exposure less accurately, as the brain cancer may have affected their memory. The combined effects of random and systematic recall errors (which may be differential and non-differential) cannot be easily predicted.

Selection bias in case–control studies of mobile phone use may arise when selection of cases and controls into the study is related to the exposure, in the present context to the use of mobile phones. It may, for example, be envisaged that mobile phone users are more likely to agree to participate in a mobile phone study, or that they are more easily contactable than non-users. Recently, Lahkola et al. (2005) found that non-participants were less likely to use mobile phones than participants in a case–control study in Finland. On the other hand, it is also possible that mobile phone users are more mobile and therefore more difficult to contact than non-users, and therefore less likely to participate. Such selection effects will depend on the way subjects are approached to participate in the study. Participation rates tend to be higher among cases than among controls in case–control studies of mobile phone use and cancer risk (Christensen et al., 2004, 2005; Lönn et al., 2004, 2005; Schoemaker et al., 2005; Hepworth et al., 2006; Schüz et al., 2006), making selection bias a possibility.

This paper examines the effects of recall and selection bias in case–control studies of mobile phone use and cancer through sensitivity analyses based on Monte–Carlo computer simulations (Steenland and Greenland, 2004). Results from simple analytical sensitivity analyses of selection bias are also included. These sensitivity analyses have been carried out within the INTERPHONE Study, an international collaborative case–control study investigating whether mobile telephone use (specifically radio-frequency field exposure resulting from this use) is related to risk of tumors of the brain and salivary glands (Cardis and Kilkenny, 2001). Thirteen countries participate in INTERPHONE following a common protocol, making this the largest study of its kind. The assessment of the impact of possible bias is important in interpreting the findings of the INTERPHONE study, as its first results are now starting to be published (Christensen et al., 2004, 2005; Lönn et al., 2004, 2005; Schoemaker et al., 2005; Hepworth et al., 2006; Schüz et al., 2006).


The impact of recall bias was evaluated through Monte–Carlo simulation by repeated sampling from plausible recall error distributions and repeatedly estimating the odds ratio for brain cancer risk related to cumulative mobile phone use. Case–control data were generated to reproduce the relevant characteristics of the INTERPHONE study. Selection bias was introduced in the simulations by use of specified probabilities determining the probability of selection into the case–control data set for exposed and unexposed cases and controls.

Generation of Case–Control Data Set

A case–control data set was simulated in several steps. First, a large study population (175,000 subjects) was created, and each subject (denoted i) was assigned a true exposure Xi. Our simulated subjects included users and non-users of mobile phones; user status was assumed to follow a Bernoulli distribution with known probability P. Users were assigned a level of exposure (i.e., amount of phone use) by sampling from a log-normal distribution with known parameters. The user status probability P and the parameters of the log-normal exposure distribution were based on preliminary information on the distribution of exposures in controls in the INTERPHONE study. Simulated subjects whose assigned exposure was unreasonably high (higher than the maximum exposure recorded among INTERPHONE controls) were excluded. Two exposure metrics were considered: the cumulative number of calls (with risk estimates provided per 10,000 calls) and the cumulative duration of calls (with risk estimates provided per 1000 h).

Second, each study subject was assigned a probability P of disease Di (=1 for a diseased and 0 for a healthy subject) according to the logistic model

Subjects were assigned a random number U from the uniform distribution U[0,1] and designated as either diseased if U<P or healthy if UP.

Third, a random sample of 1000 diseased and 2000 healthy subjects was drawn to form the simulated case–control data set. The results of this random sample were retained as (Di, Xi), i=1, …, 3000, for further analysis.

These three steps were repeated 5000 times for each of the simulation scenarios described below.

Recall Bias

Multiplicative Recall Error Model

We used a multiplicative error model to describe the effects of both random and systematic recall errors. We assumed an error model of the form

where X denotes the true exposure, ɛ denotes the multiplicative error, and Z denotes the measured level of exposure.

Information about the distribution of the multiplicative error factor ɛ was available from INTERPHONE validation studies in which short-term recall of volunteer subjects was compared with actual usage patterns recorded by mobile phone service providers or software-modified mobile phones (Vrijheid et al., 2006). The ratio of recalled to actual phone use followed a log-normal distribution. Estimates of the mean μ and standard deviation σ of the logarithm of this ratio are shown in Table 1. (This table is based on data from the eight countries that completed the validation study at the time this simulation study was initiated). Three sets of values of μ and σ were used in our simulation studies: the values for all countries combined were used as the most likely scenario, along with the largest and smallest values observed among these countries (as noted in Table 1).

Table 1 Mean (μ) and standard deviation (σ) of the logarithm of the ratio of reported to actual mobile phone use from INTERPHONE validation studies (Vrijheid et al., 2006).

Recall Bias Scenarios

Random and systematic errors in phone use recall were considered under the following four broad recall error scenarios.

  1. 1

    Non-differential random recall error. Under this scenario, the standard deviation σ of the measurement error distribution was varied, with the mean μ fixed at 0. Based on the results of the validation study (Table 1), the most likely values of the standard deviation were σ=0.95 for numbers of calls and σ=1.21 for duration of calls; extreme values were σ=0.62 and 1.30 for number of calls, and σ=0.95 and 1.39 for duration of calls.

  2. 2

    Non-differential recall error with systematic over- or underestimation of phone use and fixed random error. In this scenario, the mean μ of the exposure measurement distribution was varied, while σ remained constant at the most likely value in the validation study (σ=0.95 for number of calls, 1.21 for duration of calls). The most likely values for the mean were μ=−0.11 for number of calls and μ=0.37 for duration of calls; extreme values were μ=−0.49 and 0.47 for number of calls, and μ=0.03 and 0.90 for call duration (Table 1).

  3. 3

    Differential random recall error with no systematic over- or underestimation of phone use. In this scenario, cases were subject to greater random recall error than controls, reflecting the possibility that recall of mobile phone use may be affected by their health status (i.e., the presence or absence of brain cancer). Here, μ was held constant at 0, whereas σ was assigned different values for cases and controls. In these scenarios, the value of σ for controls was set at the most likely value (σ=0.95 for number of calls and 1.21 for duration of calls), whereas the value of this parameter for cases varied between σ and 3σ.

  4. 4

    Differential systematic over- or under-estimation of phone use and fixed random error. In this scenario, random measurement error remained constant at the same level for both cases and controls (σ=0.95 for number of calls and 1.21 for duration of calls), whereas the systematic error μ varied between cases and controls, and was set at μ=0 for controls. The three values of μ considered for cases were chosen to cover a range of effects largely based on the validation study: underestimation (μ=−0.49 for number of calls and duration of calls) and overestimation (μ=0.20 and 0.47 for number of calls, and μ=0.37 and 0.90 for duration of calls). The value of μ=0.20 was chosen to reflect a scenario of moderate overestimation in cases and did not originate from the validation study.

Levels of Risk

All of the above scenarios were simulated for four levels of the true odds ratio (OR)=exp(βX) at specified continuous levels of exposure, chosen to represent small, medium, and relatively large postulated effects. Specifically, we considered OR=1.0, 1.1, 1.2 or 1.4 per 10,000 calls, and OR=1.0, 1.1, 1.3, and 1.7 per 1000 h of calling time. Results with an OR of 1.0 are shown only for scenarios with differential errors between cases and controls.

Effect of Recall Bias

A logistic regression model was fit to each of the 5000 simulated data sets generated under each recall bias scenario considered. The variation in the estimated odds ratios across these 5000 data sets was described by calculating the average of the , as well as the 2.5th and 97.5th percentiles of the distribution of .

The coverage rate of the true OR was estimated by the percentage of times (out of 5000 simulations) the 95% confidence intervals around contained the true OR. The accuracy of risk estimates was assessed using the relative bias (RB) in the estimated OR, defined by

where denotes the average of the estimated ORs over the 5000 simulated data sets, OR denotes the true OR and OR denotes the absolute value.

Selection Bias

Calculation of Selection Bias

The effect of selection bias for OR for dichotomous exposure (ever/never use of mobile phones) was calculated analytically by multiplying the true OR by a selection bias factor (Rothman & Greenland, 1998). Specifically, we have

where Pa1 denotes the probability of selection among exposed cases, Pa0 is the probability of selection among unexposed cases, Pb1 is the probability of selection among exposed controls, and Pb0 is the probability of selection among unexposed controls.

Simulation of Selection Bias

The effects of selection bias on continuous exposure measures were evaluated using an adaptation of the simulation approach described above. After generating the study population and assigning exposure Xi and disease status Di to each individual i, the selection probabilities Pa1, Pb0, Pa0, and Pb1 were used to determine which individuals are selected into the case–control study. Note that the selection probabilities used in these simulations are related only to the fact of being or not a mobile phone user; they are not related to the level of mobile phone use.

In addition to estimating risk using a continuous exposure metric (per 10,000 calls), we estimated risk in four exposure categories (<50th, 50–69th, 70–90th, and >90th percentile) relative to unexposed subjects (i.e., non-users). True ORs of 1.0 and 1.2 per 10,000 calls were used for all selection bias scenarios considered. Results with an OR of 1.0 are shown only for the first, most plausible, scenario described below.

Selection Probabilities

Our choice of selection probabilities was guided by preliminary results from questionnaires completed by a small sample of non-respondents in the INTERPHONE study, which provide information on the ratio of the proportion of phone users among those who participated to the proportion of users among those who did not participate in the study. All scenarios were conducted assuming three plausible participation rates among controls, respectively, 45%, 65%, and 75%. Overall, participation rate among cases was assumed to be 100%, except in one scenario where exposed cases were underselected (see below). For both cases and controls, participation rates were allowed to differ among users and non-users of mobile phones, depending on the selection bias scenario as described below.

Selection Bias Scenarios

Three types of selection bias were investigated:

  1. 1

    Underselection of unexposed controls. In this scenario, there is a higher likelihood of selecting controls who use mobile telephones than those who do not and hence mobile phone users are over-represented among controls. Assumptions underlying this first (and most plausible) scenario were based on data derived from the non-response questionnaires discussed above. The percentage of users among participating controls was set at 64%, the percentage of users among non-participating controls at 50%. Also simulated was a more extreme scenario of under-selection, with the percentage of users among non-participants set at 30%.

  2. 2

    Underselection of exposed cases. In this scenario, there is a higher likelihood of selecting cases who do not use mobile telephones than those who do. This could occur if mobile phone among use was in fact related to disease severity. Case participation was set at 60% for users and 90% for non-users in this scenario. In the absence of existing data to guide this scenario, these percentages were based on assumed values.

  3. 3

    Underselection of exposed controls. In this scenario, there is a higher likelihood of selecting controls who did not use mobile phones. The percentage of users among participants was set at 64%, the percentage users among non-participants at 80%. Again, there was no existing data to base this scenario on, and these percentages were assumed values.


Recall Bias

Non-differential Random Error

The effects of non-differential random recall error on cancer risk estimates are summarized in Table 2 for both cumulative number of calls and call duration. For both exposure measures, the estimated OR was virtually unbiased in the case of no error. The dispersion of the sampling distribution of the estimated OR was limited; for example, 95% of the estimates obtained in the 5000 simulated samples fell in the range 1.08–1.13 when the OR=1.1 per 10,000 calls. In the absence of recall error, coverage probabilities were close to 95% for all values of the true OR considered.

Table 2 Effects of non-differential recall error on estimates of risk.

The presence of random exposure measurement error had the well-known effect of biasing the OR towards the null value of unity. For cumulative number of calls, random error of the most likely magnitude (σ=0.95) led to a reduction in the true OR per 10,000 calls from 1.1 to 1.05, from 1.2 to 1.12 and from 1.4 to 1.24. The relative bias values shown in Table 2 demonstrate that these are reductions of between 40% and 50% in the amount the OR exceeds one. Using the most extreme σ from the validation studies (σ=1.30), ORs were reduced to 1.02, 1.07, and 1.14, respectively, with relative biases of 66% to 77%. Coverage probabilities degraded rapidly with increasing random exposure error, with virtually none of the confidence limits encompassing the true OR when σ=0.95 or 1.30.

The results of analyses of duration of calls were qualitatively similar to those reported above for the cumulative number of calls (Table 2). However, as call duration exhibited greater random error than did the number of calls, the attenuation of risk estimates towards the null hypothesis was greater than that using cumulative number of calls as the exposure metric. For example, for the largest value of σ=1.39, the average OR was estimated to be 1.21, notably lower than the true OR of 1.7. This corresponds to a relative bias of close to 70%.

Non-differential Systematic Error

The effects of non-differential systematic recall error are shown in Table 3, in the presence of a fixed level of random error. The mean μ of the error distribution for cumulative number of calls varied, on the log-scale, between −0.49, −0.11, and 0.47, translating to 39% underestimation, 10% underestimation, and 60% overestimation of exposures, respectively, when values were antilogged. As expected, underestimation of number of calls increased ORs, whereas overestimation decreased the ORs. Changes in the OR are relatively small compared to the changes found in Table 2 with the introduction of random error only. For example, for the true OR of 1.2 per 10,000 calls, the estimated OR varied from 1.20 with underestimation to 1.07 with overestimation. The corresponding relative bias ranged from 2.1% to 63%. For true ORs of 1.1 and 1.4 per 10,000 calls, similar conclusions can be drawn. Also shown is a scenario with a much smaller (but probably unrealistic) (σ=0.1). In this case, the effect of changing μ is more pronounced: if subjects underestimate number of calls (μ=−0.49), the OR increases from 1.2 to 1.35; if subjects overestimate number of calls (μ=0.47), the OR decreases from 1.2 to 1.12.

Table 3 Effects of non-differential systematic recall error on estimates of risk.

Results for cumulative call duration were again similar to those for cumulative number of calls. Attenuation towards the null was again greater because of greater levels of overestimation of exposure modeled. In all scenarios, the relative bias is between 70% and 80% with the most likely value of overestimation, and reaches 88% when the largest overestimation error is modeled.

Differential Random Error

Differential random error between cases and controls appears to have a small impact on the risk estimates (Table 4). For a true OR of 1.0, a slight upwards bias of the estimated OR is observed, with the OR increasing to 1.03 when cases are assigned a three times larger random error than controls. For ORs greater than 1.0, the bias is towards the null value. This bias increases slightly with increasing differential random error when true ORs are greater than 1.1. For example, the true OR of 1.2 per 10,000 calls decreases from 1.12 when cases and controls have the same random error to 1.09 when the random error in cases is three times that in controls. The corresponding relative bias in the OR increased to a maximum of 60% for number of calls and 76% for duration of calls for the largest random error in cases.

Table 4 Effects of differential random recall error on estimates of risk.

Differential Systematic Error

The effects of differences in systematic recall error between cases and controls are shown in Table 5. Random error is held at a constant level among cases and controls. Although controls are not subject to systematic exposure measurement error, cases are subject to underestimation or overestimation of exposure. Results of these scenarios show that the effect of varying the systematic bias (μ) in cases is very small compared to the effect of the large random error (σ) that exists for both cases and controls. Estimated ORs and relative bias show very little variation, whether cases under- or overestimated their phone use. The most important effect continues to be the bias in risk estimates towards the null hypothesis induced by the presence of random error when the true OR is greater than 1.0. For a true OR of 1, the observed OR varies from a slight decrease (OR=0.97 for number of calls and 0.98 for duration of calls) to a slight increase (1.02 for both).

Table 5 Effects of differential systematic recall error on estimates of risk.

Selection Bias

Table 6 shows ORs for dichotomous exposure (ever/never use of mobile phones) corrected for selection bias. In the first scenario (underselection of unexposed controls), the true OR of 1.2 is reduced to values between 0.87 and 1.03, depending on the level of participation of controls. Even at the highest participation rate of 75% among controls, the OR is reduced from 1.2 to 1.03. More extreme underselection of unexposed controls gives measured ORs between 0.56 and 0.85. In the scenario with the same underselection of unexposed controls as in the first scenario, but with underselection of exposed cases, the reduction in the OR due to selection bias is even more pronounced. In the last scenario (underselection of exposed controls), the OR is notably increased, particularly when the participation rate among controls is only 45% (measured OR=1.80).

Table 6 Impact of selection bias on ORs for dichotomous exposure (user/non-user) — analytical correction.

As the selection bias factor in Table 6 is independent of the true OR, the measured OR can be calculated by multiplying any other value of the true OR by the selection bias factor. For a true OR of 1 therefore, the measured OR will be equal to the selection bias factors shown in Table 6.

Table 7 summarizes the effect of different selection bias scenarios on ORs for continuous exposure and those for exposure categories. The true OR for continuous exposure of 1.2 per 10,000 calls changes relatively little when selection bias is introduced. The most extreme scenario of underselection of unexposed controls combined with a low, 45%, participation rate in controls reduces the OR to 1.16. In all other scenarios, OR estimates are closer to the true value of 1.2. Estimates of the OR in categories of exposure compared to the baseline of non-users, however, show more clearly the effects of selection bias on the shape of the exposure–response relationship. For all scenarios in which users are more likely to participate than non-users among controls, the exposure–response relationship becomes J-shaped when selection bias is introduced: ORs for all categories of exposure are reduced and the ORs for lower exposures (below the 90th percentile) are almost all below 1. For example, the first, and least extreme, scenario gives ORs of 0.74, 0.79, 0.93, and 7.18, respectively, in the four exposure categories when the participation rate is 45% (Table 7, Figure 1). This compares to values of 1.02, 1.10, 1.30, and 9.88 when there is no selection bias. Qualitatively similar results were obtained with more extreme underselection of unexposed controls, and when overselection of exposed controls is combined with under-representation of exposed cases (Table 7). The OR for the highest exposure category (>90th percentile) is never reduced below 4.7 (in the scenario of extreme underselection of unexposed controls), with the 2.5th percentile never falling below 1. The ORs increase when exposed controls are underselected; these effects are again more pronounced for categorical as compared to continuous exposures (Table 7).

Table 7 Impact of selection bias on ORs for continuous and categorical exposure — simulation results.
Figure 1

J-shaped exposure–response relationship in the case of underselection of unexposed controls, based on 64% users among participants, 50% among non-participants. (see Table 7 for values of the ORs).

Selection bias has a much greater effect on risk estimates based on categorical exposures than those based on continuous exposures, presumably because of the dominant effect of highly exposed individuals in estimating the slope of the exposure–response curve in the latter case. This positive slope is maintained even though the ORs are less than unity in the lower exposure categories.

Table 7 also shows the results of simulations with a true OR of 1.0, under the most likely scenario of underselection of unexposed controls. As expected, all the categorical ORs within one scenario are reduced by the same factor with no apparent exposure–response relationship.


Case–control studies of mobile phones and cancer risk can be subject to recall bias and uncertainty due to inaccurate recall of mobile phone use by the study subjects, and to selection bias related to non-participation. In this article, we have evaluated the possible effects of errors in recall and of selection bias on estimates of risk in such studies. These sensitivity analyses were based, where possible, on plausible assumptions on levels of error from existing validation studies and from non-response questionnaires, and therefore give realistic indications of the direction and magnitude of possible bias in such studies.

Recall Bias

Our results suggest that plausible levels of non-differential random errors in the recall of amount of phone use can lead to substantial underestimation of cancer risk associated with mobile phone use when the true OR is greater than 1.0. Reductions of up to 30% in the OR estimate are seen in the most extreme scenarios with only random error. Further, the findings indicate that these random errors can have a greater impact on risk estimates than plausible levels of non-differential systematic error. Our results also show that bias due to differential levels of under- or overestimation of phone use by cases and controls is very small compared to the bias owing to the levels of random error simulated. In fact, the estimated ORs varied very little depending on whether cases under- or overestimated their amount of phone use, even though a relatively wide range of values was modeled. The net effect of combining non-differential random error and differential recall bias was still to substantially reduce the estimated OR. Our simulation results also indicate that, when the true OR is 1.0, differential random error can lead to small spurious associations between exposure and outcome when the random error among cases is much greater than among controls.

It has previously been documented in sensitivity analyses of dichotomous exposures that even large differences in the accuracy of recall between cases and controls may have only minor impact on the results of a study (Drews and Greenland, 1990), and that differential recall bias may not always give upwardly biased results (Greenland, 1996). These results are similar to those found in the present analysis of differential systematic error with a continuous exposure metric.

Validation studies carried out as part of INTERPHONE provided the prior plausible distributions of random and systematic recall errors used in the simulations. These validation studies used volunteer subjects, evaluated only short-term (6 months) recall, and did not provide information on possible differential recall between cases and controls (Vrijheid et al., 2006). Errors in long-term recall of case–control study subjects may be larger than those measured short-term in the volunteer study. However, scenarios of extreme recall errors, taken from the most extreme country-specific results of the validation study, were modeled so that a range of errors could be evaluated. These validation studies did not provide any information about possible differences in recall between cases and controls. There are examples in epidemiological studies where recall bias occurs owing to under-reporting of exposure by control subjects or over-reporting by case subjects. It is not self-evident that this is the case in studies of brain cancer risk and mobile phone use: brain cancer cases may, owing to their condition, recall less phone use or recall their use less accurately than controls. The validation studies showed a tendency for volunteers to underestimate the number of phone calls they made, but to overestimate the duration of phone calls (Vrijheid et al., 2006). As a consequence, the direction of any bias may also depend on the exposure metric used. In any case, the scenarios modeled showed very little impact of differential recall bias in the presence of the substantial random error. Even when cases overestimated call duration by a factor of 2.5 and the controls did not overestimate or underestimate call duration, the OR for a continuous exposure hardly changed. This indicates that very extreme levels of differential systematic bias would be needed to substantially change the risk estimates for continuous exposure in this type of study.

As part of INTERPHONE, historical billing records of case–control subjects are being collected from phone service providers in a few participating countries to provide information on the possibility of differential recall between brain tumor cases and healthy controls. These data will provide important additional information on the plausibility of the differential recall bias scenarios modeled in the current sensitivity analyses.

Selection bias

Our results suggest that selection bias resulting from differential participation in the study by exposed and non-exposed cases and controls can lead to J-shaped exposure–response patterns when the true OR is greater than 1.0, with risk apparently decreasing at low to moderate exposure levels. In the most recent studies, including significant numbers of long-term users, ORs below unity have been reported (cf. Christensen et al., 2005; Lönn et al., 2005; Schoemaker et al., 2005, Hepworth et al., 2006, Schüz et al., 2006). This could be explained by selection bias, as observed in our simulations. These studies categorized exposure into quartiles and given the very skewed distribution of exposure of mobile phone use, it is possible that an increase such as that seen in our simulations only in the highest decile could have been missed.

The effect of the selection bias depends on the participation rates and on the distribution of exposure between participants and non-participants. The mobile phone use rates among participating and non-participating controls in our sensitivity analyses were based on data from non-response questionnaires from the INTERPHONE study. For cases we assumed two different scenarios, one where participants and non-participants were equally likely to use mobile phones, and one where mobile phone use was more likely among non-participants. The scenario where mobile phone use rates in participating and non-participating cases are identical to those in participating and non-participating controls was not modeled, as this would not lead to selection bias. In the Finnish study by Lahkola et al. (2005), mobile phone use was higher among participants than among non-participants. However, the difference in mobile phone use rates between participants and non-participants was similar among cases and controls, and did not lead to substantial bias in estimates of risk. The scenarios modeled in the present paper are more extreme than either of these two situations, and may therefore lead to greater bias than may be observed in practice. Further, we only modeled scenarios where selection into the study was related to whether or not the subject was a mobile phone user, not to the amount of phone use. Refinements of the current sensitivity analyses, using selection probabilities that depend on the amount of use, could be envisaged.


Although we have attempted to base our simulations on conditions that may be encountered in practice, our findings should only be considered as indicative as we have had to make some assumptions about the underlying recall and selection bias models. Nonetheless, we believe that the present findings are realistic and will be of value in guiding the interpretation of the forthcoming INTERPHONE study results.

Confidence limits on the OR for cancer in relation to mobile phone use were relatively narrow in our simulation study. This occurs for three reasons. First, the data are generated under a perfectly specified logistic regression model, and analysed using this same model. Second, while the model takes into account interindividual variation in cancer risk, it is assumed that mobile phone use is the only covariate affecting individual risk. In practice, additional covariates, such as lifestyle, environmental, and genetic risk factors, will also determine individual cancer risk. Third, risk estimates based on the estimated slope of the exposure–response relationship using an essentially continuous exposure measure such as cumulative number of calls or cumulative call duration (representing the majority of estimates considered in this article) can be expected to demonstrate less uncertainty than risk estimates calculated within specific categories of exposure. Because the confidence limits were narrow, the lower confidence limit on the true OR almost always exceeded the null value of unity, resulting in virtually 100% power for detecting even the lowest postulated elevated OR of 1.1 regardless of the magnitude of random error. Because additional variability is expected in real data sets, the impact of the both random and systematic errors on statistical power to detect an increased risk is not clear. It is unlikely, however, that the power would remain as high as observed in these simulations.

Correcting for Recall Bias

If the degree of random and systematic recall error can be estimated with reasonable accuracy, it is possible to adjust for the presence of such error using statistical techniques such as regression calibration or simulation extrapolation (Fung and Krewski, 1999a, 1999b; Mallick et al., 2002; Carroll et al., 1995). Such adjustments have been made in recent case–control studies of the association between residential radon exposure and lung cancer risk (Darby et al., 2005). Using the results of the present study as a guide, supplementary analyses will be carried out in INTERPHONE adjusting for measurement error and results compared with those of the main unadjusted analyses.


In conclusion, the analyses reported in this paper demonstrate the effects of both recall and selection bias in case–control studies of mobile phone use and cancer. The present results, in conjunction with those of the validation studies conducted within the INTERPHONE study, will play an important role in the interpretation of existing and future case–control studies of mobile phone use and cancer risk, including the INTERPHONE study.


  1. AFSSE: Agence Française de Sécurité Sanitaire et Environnementale. AFSSE Opinion on Mobile Telephony. AFSSE, Maisons-Alfort, France, 18 May 2005. Available at

  2. AGNIR: Advisory Group on Non-ionising Radiation. Health Effects from Radiofrequency Electromagnetic Fields. Report of an Advisory Group on Non-ionising Radiation.. Doc NRPB, Chilton, Didcot, UK, 2003: 14 (2): 1–178. Available at

  3. Ahlbom A ., Green A ., Kheifets L ., Savitz D ., Swerdlow A ., and ICNIRP (International Commission for Non-Ionizing Radiation Protection) Standing Committee on Epidemiology Epidemiology of health effects of radiofrequency exposure. Environ Health Perspect 2004: 112: 1741–1754.

    Article  Google Scholar 

  4. Armstrong B.G . Effect of measurement error on epidemiological studies of environmental and occupational exposures. Occup Environ Med 1998: 55: 651–656.

    CAS  Article  Google Scholar 

  5. Auvinen A ., Hietanen M ., and Luukonen R ., et al. Brain tumors and salivary gland cancers among cellular telephone users. Epidemiology 2002: 13: 356–359.

    Article  Google Scholar 

  6. Birkett N.J . Effect of nondifferential misclassification on estimates of odds ratios with multiple levels of exposure. Am J Epidemiol 1992: 136: 356–362.

    CAS  Article  Google Scholar 

  7. British Medical Association: Board of Science and Education. Mobile phones and Health: An interim Report. BMA Publications Unit, London, 2001, pp. 1–19.

  8. Cardis E ., and Kilkenny M . International case–control study of adult brain, head and neck tumours: results of the feasibility study. Radiat Prot Dosimetry 1999: 83: 179–183.

    Article  Google Scholar 

  9. Cardis E ., and Kilkenny M . INTERPHONE International Case Control Study of Tumours of the Brain and Salivary Glands, Protocol rev. 1, IARC Internal Report 01/002. International Agency for Research on Cancer, Lyon, 2001, pp. 1–74.

    Google Scholar 

  10. Carroll R.J ., Ruppert D ., and Stefanski L.A . Measurement Error in Nonlinear Models. Chapman & Hall, London, 1995.

    Book  Google Scholar 

  11. Christensen H.C ., Schüz J ., Kosteljanetz M ., Poulsen S.H ., Boice Jr J.D ., McLaughlin J.K ., and Johansen C . Cellular telephones and risk of brain tumors. Neurology 2005: 64: 1189–1195.

    Article  Google Scholar 

  12. Christensen H.C ., Schüz J ., Kosteljanetz M ., Poulsen S.H ., Thomsen J ., and Johansen C . Cellular telephone use and risk of acoustic neuroma. Am J Epidemiol 2004: 159: 277–283.

    Article  Google Scholar 

  13. Darby S ., Hill D ., Auvinen A ., Barros-Dios J.M ., Baysson H ., Bochicchio F ., Deo H ., Falk R ., Forastiere F ., Hakama M ., Heid I ., Kreienbrock L ., Kreuzer M ., Lagarde F ., Mäkeläinen I ., Muirhead C ., Oberaigner W ., Pershagen G ., Ruano-Ravina A ., Ruosteenoja E ., Schaffrath Rosario A ., Tirmarche M ., Tomášek L ., Whitley E ., Wichmann H.-E ., Doll R ., Deo H ., Falk R ., Forastiere F ., Hakama M ., Heid I ., Kreienbrock L ., Kreuzer M ., Lagarde F ., Mäkeläinen I ., Muirhead C ., Oberaigner W ., Pershagen G ., Ruano-Ravina A ., Ruosteenoja E ., Schaffrath Rosario A ., Tirmarche M ., Tomášek L ., Whitley E ., Wichmann H.-E ., and Doll R . Radon in homes and risk of lung cancer: collaborative analysis of individual data from 13 European case–control studies. Br Med J 2005: 330: 223–226.

    CAS  Article  Google Scholar 

  14. Dosemeci M ., and Stewart P.A . Recommendations for reducing the effects of exposure misclassification on relative risk estimates. Occup Hyg 1996: 3: 169–176.

    CAS  Google Scholar 

  15. Dosemeci M ., Wacholder S ., and Lubin J.H . Does nondifferential misclassification of exposure always bias a true effect toward the null value? Am J Epidemiol 1990: 132: 746–748.

    CAS  Article  Google Scholar 

  16. Drews C.D ., and Greenland S . The impact of differential recall on the results of case–control studies. Int J Epidemiol 1990: 19: 1107–1112.

    CAS  Article  Google Scholar 

  17. Dreyer N.A ., Loughlin J.E ., and Rothman K.J . Cause-specific mortality in cellular telephone users. J Am Med Assoc 1999: 282: 1814–1816.

    CAS  Article  Google Scholar 

  18. Elwood J.M . A critical review of epidemiologic studies of radiofrequency exposure and human cancers. Environ Health Perspect 1999: 107 (Suppl 1): 155–168.

    Article  Google Scholar 

  19. Fung K ., and Krewski D . Evaluation of quasi-likelihood, regression calibration, and SIMEX methods in logistic regression when one of the predictors is subject to additive measurement error. J Epidemiol Biostat 1999a: 4: 65–74.

    CAS  PubMed  Google Scholar 

  20. Fung K.Y ., and Krewski D . On measurement error adjustment methods in Poisson regression. Environmetrics 1999b: 10: 213–224.

    Article  Google Scholar 

  21. Greenland S . Basic methods for sensitivity analysis of biases. In J Epidemiol 1996: 25: 1107–1116.

    CAS  Google Scholar 

  22. Habash R.W.Y ., Brodsky L.M ., Leiss W ., Krewski D ., and Repacholi M . Health risks of electromagnetic fields. Part II: Evaluation and assessment of radio frequency radiation. Crit Rev Biomed Eng 2003: 31: 197–254.

    Article  Google Scholar 

  23. Hardell L ., Carlberg M ., and Mild K.H . Case–control study on cellular and cordless telephones and the risk for acoustic neuroma or meningioma in patients diagnosed 2000–2003. Neuroepidemiology 2005: 25: 120–128.

    Article  Google Scholar 

  24. Hardell L ., Carlberg M ., and Mild K.H . Case–control study of the association between the use of cellular and cordless telephones and malignant brain tumors diagnosed during 2000–2003. Environ Res 2006: 100: 232–241.

    CAS  Article  Google Scholar 

  25. Hardell L ., Hallquist A ., Mild K.H ., Carlberg M ., Pahlson A ., and Lilja A . Cellular and cordless telephones and the risk for brain tumors. Eur J Cancer Prev 2002a: 11: 377–386.

    CAS  Article  Google Scholar 

  26. Hardell L ., Mild K.H ., and Carlberg M . Case–control study on the use of cellular and cordless phones and the risk for malignant brain tumors. Int J Radiat Biol 2002b: 78: 931–936.

    CAS  Article  Google Scholar 

  27. Hardell L ., Mild K.H ., and Carlberg M . Further aspects on cellular and cordless telephones and brain tumors. Int J Oncol 2003a: 22: 399–407.

    PubMed  Google Scholar 

  28. Hardell L ., Mild K.H ., Påhlson A ., and Hallquist A . Ionizing radiation, cellular telephones and the risk for brain tumours. Eur J Cancer Prev 2001: 10: 523–529.

    CAS  Article  Google Scholar 

  29. Hardell L ., Mild K.H ., Sandstrom M ., Carlberg M ., Hallquist A ., and Pahlson A . Vestibular schwannoma, tinnitus and cellular telephones. Neuroepidemiology 2003b: 22: 124–129.

    Article  Google Scholar 

  30. Hardell L ., Näsman Å ., Påhlson A ., and Hallquist A . Case–control study on radiology work, medical X-ray investigations, and use of cellular telephones as risk factors for brain tumors. MedGenMed 2000. Available at

  31. Hardell L ., Nasman A ., Pahlson A ., Hallquist A ., and Mild K.H . Use of cellular telephones and the risk for brain tumours: A case–control study. Int J Oncol 1999: 15: 113–116.

    CAS  PubMed  Google Scholar 

  32. Hepworth S ., Schoemaker M.J ., Muir K ., Swerdlow AJ ., van Tongeren M.J.A ., and McKinney P.A . Mobile phone use and risk of glioma in adults: case–control study. Br Med J 2006: 332: 883–887.

    Article  Google Scholar 

  33. IEGMP: International Expert Group on Mobile Phones. Mobile Phones and Health. Report of the Independent Expert Group on Mobile Phones (Chairman: Sir William Stewart). C/o National Radiological Protection Board, Chilton, Didcot, U.K., 2000. Available at

  34. Inskip P.D ., Tarone R.E ., Hatch E.E ., Wilcosky T.C ., Shapiro W.R ., Selker R.G ., Fine H.A ., Black P.M ., Loeffler J.S ., and Linet M.S . Cellular-telephone use and brain tumors. N Engl J Med 2001: 344: 79–86.

    CAS  Article  Google Scholar 

  35. Johansen C ., Boice Jr J ., McLaughlin J ., and Olsen J. Cellular telephones and cancer-a nationwide cohort study in Denmark. J Natl Cancer Inst 2001: 93: 203–207.

    CAS  Article  Google Scholar 

  36. Krewski D ., Byus C ., Glickman B.W ., Habash R.W.Y ., Habbick B ., Lotz W.G ., Mandeville R ., McBride M ., Prato F.S ., Salem T ., Stuchley M ., and Weaver D.F . Recent advances in radio-frequency fields and health: 2001–2003. J Toxicol Environ Health 2006. (in press).

  37. Krewski D ., Byus C ., Glickman B.W ., Lotz W.G ., Mandeville R ., McBride M ., Prato F.S ., and Weaver D.F . Potential health risks of radiofrequency fields from wireless telecommunications devices. J Toxicol Environ Health 2001a: B4: 1–143.

    Article  Google Scholar 

  38. Krewski D ., Byus C ., Glickman B.W ., Lotz W.G ., Mandeville R ., McBride M ., Prato F.S ., and Weaver D.F . Recent advances in radiofrequency fields and health. J Toxicol Environ Health 2001b: B4: 145–159.

    Article  Google Scholar 

  39. Lahkola A ., Salminen T ., and Auvinen A . Selection bias due to differential participation in a case–control study of mobile phone use and brain tumours. Ann Epidemiol 2005: 15: 321–325.

    Article  Google Scholar 

  40. Lönn S ., Ahlbom A ., Hall P ., and Feychting M . Mobile phone use and risk of acoustic neuroma. Epidemiology 2004: 15: 653–659.

    Article  Google Scholar 

  41. Lönn S ., Ahlbom A ., Hall P ., Feychting M ., and the Swedish Interphone Study Group Long-term mobile phone use and brain tumor risk. Am J Epidemiol 2005: 161: 526–535.

    Article  Google Scholar 

  42. Mallick R ., Fung K ., and Krewski D . Adjusting for measurement error in the Cox proportional hazards regression model. J Cancer Epidemiol Prev 2002: 7: 155–164.

    CAS  PubMed  Google Scholar 

  43. Muscat J.E ., Malkin M.G ., Shore R.E ., Thompson S ., Neugut A.I ., Stellman S.D ., and Bruce J . Handheld cellular telephones and risk of acoustic neuroma. Neurology 2002: 58: 1304–1306.

    CAS  Article  Google Scholar 

  44. Muscat J.E ., Malkin M.G ., Thompson S ., Shore R.E ., Stellman S.D ., McRee D ., Neugut A.I ., and Wynder E.L . Handheld cellular telephone use and risk of brain cancer. J Am Med Assoc 2000: 284: 3001–3007.

    CAS  Article  Google Scholar 

  45. Rothman K.J ., and Greenland S . Modern Epidemiology. 2nd ed. Lippincott Williams & Wilkins, Philadelphia, 1998.

    Google Scholar 

  46. Rothman K.J ., Loughlin J.E ., Funch D.P ., and Dreyer N.A . Overall mortality of cellular telephone customers. Epidemiology 1996: 7: 303–305.

    CAS  Article  Google Scholar 

  47. Schoemaker M.J ., Swerdlow A.J ., Ahlbom A ., Auvinen A ., Blaasaas K.G ., Cardis E ., Christensen H.C ., Feychting M ., Hepworth S.J ., Johansen C ., Klaeboe L ., Lonn S ., McKinney P.A ., Muir K ., Raitanen J ., Salminen T ., Thomsen J ., and Tynes T . Mobile phone use and risk of acoustic neuroma: results of the INTERPHONE case–control study in five North European countries. Br J Cancer 2005: 93: 842–848.

    CAS  Article  Google Scholar 

  48. Schüz J ., Böhler E ., Berg G ., Schlehofer B ., Hettinger I ., Schlaefer K ., Wahrendorf J ., Kunna-Grass K ., and Blettner M . Cellular phones, cordless phones, and the risks of glioma and meningioma (interphone study group, Germany). Am J Epidemiol 2006: 163: 512–520.

    Article  Google Scholar 

  49. Sienkiewicz Z.J ., and Kowalczuk C.I.A . Summary of Recent Reports on Mobile Phones and Health (2000–2004). NRPB-W65, National Radiological Protection Board, Chilton, Didcot, U.K., 2005, pp. 1–38.

    Google Scholar 

  50. Stang A ., Anastassiou G ., Ahrens W ., Bromen K ., Bornfeld N ., and Jockel K.H . The possible role of radiofrequency radiation in the development of uveal melanoma. Epidemiology 2001: 12: 7–12.

    CAS  Article  Google Scholar 

  51. Steenland K ., and Greenland S . Monte–Carlo sensitivity analysis and Baysian analysis of smoking as an unmeasured confounder in a study of silica and lung cancer. Am J Epidemiol 2004: 160: 384–392.

    Article  Google Scholar 

  52. Vrijheid M ., Cardis E ., Armstrong B.K ., Auvinen A ., Berg G ., Blaasaas K.G ., Brown J ., Carroll M ., Chetrit A ., Christensen H.C ., Deltour I ., Feychting M ., Giles G.G ., Hepworth S.J ., Hours M ., Iavarone I ., Johansen C ., Klæboe L ., Kurttio P ., Lagorio S ., Lönn S ., McKinney P.A ., Montestrucq L ., Parslow R.C ., Richardson L ., Sadetzki S ., Salminen T ., Schüz J ., Tynes T ., Woodward A ., and for the Interphone Study Group Validation of short-term recall of mobile phone use for the Interphone Study. Occup Environ Med 2006: 63: 237–243.

    CAS  Article  Google Scholar 

Download references


This work was supported in part by grants from the European Union Fifth Framework Program, “Quality of Life and Management of living Resources” (contract QLK4-CT-1999-01563) and the International Union against Cancer (UICC), and national funding sources. The UICC received funds for this purpose from the Mobile Manufacturers’ Forum and GSM Association. Provision of funds to the INTERPHONE study investigators via the UICC was governed by agreements that guaranteed INTERPHONE's complete scientific independence. These agreements are publicly available at

D Krewski is the NSERC/SSHRC/McLaughlin Chair in Population Health Risk Assessment at the University of Ottawa, and a Visiting Scientist at the International Agency for Research on Cancer.

Author information



Corresponding author

Correspondence to Martine Vrijheid.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Vrijheid, M., Deltour, I., Krewski, D. et al. The effects of recall errors and of selection bias in epidemiologic studies of mobile phone use and cancer risk. J Expo Sci Environ Epidemiol 16, 371–384 (2006).

Download citation


  • mobile phones
  • recall bias
  • measurement error
  • selection bias
  • sensitivity analyses
  • Monte–Carlo simulations
  • case–control studies

Further reading


Quick links