Main

The placebo has been defined as a pharmacological inert substance and the placebo effect as “any effects attributable to a pill, potion or procedure, but not to its pharmacodynamics or specifics properties” (1). Its use in clinical trials became the mean to control for psychological effects associated to the administration of a substance. Researchers soon became aware that the administration of a placebo could result into a relief or an improvement of symptoms. Such effect became known as the placebo effect (2). Placebo effect is usually measured in randomized controlled trials by the nonblinded comparison between placebo and no-treatment groups (3). Consequently, the true effect of placebo interventions is potentially biased by the type of outcomes, cointervention, selective publication, and reporting (4). Placebo research is not limited, however, to the field of clinical trials, and has expanded to the field of neurobiology. Pharmacology, brain imaging techniques, genetics, and animal models have shown, for instance, the capacity of the placebo to mimic active drugs and activate the same brain areas (5), the association of the placebo response with some genotypes in some conditions, and the important role of prefrontal cortex functioning impairment in reducing placebo response (6). The similarity in the mechanism of action between the placebo and the active substance can be explained partly by Pavlovian conditioning or learning by patients of the effect of the active drug (7), and also by expectation, social propagation of expectations, or the Hawthorn effect (5).

Since 1955 with Beecher’s statement on the high degree of therapeutic efficacy of placebos (8), the placebo effect, also known as the “true” placebo effect, has been misinterpreted and confounded with the “perceived placebo effect” (9). The perceived placebo effect, the term we will use in this article to avoid any confusion with the placebo effect, equals the “true” placebo effect (10,11) plus other factors that may explain the improvement or worsening of the patients’ outcomes in the placebo arm of clinical trials. Those factors include the natural history with the potential of spontaneous regression of the disease, the regression to the mean, the use of concomitant treatments, the experimental subordination, the conditioned responses, and other unknown factors. Experimental subordination means that the subject learns what the expected effects could be and this conditions his actual response.

As it seems difficult to conduct research in children without direct therapeutic benefits, the placebo effect has been commonly measured from adult trials with a placebo group vs. an untreated group. For instance, a meta-analysis focusing on placebo interventions included 202 randomized placebo trials with a no-treatment control group. Authors showed that there was a significant overall effect of placebo and found that placebo interventions can influence patient-reported outcomes. Among the 202 trials, 21 (10.4%) included pediatric subjects, and one included newborns. There were no significant differences between the placebo and no-treatment group for 16 of the pediatric trials, 3 showed a significant difference and 2 had no exploitable outcomes (3). Another narrative review identified 9,000 citations using the terms “placebo” and “children”, among which only 50 (2.5%) studied, but not measured, the perceived placebo effect in children (12).

Because the perceived placebo effect has been mostly studied in adults, its extent is often extrapolated from adults to children. Children and adults, however, differ in terms of physiological development, physiopathology, pharmacokinetics, and pharmacodynamics but probably also in terms of perceived placebo effect (13,14). A recent meta-analysis of antiepileptics suggests that the perceived placebo effect might be higher in children than in adults (15). The authors measured the perceived placebo effect by measuring the difference between the proportion of responders between the start and end of the study in the placebo group. The difference between children and adults could be attributed to a greater regression to the mean in children or to a strong placebo-by-proxy effect. Placebo-by-proxy effect occurs when children are receiving more attention and parents are more eager to report favorable outcomes in the pediatric population (15,16,17).

In this study, we aimed at exploring the differential perceived placebo effect between adults and children in all available published meta-analyses. The main objective of this systematic review of reviews is to confirm a potential more favorable perceived placebo effect in children compared with adults.

Results

We identified 3,484 reviews. After screening of titles and abstracts, and the exclusion of irrelevant and duplicates, 762 reviews were screened ( Figure 1 ). Seventy-five reviews, not reporting the difference between the start and end of the study, were also excluded. Thirty-five reviews, including 179 trials with adult and 117 with pediatric participants, were finally analyzed (15,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51) (Supplementary Table S1 online). From these reviews, 19 assessed the risk of bias (18,20,22,25,26,28,29,32,35,37,38,39,40,41,44,46,49,50,51), 6 reported only the Jadad score (15,19,21,36,45,48), 4 assessed only the allocation concealment (34,42,43,47), and 6 did not assess quality (23,24,27,30,31,33). Overall, 13 382 adult and 5 417 pediatric participants were enrolled in the placebo groups.

Figure 1
figure 1

Flowchart of the literature search.

PowerPoint slide

Results for Continuous Outcomes

Two hundred fourteen trials were included, 126 in adults and 88 in children, covering 13 different therapeutic indications. The three most common therapeutic indications were asthma (62 trials), exercise-induced asthma (54 trials), and atopic dermatitis (24 trials) ( Table 1 ). Crossover exercise-induced asthma trials (50 trials) did not report results for each period.

Table 1 Characteristics of included randomized controlled trials

Overall, children’s (standardized mean change −0.32; 95% CI (−0.52; −0.12)) and adults’ (standardized mean change −0.11; 95% CI (−0.24; 0.02)) outcomes deteriorated with placebo with no significant difference between children and adults (β = −0.20; P = 0.30; Figure 2 ; Supplementary Table S2 online and Supplementary Figure S1 online).

Figure 2
figure 2

Linear regression of the perceived placebo effect in children compared with adults for continuous outcomes. Each circle represents pooled data from pediatric (x-axis) and adult (y-axis) studies for the same disease and with the same drug. When the circle is above the diagonal (dashed line) the perceived placebo effect is lower and when it is below, higher, in children compared with adults.

PowerPoint slide

Sensitivity Analysis for Continuous Outcomes

The sensitivity analyses showed a significant difference between adults’ and children’s perceived placebo effect when only crossover trials (β = 0.5; P = 0.03) and only objective outcomes (β = −0.67; P = 0.003) were included. For crossover trials and objective outcomes, children and adults showed an unfavorable effect with placebo. Perceived placebo effect remained unchanged for each stratum of diseases (Supplementary Table S2 online and Supplementary Figure S1 online).

Results for Binary Outcomes

Eighty-two trials, 53 in adults and 29 in children, reported binary outcomes in 6 different therapeutic indications. In resistant partial epilepsy, 10 crossover trials reported only the first period. All trials that defined responders as 50% reduction in the number of seizures were in parallel groups.

Binary outcomes improved more with placebo in children (responders proportion 0.32; 95% CI (0.26; 0.39)) than in adults (responders proportion = 0.19; 95% CI (0.15; 0.23), with a significant difference between adults and children β = 0.13; P = 0.001; Figure 3 ; Supplementary Table S3 online and Supplementary Figure S2 online).

Figure 3
figure 3

Linear regression of the perceived placebo effect in children compared with adults for binary outcomes. Each circle represents pooled data from pediatric x-axis) and adult (y-axis) studies. When the circle is above the diagonal (dashed line) the perceived placebo effect is lower and when it is below, higher, in children compared with adults.

PowerPoint slide

Sensitivity Analysis for Binary Outcomes

For drug resistant partial epilepsy, children (responders proportion 0.18; 95% CI (0.14; 0.22)) improved more with placebo than adults (responders proportion 0.13; 95% CI (0.10; 0.15); with a significant difference between adults and children β = 0.06, P = 0.02; Supplementary Table S3 online and Supplementary Figure S2 online).

Other Factors than Population Influencing the Perceived Placebo Effect

The univariate meta-regression for binary outcomes showed that participants with asthma ((β = 0.36; P < 0.001), depression (β = 0.29; P < 0.001), and drug-resistant partial epilepsy (β = −0.22; P = 0.001) improved more with placebo compared with other diseases. All the trials were parallel groups and all used subjective outcomes, the univariate and multivariate meta-regression were not feasible (Supplementary Table S3 online and Supplementary Figure S2 online).

For continuous outcomes, participants with asthma ((β = 0.68; P = 0.001), atopic dermatitis (β = 1.21; P < 0.001), bipolar disorder (β = 1.21; P = 0.001) improved with placebo. Those with exercise-induced asthma (β = −2.23; P < 0.001), however, deteriorated with placebo (Supplementary Table S2 online and Supplementary Figure S1 online).

The univariate meta-regression also showed a larger improvement with placebo in parallel group (standardized mean change 0.24; 95% CI (0.14; 0.34)) compared with crossover studies (standardized mean change −1.81; 95% CI (−1.60; −2.01)), and for subjective (standardized mean change 0.75; 95% CI (0.54; 0.95)) compared with objective outcomes (standardized mean change −0.50; 95% CI (−0.61; −0.39))

In the multivariate model, population, design, and outcome, explained 64.03% of the between studies variance. The design (β = −1.83; P < 0.000), the outcome (β = −0.76; P < 0.000) significantly influenced the perceived placebo effect. The difference between children and adults remained nonsignificant in the multivariate model (β = 0.09; P = 0.526).

Discussion

In our broad overview, we found a significant difference in the perceived placebo effect between adults and children for binary outcomes. Overall, when binary outcomes are used children tend to improve more with placebo compared with adults. The results found for binary outcomes are coherent with Rheims et al. (15) study and the literature (12,16). The disease, and probably the outcomes and the design seem to influence the perceived placebo effect on binary outcomes and need to be investigated in future studies.

For continuous outcomes, we did not show any difference between adults and children on the perceived placebo effect. The perceived placebo effect seemed to be influenced by the disease, the design of the studies and by type of outcome measures. It increases when the design used was parallel groups compared with crossover as it was shown in a previous report (52). The effect observed with crossover trials for continuous outcomes could be explained by the regression to the mean potentially more important in the first compared with the second period. Patients receiving placebo during the first period may benefit from a favorable natural course of the disease and accentuate the regression to the mean (53). Also, the regression to the mean, as part of the perceived placebo effect, could be diluted by taking the mean effect with placebo regardless of the periods. Patients who receive the drug first and then the placebo may also show a higher placebo response because of a carry-over effect or a conditioning learning effect (54). To be able to investigate further the influence of the design on the perceived placebo effect the outcome measures for the different treatment periods should be analyzed, but they are rarely reported.

The larger improvement with placebo for subjective outcomes might be explained by the measurement bias when these outcomes are used to select patients participating to the trials, and by the regression to the mean (55). The way trials are conducted and patients informed can influence the placebo response (3). Another explanation could be that children show a stronger placebo-by-proxy effect (17). It has also been shown that the mood and belief of the adult caregiver can influence the placebo response in children (56). Conditioning learning plays also an important role in the response of children to the placebo. Children have greater capacity in associative learning (12). This learning process can be emphasized in crossover trials (54).

Our study has some limits. Confounding factors cannot be excluded because of the absence of randomization between compared groups. The difference between the start and end of the study in the placebo arm can also reflect the effect of concomitant treatments and the natural history of the disease. In the absence of no-treatment arm, our analysis assumes that the natural history of the disease and the effect of concomitant treatments could be similar in adults and children. Also, for binary outcomes, we were not able to explore the influence of the design and the outcomes measures on the perceived placebo effect. Furthermore, incomplete reports of crossover trials did not allow us to further explore the importance of the regression to the mean in each treatment periods. The major limit on the validity of our study is shared by other recent publications (15,16,57,58) suggesting a higher perceived placebo response in children compared with adults. In summary, our results underline that the difference observed in these reviews should be interpreted cautiously, because they are highly influenced by the disease, the design and the outcomes. It is not clear whether for binary outcomes the difference between adults and children in the perceived placebo effect could disappear when adjusting for these variables.

In order to avoid missing a potential treatment benefit, when performing randomized trials in children, calibration should take account for the design, disease, and type of outcomes.

Methods

Literature Search

The unit of research for our work was the trial and those were identified through a systematic review of meta-analyses in the literature. Three electronic databases (PubMed (US National Library of Medicine, Bethesda, Maryland), Embase (Elsevier, Amsterdam, Netherlands) and the Cochrane Library (John Wiley & Sons, Chichester, UK)) were searched for meta-analyses, with no limitation, on language, dates, diseases or treatments. The last bibliographic search was done on 11 February 2015. The following search terms were used: (Child OR preschool OR infant OR adolescent) AND adult*) AND placebo. For PubMed, we specified the type of study (“meta-analysis”). For EMBASE, we specified the following filters: “human” and “meta-analysis”.

Meta-analyses Selection

Meta-analyses were eligible when they included randomized controlled trials (RCTs) in adults and children that were double-blinded, placebo-controlled, and reported separately their results for adults and children. All types of pharmacological treatments, except for homeopathic treatments, were eligible. The age limit between adults and children, when necessary, was arbitrarily set at 18 y. The RCTs from the included meta-analyses were classified according to their therapeutic indications. When two reviews reported the same RCTs, the review with the most complete information was considered. When both reported the same information, the most recent review was considered.

Three authors (P.J., B.K., A.D.) reviewed all citation abstracts and excluded irrelevant studies according to prespecified exclusion criteria.

Data Extraction

The following information was extracted for each relevant trial included in the meta-analyses and entered into the database: (i) the design of the study (randomization, parallel group, crossover, and blinding); (ii) patient characteristics (adults or children, number of patients in the placebo and treatment arms, and the number of events and no-events in each arm for dichotomous data or the mean change from baseline to the end of study for each arms for continuous data); (iii) the disease (e.g., “asthma”); (iv) the drug used, when more than one drug was reported, data were extracted for each drug studied in the meta-analysis; (v) the drug’s therapeutic class; (vi) the outcome; (vii) the dose for adults and the dose adjustment methods for children. Duplicated placebo groups, i.e., same RCTs included in different meta-analyses, were excluded.

The main outcome and the treatment benefit (number of events or effect size in each group) were extracted blindly from the original systematic review by three authors (P.J., C.C., A.L.). Differences were resolved by consensus.

Quality Assessment

We reported the quality assessment reported by the authors of the meta-analyses for each included RCT. We used the assessments reported in meta-analyses, the Cochrane assessment of risk of bias (59), and the five-point scoring instrument developed by Jadad and Enkin (60) or both.

Outcome

We extracted the primary outcome measured at the start and end of the study for adults and children. The outcomes were classified as subjective or objective. Subjective outcomes were any outcomes that were reported by the patient or family reported scale, or were subject to measurement bias (Supplementary Table S1 online). When a biological (cholesterol, Hb) or device measurement (spirometer or body weight scale) was used, it was considered as an objective outcome.

Dealing With Missing Data

To fill out missing data, we consulted the original article and contacted authors of meta-analyses. For continuous outcome, we calculated or imputed missing values when the mean change from baseline or the SD was missing (59).

Unit of Analysis Error

The unit of analysis error occurs when dealing with crossover trials and multiple intervention groups. As we were interested in the perceived placebo effect, for crossover trials only data from the first period with placebo were considered. When the effect reported was calculated from the difference between the start and end of the study regardless of the periods (i.e., as if a parallel trial), we extracted the mean change from baseline only for the placebo periods. For multiple intervention groups, i.e., different doses vs. placebo, no adjustment was required (59).

Statistical Analysis

The perceived placebo effect was defined as the change in the outcome experienced by the patient in the placebo arms between the beginning (baseline) and the end of the trial.

For continuous outcomes, we calculated the standardized mean change and for dichotomous data the proportion of responders in the placebo arm. Standardized mean change > 0 indicates improvement and < 0 worsening of the outcomes. To assess a potential difference between children’s and adults’ perceived placebo effect; univariate random-effect restricted maximum likelihood meta-regression analyses were performed. The meta-regression analyses included the following explanatory variables defined a priori: (i) population (children under the age of 18 y coded as 1 or adults coded as 0); (ii) diseases (dummy variables created, disease of interest coded as 1 and other diseases coded as 0); (iii) design of study (crossover coded as 1 or parallel coded as 0); and (iv) type of outcome (objective coded as 1 or subjective coded as 0). The multivariate meta-regression included the population, design of the study, and outcome variables.

To adjust for multiple testing, the t-test from the Monte-Carlo permutation (with 10,000 replications) was used. When all trials were parallel groups or used only subjective outcomes, the multivariate meta-regression was not feasible. The unit of analysis was the trial. All analyses were performed using the Stata/IC12 software (StataCorp LP, College Station, TX).

Sensitivity Analyses

We conducted sensitivity analyses to test how robust are the potential differences between adults’ and children’s perceived placebo effect. At each step of the analysis, we excluded one of the following categories: crossover trials, parallel trials, trials using an objective outcome, trials using a subjective outcome. We also checked the robustness of our results for each disease separately.

Statement of Financial Support

P.J. is currently receiving a grant from GlaxoSmithKline, France, for her three years PhD at the UMR 5558 CNRS. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

Disclosure

The authors have no conflict of interest.

SUPPLEMENTARY MATERIAL

Supplementary material is linked to the online version of the paper at http://www.nature.com/pr