Interpreting clinical trial data in multiple myeloma: translating findings to the real-world setting

Article metrics


Substantial improvements in survival have been seen in multiple myeloma (MM) over recent years, associated with the introduction and widespread use of multiple novel agents and regimens, as well as the emerging treatment paradigm of continuous or long-term therapy. However, these therapies and approaches may have limitations in the community setting, associated with toxicity burden, patient burden, and other factors including cost. Consequently, despite improvements in efficacy in the rigorously controlled clinical trials setting, the same results are not always achieved in real-world practice. Furthermore, the large number of different treatment options and regimens under investigation in various MM settings precludes the feasibility of obtaining head-to-head clinical trial data, and there is a temptation to use cross-trial comparisons to evaluate data across regimens. However, multiple aspects, including patient-related, disease-related, and treatment-related factors, can influence clinical trial outcomes and lead to differences between studies that may confound direct comparisons between data. In this review, we explore the various factors requiring attention when evaluating clinical trial data across available agents/regimens, as well as other considerations that may impact the translation of these findings into everyday MM management. We also investigate discrepancies between clinical trial efficacy and real-world effectiveness through a literature review of non-clinical trial data in relapsed/refractory MM on novel agent−based regimens and evaluate these data in the context of phase 3 trial results for recently approved and commonly used regimens. We thereby demonstrate the complexity of interpreting data across clinical studies in MM, as well as between clinical studies and routine-care analyses, with the aim to help clinicians consider all the necessary issues when tailoring individual patients’ treatment approaches.


Substantial improvements in overall survival (OS) have been seen in multiple myeloma (MM) over recent years1, with data from the United States National Cancer Institute Surveillance, Epidemiology, and End Results Program demonstrating a 5-year OS rate of almost 50%2 and an increase in the 10-year OS rate among patients diagnosed in 1990 and in 2004 from 10% to 26.8%3. These improvements are associated with the introduction and widespread use of multiple novel agents and regimens4, as well as with the emerging treatment paradigm of continuous therapy or long-term maintenance therapy5,6,7,8, an approach that has been shown in clinical trials to offer prolonged survival versus fixed-duration or shorter-term therapeutic approaches6,7,8,9.

However, there is the potential for discrepancies between clinical trial efficacy, for which an intervention is studied under ideal circumstances, and real-world effectiveness, which reflects the true benefit of an intervention to patients in routine practice. This is associated with a number of factors and confounds translation of clinical trial data into the real world. For example, continuous or long-term therapy may have limitations in routine clinical practice, associated with toxicity burden, patient burden, and other factors such as cost5,10,11. Strict patient selection criteria in clinical trials is another important aspect and is the subject of a recent American Society of Clinical Oncology initiative to broaden clinical trial eligibility criteria to be more representative of patient populations12. Determination of the appropriate regimen for MM patients in clinical practice requires individualized assessment of various patient-related, disease-related, and treatment-related characteristics. The gap between efficacy and effectiveness is also associated with toxicity and comorbidity burden, patient and physician motivation, different distributions of academic versus community centers at which patients receive their treatment, strict protocol-enforced surveillance, treatment access issues, and other determinants contributing to premature discontinuation of treatment regimens outside of clinical studies.

A related issue is that relative efficacy in the clinical trial setting represents a key consideration for regimen selection. There is a temptation to use cross-trial comparisons to compare data across regimens; however, many factors can influence clinical trial outcomes, and there may be differences between studies that may confound indirect comparisons. Indirect comparisons of relative efficacy across homogeneous study populations, such as the network meta-analysis approach recently utilized to compare PFS across multiple treatment options for RRMM13, using hazard ratios (HRs) may prove more valid in this context. Nonetheless, while rigorously conducted network meta-analyses are useful to inform treatment decisions, known limitations, including publication bias, study heterogeneity, and differences in study populations and median follow-up across clinical trials, may still lead to biased estimates of the comparative treatment effects14.

This review explores the various factors that physicians need to consider when evaluating clinical trial data across agents and regimens, focusing on studies in relapsed/refractory MM (RRMM), and addresses considerations regarding how these findings will translate into everyday MM management.

Recent approvals in RRMM

Regulatory approvals based upon the results from randomized, phase 3 clinical trials remain the gold standard. Table 1 summarizes phase 3 clinical trial results for recently approved regimens for RRMM. These include monoclonal antibodies (daratumumab15,16 and elotuzumab17), proteasome inhibitors (intravenously administered [IV] carfilzomib18,19 and orally administered ixazomib20), and the histone deacetylase inhibitor panobinostat21,22. Real-world data in this setting are emerging for carfilzomib and ixazomib23,24,25,26, but such data are unfortunately limited for monoclonal antibodies27,28 and panobinostat to date29,30.

Table 1 Novel agents with new/updated approvals for the treatment of RRMM within the past 3 years, plus key efficacy findings from phase 3 studies leading to regulatory approvals

The impact of disease and patient heterogeneity on clinical outcomes

A substantial challenge in cross-study comparisons and in comparisons between clinical trials and real-world data is disease and patient heterogeneity, which may influence treatment outcomes31,32. Differences in eligibility criteria across clinical trials can result in imbalances between trial populations that can affect outcomes, as exemplified by the range of outcomes seen with the Rd ( ± placebo) comparator arms in phase 3 trials in RRMM (Table 1)15,17,19,20. Differences were seen in response rates and outcomes, with median PFS ranging from 14.9 months in ELOQUENT-2 to 18.4 months in POLLUX.

Similarly, real-world populations may have substantially different patient/disease characteristics compared with clinical trial cohorts, and thus, clinical trial outcomes may not reflect real-world experience. In a recent analysis of the CONNECT-MM registry, it was reported that up to 40% of patients treated in routine care would be ineligible for enrollment to randomized controlled trials in newly diagnosed MM due to common stringent eligibility criteria33. Importantly, this analysis showed that trial-ineligible patients had a significantly lower 3-year survival rate (63%) compared with trial-eligible patients (70%, p-value = 0.0392)33. Broadening eligibility criteria to increase the generalizability of clinical trial results is a recognized need towards more informed treatment decision-making33,34.

There are a range of prognostic patient and disease characteristics that may vary between clinical trial populations and between clinical trial and real-world cohorts, potentially driving differences in outcomes. These are reviewed below.

Geographic variations

Geographic differences in patient populations and in treatment availability may affect outcomes. In addition to the potential for drug metabolism/pharmacology to be affected by ethnic differences35, clinical presentation may differ between regions. For example, Chinese MM patients have much more advanced-stage disease at diagnosis compared with Western MM patients36. Furthermore, regional variation in therapies that patients are exposed to prior to and after trial interventions may also impact outcomes in intention-to-treat analyses of protocol therapy. For example, the use of melphalan–prednisone-based regimens is common in Europe37,38 but rare in North America, where the majority receive Rd in the non-transplant setting4. Long-term outcomes such as OS will also depend on the number of available subsequent active treatment options in a particular country or region. Given these differences, real-world outcomes with a specific regimen in a particular region may not reflect outcomes from clinical trials conducted in a geographically broader or different patient population. These aspects highlight the importance of considering the regional composition of patient populations when evaluating different clinical trial or real-world data.

Age and comorbidities

Patient age is a key predictive parameter in MM, with median OS decreasing from 6.4 years in patients aged < 50 years to 2.5 years in patients aged ≥ 80 years in one analysis of OS by age cohort1,39. The presence and extent of comorbidities are also prognostically important40,41,42,43, with greater comorbidities and poorer performance status resulting in worse responses to treatment; however, these are rarely reported in trials. Comorbidities such as diabetes (21.5% vs. 16.3%), cardiovascular disease (including hypertension, 62.0% vs. 52.7%), and some of the CRAB criteria for MM–hypercalcemia (11.0% vs. 5.5%), renal impairment (38.9% vs. 6.2%), and anemia (59.5% vs. 39.5%)–have been shown to be more common in clinical trial-ineligible versus clinical trial-eligible patients in the CONNECT-MM registry, further contributing to the gap between efficacy and effectiveness33.

Disease stage

International Staging System (ISS) stage is widely reported in MM clinical trials and frequently used as a stratification factor20 to avoid imbalances between study arms, as it has important prognostic implications. However, the relative proportions of patients with stage I, II, and III disease may vary substantially across clinical studies and may be reported at different time points, i.e., either at initial diagnosis or at study entry. For example, in the CASTOR phase 3 study of daratumumab plus bortezomib-dexamethasone in RRMM, 39%, 37.5%, and 23.5% of patients on the investigational arm had stage I, II, and III disease at screening, respectively16, whereas in the TOURMALINE-MM1 phase 3 study of ixazomib-lenalidomide-dexamethasone in RRMM the respective proportions were 64%, 24%, and 12%20. In contrast, disease staging in the ASPIRE phase 3 study of carfilzomib-lenalidomide-dexamethasone in RRMM was reported from initial MM diagnosis, at which time 17.4%, 24.4%, and 43.7% of patients had stage I, II, and III disease, respectively, with 14.5% unknown19.

Similarly, the relative proportions may vary substantially between clinical studies and real-world patient populations; in the analysis of patients in the CONNECT-MM registry, 29%/27%/22% of clinical trial-eligible patients had stage I/II/III disease, compared to 13%/22%/40% of patients ineligible for clinical trials, suggesting that real-world populations may include a greater proportion of patients with advanced-stage disease33. Such a discrepancy may result in poorer outcomes among real-world versus clinical trial populations.

More recently, the ISS has been updated to incorporate the presence of cytogenetic abnormalities and lactate dehydrogenase levels as additional prognostic factors32. Although it is suggested that the Revised-ISS is a more powerful prognostic system than the original ISS classification system, it has not been substantially implemented to date in MM; therefore, these data are not currently widely reported in clinical trials or in real-world analyses, adding another source of potential unobserved confounding.

Disease subtype

A small proportion ( < 3%) of MM patients have non-secretory disease44, which may have a variable prognosis44, whereas others have disease that is evaluable according to free light chain (FLC) levels/ratio only. Furthermore, the variability in FLC levels/ratio in patients with non-secretory MM45 and differences in FLC/light chain development during follow-up in non-secretory patients46 may result in challenges for interpretation of response and progression. Serum FLC ratio is prognostic for PFS and OS in MM, but discrepancies have been reported in FLC-based relapse versus conventional relapse, with serum FLC escape occurring a median of 3.8 months earlier than conventional relapse in 20% of patients in one retrospective investigation47. Thus, there is a potential impact on the interpretation of overall outcomes between studies that include or exclude FLC-only evaluable patients.

Renal impairment

Renal impairment is a known adverse prognostic indicator and a frequently applied exclusion criterion in clinical trials; however, as many as 59% of RRMM patients treated in routine care have a history of renal impairment (defined by ICD-9 diagnosis code, creatinine clearance < 40 mL/min, or serum creatinine > 2 mg/dL) at the time they initiate salvage therapy48. The exclusion criterion for creatinine clearance is commonly defined in clinical trial eligibility criteria as < 30 mL/min but has also been defined as < 20, < 30, or < 50 mL/min in phase 3 trials in RRMM;16,19,20 reported rates of renal impairment in phase 3 trials include 7–20% of patients with creatinine clearance < 50 mL/min18,19 and 24–27% with creatinine clearance < 60 mL/min16,17,20. Such differences in eligibility criteria and patient populations can impact outcomes and the translation of findings to the real-world setting.

Cytogenetic abnormalities

There is substantial genetic complexity in MM, and multiple primary and secondary cytogenetic abnormalities can potentially impact outcomes31,49. Not all of the abnormalities now recognized as conferring poor prognosis are routinely collected or reported in clinical trials or observational studies, including deletion 17 [del(17)], the translocations t(4;14), and t(14;16)19,20, 1q amplification50, and 1p deletion51. The proportion of patients with cytogenetics reported is often low in clinical trials (e.g., 47% of patients in FIRST;9 53% in ASPIRE52), leading to a high level of missing information, although this proportion was higher in the TOURMALINE-MM1 (76%)20, CASTOR (71%)16, and POLLUX (77%)15 trials. Similarly, these data appear to be limited in analyses of routine practice, with conventional cytogenetic and fluorescence in situ hybridization (FISH) analysis being reported in only 37–63.2% of patients in recent real-world analyses;24,53,54 a contributory factor may be the limited availability of these analytical techniques, notably FISH, at different sites around the world. This raises the possibility of ‘hidden’ imbalances in prognostic markers across these studies, making indirect comparisons even more difficult. Additionally, there is no consistent methodology (and therefore sensitivity) or cut-off to define the presence of a high-risk abnormality; for example, presence of del(17p) has variously been defined in recent clinical studies based on abnormalities in a single cell17, through 1.5–7.5% of cells20, up to 60% of cells19. Yet, different clone sizes may have different prognostic impact, and thus patient populations appearing to have the same rate of a specific cytogenetic abnormality may have different outcomes.

Prior treatment exposure

Prior therapy exposure can markedly affect treatment outcomes. Refractoriness to previous therapy55 and number and type of previous lines of therapy56 are known determinants of response to subsequent therapy; however, these may be confounded by the use of different definitions for determining ‘refractory’ disease and classifying a line of therapy between clinical trials and compared with the real-world setting. Patients typically have poorer outcomes with successive lines of therapy, including shorter disease-free intervals or periods of disease control, both in clinical trials and in the real-world setting24,38,57, associated with increasing disease refractoriness and accumulating frailty/comorbidities. Standard clinical trial eligibility criteria typically exclude more heavily pretreated patients38. Additionally, type of prior therapy can impact response to treatment. For example, in North America, many patients receive Rd4 initially and therefore may develop lenalidomide-refractory disease. However, phase 3 clinical trials of regimens consisting of an Rd backbone have often excluded lenalidomide-refractory patients15,17,20, making it difficult to translate the efficacy of the studied regimen to effectiveness in a real-world patient population.

The potential impact of clinical trial design

An important consideration in the interpretation of clinical trial results is the study design, specifically whether an open-label or placebo-controlled double-blind design was used. An unblinded randomized trial design may introduce bias when using PFS as an endpoint58, leading to possible differential withdrawal rates associated with more patients on the control arm withdrawing from the study for reasons other than disease progression and potentially receiving a subsequent therapy without having disease progression. These issues may be overcome through the use of central blinded review58. Similarly, there is the potential for bias in quality of life (QoL) and patient-reported outcome endpoints in unblinded studies, associated with a more ‘upbeat’ evaluation of their status by patients enrolled to receive the novel, ‘exciting’ treatment option59.

Interpreting endpoint data in multiple myeloma clinical trials

Discrepancies occur between clinical trials with regards to criteria used for response assessment and schedule of assessments, potentially impacting the interpretation of response and/or progression data. The International Myeloma Working Group (IMWG) has recently published updated consensus criteria for assessment of response and progression;60,61 however, older studies are more likely to have used the European Group for Blood and Marrow Transplantation (EBMT) criteria62 or the original IMWG uniform response criteria63. Therefore, PFS may be affected by the stringency of the criteria used for determining relapse from CR; this so-called ‘CR penalty’ when using the EBMT criteria64 arises because relapse from CR is defined as M-protein reappearance on immunofixation62, whereas for PFS evaluation, the IMWG criteria require an absolute increase in serum or urine M-protein to define relapse from CR63. Furthermore, response and progression assessment may differ in the real-world setting, with potentially less rigorous criteria used to determine progression and to evaluate response than in a clinical trial. For example, bone marrow confirmation and flow cytometry/PCR assessment of minimal residual disease (MRD) may not routinely be conducted or repeated for cases of suspected CR/stringent CR. Additionally, depending on the rigor of response assessment and extent of available documentation, all subcategories of depth of response may not feasibly be reported in the real-world setting.

While it is generally established that, with all other things being equal, depth of response is clearly associated with improved long-term outcomes65, there are examples of clinical trial data in which the response rates do not correlate with PFS and/or OS37,66,67,68,69. These discordances may arise for a number of reasons, such as the effects of toxicity (e.g., treatment discontinuation, death) or more aggressive relapse, and should be considered when interpreting clinical trial data. In a phase 3 study of lenalidomide plus high-dose versus low-dose dexamethasone in NDMM66, the response rate was higher (79% vs. 68%) in the high-dose dexamethasone arm, but due to toxicities associated with the higher dose of dexamethasone, the 1-year OS rate was lower (87% vs. 96%). Similarly, in a randomized study of thalidomide-dexamethasone (TD) versus melphalan-prednisone (MP) as frontline therapy in transplant-ineligible NDMM patients69, response rates were higher with TD versus MP (68% vs. 50%; CR + VGPR: 26% vs. 13%) but median OS was significantly shorter (41.5 vs. 49.4 months). This was also seen in the phase 3 FOCUS study of single-agent carfilzomib versus best supportive care in heavily pretreated RRMM patients; carfilzomib resulted in a higher response rate (19% vs. 11%), but this did not translate into improved outcomes in these ‘end-stage’ patients, in whom survival times would be expected to be limited–median PFS (3.7 vs. 3.3 months) and OS (10.2 vs. 10.0 months) were similar between arms67. Additionally, in the phase 3 CLARION study of KMP versus VMP in NDMM, the response rate was slightly higher with KMP (84% vs. 79%, including 26% vs. 23% CR) but PFS was similar (median 22.3 vs. 22.1 months)68.

A more important prognostic factor for improved outcomes in clinical trials may be achievement of a sustained response70 or the improvement of response over the course of treatment71. Evaluation of best response alone may not capture evolution of response and the impact of late, evolving responses on outcomes72, nor does it capture short-lived responses, which reflect aggressive disease. These aspects may account for discordance between response rates and long-term outcomes. Additionally, standard depth-of-response assessments may potentially mask responses of greater depth in both clinical trials and the real world. For example, while CR is associated with improved PFS and OS in MM73, this standard category of depth of response may include patients with differing levels of MRD. Increasing depth of MRD elimination has been associated with improvements in outcomes;74 thus, not all CRs are equal, and an imbalance in the ‘hidden’ rate of MRD elimination may confound interpretation of clinical trial and real-world data. In the GEM2005 phase 3 study in transplant-ineligible NDMM patients of VMP versus VTP induction plus VT vs. VP maintenance, although the CR rate favored the VTP arm (20% vs. 28%), among patients achieving CR on VMP and VTP, 70% and 45%, respectively, were MRD-negative by multiparameter flow cytometry, which translated into longer median PFS (32 vs. 23 months) and median OS (63 vs. 43 months) in the VMP arm37. This imbalance in MRD elimination may have contributed to the apparent disconnect between the relative CR rates and PFS/OS with VMP and VTP.

Furthermore, cross-trial comparison of MRD-negative rates may also be confounded by the use of different techniques, with different sensitivities, for determining MRD elimination. Of note, the limited use of MRD negativity as a treatment goal in clinical practice may result in poorer outcomes compared to a clinical trial, with real-world patients potentially discontinuing treatment upon having achieved a CR but before obtaining possible MRD elimination.

Patient-reported outcomes

Patient-reported outcomes are also of importance in MM, particularly in the context of long-term or continuous therapy administration, which is made feasible if therapies have minimal impact on patients’ QoL75,76. MM patients typically have a high symptom burden and impaired QoL76, and health-related QoL questionnaires have been employed with the aim of determining the extent of disease-related effects and the impact of treatment response and toxicity on QoL75. Recent novel therapies for RRMM have demonstrated a limited adverse impact or a positive impact on patients’ QoL in phase 3 trials, likely associated with a reduction in disease symptoms20,75,77,78,79. However, in interpreting these findings, it is important to consider the study design–as QoL data are susceptible to bias in open-label studies. Additionally, the instrument(s) employed should be evaluated; prior to the introduction of more recent instruments, there was a historical lack of an MM-specific QoL questionnaire to reflect the key aspects of disease and treatment burden on patients in MM;80 thus, while improvements may be recorded in more generic instruments, these may not capture some MM-specific issues of importance to patients. Furthermore, current instruments may not be sufficiently sensitive to detect QoL variations, depending on the type of treatment, particularly effects specific to recent novel agents. Although these tools are validated and widely used, they may lack the power to reflect the details of the real impacts of treatment on QoL81.

The timing of the patient-reported outcome assessments may also influence the extent to which effects of treatment toxicity are adequately captured, with patient-reported outcomes from clinical studies typically collected over a relatively short follow-up period and at the beginning of a treatment cycle, thus only reflecting patient states with resolved adverse events and/or short-term QoL information82. Intra- and inter-trial differential attrition and compliance rates across comparator arms may contribute to data missing not at random that may bias the relative treatment effects. Furthermore, there is often variation across trials in the types of analytic methods applied, including non-uniform approaches that address missing data, which may have a substantial impact on the point estimates of treatment effects. Patient-reported outcomes should thus be interpreted in this context.

Understanding disparities between different clinical trials and between real-world experience: acknowledging real-world considerations

Targeted literature review: real-world and clinical trial data in RRMM

There are inherent difficulties in obtaining and analyzing complete sets of real-world data. Several methods can be used, including prospectively designed observational studies, retrospective chart reviews, and claims database analyses. However, currently there are no standardized methods for claims-based outcomes research in MM. The varied application of MM treatment algorithms across studies can also present challenges in retrospective interpretation of electronic medical record (EMR) analyses and other real-world data, for example, how to determine lines of therapy or when a patient is receiving maintenance rather than extended induction therapy.

To investigate discrepancies between clinical trial efficacy and real-world effectiveness, we conducted a targeted literature review to identify sources of real-world, non-clinical-trial data in RRMM and evaluated these data in the context of phase 3 clinical trial results. For a description of the methodology, please see the supplementary information. Data from 61 relevant publications and abstracts are summarized in Supplementary Tables S1 and S2, and corresponding data from phase 3 studies are summarized in Supplementary Table S3.

Tables 2 and 3 present summaries of the PFS/time to next therapy (TTNT) and duration of therapy (DOT) data from relevant real-world reports and clinical studies in RRMM patients with 1–3 prior therapies. Our findings show that outcomes seen in clinical trials are not always replicated in the real-world setting. The ranges of median PFS/TTNT values in real-world reports were generally shorter than those reported in phase 3 clinical studies (Table 2), with a larger gap seen with injectable PI-immunomodulatory drug-based triplet regimens. Conversely, PFS/TTNT in clinical and real-world studies appeared more closely aligned with all-oral regimens. As noted, longer DOT has been associated with prolonged PFS/OS9,83,84. Therefore, these data were evaluated similarly to PFS/TTNT data (Table 3). The ranges of median DOT values in the real-world reports were shorter than, or similar to, those reported in phase 3 clinical studies in RRMM patients with 1–3 prior therapies. Although reasons for discontinuations were not consistently reported, treatment toxicity is anticipated to have contributed to patients discontinuing therapy, and thus tolerability may be an important factor for a number of regimens in the real-world setting. In a real-world analysis of treatment among US community oncology practices, rates of discontinuation due to toxicity for second-line and third-line regimens ranged from 15.3−32.0%;24 this contrasts with rates of 6.7%–20.9% in recent phase 3 studies in RRMM after typically 1–3 prior lines15,16,17,18,19,20. Of note, in our analysis, the ranges of median PFS/TTNT and DOT with bortezomib-based regimens appeared similar in clinical trials and real-world analyses. This might possibly be associated with the fixed duration of therapy utilized in bortezomib phase 3 studies closely mirroring the length of therapy tolerated in the real world.

Table 2 Comparison of PFS/TTNT from real-world reports and phase 3 clinical studies in RRMM patients after 1–3 prior lines of therapy; see Supplementary Table S4 for full details of studies cited for each range/piece of data
Table 3 Comparison of DOT from real-world reports and phase 3 clinical studies in RRMM patients after 1–3 prior lines of therapy; see Supplementary Table S5 for full details of studies cited for each range/piece of data

Reasons for discrepancies between real-world and clinical trial data

Patient selection is a known contributor to the gap between efficacy in clinical trials and effectiveness in the real-world setting85. Only 3% of patients participate in oncology trials in the United States86, while the UK is at the other end of the spectrum with 35% of MM patients participating in research87. Older patients, those with higher comorbidity burden, and patients from lower socioeconomic background are under-represented in trials88. In MM in particular, advanced age, functional decline, and comorbid conditions represent components of frailty that are predictive of mortality and toxicity risk43. As discussed earlier, the disparities seen between real-world effectiveness and clinical trial efficacy may, in part, be associated with differences between eligibility criteria and characteristics of study populations. This makes it critical to compare the baseline patient characteristics when interpreting results of studies. It is interesting to note that the gap between routine clinical practice and clinical trial outcomes in later lines of therapy (i.e., in a more heavily pretreated/refractory population) appears smaller than in earlier lines of therapy for RRMM. It may be speculated that this could be due to closer alignment between the real-world and clinical trial patient populations in this setting or that the generally limited benefit in this setting results in more aligned outcomes.

Other potential sources for the gap between DOT achieved in the real-world versus the clinical trial setting may include treatment center effect (academic vs. community centers having differing levels of experience of managing patients being treated with novel regimens, with community centers being under-represented in clinical trials), study design (e.g., use of treat-to-progression clinical study designs not being feasible or not being utilized in the real-world setting), and physician and patient preference. Furthermore, protocol-directed treatment rigor in clinical trials dictates dose modifications that may lead to better tolerability and longer duration of therapy in clinical trials. This is important because, as demonstrated in a number of clinical studies, a fixed duration of therapy may be associated with poorer outcomes in real-world practice, e.g., if patients discontinue therapy due to poor tolerability or high burden of treatment not seen or anticipated in the clinical trial84,89. Similarly, multiple unplanned dose modifications outside of the clinical trial setting, such as dose reductions, treatment delays, or dropping a component of therapy may adversely impact the relative dose intensity of active drugs, which has been associated with poorer OS90.

Real-world considerations such as the tolerability, convenience, and practicality of therapy are not captured within clinical trial reports or using conventional endpoints; however, they may also contribute to discrepancies between clinical trial and real-world outcomes. For example, treatment with a novel agent or regimen in the real-world setting may be associated with substantial patient time and economic burden91,92, including direct and indirect costs associated with medications and attending regular clinic visits. The burden of treatment, such as the route of administration and travel to the treatment center10,93, may not be captured by standard clinical trial endpoints but may substantially affect the feasibility of long-term treatment in the real-world setting as patients may succumb to treatment fatigue outside of the ‘motivating’ environment of clinical trial participation. Differences in adherence to treatment between a stringently monitored clinical trial setting and routine care may thus impact the generalizability of trial results to the real world.

Similarly, as noted earlier when discussing patient-reported outcomes, clinical trial data may not necessarily capture the cumulative long-term burden of the disease, its treatment, and the associated comorbidities and toxicity, or the psychosocial effects and lifestyle impact of living with MM82. These considerations must be acknowledged in tandem with clinical trial efficacy and safety data when interpreting data on different regimens; in this context, it is also important for patients to be well educated about treatment options and for clinicians to consider patient goals of therapy for what remains a generally incurable disease. For example, while a highly active and aggressive treatment approach, involving considerable burden and possibly toxicity, may be acceptable for younger, fitter patients if it offers the potential of long-term remission and elimination of MRD, for other groups of patients, the achievement of long-term disease control with minimal toxicity and preserved QoL may be an equally meaningful endpoint.

In consideration of these issues, a number of recommendations may be made to aid the broader real-world use of drugs and attempt to close the efficacy versus effectiveness gap. First, greater education of academic and community physicians can provide them access to clinical trial management algorithms to improve utilization of novel agents and regimens. Associated guidance on side-effect management, QoL monitoring, and support regarding adherence to medication should be provided to enable prolonged therapy. Second, ensuring drug labels are updated for use in routine practice following approval of a novel agent in combination with an existing agent is recommended, as clinicians who are utilizing drugs per label need up-to-date guidance on the use of these drugs in all approved indications. Indications for use will need to be updated/maintained regularly to help ensure optimal use of therapy. Furthermore, the use of adaptive study designs, including for regulatory pathway studies, that could be adjusted to reflect changes in the treatment landscape would help with providing relevant data to the current real-world setting once results become available94,95.


In conclusion, interpretation of data across clinical studies in MM and between clinical studies and real-world analyses is highly complex, with a multitude of factors confounding simple interpretation of efficacy, safety, and effectiveness between regimens. Both clinical trials and observational studies provide complementary information of importance in treatment decision-making. Clinical trials isolate treatment efficacy in selected patient populations and are less prone to bias, with good internal validity, while observational studies provide insights into treatment effectiveness in heterogeneous patient populations. In the absence of head-to-head comparisons between regimens, indirect comparisons of clinical study findings should be made with extreme caution; the most valid approach may be indirect comparisons of relative efficacy versus a common comparator using hazard ratios. Equally importantly, clinicians need to consider patient-related factors that may impact the translation of clinical trial outcomes to daily practice, such as QoL, tolerability, and burden of treatment, which may also help with tailoring treatment approaches for individual patients and thus optimize outcomes.

In the future, it will be important not only to systematically assess the discrepancies between clinical trials but also the inconsistencies between the real-world and clinical trial settings, and to evaluate in greater detail the drivers of these differences. This may be supported by increased utilization of patient-reported outcomes, which are of increasing importance in informing treatment. Real-world effectiveness should be a metric considered in routine clinical practice, as it will be important to develop drugs and combinations that will be effective in the real world across patient populations, outside of the rigorously controlled clinical trial setting.


  1. 1.

    Kumar, S. K. et al. Continued improvement in survival in multiple myeloma: changes in early mortality and outcomes in older patients. Leukemia 28, 1122–1128 (2014).

  2. 2.

    National Cancer Institute. Surveillance, Epidemiology, and End Results Program. Cancer Stat Facts: Myeloma. (National Cancer Institute, 2017).

  3. 3.

    Howlader, N. et al. SEER Cancer Statistics Review, 1975–2014, Table 18.9, Myeloma, SEER Relative Survival (Percent) By Year of Diagnosis, All Races, Males and Females 2017.; (National Cancer Institute, Bethesda, 2017).

  4. 4.

    Kumar, S. K. et al. Multiple Myeloma, Version 3.2017, NCCN Clinical Practice Guidelines in Oncology. J. Natl Compr. Canc. Netw. 15, 230–269 (2017).

  5. 5.

    Guglielmelli, T. & Palumbo, A. Multiple myeloma: is a shift toward continuous therapy needed to move forward? Expert Rev. Hematol. 8, 253–256 (2015).

  6. 6.

    Palumbo, A. et al. Continuous Therapy Versus Fixed Duration of Therapy in Patients With Newly Diagnosed Multiple Myeloma. J. Clin. Oncol. 33, 3459–3466 (2015).

  7. 7.

    Bahlis, N. J. et al. Benefit of continuous treatment for responders with newly diagnosed multiple myeloma in the randomized FIRST trial. Leukemia 31, 2435–2442 (2017).

  8. 8.

    McCarthy, P. L. et al. Lenalidomide Maintenance After Autologous Stem-Cell Transplantation in Newly Diagnosed Multiple Myeloma: A Meta-Analysis. J. Clin. Oncol. 35, 3279–3289 (2017).

  9. 9.

    Benboubker, L. et al. Lenalidomide and dexamethasone in transplant-ineligible patients with myeloma. N. Engl. J. Med. 371, 906–917 (2014).

  10. 10.

    Baz, R. et al. Development of a conceptual model to illustrate the impact of multiple myeloma and its treatment on health-related quality of life. Support. Care Cancer 23, 2789–2797 (2015).

  11. 11.

    Rajkumar, S. V. & Harousseau, J. L. Next-generation multiple myeloma treatment: a pharmacoeconomic perspective. Blood 128, 2757–2764 (2016).

  12. 12.

    Kim, E. S. et al. Broadening Eligibility Criteria to Make Clinical Trials More Representative: American Society of Clinical Oncology and Friends of Cancer Research Joint Research Statement. J. Clin. Oncol. 35, 3737–3744 (2017).

  13. 13.

    van Beurden-Tan, C. H. Y., Franken, M. G., Blommestein, H. M., Uyl-de Groot, C. A. & Sonneveld, P. Systematic Literature Review and Network Meta-Analysis of Treatment Outcomes in Relapsed and/or Refractory Multiple Myeloma. J. Clin. Oncol. 35, 1312–1319 (2017).

  14. 14.

    Li, T., Puhan, M. A., Vedula, S. S., Singh, S. & Dickersin, K., Ad Hoc Network Meta-analysis Methods Meeting Working G. Network meta-analysis-highly attractive but more methodological research is needed. BMC Med. 9, 79 (2011).

  15. 15.

    Dimopoulos, M. A. et al. Daratumumab, Lenalidomide, and Dexamethasone for Multiple Myeloma. N. Engl. J. Med. 375, 1319–1331 (2016).

  16. 16.

    Palumbo, A. et al. Daratumumab, Bortezomib, and Dexamethasone for Multiple Myeloma. N. Engl. J. Med. 375, 754–766 (2016).

  17. 17.

    Lonial, S. et al. Elotuzumab Therapy for Relapsed or Refractory Multiple Myeloma. N. Engl. J. Med. 373, 621–631 (2015).

  18. 18.

    Dimopoulos, M. A. et al. Carfilzomib and dexamethasone versus bortezomib and dexamethasone for patients with relapsed or refractory multiple myeloma (ENDEAVOR): a randomised, phase 3, open-label, multicentre study. Lancet Oncol. 17, 27–38 (2016).

  19. 19.

    Stewart, A. K. et al. Carfilzomib, lenalidomide, and dexamethasone for relapsed multiple myeloma. N. Engl. J. Med. 372, 142–152 (2015).

  20. 20.

    Moreau, P. et al. Oral Ixazomib, Lenalidomide, and Dexamethasone for Multiple Myeloma. N. Engl. J. Med. 374, 1621–1634 (2016).

  21. 21.

    San-Miguel, J. F. et al. Overall survival of patients with relapsed multiple myeloma treated with panobinostat or placebo plus bortezomib and dexamethasone (the PANORAMA 1 trial): a randomised, placebo-controlled, phase 3 trial. Lancet Haematol. 3, e506–e515 (2016).

  22. 22.

    San-Miguel, J. F. et al. Panobinostat plus bortezomib and dexamethasone versus placebo plus bortezomib and dexamethasone in patients with relapsed or relapsed and refractory multiple myeloma: a multicentre, randomised, double-blind phase 3 trial. Lancet Oncol. 15, 1195–1206 (2014).

  23. 23.

    Romanus, D. et al. Association Between Treatment Regimen Type in Second-Line Therapy (2LT) and Duration of Therapy (DOT) & Time To Next Treatment (TTNT) in a United States (US) Relapsed/Refractory Multiple Myeloma (RRMM) Cohort. Clin. Lymphoma Myeloma Leuk. 17, e81–e82 (2017).

  24. 24.

    Jagannath, S. et al. Real-world treatment patterns and associated progression-free survival in relapsed/refractory multiple myeloma among US community oncology practices. Expert Rev. Hematol. 9, 707–717 (2016).

  25. 25.

    Cerchione, C. et al. Carfilzomib-lenalidomide-dexamethasone in the management of relapsed and refractory multiple myeloma: a real-life experience. Haematologica 102(s2), 804 (2017).

  26. 26.

    Ziff, M. et al. Real world use of ixazomib with lenalidomide and dexamethasone for patients with relapsed and relapsed refractory multiple myeloma. Haematologica 102(s2), 786–787 (2017).

  27. 27.

    Lakshman, A. et al. Daratumumab-based combination therapies (DCT) in heavily-pretreated patients (pts) with relapsed and/or refractory multiple myeloma (RRMM). J. Clin. Oncol. 35(suppl), 8038 (2017).

  28. 28.

    Branca, A. et al. Daratumumab Single Agent and Daratumumab Plus Pomalidomide and Dexametasone in Relapsed/Refractory Multiple Myeloma: A Real Life Retrospective Evaluation. Blood 128, 4516 (2016).

  29. 29.

    Biran, N. et al. Real-world outcomes with panobinostat in patients with penta- and quad-refractory multiple myeloma. J. Clin. Oncol. 35(suppl), e19522 (2017).

  30. 30.

    Baertsch, M. A. et al. Efficacy and Tolerability of the Histone-Deacetylase Inhibitor Panobinostat in Clinical Practice. Clin. Lymphoma Myeloma Leuk. 17, e119–e120 (2017).

  31. 31.

    Mikhael, J. R. et al. Management of newly diagnosed symptomatic multiple myeloma: updated Mayo Stratification of Myeloma and Risk-Adapted Therapy (mSMART) consensus guidelines 2013. Mayo Clin. Proc. 88, 360–376 (2013).

  32. 32.

    Palumbo, A. et al. Revised International Staging System for Multiple Myeloma: A Report From International Myeloma Working Group. J. Clin. Oncol. 33, 2863–2869 (2015).

  33. 33.

    Shah, J. J. et al. Analysis of Common Eligibility Criteria of Randomized Controlled Trials in Newly Diagnosed Multiple Myeloma Patients and Extrapolating Outcomes. Clin. Lymphoma Myeloma Leuk. 17, 575–583 (2017).

  34. 34.

    Kim E. S., et al. Broadening Eligibility Criteria to Make Clinical Trials More Representative: American Society of Clinical Oncology and Friends of Cancer Research Joint Research Statement. J. Clin. Oncol. JCO2017737916 (2017).

  35. 35.

    Phan, V. H. et al. Ethnic differences in drug metabolism and toxicity from chemotherapy. Expert. Opin. Drug. Metab. Toxicol. 5, 243–257 (2009).

  36. 36.

    Lu, J. et al. Clinical features and treatment outcome in newly diagnosed Chinese patients with multiple myeloma: results of a multicenter analysis. Blood Cancer J. 4, e239 (2014).

  37. 37.

    Mateos, M. V. et al. GEM2005 trial update comparing VMP/VTP as induction in elderly multiple myeloma patients: do we still need alkylators? Blood 124, 1887–1893 (2014).

  38. 38.

    Yong, K. et al. Multiple myeloma: patient outcomes in real-world practice. Br. J. Haematol. 175, 252–264 (2016).

  39. 39.

    Ludwig, H. et al. Survival and years of life lost in different age cohorts of patients with multiple myeloma. J. Clin. Oncol. 28, 1599–1605 (2010).

  40. 40.

    Oortgiesen, B. E. et al. The role of initial clinical presentation, comorbidity and treatment in multiple myeloma patients on survival: a detailed population-based cohort study. Eur. J. Clin. Pharmacol. 73, 771–778 (2017).

  41. 41.

    Engelhardt, M. et al. A concise revised myeloma comorbidity Index as a valid prognostic instrument in a large cohort of 801 multiple myeloma patients. Haematologica 102, 910–921 (2017).

  42. 42.

    Engelhardt, M. et al. Geriatric assessment in multiple myeloma patients: validation of the International Myeloma Working Group (IMWG) score and comparison with other common comorbidity scores. Haematologica 101, 1110–1119 (2016).

  43. 43.

    Palumbo, A. et al. Geriatric assessment predicts survival and toxicities in elderly myeloma patients: an International Myeloma Working Group report. Blood 125, 2068–2074 (2015).

  44. 44.

    Lonial, S. & Kaufman, J. L. Non-secretory myeloma: a clinician’s guide. Oncology 27, 924–928 (2013). 930.

  45. 45.

    Murng, S. H. et al. Defining the impact of individual sample variability on routine immunoassay of serum free light chains (sFLC) in multiple myeloma. Clin. Exp. Immunol. 171, 201–209 (2013).

  46. 46.

    Kyle, R. A. et al. Review of 1027 patients with newly diagnosed multiple myeloma. Mayo Clin. Proc. 78, 21–33 (2003).

  47. 47.

    Tacchetti, P. et al. Prognostic impact of serial measurements of serum-free light chain assay throughout the course of newly diagnosed multiple myeloma treated with bortezomib-based regimens. Leuk. Lymphoma 57, 2058–2064 (2016).

  48. 48.

    Hari, P. et al. The impact of age and comorbidities on practice patterns and outcomes in patients with relapsed/refractory multiple myeloma in the era of novel therapies. J. Geriatr. Oncol. 9, 138–144 (2018).

  49. 49.

    Sonneveld, P. et al. Treatment of multiple myeloma with high-risk cytogenetics: a consensus of the International Myeloma Working Group. Blood 127, 2955–2962 (2016).

  50. 50.

    Shah, G. L. et al. Gain of chromosome 1q portends worse prognosis in multiple myeloma despite novel agent-based induction regimens and autologous transplantation. Leuk. Lymphoma 58, 1823–1831 (2017).

  51. 51.

    Hebraud, B. et al. Deletion of the 1p32 region is a major independent prognostic factor in young patients with myeloma: the IFM experience on 1195 patients. Leukemia 28, 675–679 (2014).

  52. 52.

    Avet-Loiseau, H. et al. Carfilzomib significantly improves the progression-free survival of high-risk patients in multiple myeloma. Blood 128, 1174–1180 (2016).

  53. 53.

    Rifkin, R. M. et al. Connect MM Registry: The Importance of Establishing Baseline Disease Characteristics. Clin. Lymphoma Myeloma Leuk. 15, 368–376 (2015).

  54. 54.

    Katodritou, E. et al. “Real-world” data on the efficacy and safety of lenalidomide and dexamethasone in patients with relapsed/refractory multiple myeloma who were treated according to the standard clinical practice: a study of the Greek Myeloma Study Group. Ann. Hematol. 93, 129–139 (2014).

  55. 55.

    Majithia, N. et al. Outcomes of primary refractory multiple myeloma and the impact of novel therapies. Am. J. Hematol. 90, 981–985 (2015).

  56. 56.

    Dimopoulos, M. A. et al. Carfilzomib-lenalidomide-dexamethasone vs lenalidomide-dexamethasone in relapsed multiple myeloma by previous treatment. Blood Cancer J. 7, e554 (2017).

  57. 57.

    Kumar, S. K. et al. Clinical course of patients with relapsed multiple myeloma. Mayo Clin. Proc. 79, 867–874 (2004).

  58. 58.

    Freidlin, B. et al. Proposal for the use of progression-free survival in unblinded randomized trials. J. Clin. Oncol. 25, 2122–2126 (2007).

  59. 59.

    Center for Drug Evaluation and Research. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. (United States Food and Drug Administration, Silver Spring, 2009).

  60. 60.

    Rajkumar, S. V. et al. Consensus recommendations for the uniform reporting of clinical trials: report of the International Myeloma Workshop Consensus Panel 1. Blood 117, 4691–4695 (2011).

  61. 61.

    Kumar, S. et al. International Myeloma Working Group consensus criteria for response and minimal residual disease assessment in multiple myeloma. Lancet Oncol. 17, e328–e346 (2016).

  62. 62.

    Blade, J. et al. Criteria for evaluating disease response and progression in patients with multiple myeloma treated by high-dose therapy and haemopoietic stem cell transplantation. Myeloma Subcommittee of the EBMT. European Group for Blood and Marrow Transplant. Br. J. Haematol. 102, 1115–1123 (1998).

  63. 63.

    Durie, B. G. et al. International uniform response criteria for multiple myeloma. Leukemia 20, 1467–1473 (2006).

  64. 64.

    Richardson, P. G., Niesvizky, R., Anderson, K. C. & Blade, J. Re: When you look matters: the effect of assessment schedule on progression-free survival. J. Natl Cancer Inst. 100, 373 (2008).

  65. 65.

    Lonial, S. & Anderson, K. C. Association of response endpoints with survival outcomes in multiple myeloma. Leukemia 28, 258–268 (2014).

  66. 66.

    Rajkumar, S. V. et al. Lenalidomide plus high-dose dexamethasone versus lenalidomide plus low-dose dexamethasone as initial therapy for newly diagnosed multiple myeloma: an open-label randomised controlled trial. Lancet Oncol. 11, 29–37 (2010).

  67. 67.

    Hajek, R. et al. A randomized phase III study of carfilzomib vs low-dose corticosteroids with optional cyclophosphamide in relapsed and refractory multiple myeloma (FOCUS). Leukemia 31, 107–114 (2017).

  68. 68.

    Facon, T. et al. Phase 3 Study (CLARION) of Carfilzomib, Melphalan, Prednisone (KMP) v Bortezomib, Melphalan, Prednisone (VMP) in Newly Diagnosed Multiple Myeloma (NDMM). Clin. Lymphoma Myeloma Leuk. 17, e26–e27 (2017).

  69. 69.

    Ludwig, H. et al. Thalidomide-dexamethasone compared with melphalan-prednisolone in elderly patients with multiple myeloma. Blood 113, 3435–3442 (2009).

  70. 70.

    Barlogie, B. et al. Complete remission sustained 3 years from treatment initiation is a powerful surrogate for extended survival in multiple myeloma. Cancer 113, 355–359 (2008).

  71. 71.

    Lahuerta, J. J. et al. Influence of pre- and post-transplantation responses on outcome of patients with multiple myeloma: sequential improvement of response and achievement of complete response are associated with longer survival. J. Clin. Oncol. 26, 5775–5782 (2008).

  72. 72.

    Garderet, L. et al. Association between response kinetics and outcomes in relapsed/refractory multiple myeloma: analysis from TOURMALINE-MM1. Leukemia 32, 2032–2036 (2018).

  73. 73.

    Gay, F. et al. Complete response correlates with long-term progression-free and overall survival in elderly myeloma treated with novel agents: analysis of 1175 patients. Blood 117, 3025–3031 (2011).

  74. 74.

    Rawstron, A. C. et al. Minimal residual disease in myeloma by flow cytometry: independent prediction of survival benefit per log reduction. Blood 125, 1932–1935 (2015).

  75. 75.

    Nielsen, L. K., Jarden, M., Andersen, C. L., Frederiksen, H. & Abildgaard, N. A systematic review of health-related quality of life in longitudinal studies of myeloma patients. Eur. J. Haematol. 99, 3–17 (2017).

  76. 76.

    Ramsenthaler, C. et al. The impact of disease-related symptoms and palliative care concerns on health-related quality of life in multiple myeloma: a multi-centre study. Bmc. Cancer 16, 427 (2016).

  77. 77.

    Stewart, A. K. et al. Health-Related Quality of Life Results From the Open-Label, Randomized, Phase III ASPIRE Trial Evaluating Carfilzomib, Lenalidomide, and Dexamethasone Versus Lenalidomide and Dexamethasone in Patients With Relapsed Multiple Myeloma. J. Clin. Oncol 34, 3921–3930 (2016).

  78. 78.

    Weisel, K. et al. Pomalidomide and Low-Dose Dexamethasone Improves Health-Related Quality of Life and Prolongs Time to Worsening in Relapsed/Refractory Patients With Multiple Myeloma Enrolled in the MM-003 Randomized Phase III Trial. Clin. Lymphoma Myeloma Leuk. 15, 519–530 (2015).

  79. 79.

    Leleu, X. et al. Patient-reported health-related quality of life from the phase III TOURMALINE-MM1 study of ixazomib-lenalidomide-dexamethasone versus placebo-lenalidomide-dexamethasone in relapsed/refractory multiple myeloma. Am. J. Hematol 93, 985–993 (2018).

  80. 80.

    Wagner, L. I. et al. Content development for the Functional Assessment of Cancer Therapy-Multiple Myeloma (FACT-MM): use of qualitative and quantitative methods for scale construction. J. Pain. Symptom Manag. 43, 1094–1104 (2012).

  81. 81.

    Osborne, T. R. et al. What issues matter most to people with multiple myeloma and how well are we measuring them? A systematic review of quality of life tools. Eur. J. Haematol. 89, 437–457 (2012).

  82. 82.

    Snowden, J. A. et al. Guidelines for screening and management of late and long-term consequences of myeloma and its treatment. Br. J. Haematol. 176, 888–907 (2017).

  83. 83.

    Weisel, K. et al. A systematic literature review and network meta-analysis of treatments for patients with untreated multiple myeloma not eligible for stem cell transplantation. Leuk. Lymphoma 58, 153–161 (2017).

  84. 84.

    Hari, P. et al. Prolonged Duration of Therapy Is Associated With Improved Survival in Patients Treated for Relapsed/Refractory Multiple Myeloma in Routine Clinical Care in the United States. Clin. Lymphoma Myeloma Leuk. 18, 152–160 (2018).

  85. 85.

    Sherman, R. E. et al. Real-World Evidence - What Is It and What Can It Tell Us? N. Engl. J. Med. 375, 2293–2297 (2016).

  86. 86.

    Combest, A. J., Reitsma, D. J., Moseley, A., Steele, S. D. & Bonneterre, M.-E. A. Adult participation in oncology clinical trials by indication, race, and age. J. Clin. Oncol. 31(15 suppl), e17586 (2013).

  87. 87.

    Myeloma, U. K. Myeloma Patient Experience Report 2016. (Myeloma, UK, 2016).

  88. 88.

    Booth, C. M. & Tannock, I. F. Randomised controlled trials and population-based observational research: partners in the evolution of medical evidence. Br. J. Cancer 110, 551–555 (2014).

  89. 89.

    San-Miguel, J. F. et al. Effects of lenalidomide and dexamethasone treatment duration on survival in patients with relapsed or refractory multiple myeloma treated with lenalidomide and dexamethasone. Clin. Lymphoma Myeloma Leuk. 11, 38–43 (2011).

  90. 90.

    Lyman, G. H. Impact of chemotherapy dose intensity on cancer patient outcomes. J. Natl Compr. Canc. Netw. 7, 99–108 (2009).

  91. 91.

    Robinson, D. Jr. et al. Economic Burden of Relapsed or Refractory Multiple Myeloma: Results from an International Trial. Eur. J. Haematol. 99, 119–132 (2017).

  92. 92.

    Huntington, S. F. et al. Financial toxicity in insured patients with multiple myeloma: a cross-sectional pilot study. Lancet Haematol. 2, e408–e416 (2015).

  93. 93.

    Touati, M. et al. Cost savings of home bortezomib injection in patients with multiple myeloma treated by a combination care in Outpatient Hospital and Hospital care at Home. Support. Care Cancer 24, 5007–5014 (2016).

  94. 94.

    Bhatt, D. L. & Mehta, C. Adaptive Designs for Clinical Trials. N. Engl. J. Med. 375, 65–74 (2016).

  95. 95.

    Sridhara, R. Innovative adaptive trial designs. (United States Food and Drug Administration, 2015).

  96. 96.

    Siegel, D. S. et al. Improvement in Overall Survival With Carfilzomib, Lenalidomide, and Dexamethasone in Patients With Relapsed or Refractory Multiple Myeloma. J. Clin. Oncol 36, 728–734 (2018).

  97. 97.

    Dimopoulos, M. A. et al. Carfilzomib or bortezomib in relapsed or refractory multiple myeloma (ENDEAVOR): an interim overall survival analysis of an open-label, randomised, phase 3 trial. Lancet Oncol. 18, 1327–1337 (2017).

  98. 98.

    Dimopoulos, M. A. et al. Elotuzumab plus lenalidomide/dexamethasone for relapsed or refractory multiple myeloma: ELOQUENT-2 follow-up and post-hoc analyses on progression-free survival and tumour growth. Br. J. Haematol. 178, 896–905 (2017).

  99. 99.

    Dimopoulos, M. A. et al. Daratumumab, Lenalidomide, and Dexamethasone (DRd) Versus Lenalidomide and Dexamethasone (Rd) in Relapsed or Refractory Multiple Myeloma (RRMM): Updated Efficacy and Safety Analysis of Pollux. Blood 130, 739 (2017).

  100. 100.

    Lentzsch, S. et al. Daratumumab, Bortezomib, and Dexamethasone Versus Bortezomib and Dexamethasone for Relapsed/Refractory Multiple Myeloma (RRMM) Patients: An Update of Overall Survival in Castor. Blood 130, 1852 (2017).

Download references


The authors acknowledge Steve Hill, PhD, of FireKite (an Ashfield Company, part of UDG Healthcare PLC) for medical writing support, which was funded by Millennium Pharmaceuticals Inc, a wholly owned subsidiary of Takeda Pharmaceutical Company Limited, and complied with Good Publication Practice-3 (GPP3) guidelines (Battisti WP et al. Ann Intern Med 2015; 163: 461–464), and Renda Ferrari, PhD (Millennium Pharmaceuticals, Inc) for contributing to the editorial and scientific content of the manuscript.

Author information

Correspondence to Paul G. Richardson.

Ethics declarations

Conflict of interest

P.G.R.: Jazz Pharmaceuticals: Consultancy, Membership on an entity’s Board of Directors or advisory committees, Research Funding; Celgene: Consultancy, Research Funding; Oncopeptides AB: Membership on an entity’s Board of Directors or advisory committees; Takeda: Consultancy, Research Funding. J.S.M.: Celgene: Consultancy, Membership on an entity’s Board of Directors or advisory committees; Bristol-Myers Squibb: Consultancy, Membership on an entity’s Board of Directors or advisory committees; Takeda: Consultancy, Membership on an entity’s Board of Directors or advisory committees; MSD: Consultancy, Membership on an entity’s Board of Directors or advisory committees; Amgen: Consultancy, Membership on an entity’s Board of Directors or advisory committees; Novartis: Consultancy, Membership on an entity’s Board of Directors or advisory committees; Janssen: Consultancy, Membership on an entity’s Board of Directors or advisory committees; Roche: Membership on an entity’s Board of Directors or advisory committees; Sanofi: Consultancy, Membership on an entity’s Board of Directors or advisory committees. P.M.: Novartis: Consultancy, Honoraria; Celgene, Janssen, Takeda, Novartis, Amgen, Roche: Membership on an entity’s Board of Directors or advisory committees; Celgene: Consultancy, Honoraria; Takeda: Consultancy, Honoraria; Janssen: Consultancy, Honoraria; Amgen: Consultancy, Honoraria; Bristol-Myers Squibb: Consultancy, Honoraria; Millennium: Consultancy, Honoraria; Onyx Pharmaceutical: Consultancy, Honoraria. R.H.: Takeda: Consultancy, Honoraria, Membership on an entity’s Board of Directors or advisory committees, Research Funding; Novartis: Consultancy, Research Funding; Celgene: Consultancy, Honoraria, Research Funding; Pharma MAR: Consultancy, Honoraria; BMS: Consultancy, Honoraria, Research Funding; Amgen: Consultancy, Honoraria, Membership on an entity’s Board of Directors or advisory committees, Research Funding; Janssen: Consultancy, Honoraria, Research Funding; Abbvie: Consultancy, Honoraria. M.A.D.: Genesis Pharma: Research Funding; Novartis: Consultancy, Honoraria; Amgen Inc, Celgene Corporation, Janssen Biotech Inc, Onyx Pharmaceuticals, an Amgen subsidiary, Takeda Oncology: Consultancy, Honoraria, Other: Advisory Committee: Amgen Inc, Celgene Corporation, Janssen Biotech Inc, Onyx Pharmaceuticals, an Amgen subsidiary, Takeda Oncology. D.R., A.P., T.S.: Employment: Millennium Pharmaceuticals, Inc., Cambridge, MA, USA, a wholly owned subsidiary of Takeda Pharmaceutical Company Limited. T.S.: Also affiliated with Department of Hematology, Charles University General Hospital Prague, Czech Republic. K.L.: Employment, previously Millennium Pharmaceuticals, Inc., Cambridge, MA, USA, a wholly owned subsidiary of Takeda Pharmaceutical Company Limited, currently TESARO, Waltham, MA. S.K.K.: Skyline: Honoraria; Celgene, Millennium, BMS, Onyx, Janssen, Noxxon, AbbVie, Amgen, Merck, Oncopeptides, Skyline Diagnostics, Takeda: Consultancy; Celgene, Millennium/Takeda, Onyx, AbbVie, Janssen, Sanofi, Novartis, Amgen, Genentech, Merck, Oncopeptides, Roche, Skyline Diagnostics: Research Funding. K.C.A.: Bristol-Myers Squibb: Membership on an entity’s Board of Directors or advisory committees; Gilead Sciences: Membership on an entity’s Board of Directors or advisory committees; MedImmune: Membership on an entity’s Board of Directors or advisory committees; Oncopep: Other: scientific founder; Millennium Pharmaceuticals: Membership on an entity’s Board of Directors or advisory committees; C4 Therapeutics: Other: scientific founder.

Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Supplement - clean

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Further reading