Open clinical trial data offer many opportunities for the scientific community to independently verify published results, evaluate new hypotheses and conduct meta-analyses. These data provide valuable opportunities for scientific advances in medical research. Herein we present the comparative meta-analysis of different standard of care treatments from newly available comparator arm data from several prostate cancer clinical trials. Comparison of survival rates following treatment with mitoxantrone or docetaxel in combination with prednisone as well as prednisone alone, validated the previously demonstrated superiority of treatment with docetaxel. Additionally, comparison of four testosterone suppression treatments in hormone-refractory prostate cancer revealed that subjects who had undergone surgical castration had significantly lower survival rates than those treated with LHRH, anti-androgen or LHRH plus anti-androgen, suggesting that this treatment option is less optimal. This study illustrates how the use of patient-level clinical trial data enables meta-analyses that can provide new insights into clinical outcomes of standard of care treatments and thus, once validated, has the potential to help optimize healthcare delivery.
Prostate cancer is one of the most common malignancies in men and a leading cause of illness and death in industrialized countries1. This type of malignancy is heterogeneous in nature and consists of both hormone-responsive and hormone-independent cells. Earlier diagnosis has meant that many patients are treated while the cancer is still in its localized form. This localized form of prostate cancer may be managed by a variety of different approaches including prostatectomy, various forms of radiotherapy and watchful waiting. A small percentage of subjects, however, are diagnosed or eventually develop an advanced form of the disease; and even though radical prostatectomy and radiation therapy can help control the disease, in over a third of patients elevated prostate-specific antigen (PSA) levels will recur2,3. These patients are often treated with hormonal therapy such as Luteinizing Hormone Release Hormone (LHRH) agonists or anti-androgens which reduce the level of serum testosterone. Following therapy of curative intent, androgen ablation by hormonal treatment or by surgical castration (orchiectomy) in subjects with hormonally sensitive prostate cancer may lead to significant reduction in the risk of disease recurrence and increase overall survival4,5. Moreover, in the majority of patients with metastatic disease, androgen ablation has been shown to improve symptoms and lead to regression of metastases and a lowering of serum PSA levels6–8. While the benefits of hormonal or surgical castration are well documented, to the best of our knowledge, the different approaches have not been systematically compared to each other.
All patients with metastatic disease become un-responsive to hormonal therapy with time. Tumors treated with anti-androgen therapy eventually become androgen-independent and start to grow again6,9. In cases where the disease continues to progress even though testosterone ablation by surgical or hormonal treatment has been achieved, the disease is referred to as Hormone-Refractory Prostate Cancer (HRPC).
Since metastatic HRPC is incurable, treatments for this form of the disease focus on relieving symptoms, prolonging and improving the quality of the patient’s life. Currently, the approved chemotherapy treatment for HRPC patients is a combination of prednisone with mitoxantrone or docetaxel. While survival differences between different chemotherapy treatments in HRPC have been previously demonstrated, this work aims to validate those findings while taking a more systematic approach for comparison.
Many cancer clinical trials are conducted each year; recently, the scientific community’s demand for open sharing of data from these trials has encouraged sharing of patient-level data from clinical trials10–12. One such clinical trial data sharing platforms is the Project Data Sphere10,11 which aims at making raw data from cancer clinical trials available for research. The database currently holds data from the comparator arms of 55 cancer clinical trials. In its current form, data pertaining only to subjects assigned to the comparator arms of cancer clinical trials (usually receiving standard of care treatment) are made available. Nevertheless, this data resource has the potential to be very useful to the community.
Herein we present the meta-analysis and comparison of prostate cancer standard-of-care treatments from the control, or comparator, arms of eight clinical trials including 4127 patients. By combining patient-level data from comparator arms across different trials we were able to validate previously published results as well as identify adverse survival outcomes for surgical castration therapy in prostate cancer. While these findings are for hypothesis-generation only, this work aims to demonstrate how meta-analysis of comparator arms from clinical trials can provide new insights into clinical outcomes.
A meta-dataset of clinical trial comparator arms
Patient-level data from eight prostate cancer clinical trials, with a total of 4127 subjects, were combined, integrated and used for this study. The mean age of subjects included in these trials was 67.3 years (Fig. 1a), the majority (85%) were Caucasian (Fig. 1b), and most were diagnosed with stage II or stage III cancer (Fig. 1c). Overall, 868 (21%) subjects were reported to have died during the studies and follow-up.
A comparison of chemotherapies combined with prednisone and treatment with prednisone alone
We compared the survival of a subset of subjects from three comparator treatment groups (a total of 923 subjects), two combining different chemotherapies with prednisone and one of prednisone alone, while controlling for age, race and the study from which the data originated (Fig. 2a). Similar age group distribution was found between the three treatment groups (Fig. 2e), all subjects are male and all have stage IV prostate cancer. No survival differences were found between racial groups within each treatment group (Supplementary Fig. 1). Comparison of the survival of subjects from different clinical trials but receiving the same treatment (mitoxantrone plus prednisone, the only treatment group combining data from 2 different trials) showed no significant differences between the trials (Supplementary Fig. 2) suggesting it was safe to combine these data. Our results reveal that there are no significant differences in survival of subjects treated with mitoxantrone plus prednisone to those treated with prednisone alone (with estimated survival probabilities of 0.54 and 0.495, respectively, at 1 year follow-up and 0.123 and 0.19, respectively, at 2 years follow-up, Fig. 2b). On the other hand, subjects treated with a combination of docetaxel plus prednisone showed significantly higher survival (P<0.001) than those treated with prednisone alone (0.73 in docetaxel plus prednisone treated subjects at 1 year follow-up and 0.385 at 2 years follow-up, Fig. 2c). Survival rates are also significantly (P<0.001) higher in the docetaxel plus prednisone treated group in comparison to mitoxantrone plus prednisone treated group (Fig. 2d).
Surgical castration shows lower survival rates than hormonal therapy
We next compared the survival of three hormonal testosterone suppression treatment groups and surgical castration (orchiectomy), totaling with 802 subjects. The majority of subjects in all treatment groups were diagnosed with stage II or stage III (Fig. 3a). Some differences in survival were seen between the original clinical trials within the LHRH and the anti-androgen treatment groups, however these were not statistically significant when controlling for age, race and cancer stage (Supplementary Fig. 3). Nevertheless, these differences were accounted for in our Cox proportional regression model used for calculating survival differences between the treatment groups. Similar age group distributions were found between treatment groups (Fig. 3b) and the vast majority of the subjects (90%) were Caucasian. Our results reveal that there are no differences in survival between subjects treated with anti-androgen or LHRH (with estimated survival probabilities of 0.858 and 0.837, respectively, at 3 years follow-up and 0.593 and 0.713, respectively, at 4 years follow-up, Fig. 3c). On the other hand, the survival of subjects treated with surgical castration was significantly lower (0.394 at 3 years follow-up and only 0.236 at 4 years follow-up) than those in any of the other treatment groups (P<0.05) even when controlling for age, cancer stage, race and study. Additionally, the survival of subjects treated LHRH plus anti-androgen was nominally lower (0.761 at 3 years follow-up) than those of subjects treated with LHRH or anti-androgen alone. Similar adverse events were reported for each of the treatment groups; however, proportions for these adverse events varied (Table 1).
The standard of care implemented for a given cancer type can vary dramatically amongst providers. The availability of data from multiple clinical trials offers the unprecedented opportunity to compare outcomes from different standard of care treatments. To evaluate differences in standard-of-care treatment for prostate cancer, we present here the analysis of comparator arm patient-level data from a newly available open clinical trial dataset. Using this dataset, known outcome differences for different chemotherapy treatments for hormone-refractory prostate cancer are further validated. By contrast, there is no general agreement on the best method for reducing testosterone levels in prostate cancer patients, and we were able here to gain insight into comparative survival outcomes of four different testosterone suppression treatment options.
In our first analyses we compare the survival outcomes between two chemotherapies in combination with prednisone as well as prednisone alone showing a better outcome after treatment with the docetaxel plus prednisone combination. Our findings are in line with the results of a separate phase 3 clinical trial, where treatment with docetaxel plus prednisone in the first-line treatment of patients with castration resistant prostate cancer was shown to have a 2.4 month survival benefit compared to mitoxantrone plus prednisone, prolonging survival from 16.5 months to 18.9 months13.
As a result of this trial, docetaxel every 3 weeks in combination with daily prednisone was approved for the treatment of patients with hormone-refractory metastatic prostate cancer, and is now the accepted standard of care for these patients14. The meta-analysis conducted here further demonstrates the survival benefits of treatment with docetaxel plus prednisone in comparison to mitoxantrone plus prednisone or prednisone alone. However, since subjects in the mitoxantrone plus prednisone and the prednisone treatment groups were selected after failing treatment with docetaxel, it is possible that they are generally less likely to respond to treatment and this contributed to the lower survival seen in these groups. We additionally show no survival advantages for treatment with mitoxantrone plus prednisone in comparison to prednisone alone, similarly to previous studies15,16. While palliative effects were also observed in HRPC patients following the administration of either corticosteroid alone17 or, mitoxantrone with either prednisone or hydrocortisone16,18–20, these were even more significant in subjects treated with docetaxel13. In addition to validating other trial results, this analysis demonstrates the power that meta-analyses have in detecting therapeutic advantages.
One of the goals in treating prostate cancer is achieving and maintaining an effective suppression of testosterone levels. This can be achieved by administration of LHRH agonists, anti-androgens or by surgical castration. While with bilateral orchiectomy, lowered testosterone levels are almost instantly achieved, it is not commonly performed mostly due the irreversibility of the procedure21. In an early prostate cancer study, treatment with orchiectomy, placebo, estrogen or orchiectomy plus estrogen was compared. In stage IV patients, equivalent survival rates at nine years follow-up were seen in all four arms suggesting no survival differences between treatments in this subset of patients22,23. In a second trial, orchiectomy did not differ from androgen-suppression therapy in survival and response to chemotherapy in patients with hormone-refractory prostate cancer24. Our results however, indicate that orchiectomy is less beneficial due to lower survival rates in comparison to modern hormonal therapies (i.e., other than estrogen) even when controlling for age, cancer stage, race and the study from which the data originated. While there are better quality-of-life outcomes such as less frequently reported erectile dysfunction, breast swelling and physical discomfort for orchiectomy in comparison to patients treated with LHRH25,26, the lower survival rates demonstrated here should be considered in the decision to undergo surgical castration following further validation of our results. Additionally, our results indicate the trend that subjects treated with LHRH and anti-androgen have lower survival rates than those treated with either LHRH or anti-androgen alone. Anti-androgens may be added to treatment when the LHRH agonist (or other androgen lowering treatment) is no longer working well on its own or it may be given along with an LHRH agonist as initial therapy (referred to as combined androgen blockade). Meta-analysis of the literature showed that combined androgen blockade had no survival benefits in comparison to treatment with LHRH agonists or orchiectomy at 2 years, and better survival at 5 years27. This literature meta-analyses compared combined androgen blockade therapy to all monotherapies (LHRH agonists or orchiectomy) grouped as one, which could explain the difference from our results. Additionally, none of the trials included in these previous meta-analyses included subjects treated with bicalutamide as the anti-androgen while in our analysis at least 115 of the 309 subjects in the LHRH plus anti-androgen group were treated with bicalutamide plus some LHRH agonist. A clinical trial, specifically designed to compare the four androgen ablation treatment options should be considered in order to validate our own findings and to clarify which treatment approach is most favorable.
There are several limitations to the work presented here. First, only outcomes as measured by survival rates and adverse events are presented. Ideally, testosterone levels in each of the testosterone suppression treatment groups should have been examined and compared to clinically relevant levels agreed upon in the literature21, however these data were not fully available in this dataset. Second, some of the data lacks critical detail; for example, for many of the subjects we do not know which specific drugs (or dose) were given in each of the testosterone suppression treatments (such as goserelin or leuprorelin) since the data files only included general terms to describe each treatment arm (such as LHRH agonists). Third, while age, race and cancer stage were controlled for in the analyses presented here, there could be some other confounders not taken into account. Finally, significant effort had to be invested in organizing, annotating and integrating the data from the different trials before a comparative analysis could be performed. Since considerable manual effort needed to be invested in the processing of these data, only eight prostate cancer trials were downloaded and used as proof of concept for the work presented here. Additionally, only the control, placebo or comparator arms data were made available for research, making reanalysis of the original trials or a more comprehensive meta-analysis impossible. Nevertheless, the clinical trials dataset we describe here holds a lot of potential for cancer research and future work on this project will include adding data from all the trials available on the Project Data Sphere site and from other resources as they become available.
There are many potential benefits for the sharing of clinical trial data28–30; with trial data available to the scientific community, trial results can be examined, reproduced and combined with other data to conduct meta-analyses31. Comparing treatments, outcomes and other disease-related patterns by meta-analysis can help gain a better understanding of the disease under investigation. Furthermore, given a large enough number of studies pertaining to the same disease, the outcomes of different treatments may be compared. Additionally, these data may be used to identify and define subgroups of subjects who respond better to a specific treatment. The abundance of raw, patient-level clinical data has great potential in leading to scientific advances in medical research and development of new techniques in clinical informatics32–34. Availability of patient-level data such as raw clinical measurements, rather than summarized table data, can allow researchers to independently verify published results as well as evaluate new hypotheses.
To conclude, we present here the meta-analyses of data from newly available pharma-released clinical trials and the comparison of several lines of standard-of-care treatment in prostate cancer. By combining comparator arms from different trials we were able to validate previously described results as well as identify possible adverse survival outcomes for surgical castration therapy in prostate cancer. While potential refinements in standard of care are highly desirable outcomes of future meta-analyses of other clinical trial control data sets, we envision that availability of data from experimental arms from multiple clinical trials would enable meta-analyses that could lead to the discovery of experimental drug effects not observable in individual clinical trials.
Clinical trial data from the project data sphere portal
Clinical trial data were obtained from the Project Data Sphere portal (projectdatasphere.org) which stores, shares and allows analysis of patient level phase III cancer trial data11. Following registration, submission and approval of a research proposal, the data are made available for either download or analysis on an online SAS platform (Fig. 4).
Survival, demographic and treatment data for 8 prostate cancer clinical trials (of the first trials made available on the site that included annotation files, Data Citations 1-8, Table 2) were downloaded from the Project Data Sphere database and used for the analyses presented here, totaling 4127 comparator arm participants represented by patient-level data. Subsets of subjects with matching treatments were generated for the comparison analyses described herein. For the comparison of chemotherapies combined with prednisone and treatment with prednisone alone, a total of 923 subjects, for which treatment and survival data were available, were used. For the comparison of androgen ablation treatments a total of 802 subjects, for which treatment and survival data were available, were used.
Assigning cancer stage to subjects with missing assessments
For several of the trials in our dataset (trials 1–4, Table 2), the cancer stage was not readily available for the subjects included in our analysis (a total of 802 subjects). We therefore assigned each subject with a cancer stage based on the available tumor status and involvement of lymph nodes and based on the AJCC cancer staging manual35. If there was any indication of metastasis in lymph nodes, stage IV was assigned to those subjects (regardless of tumor status). For subjects with no lymph node involvement and who had a tumor status of T1b, T1c, T1 or T2, stage II was assigned. For subjects with no lymph node involvement and a tumor status of T3, stage III was assigned. For subjects with no lymph node involvement and tumor status T4, stage IV was assigned. There were no other combinations of tumor and metastasis status in the data. A cancer stage was successfully assigned for 640 subjects.
Kaplan-Meier analyses were conducted using the ‘Survival’ package (version 2.38–3) in R36. Cox proportional regression was used to calculate the significance for the differences between sample sets. These models controlled for differences in age, race, cancer stage and the clinical trial from which the data originated (where applicable). Chi-squared test was used for calculating differences between age group distributions.
The scripts used for all data analyses, implemented in R, are available in the Supplementary Code section of the Supplementary Information.
Disclaimer: This publication is based on research using information obtained from www.projectdatasphere.org, which is maintained by Project Data Sphere, LLC. Neither Project Data Sphere, LLC nor the owner(s) of any information from the web site have contributed to, approved or are in any way responsible for the contents of this publication.
How to cite this article: Geifman, N. & Butte, A. J. A patient-level data meta-analysis of standard-of-care treatments from eight prostate cancer clinical trials. Sci. Data 3:160027 doi: 10.1038/sdata.2016.27 (2016).
Jemal, A. et al. Global cancer statistics. CA: a cancer journal for clinicians 61, 69–90 (2011).
Hanks, G. E., Hanlon, A. L., Epstein, B. & Horwitz, E. M. Dose response in prostate cancer with 8-12 years' follow-up. International journal of radiation oncology, biology, physics 54, 427–435 (2002).
Freedland, S. J. et al. Risk of prostate cancer-specific mortality following biochemical recurrence after radical prostatectomy. Jama 294, 433–439 (2005).
Bolla, M. et al. Long-term results with immediate androgen suppression and external irradiation in patients with locally advanced prostate cancer (an EORTC study): a phase III randomised trial. Lancet 360, 103–106 (2002).
Pilepich, M. V. et al. Androgen suppression adjuvant to definitive radiotherapy in prostate carcinoma--long-term results of phase III RTOG 85-31. International journal of radiation oncology, biology, physics 61, 1285–1290 (2005).
Crawford, E. D. et al. A controlled trial of leuprolide with and without flutamide in prostatic carcinoma. The New England journal of medicine 321, 419–424 (1989).
Sharifi, N., Gulley, J. L. & Dahut, W. L. Androgen deprivation therapy for prostate cancer. Jama 294, 238–244 (2005).
Denmeade, S. R. & Isaacs, J. T. A history of prostate cancer treatment. Nature reviews. Cancer 2, 389–396 (2002).
Eisenberger, M. A. et al. Bilateral orchiectomy with or without flutamide for metastatic prostate cancer. The New England journal of medicine 339, 1036–1042 (1998).
Green, A. K. et al. The Project Data Sphere Initiative: Accelerating Cancer Research by Sharing Data. The oncologist 20, 464–e20 (2015).
Hede, K. Project data sphere to make cancer clinical trial data publicly available. Journal of the National Cancer Institute 105, 1159–1160 (2013).
Nisen, P. & Rockhold, F. Access to patient-level data from GlaxoSmithKline clinical trials. The New England journal of medicine 369, 475–478 (2013).
Tannock, I. F. et al. Docetaxel plus prednisone or mitoxantrone plus prednisone for advanced prostate cancer. The New England journal of medicine 351, 1502–1512 (2004).
Mohler, J. et al. NCCN clinical practice guidelines in oncology: prostate cancer. Journal of the National Comprehensive Cancer Network: JNCCN 8, 162–200 (2010).
Green, A. K. et al. Comparative effectiveness of mitoxantrone plus prednisone versus prednisone alone in metastatic castrate-resistant prostate cancer after docetaxel failure. The oncologist 20, 516–522 (2015).
Tannock, I. F. et al. Chemotherapy with mitoxantrone plus prednisone or prednisone alone for symptomatic hormone-resistant prostate cancer: a Canadian randomized trial with palliative end points. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 14, 1756–1764 (1996).
Tannock, I. et al. Treatment of metastatic prostatic cancer with low-dose prednisone: evaluation of pain and quality of life as pragmatic indices of response. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 7, 590–597 (1989).
Osoba, D., Tannock, I. F., Ernst, D. S. & Neville, A. J. Health-related quality of life in men with metastatic prostate cancer treated with prednisone alone or mitoxantrone and prednisone. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 17, 1654–1663 (1999).
Kantoff, P. W. et al. Hydrocortisone with or without mitoxantrone in men with hormone-refractory prostate cancer: results of the cancer and leukemia group B 9182 study. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 17, 2506–2513 (1999).
Moore, M. J. et al. Use of palliative end points to evaluate the effects of mitoxantrone and low-dose prednisone in patients with hormonally resistant prostate cancer. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 12, 689–694 (1994).
Gomella, L. G. Effective testosterone suppression for prostate cancer: is there a best castration therapy? Reviews in urology 11, 52–60 (2009).
Byar, D. P. Treatment of prostatic cancer: studies by the Veterans Administration cooperative urological research group. Bulletin of the New York Academy of Medicine 48, 751–766 (1972).
Blackard, C. E., Byar, D. P. & Jordan, W. P. Jr. Orchiectomy for advanced prostatic carcinoma. A reevaluation. Urology 1, 553–560 (1973).
Hussain, M., Wolf, M., Marshall, E., Crawford, E. D. & Eisenberger, M. Effects of continued androgen-deprivation therapy and other prognostic factors on response and survival in phase II chemotherapy trials for hormone-refractory prostate cancer: a Southwest Oncology Group report. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 12, 1868–1875 (1994).
Potosky, A. L. et al. Quality-of-life outcomes after primary androgen deprivation therapy: results from the Prostate Cancer Outcomes Study. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 19, 3750–3757 (2001).
Clark, J. A., Wray, N. P. & Ashton, C. M. Living with treatment decisions: regrets and quality of life among men treated for metastatic prostate cancer. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 19, 72–80 (2001).
Samson, D. J. et al. Systematic review and meta-analysis of monotherapy compared with combined androgen blockade for patients with advanced prostate carcinoma. Cancer 95, 361–376 (2002).
Krumholz, H. M. & Peterson, E. D. Open access to clinical trials data. Jama 312, 1002–1003 (2014).
Lo, B. Sharing clinical trial data: maximizing benefits, minimizing risk. Jama 313, 793–794 (2015).
Rosenblatt, M., Jain, S. H. & Cahill, M. Sharing of clinical trial data: benefits, risks, and uniform principles. Annals of internal medicine 162, 306–307 (2015).
Ross, J. S., Lehman, R. & Gross, C. P. The importance of clinical trial data sharing: toward more open science. Circulation. Cardiovascular quality and outcomes 5, 238–240 (2012).
National Research Council (US) Committee on A Framework for Developing a New Taxonomy of Disease. in Toward Precision Medicine: Building a Knowledge Network for Biomedical Research and a New Taxonomy of Disease (National Academies Press, 2011).
Chawla, N. V. & Davis, D. A. Bringing big data to personalized healthcare: a patient-centered framework. Journal of general internal medicine 28 Suppl 3, S660–S665 (2013).
Shaikh, A. R. et al. Collaborative biomedicine in the age of big data: the case of cancer. Journal of medical Internet research 16, e101 (2014).
American Joint Committee on Cancer. in Cancer Staging Manual, 6th edn, 309–316 (Springer, 2002).
A Package for Survival Analysis in S. v. 2.38. http://CRAN.R-project.org/package=survival (2015).
Project Data Sphere Prostat_AstraZe_1995_102 (2014)
Project Data Sphere Prostat_AstraZe_2008_103 (2014)
Project Data Sphere Prostat_AstraZe_1995_106 (2014)
Project Data Sphere Prostat_AstraZe_1995_105 (2014)
Project Data Sphere Prostat_Centoco_2006_98 (2014)
Project Data Sphere Prostat_Celgene_2009_90 (2014)
Project Data Sphere Prostat_Pfizer_2008_81 (2014)
Project Data Sphere Prostat_Sanofi_2007_79 (2014)
This work was supported by the National Cancer Institute of the National Institutes of Health under award number U24 CA195858. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The authors would also like to thank Dr Uta Grieshammer, Prof Marina Sirota and Dr Dvir Aran for helpful discussion and useful suggestions.
The authors declare no competing financial interests.
About this article
Cite this article
Geifman, N., Butte, A. A patient-level data meta-analysis of standard-of-care treatments from eight prostate cancer clinical trials. Sci Data 3, 160027 (2016). https://doi.org/10.1038/sdata.2016.27
BMC Cancer (2017)
Alzheimer's Research & Therapy (2017)
Publishing descriptions of non-public clinical datasets: proposed guidance for researchers, repositories, editors and funding organisations
Research Integrity and Peer Review (2016)