More than 50 years after the introduction of modern pharmacotherapies for schizophrenia, there remains a tremendous need for therapeutic advances. A second generation of antipsychotic drugs, introduced over the past 15 years, has provided uncertain advantages over the first-generation drugs. This paper reviews the designs of studies that evaluate the effectiveness of putative antipsychotic drugs. Data from the trials needed to achieve regulatory approval do not meet all the needs of clinicians and policy makers. Practical and large, simple trials that evaluate the comparative effectiveness of antipsychotic drugs in real-world settings can help to meet these needs once a drug has reached the market.
Schizophrenia is a severe and complex illness for which current treatments are only partially effective. The development of antipsychotic drugs that are used to treat schizophrenia follows usual drug development paradigms, but these studies have illness-specific challenges.
The complex nature of schizophrenia means there are many clinically relevant outcomes worthy of study. Typical studies attempt to address many outcomes, leading to a multiple comparisons problem and the risk of false-positive research findings. Non-compliance with treatment regimens, study drop-out rates and missing data pose major problems in schizophrenia trials.
Most available data regarding antipsychotic drug effectiveness come from industry-sponsored studies that were intended to meet regulatory requirements efficiently. Available data are not adequately informative for clinicians and policy-makers, who face difficult, 'real-world' decisions.
Large, simple trials attempt to answer important clinical questions by enrolling large numbers of subjects in randomized trials in typical treatment settings that collect minimal data regarding only crucial outcomes.
Practical clinical trials attempt to aid clinical and policy decision-makers by addressing a broad range of relevant questions regarding existing treatments in settings and conditions that are representative of 'real-world' conditions.
Subscribe to Journal
Get full journal access for 1 year
only $22.08 per issue
All prices are NET prices.
VAT will be added later in the checkout.
Rent or Buy article
Get time limited or full article access on ReadCube.
All prices are NET prices.
Lieberman, J. A. & Stroup, T. S. Guest editors' introduction: what can large pragmatic clinical trials do for public mental health care? Schizophr. Bull. 29, 1–6 (2003).
Stroup, T. S. et al. The National Institute of Mental Health Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) project: schizophrenia trial design and protocol development. Schizophr. Bull. 29, 15–31 (2003). One of two papers referenced here (see also reference 66) describing the rationale, design and primary results of the National Institute of Mental Health-sponsored Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) project, an example of a practical trial that examined the comparative effectiveness of antipsychotic drugs.
Beasley, C. M. Jr et al. Olanzapine versus placebo and haloperidol: acute phase results of the North American double-blind olanzapine trial. Neuropsychopharmacology 14, 111–123 (1996).
Beasley, C. M. Jr et al. Olanzapine versus haloperidol: acute phase results of the international double-blind olanzapine trial. Eur. Neuropsychopharmacol. 7, 125–137 (1997).
Tollefson, G. D. et al. Olanzapine versus haloperidol in the treatment of schizophrenia and schizoaffective and schizophreniform disorders: results of an international collaborative trial. Am. J. Psychiatry 154, 457–465 (1997).
Buchanan, R. W., Breier, A., Kirkpatrick, B., Ball, P. & Carpenter, W. T. Jr. Positive and negative symptom response to clozapine in schizophrenic patients with and without the deficit syndrome. Am. J. Psychiatry 155, 751–760 (1998).
Rosenheck, R. et al. Impact of clozapine on negative symptoms and on the deficit syndrome in refractory schizophrenia. Department of Veterans Affairs Cooperative Study Group on Clozapine in Refractory Schizophrenia. Am. J. Psychiatry 156, 88–93 (1999).
Tollefson, G. D. & Sanger, T. M. Negative symptoms: a path analytic approach to a double-blind, placebo- and haloperidol-controlled clinical trial with olanzapine. Am. J. Psychiatry 154, 466–474 (1997).
Green, M. F. Does risperidone improve verbal working memory in treatment-resistant schizophrenia? Am. J. Psychiatry 154, 799–804 (1997).
Bilder, R. M. et al. Neurocognitive effects of clozapine, olanzapine, risperidone, and haloperidol in patients with chronic schizophrenia or schizoaffective disorder. Am. J. Psychiatry 159, 1018–1028 (2002).
Purdon, S. E. et al. Neuropsychological change in early phase schizophrenia during 12 months of treatment with olanzapine, risperidone, or haloperidol. The Canadian Collaborative Group for research in schizophrenia. Arch. Gen. Psychiatry 57, 249–258 (2000).
Citrome, L. et al. Effects of clozapine, olanzapine, risperidone, and haloperidol on hostility among patients with schizophrenia. Psychiatr. Serv. 52, 1510–1514 (2001).
Meltzer, H. Y. et al. Clozapine treatment for suicidality in schizophrenia: International Suicide Prevention Trial (InterSePT). Arch. Gen. Psychiatry 60, 82–91 (2003).
Emsley, R. A. Risperidone in the treatment of first-episode psychotic patients: a double-blind multicenter study. Risperidone Working Group. Schizophr. Bull. 25, 721–729 (1999).
Bobes, J. et al. Safety and effectiveness of olanzapine versus conventional antipsychotics in the acute treatment of first-episode schizophrenic inpatients. Prog. Neuropsychopharmacol. Biol. Psychiatry 27, 473–481 (2003).
Lieberman, J. A. et al. Atypical and conventional antipsychotic drugs in treatment-naive first-episode schizophrenia: a 52-week randomized trial of clozapine vs chlorpromazine. Neuropsychopharmacology 28, 995–1003 (2003).
McGorry, P. D. et al. Randomized controlled trial of interventions designed to reduce the risk of progression to first-episode psychosis in a clinical sample with subthreshold symptoms. Arch. Gen. Psychiatry 59, 921–928 (2002).
Robinson, D. et al. Predictors of relapse following response from a first episode of schizophrenia or schizoaffective disorder. Arch. Gen. Psychiatry 56, 241–247 (1999). Refs 16–18 describe representative first-episode and prodromal studies of schizophrenia.
Keefe, R. S. et al. Comparative effect of atypical and conventional antipsychotic drugs on neurocognition in first-episode psychosis: a randomized, double-blind trial of olanzapine versus low doses of haloperidol. Am. J. Psychiatry 161, 985–995 (2004).
Lieberman, J. A. et al. Antipsychotic drug effects on brain morphology in first-episode psychosis. Arch. Gen. Psychiatry 62, 361–370 (2005).
Arvanitis, L. A. & Miller, B. G. Multiple fixed doses of 'Seroquel' (quetiapine) in patients with acute exacerbation of schizophrenia: a comparison with haloperidol and placebo. The Seroquel Trial 13 Study Group. Biol. Psychiatry 42, 233–246 (1997).
Copolov, D. L., Link, C. G. & Kowalcyk, B. A multicentre, double-blind, randomized comparison of quetiapine (ICI 204, 636, 'Seroquel') and haloperidol in schizophrenia. Psychol. Med. 30, 95–105 (2000).
Daniel, D. G. et al. Ziprasidone 80 mg/day and 160 mg/day in the acute exacerbation of schizophrenia and schizoaffective disorder: a 6-week placebo-controlled trial. Ziprasidone Study Group. Neuropsychopharmacology 20, 491–505 (1999).
Kane, J. M. et al. Efficacy and safety of aripiprazole and haloperidol versus placebo in patients with schizophrenia and schizoaffective disorder. J. Clin. Psychiatry 63, 763–771 (2002).
Peuskens, J. & Link, C. G. A comparison of quetiapine and chlorpromazine in the treatment of schizophrenia. Acta Psychiatr. Scand. 96, 265–273 (1997).
Csernansky, J. G., Mahmoud, R. & Brenner, R. A comparison of risperidone and haloperidol for the prevention of relapse in patients with schizophrenia. N. Engl. J. Med. 346, 16–22 (2002).
Azorin, J. M. et al. A double-blind comparative study of clozapine and risperidone in the management of severe chronic schizophrenia. Am. J. Psychiatry 158, 1305–1313 (2001).
Emsley, R. A., Raniwalla, J., Bailey, P. J. & Jones, A. M. A comparison of the effects of quetiapine ('seroquel') and haloperidol in schizophrenic patients with a history of and a demonstrated, partial response to conventional antipsychotic treatment. PRIZE Study Group. Int. Clin. Psychopharmacol. 15, 121–131 (2000).
Rabinowitz, J. & Davidson, M. Risperidone versus haloperidol in long-term hospitalized chronic patients in a double blind randomized trial: a post hoc analysis. Schizophr. Res. 50, 89–93 (2001).
Tollefson, G. D., Birkett, M. A., Kiesler, G. M. & Wood, A. J. Double-blind comparison of olanzapine versus clozapine in schizophrenic patients clinically eligible for treatment with clozapine. Biol. Psychiatry 49, 52–63 (2001).
Volavka, J. et al. Clozapine, olanzapine, risperidone, and haloperidol in the treatment of patients with chronic schizophrenia and schizoaffective disorder. Am. J. Psychiatry 159, 255–262 (2002).
Breier, A. & Hamilton, S. H. Comparative efficacy of olanzapine and haloperidol for patients with treatment-resistant schizophrenia. Biol. Psychiatry 45, 403–411 (1999).
Kane, J. M., Honigfeld, G., Singer, J. & Meltzer, H. Clozapine in treatment-resistant schizophrenics. Psychopharmacol. Bull. 24, 62–67 (1988).
Kumra, S. et al. Childhood-onset schizophrenia. A double-blind clozapine-haloperidol comparison. Arch. Gen. Psychiatry 53, 1090–1097 (1996).
Essock, S. M., Drake, R. E., Frank, R. G. & McGuire, T. G. Randomized controlled trials in evidence-based mental health care: getting the right answer to the right question. Schizophr. Bull. 29, 115–123 (2003). Critiques the role of clinical trials in determining treatment effectiveness.
Chakos, M., Lieberman, J., Hoffman, E., Bradford, D. & Sheitman, B. Effectiveness of second-generation antipsychotics in patients with treatment-resistant schizophrenia: a review and meta-analysis of randomized trials. Am. J. Psychiatry 158, 518–526 (2001).
Revicki, D. A., Genduso, L. A., Hamilton, S. H., Ganoczy, D. & Beasley, C. M. Jr. Olanzapine versus haloperidol in the treatment of schizophrenia and other psychotic disorders: quality of life and clinical outcomes of a randomized clinical trial. Qual. Life Res. 8, 417–426 (1999).
Hoyberg, O. J. et al. Risperidone versus perphenazine in the treatment of chronic schizophrenic patients with acute exacerbations. Acta Psychiatr. Scand. 88, 395–402 (1993).
Peuskens, J. Risperidone in the treatment of patients with chronic schizophrenia: a multi-national, multi-centre, double-blind, parallel-group study versus haloperidol. Risperidone Study Group. Br. J. Psychiatry 166, 712–726; discussion 727–733 (1995).
Volavka, J., Cooper, T. B., Laska, E. M. & Meisner, M. Placebo washout in trials of antipsychotic drugs. Schizophr. Bull. 22, 567–576 (1996).
Borison, R. L., Pathiraja, A. P., Diamond, B. I. & Meibach, R. C. Risperidone: clinical safety and efficacy in schizophrenia. Psychopharmacol. Bull. 28, 213–218 (1992).
Simpson, G. M. et al. Double-blind study of clozapine dose response in chronic schizophrenia. Am. J. Psychiatry 156, 1744–1750 (1999).
Zimbroff, D. L. et al. Controlled, dose-response study of sertindole and haloperidol in the treatment of schizophrenia. Sertindole Study Group. Am. J. Psychiatry 154, 782–791 (1997).
Adams, C. E. Schizophrenia trials: past, present and future. Epidemiol. Psichiatr. Soc. 11, 144–151 (2002).
Thornley, B. & Adams, C. Content and quality of 2000 controlled trials in schizophrenia over 50 years. BMJ 317, 1181–1184 (1998).
Kane, J., Honigfeld, G., Singer, J. & Meltzer, H. Clozapine for the treatment-resistant schizophrenic. A double-blind comparison with chlorpromazine. Arch. Gen. Psychiatry 45, 789–796 (1988).
Rosenheck, R. et al. Effectiveness and cost of olanzapine and haloperidol in the treatment of schizophrenia: a randomized controlled trial. JAMA 290, 2693–2702 (2003).
Hong, C. J., Chen, J. Y., Chiu, H. J. & Sim, C. B. A double-blind comparative study of clozapine versus chlorpromazine on Chinese patients with treatment-refractory schizophrenia. Int. Clin. Psychopharmacol. 12, 123–130 (1997).
Tollefson, G. D. & Sanger, T. M. Anxious-depressive symptoms in schizophrenia: a new treatment target for pharmacotherapy? Schizophr. Res. 35 (Suppl.), S13–S21 (1999).
Tollefson, G. D., Sanger, T. M., Beasley, C. M. & Tran, P. V. A double-blind, controlled comparison of the novel antipsychotic olanzapine versus haloperidol or placebo on anxious and depressive symptoms accompanying schizophrenia. Biol. Psychiatry 43, 803–810 (1998).
Tollefson, G. D., Sanger, T. M., Lu, Y. & Thieme, M. E. Depressive signs and symptoms in schizophrenia: a prospective blinded trial of olanzapine and haloperidol. Arch. Gen. Psychiatry 55, 250–258 (1998).
Beasley, C. M. et al. Randomised double-blind comparison of the incidence of tardive dyskinesia in patients with schizophrenia during long-term treatment with olanzapine or haloperidol. Br. J. Psychiatry 174, 23–30 (1999).
Tollefson, G. D., Beasley, C. M. Jr, Tamura, R. N., Tran, P. V. & Potvin, J. H. Blind, controlled, long-term study of the comparative incidence of treatment-emergent tardive dyskinesia with olanzapine or haloperidol. Am. J. Psychiatry 154, 1248–1254 (1997).
Tran, P. V. et al. Double-blind comparison of olanzapine versus risperidone in the treatment of schizophrenia and other psychotic disorders. J. Clin. Psychopharmacol. 17, 407–418 (1997).
Keefe, R. S., Silva, S. G., Perkins, D. O. & Lieberman, J. A. The effects of atypical antipsychotic drugs on neurocognitive impairment in schizophrenia: a review and meta-analysis. Schizophr. Bull. 25, 201–222 (1999).
Davis, J. M., Chen, N. & Glick, I. D. A meta-analysis of the efficacy of second-generation antipsychotics. Arch. Gen. Psychiatry 60, 553–564 (2003).
Davis, S. M., Koch, G. G., Davis, C. E. & LaVange, L. M. Statistical approaches to effectiveness measurement and outcome-driven re-randomizations in the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) studies. Schizophr. Bull. 29, 73–80 (2003).
DiMasi, J. A., Hansen, R. W., Grabowski, H. G. & Lasagna, L. Cost of innovation in the pharmaceutical industry. J. Health. Econ. 10, 107–142 (1991).
DiMasi, J. A., Seibring, M. A. & Lasagna, L. New drug development in the United States from 1963 to 1992. Clin. Pharmacol. Ther. 55, 609–622 (1994).
Kaitin, K. I. & Manocchia, M. The new drug approvals of 1993, 1994, and 1995: trends in drug development. Am. J. Ther. 4, 46–54 (1997).
Kaitin, K. I., Manocchia, M., Seibring, M. & Lasagna, L. The new drug approvals of 1990, 1991, and 1992: trends in drug development. J. Clin. Pharmacol. 34, 120–127 (1994).
Leber, P. The use of placebo control groups in the assessment of psychiatric drugs: an historical context. Biol. Psychiatry 47, 699–706 (2000).
Corcoran, C., Malaspina, D. & Hercher, L. Prodromal interventions for schizophrenia vulnerability: the risks of being 'at risk'. Schizophr. Res. 73, 173–184 (2005).
Geddes, J., Freemantle, N., Harrison, P. & Bebbington, P. Atypical antipsychotics in the treat-ment of schizophrenia: systematic overview and meta-regression analysis. BMJ 321, 1371–1376 (2000). A pivotal paper that highlighted a key methodological issue in comparative studies of antipsychotic drugs: when first-generation drugs were dosed moderately, differences in effectiveness compared with second-generation drugs were no longer apparent.
Rosenheck, R. A. Open forum: effectiveness versus efficacy of second-generation antipsychotics: haloperidol without anticholinergics as a comparator. Psychiatr. Serv. 56, 85–92 (2005). The author argues that the failure to treat common and expected extrapyramidal side effects in studies using the high-potency first-generation antipsychotic haloperidol as a comparator biases studies in favour of second-generation drugs.
Lieberman, J. A. et al. Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. N. Engl. J. Med. 353, 1209–1223 (2005). The second paper describing the rationale, design and primary results of the CATIE trial (see also reference 2).
Marder, S. R. & Meibach, R. C. Risperidone in the treatment of schizophrenia. Am. J. Psychiatry 151, 825–835 (1994).
Hotopf, M., Churchill, R. & Lewis, G. Pragmatic randomised controlled trials in psychiatry. Br. J. Psychiatry 175, 217–223 (1999). This article makes the case for pragmatic or large, simple trials to evaluate psychiatric treatments.
March, J. S. et al. The case for practical clinical trials in psychiatry. Am. J. Psychiatry 162, 836–846 (2005). A second paper making a case for practical trials to evaluate psychiatric treatments. However, the authors make no distinction between practical trials and pragmatic or large, simple trials.
Peto, R. & Baigent, C. Trials: the next 50 years. Large scale randomised evidence of moderate benefits. BMJ 317, 1170–1171 (1998). The case for large, simple trials is further advanced by this paper.
Tunis, S. R., Stryer, D. B. & Clancy, C. M. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA 290, 1624–1632 (2003). The authors make a case for practical trials that address a range of important issues that might be important to clinical and policy decision-makers.
Dempster, A. P., Laird, N. M. & Rubin, D. B. Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Stat. Soc. Series B 39, 1–38 (1977).
Diggle, P. J., Liang, K. Y. & Zeger, S. L. Analysis of Longitudinal Data (Clarendon, Oxford, 1994).
Hartley, H. O. & Rao, J. N. K. Maximum-likelihood estimation for the mixed analysis of variance model. Biometrika 54, 93–108 (1967).
Liang, K. Y. & Zeger, S. L. Longitudinal data analysis using generalized linear models. Biometrika 73, 13–22 (1986).
Cook, R. & Farewell, V. Multiplicity considerations in the design and analysis of clinical trials. J. R. Stat. Soc. Series A 159, 93–110 (1996).
Als-Nielsen, B., Chen, W., Gluud, C. & Kjaergard, L. L. Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA 290, 921–928 (2003).
Elkes, J. & Elkes, C. Effect of chlorpromazine on the behaviour of chronically over-active psychotic patients. BMJ, 560–565 (1954).
Guttmacher, M. S. et al. Phenothiazine treatment in acute schizophrenia; effectiveness: the National Institute Of Mental Health Psychopharmacology Service Center Collaborative Study Group. Arch. Gen. Psychiatry 10, 246–261 (1964).
May, P. R. A. Treatment of Schizophrenia: a Comparative Study of Five Treatment Methods (Science House, New York, 1968).
Hogarty, G. E. & Goldberg, S. C. Drug and sociotherapy in the aftercare of schizophrenic patients. One-year relapse rates. Arch. Gen. Psychiatry 28, 54–64 (1973).
van Putten, T. et al. A controlled dose comparison of haloperidol in newly admitted schizophrenic patients. Arch. Gen. Psychiatry 47, 754–758 (1989).
The authors' research was supported in part by a research grant from the National Institutes of Health, USA, and funded by the National Institute of Mental Health (NIMH), the Office of the Director, Office of Behavioral and Social Research (OD/OBSSR) and the Clinical Antipsychotic Trials of Intervention Effectiveness project, which, in turn, is supported by the NIMH. The authors thank D. Healy for his suggestions regarding the timeline.
W.M.A. has no competing interests relevant to this paper.
T.S.S. has consulted for Pfizer, Lilly and GlaxoSmithKline.
J.A.L. has received research funding and speaking and consultancy fees from Bristol-Myers Squibb, Pfizer, Lilly and AstraZeneca.
R.M.H. has consulted for Janssen, Lilly, Somerset, Forest, Corcept Therapeutics and Xcel Pharmaceuticals. He also serves on Data Safety Monitoring Boards for the National Institute of Neurological Disorders and Stroke, Schwartz Pharma, Johnson &Johnson, Pfizer, Solvay and Duke University. He is a principal investigator (PI) on a contract between the University of North Carolina and Lilly for the analysis of data from a clinical trial on which J.A.L. was PI comparing two antipsychotics (olanzapine and haloperidol). He has served on multiple NIMH study sections and, from 1998 to 2001, on the FDA Psychopharmacologic Drugs Advisory Committee.
About this article
The Korean Journal of Pain (2019)
Trial exclusion criteria and their impact on the estimation of antipsychotic drugs effect: A case study using the SOHO database
Schizophrenia Research (2018)
The “RCT augmentation”: a novel simulation method to add patient heterogeneity into phase III trials
BMC Medical Research Methodology (2018)
Methodological issues associated with preclinical drug development and increased placebo effects in schizophrenia clinical trials
Expert Review of Clinical Pharmacology (2016)
Effects of first-generation antipsychotics versus second-generation antipsychotics on quality of life in schizophrenia: a double-blind, randomised study
The Lancet Psychiatry (2016)