Original Article

Bone Marrow Transplantation (2011) 46, 443–447; doi:10.1038/bmt.2010.139; published online 7 June 2010

Clinical Trials

Impact of the European Clinical Trials Directive on prospective academic clinical trials associated with BMT
Open

L J Frewer1, D Coles1,2, I A van der Lans1, D Schroeder2, K Champion3 and J F Apperley4

  1. 1MCB Group, Wageningen University, Wageningen, The Netherlands
  2. 2Centre for Professional Ethics, University of Central Lancashire, Preston, UK
  3. 3EBMT Trials Office, Tower Wing, Guy's Hospital, London, UK
  4. 4Department of Haematology, Faculty of Medicine, Imperial College London, London, UK

Correspondence: Dr LJ Frewer, MCB Group, Wageningen University, Hollandseweg 1, Wageningen 6706 KN, The Netherlands. E-mail: Lynn.Frewer@wur.nl

Received 2 November 2009; Revised 29 January 2010; Accepted 21 April 2010; Published online 7 June 2010.

Top

Abstract

The European Clinical Trials Directive (EU 2001; 2001/20/EC) was introduced to improve the efficiency of commercial and academic clinical trials. Concerns have been raised by interested organizations and institutions regarding the potential for negative impact of the Directive on non-commercial European clinical research. Interested researchers within the European Group for Blood and Marrow Transplantation (EBMT) were surveyed to determine whether researcher experiences confirmed this view. Following a pilot study, an internet-based questionnaire was distributed to individuals in key research positions in the European haemopoietic SCT community. Seventy-one usable questionnaires were returned from participants in different EU member states. The results indicate that the perceived impact of the European Clinical Trials Directive has been negative, at least in the research areas of interest to the EBMT.

Keywords:

European Clinical Trials Directive; perceived impact; academic clinical trials; national trials; multinational trials

Top

Introduction

The European Clinical Trials Directive (EU 2001; 2001/20/EC) was introduced on 1 May 2004 to simplify and harmonize the administrative procedures governing commercial and academic clinical trials. Concerns have been raised by interested organizations and institutions regarding the potential for negative impact of the Directive on non-commercial European clinical research.1, 2, 3, 4, 5, 6 These have been supported by empirical investigation.7 The impact may not be negative in all EU member states for all types of clinical trials.8, 9 The predominant view is that the net impact of the Directive has been to increase the administrative burden associated with the competent authority and ethical clearances, in particular for multinational trials.10 The aim of the research presented here was to examine researcher concerns and perceptions regarding the impact of the Directive on academic clinical trials in the area of haematopoietic SCT.

Top

Materials and methods

A pilot questionnaire (All questionnaires are available from the corresponding author upon request.) was designed and distributed electronically to active researchers within the European Group for Blood and Marrow Transplantation (EBMT). This aimed to explore researcher concerns about conducting clinical trials in the area of SCT, post-implementation of the European Clinical Trials Directive. Respondents were asked to provide information about their professional responsibilities associated with prospective clinical trials, including drug trials (job description, institution, country and experience with single-centre, multicentre national and multicentre international prospective clinical trials relating to SCT, and institutional activities related to different types of prospective clinical trials). Information was then provided regarding the date of implementation of the European Clinical Trials Directive in different EU member states. Respondents were asked whether they thought the numbers of academic and pharmaceutical clinical trials (single-centre, multicentre national and multicentre international) being conducted in their country and by their own institutions had been influenced by the implementation of the Directive. Respondents were also asked the reasons why they thought a decline in the numbers of trials had occurred where relevant.

Forty-one respondents returned the pilot questionnaire. The results indicated that the majority of respondents perceived the impact of the Directive to be negative (75%), although a minority reported that it had made no difference or had a positive effect on the implementation of prospective clinical trials. Nearly all respondents reported being involved, at a reasonably senior level, in academic clinical trials. The higher number of respondents from certain EU member states (for example, Germany) may have reflected the differential perception of problems and concerns in these states in particular (Table 1). The results of the pilot questionnaire were used to develop the main study questionnaire. The questionnaire used the results of the qualitative analysis of the pilot study results to formulate closed questions, focused on (1) researcher perceptions of the potential problems that have arisen following the implementation of the European Clinical Trials Directive (Table 2), and (2) their priorities for specific changes that could improve the implementation of clinical trials in areas of relevance to the EBMT (Table 3).




Cascade methodology was applied to ensure equal distribution of responses across EU member states. Respondents were recruited via the Chairs of the 11 EMBT Working Parties. This enabled the opinions of individuals in key research positions in the European haemopoietic SCT community to be surveyed.

Top

Results

Seventy-one usable questionnaires were returned. As before, respondents provided information about their professional responsibilities. All respondents were senior researchers or principal investigators who were actively involved in clinical trials in the area of haemopoietic SCT and were located across different EU member states (Table 1). In all, 86% had been involved in multicentre national trials at a senior level. In line with the results of the pilot study, 70% of respondents indicated that they perceived the overall impact of the Directive to be negative, 20% positive, 3% reported no change and the remainder expressed no opinion. Respondents were asked whether they ‘believed that time to Ethics Committee/Competent Authority approval is longer or shorter since the implementation of the Clinical Trials Directive’, and, if they replied ‘longer’, to indicate whether this was attributable to increased pre-submission administration, increased post-submission committee delays or other factors. Generally respondents (63.4%) perceived that time to approval was longer. Of these, 93% attributed this to pre-submission administration delays and 69% to post-submission delays (some participants indicated both as relevant). Other delaying factors were indicated as important by 76% of this subsample.

In response to the question ‘do you consider it more difficult for institutions in your country to become involved in academic prospective clinical trials since the implementation of the Clinical Trials Directive’, 86% of the participants reported that it was more difficult to become involved in single-centre prospective clinical trials, 82% in multicentre clinical trials and 86% in international multicentre clinical trials.

A series of statements regarding researcher perspectives on the impact of the European Clinical Trials Directive were developed from the pilot study. These statements are included as they appeared in the questionnaire in Table 2. Participants were asked to rate the extent to which they agreed or disagreed with each statement (5-point rating scale, anchored by 1=‘agree strongly’ and 2=‘disagree strongly’, midpoint of ‘neither agree nor disagree’, and a ‘no opinion’ option). Application of a general linear model repeated-measures procedure tested for the main effects of trial type (single-centre, multicentre national and multicentre international), type of concern and potential interactions between these. For all types of trials, the average ratings were below the midpoint of the scale, indicating that participants tended to evaluate negatively the impact of the European Clinical Trials Directive across all of the items. Differences did not (quite) reach the significance for trial type (F(2,41)=3.7, P=0.06).

A significant effect attributable to type of concern was observed (F(13,30)=5.6, P<0.001). Significant pairwise differences (Tukey's post-hoc test) between different types of concern are summarized in Table 2. The greatest concern was associated with the increased volume of paperwork, increased demands associated with running the trial (monitoring or audit, or legal requirements), or increased costs for insurance or ethical approval. The significant interaction between type of concern and trial type (F(26,17)=2.39, P<0.05, Figure 1) indicated that greater concerns were expressed for multicentre international trials regarding increased insurance costs, delays in institutional approval and increased liability. Concerns about increased running costs and increased legal requirements were not so great. The lower levels of concern about the potential increase in regulatory approvals may reflect that, in most countries, there is already an obligation pre-Directive to gain approval.

Figure 1.
Figure 1 - Unfortunately we are unable to provide accessible alternative text for this. If you require assistance to access this image, please contact help@nature.com or the author

Differences in researcher concerns associated with the impact of the European Clinical Trials Directive on different types of clinical trial. The lower the mean rating, the greater the respondent agreement that the concern represented a problem regarding the implementation of clinical trials following the European Clinical Trials Directive.

Full figure and legend (147K)

Finally, respondents rated potential changes that might be implemented to facilitate national single-centre, national multicentre or international multicentre trials. The different items, derived from the pilot study, are reproduced in Table 3. As before, a general linear model repeated-measures procedure was applied. A significant main effect attributable to type of change was observed (F(16, 44)=6.14, P<0.001). Significant differences are summarized in Table 3. Note that all of the mean scores had values less than the midpoint of the scale (3), indicating, on average, agreement with all the changes. Reduction in administrative burden, harmonization of documents required for approval, and increased access to public funding for clinical trials and translational research were priority changes for respondents.

Top

Discussion

The results indicate that the perceived impact of the European Clinical Trials Directive has been negative, at least in the research areas of interest to EBMT. The results of the pilot and main studies suggest similar interpretation in this regard, despite the potential self-selection bias for respondents included in the pilot study. In terms of identifying potential changes that would remedy the situation, prioritization was given to the need to reduce the administrative burden associated with running academic clinical trials. As part of this, the need to harmonize documentation associated with the application process for trial approval and monitoring was identified. Increased insurance costs, delays in institutional approval and increased liability were particularly problematic for multicentre international trials. The creation of a single European Competent Authority was not rated as being as important as some of the other potential changes.

To conclude, the results support the impression provided by much of the literature that the European Clinical Trials Directive has increased the (perceived) administrative burden on researchers, and introduced additional barriers and bottlenecks into the research process. This may be attributable to the process by which each member state incorporated the Directive into national legislation, thereby introducing important differences in interpretation. Policy changes are required, specifically aimed at facilitating clinical trials by promoting harmonization, reducing administrative burdens, and streamlining the regulatory and approval process.

The CLINT project partners met to share the findings with ICREL (Impact on Clinical Research of European Legislation, a 1-year project funded by FP7 to measure change in the performance of clinical trials in Europe between 2003 and 2007), ECRIN (European Clinical Research Infrastructures Network) and ELN (The European Leukaemia Network). The meeting also took into account the findings of the European Science Foundation ‘Forward Look’.11 A series of stakeholder workshops (also involving EFGCP, the European Forum for Good Clinical Practice.) have explored issues relevant to clinical research in Europe, and will deliver recommendations through a final stakeholder conference in mid-2010, specifically a set of concrete and actionable recommendations relevant to the formal review of the Directive, which is scheduled in 2010.

Top

Conflict of interest

The authors declare no conflict of interest.

Top

References

  1. Meunier F, Dubois N, Negrouk A, Rea LA, Saghatchian M, Turz T et al. Throwing a wrench in the works? Lancet Oncol 2003; 4: 717–719. | Article | PubMed |
  2. Lacombe D, Rea LA, Meunier F. New EU legislation may hinder academic clinical cancer research. Eur J Hospital Pharm Pract 2003; 3: 14–18.
  3. Moulton B. Save European research campaign. Br Med J 2004; 328: 286. | Article |
  4. Hemminiki A, Kellokumpku-Lehtinen K. Harmful impact of EU clinical trials directive. Br Med J 2006; 332: 501–502. | Article |
  5. Keim B. Tied up in red tape. European trials shut down [letter]. Nat Med 2007; 13: 110. | PubMed |
  6. van Vyve D, Meunier F. Facing the Challenges of the European Clinical Trials Directive: the European Organisation for Research and Treatment of Cancer perspective. Eur Oncol 2008; 4: 1.
  7. Hartmann A, Hartmann-Vareilles F. The Clinical Trials Directive: how is it affecting European non-commercial research. PLoS (Public Library of Science) Clin Trials 2006; 1: 1–8.
  8. Berendt L, Hakansson C, Bach KF, Dalhoff K, Andreaen A, Petersen LG et al. Effect of European Clinical trials Directive on academic drug trials in Denmark: retrospective study of applications to the Danish Medicines Agency 1993–2006. Br Med J 2008; 336: 33–35. | Article |
  9. European Forum for Good Clinical Practice (EFGCP) HEALTH-F1-007-201002 2009 ‘Impact on Clinical Research of European Legislation (ICREL), Project report submitted to the European Commission, Directorate Research. Available from: http://www.efgcp.be/downloads/icrel_docs/Final_report_ICREL.pdf (accessed 29 October 2009).
  10. Frewer LJ, Coles D, Champion K, Lejeune S, Klingmann I, Kubiak C et al. Has the European Clinical Trials Directive been a success? Br Med J 2010; 340: 1862. | Article |
  11. European Science Foundation 2008 FL 07-001, ‘Investigator-driven clinical trials (Forward Look)’. Available from http://www.esf.org/fileadmin/links/EMRC/FL_IDCT.pdf (accessed 3 April 2009).
Top

Acknowledgements

The research reported here was supported by the EU-funded CLINT project (Facilitating International Prospective Clinical Trials in Stem Cell Transplantation, Proposal no. 037662). The views expressed are those of the authors. The authors would also like to thank Cathy Lennon at the University of Central Lancashire for her help with this research.

This work is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 Unported License.
To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-sa/3.0/