Lymphatic filariasis and onchocerciasis are neglected tropical diseases (NTDs) targeted for elimination by mass (antifilarial) drug administration. These drugs are predominantly active against the microfilarial progeny of adult worms. New drugs or combinations are needed to improve patient therapy and to enhance the effectiveness of interventions in persistent hotspots of transmission. Several therapies and regimens are currently in (pre-)clinical testing. Clinical trial simulators (CTSs) project patient outcomes to inform the design of clinical trials but have not been widely applied to NTDs, where their resource-saving payoffs could be highly beneficial. We demonstrate the utility of CTSs using our individual-based onchocerciasis transmission model (EPIONCHO-IBM) that projects trial outcomes of a hypothetical macrofilaricidal drug. We identify key design decisions that influence the power of clinical trials, including participant eligibility criteria and post-treatment follow-up times for measuring infection indicators. We discuss how CTSs help to inform target product profiles.
The global health community aims to eliminate lymphatic filariasis (LF, elephantiasis) and onchocerciasis (river blindness) predominantly by mass drug administration (MDA) of antifilarial medicines1,2. The three cornerstone drugs to achieve this goal are albendazole either alone3 or in combination with ivermectin and/or diethylcarbamazine (DEC) for LF4, and ivermectin alone for onchocerciasis. In 2017, 465.4 million people received treatment for LF and 142.4 million people received ivermectin for onchocerciasis5,6. Ivermectin and DEC have potent activity against the microfilarial progeny (the stage transmitted to vectors) of adult worms (macrofilariae). For onchocerciasis, ivermectin also temporarily inhibits the production of microfilariae (mf) by adult female Onchocerca volvulus7 and is partially macrofilaricidal after multiple doses8. For LF, combinations of DEC and albendazole9, and triple combination therapy, IDA (ivermectin with DEC and albendazole)4, has significant activity against adult worms.
The suppression of mf elicited by antifilarial drugs—combined with their efficacy in single oral doses—makes them perfectly suited for lowering and potentially interrupting transmission of filarial infections by MDA if delivered at a high coverage and treatment adherence, and on either an annual or semi-annual basis2. For LF, the microfilaricidal (and macrofilaricidal) efficacy of the drugs, and the shorter life-expectancy of the adult worm compared to O. volvulus (about 5 years compared to about 10 years), has led to the expectation that widespread elimination is feasible, particularly if MDA is combined with vector control10,11. As of 2017, 21 out of 73 LF-endemic countries had stopped MDA and transitioned to post-treatment surveillance6. For onchocerciasis, MDA has greatly reduced morbidity and excess mortality12,13 and has successfully eliminated onchocerciasis transmission from Colombia14, Ecuador15, northern Venezuela16, Mexico17, and Guatemala in Latin America18. Good progress towards elimination has also been made in Africa19, which bears 99% of the onchocerciasis cases, with notable successes in foci in Mali, Senegal20,21 Nigeria19 and Sudan22.
However, the long-lived nature of adult O. volvulus, and the persistence of focal areas of intense transmission mean that elimination of onchocerciasis at a country scale will be extremely challenging within currently proposed timeframes23. Despite many years of MDA, transmission continues in highly endemic onchocerciasis communities with high vector biting rates24,25,26,27. Moreover, in areas of Central and West Africa where loiasis (African eye worm28, caused by another filarial parasite, Loa loa) occurs co-endemically with onchocerciasis, ivermectin cannot be safely delivered through routine MDA because of the rare but severe and life-threatening reactions associated with the killing of L. loa mf in heavily microfilaraemic individuals29. Additionally, suboptimal responses to ivermectin (potentially indicating loss of drug efficacy) have been reported phenotypically in Ghana30 and confirmed genetically in Ghana and Cameroon31. Hence, there is a growing consensus that it is unlikely that ivermectin alone will be sufficient to eliminate onchocerciasis in all endemic African settings and that drugs with macrofilaricidal properties are pressingly needed32,33,34. Macrofilaricides will help accelerate progress towards country-wide elimination and improve individual patient treatment options. Public and privately funded drug development partnerships for the neglected tropical diseases (NTDs), including onchocerciasis, have been developed in response to this need35,36,37,38.
Clinical trial simulation is the (mathematical) representation of clinical trials to inform decision-making on trial design by forward projecting likely trial outcomes39, e.g., Vegvari et al.40 Simulation has been widely implemented in the pharmaceutical sector to assist with the design of trials, often seeking to balance the cost of collecting data with the information (such as safety and/or efficacy) on the drug under consideration that these data will provide41. Clinical trial simulation has not been used to assist drug development in the NTD domain, although simulation has been used widely to project the impact of population-level interventions on onchocerciasis, LF and other NTDs42, and to inform the design of cluster intervention trials targeting elimination of soil-transmitted helminthiases43,44. Simulation could inform the design of clinical trials, offering resource savings that may be particularly important for NTD drug development.
Simulators can include all aspects of the trial protocol, from the recruitment of participants meeting pre-defined eligibility criteria in simulated populations, to the projection of trial outcomes under desired drug properties defined by a target product profile (TPP). Simulations can answer questions such as: (a) how many trial participants need to be recruited to demonstrate superiority over existing treatments (in two- or multi-armed trials); (b) when should participants be followed up, and (c) what infection indicators should be measured as primary and secondary outcomes? These questions are particularly pertinent to the design of antifilarial drug trials because: (a) drugs are generally not completely curative, yet can exert long-lasting reductions in infection intensities; (b) macrofilaricidal drug responses are typically quantified indirectly by measuring mf; (c) response variation among participants is generally very high, and (d) reinfection by unexposed drug-naïve parasites during trials conducted in endemic settings is inevitable (and can be accounted for using trial simulators that explicitly model transmission).
Here we illustrate how a clinical trial simulator (CTS) can be used to help design antifilarial drug trials, using as an example a hypothetical macrofilaricidal drug for the treatment of onchocerciasis. We use an adaptation of our individual-based onchocerciasis transmission model, EPIONCHO-IBM45,46 (a stochastic analogue of the well-established EPIONCHO transmission model)47,48,49, to simulate a hypothetical phase IIb two-arm clinical trial (i.e. a trial focused on assessing efficacy but more limited in size than a phase III trial) comparing the efficacy of the hypothetical macrofilaricide to ivermectin. The CTS can model the (modifiable) antifilarial action of macrofilaricides and factors defining participant eligibility. We focus on trials conducted in previously ivermectin-naïve, mesoendemic transmission foci with a microfilarial prevalence among individuals aged ≥ 5 years ranging from 40% to 50% (transmission foci with higher microfilarial prevalence are likely to have been undergoing MDA for many years). We compare drug responses elicited by a macrofilaricide that is either purely macrofilaricidal (macrofilaricidal only macrofilaricide, MOM) or that has accompanying microfilaricidal activity (macrofilaricidal and microfilaricidal macrofilaricide, MAMM), and identify opportune sampling (follow-up) times and associated sample sizes for demonstrating superiority of these drugs (MOM and MAMM) compared to ivermectin-treated control groups. We explore how design choices related to participant eligibility criteria and parasitological sampling affect the efficiency of trials and we discuss our results in the context of the definition and refinement of TPPs, the need for improved diagnostic indicators (biomarkers) of patent onchocerciasis, and the implementation of trials within a landscape of MDA.
Clinical trial simulation
A schematic description of the simulated trial design is given in Fig. 1 and of the individual-based onchocerciasis transmission model, EPIONCHO-IBM in Fig. 2. An overview of the varied eligibility criteria, diagnostic protocols, macrofilaricidal efficacies and assumed pharmacodynamics (PD) properties of the hypothetical MOM/MAMM is given in Table 1. Macrofilaricidal effects are modelled as the percentage of adult O. volvulus killed within three months of treatment. The microfilaricidal effect of a MAMM is assumed to be identical to that of ivermectin (but without the temporary sterilisation or so-called embryostatic effect, see Basáñez et al.7). Mathematical details of EPIONCHO-IBM, including a complete description of the PD properties of ivermectin, macrofilaricides and other adaptions implemented to yield the CTS, are given in the Supplementary Methods.
Treatment response dynamics
The different PD properties of hypothetical macrofilaricides elicit profoundly different dynamics in microfilarial outcome measures (the arithmetic mean number of mf/mg of skin, i.e., microfilarial intensity, or the percentage of participants positive for mf, i.e., microfilarial prevalence) with time after treatment (Fig. 3 and Supplementary Fig. 1 for an upper-end mesoendemic setting with a pre-treatment microfilarial prevalence among individuals aged ≥5 years of 50%). A MOM elicits a slow and sustained decline in mf caused by the decreased rate of replenishment of mf following the death of adult worms. The rate of attrition is driven by the approximate 10-month average life span of mf and the nadir (the lowest density of microfilaridermia following treatment) is determined by the competing effects of macrofilaricidal activity and reinfection by drug-naïve worms. Incomplete clearance of adult parasites and ongoing reinfection result in the mf population not declining to 0 and gradually repopulating (Fig. 3). The microfilaricidal activity of a MAMM reduces the microfilarial population more rapidly, followed by a similarly sustained suppression of mf. The more transient effects of ivermectin arise because female worms regain fertility and resume production of mf7, effecting a more rapid ‘bounce back’ in the parasite population. There is negligible qualitative difference in the treatment response dynamics between the lower and upper end of the mesoendemicity setting (compare Fig. 3 with Supplementary Fig. 1).
Opportune follow-up timeframes
The response dynamics define opportune follow-up timeframes for demonstrating a difference between outcome measures among macrofilaricide-treated (test) and ivermectin-treated (control) groups. Defining the optimal follow-up times is a balance between the average response among participants in different groups (i.e., when the difference between the means is greatest, Fig. 4 and Supplementary Fig. 2 for an upper-end mesoendemic setting) and the variability in responses among participants within the same group (i.e., when the estimated difference between means is suitably precise, Fig. 4). For example, the greatest difference in the average microfilarial intensity between treated (with either MOM or MAMM) and control groups occurs between 30 and 36 months after treatment. However, the uncertainty associated with this difference is also greatest at these long follow-up times (Fig. 4a, b). At follow-up times less than 12 months after treatment, ivermectin is observed to be either superior or equally efficacious as the macrofilaricides (MOM/MAMM) because of its rapid microfilaricidal activity (and concomitant embryostatic effect). The MOM begins to elicit a superior response compared to ivermectin between 12 and 24 months after treatment (depending on the macrofilaricidal efficacy, Fig. 4a, c). The MAMM yields superior reductions in mf compared to ivermectin sooner, between 6 and 12 months (depending on macrofilaricidal efficacy), because of its accompanying microfilaricidal activity (Fig. 4b, d). Inference on opportune follow-up timeframes is qualitatively very similar between the lower and upper end of the mesoendemicity setting, albeit there is noticeably greater variation in the difference between the microfilarial intensity outcome measure at the upper endemicity end of the setting (compare Supplementary Fig. S2a, b with Fig. 4a, b).
Estimated sample sizes
The sample size required to achieve a given statistical power to detect a difference between (ivermectin-treated) control and (macrofilaricide-treated) test groups will depend on the difference in the average response between groups (effect size), the variability associated with this difference and on the chosen outcome measure (microfilarial intensity or prevalence). For each outcome measure, effect size and variability depend on the PD properties of the macrofilaricide (MOM/MAMM), the follow-up timeframe and the macrofilaricidal efficacy (Fig. 4). The CTS approach permits exploration of how decisions on minimum infection inclusion criterion and the number of skin snips used to detect mf (Table 1 and Fig. 1) also influence the required sample size. For examples of trials employing different design decisions see Awadzi et al.50, Batsa Debrah et al.51, Opoku et al.52, and Turner et al.53.
Estimated sample sizes required to detect with 80% power a statistically significant superior response (using either microfilarial intensity and prevalence) in the macrofilaricide-treated test group compared to the ivermectin-treated control group at various times after treatment, macrofilaricidal efficacies, inclusion criteria and number of skin snips are shown in Fig. 5. Sample sizes decrease with increasing macrofilaricidal efficacy, and marginally for microfilarial intensity (because of the increased measurement precision) for 4 versus 2 skin snips. More pronounced effects result from the choice of outcome measure and infection level inclusion criteria. Sample sizes are generally lower when using microfilarial prevalence compared to microfilarial intensity for an inclusion criterion of >0 mf/mg because of the lower inter-participant variability associated with the former. However, for an increasing minimum microfilarial intensity inclusion criterion (ranging from >0 mf/mg to >8 mf/mg) opposing directional effects on sample sizes for the different outcome measures are evident. For microfilarial intensity, increasing the infection level inclusion criterion decreases required sample sizes because inter-participant variability in microfilarial counts is reduced (by selecting individuals with somewhat more similar microfilarial loads). By contrast, for microfilarial prevalence, increasing the infection level inclusion criterion increases the sample size. This is because the selection of more heavily infected participants decreases the number of participants who are ostensibly ‘cured’ (i.e., achieving zero mf) following treatment (note that macrofilaricidal efficacy is defined probabilistically as the chance that an adult Onchocerca volvulus worm is killed by treatment). These contrasting effects are enhanced in the upper-end mesoendemic setting because participants tend to be more heavily infected (Supplementary Fig. 3).
We have illustrated, using onchocerciasis as an example, how a CTS can be used to inform the design of antifilarial drug trials by projecting responses in outcomes measured in test and control groups (cohorts) receiving either a (hypothetical) macrofilaricidal treatment or an existing (predominantly microfilaricidal) comparator therapy. The transmission model that underpins the CTS accounts for the inevitable reinfection of participants by drug-naïve parasites in endemic settings. Crucially, this permits a priori identification of opportune follow-up times after treatment when the balance between measurable drug effects and reinfection is most favourable. Moreover, the individual-based structure of the transmission model permits explicit simulation (and exploration) of other proposed protocols, such as the use of minimum infection level eligibility criteria and sampling procedures (e.g., parasitological sampling by skin snips). Explicit simulation of transmission and trial protocols represent the key benefits of using a CTS to inform trial design.
For the PD properties of macrofilaricides (MOM/MAMM) considered here, the best follow-up times (requiring the smallest sample sizes) occur at least (but often greater than) 12 and 18 months after treatment. But follow-up times and required sample sizes are also strongly influenced by the presumed efficacy of the treatment, such that for the lowest 60% efficacy considered here, follow-up times and/or required sample sizes may be deemed too long to be feasible. Hence, the CTS plays an important role in evaluating and revising a TPP as being demonstrable within a clinical trial framework. The CTS also permits the impact of other frequently considered trial design choices—such as pre-selection of individuals with a minimum intensity of infection6,40, protocols to increase diagnostic sensitivity (i.e., 4 versus 2 skins snips)54 and the choice of primary outcome measure (i.e., prevalence versus intensity)—to be evaluated in practically relevant quantities such as required sample sizes.
Long follow-up times of 1 year to 18 months are a feature of antifilarial drug trials (not necessarily including macrofilaricidal therapies) because of the protracted and often non-curative parasitological response to treatment53,55,56,57. Trials of MOMs compared to predominantly microfilaricidal drugs incur particularly protracted follow-up times because of the indirect nature of parasitological outcome assessment; mf populations decrease by natural attrition after the removal of reproductively active female worms45. This is also a feature of microfilarial responses in clinical trials of anti-Wolbachia drugs that deplete the endosymbionts of O. volvulus and lymphatic filariae causing female worm sterility and eventual death58,59. The heavy reliance on mf as a primary outcome measure is because they are the most accessible parasite stage and, in onchocerciasis, because there is not any other reliable indicator of patent infection (e.g. ultrasound examination of onchocercomata for signs of adult worm viability)60. Serology61 is not suitable as it predominately tests for past exposure to O. volvulus antigens62. This is unlike LF, for which (in addition to ultrasonography)63 there exist circulating filarial antigen (CFA) tests64,65 which can be used as alternatives to sampling mf66,67 and offer a more direct means of detecting macrofilariae.
It is possible to make direct observations on the fertility and viability of adult O. volvulus extracted from superficial (palpable and accessible) onchocercomas (nodules) (see for example Gardon et al.)68. For directly acting macrofilaricides, this could be used to assess efficacy earlier than is apparent in microfilarial outcome measures. It also permits better understanding of drug activity against adult filariae. Direct assessment of adult worms collected by nodulectomy has been used extensively to demonstrate the efficacy of anti-Wolbachia therapies in depleting endosymbiotic Wolbachia58,69, albeit the indirect killing effect of these therapies means that, even by this approach, detecting macrofilaricidal activity still requires follow-up times in excess of 18 months59. However, although these methods are useful as secondary outcome measures, it remains difficult to design and power trials using adult worms as the primary outcome measure. Infection with adult worms is typically diagnosed by identifying palpable nodules but the relationship between the presence of nodules and numbers of adult worms is highly uncertain70, and there do not exist validated statistical models that describe the number of adult worms typically found in onchocercomata (but see Duerr et al.)71. Ideally, an O. volvulus antigen test would become available to replace the invasive procedures of nodulectomy or skin snipping72.
The variability in estimated sample sizes required to detect superiority of a macrofilaricide compared to ivermectin reflects the potential resource-saving benefits and efficiency gains that clinical trial simulation can offer. For example, even to demonstrate superiority of a macrofilaricide with a high 90% target efficacy, estimates range from ≤25 to >250 participants per cohort depending on the chosen outcome measure (microfilarial intensity or prevalence), the follow-up time and the inclusion criterion for minimum infection level. For drugs with the lowest assumed macrofilaricidal efficacy of 60%, the trial design can make the difference between being able or unable to demonstrate superiority compared to ivermectin (i.e., to make the go/no go decisions). For example, our results suggest that it is not possible to demonstrate superiority of a MOM with 60% efficacy with a follow up shorter than an 18-month and even at long (18- to 24-month) follow ups, the required sample sizes will exceed 250 per treatment group). It is a noteworthy limitation that in this CTS, variation among drug responses is driven only by stochastic variation in numbers of adult worms and numbers (or presence) of mf detected by 2 or 4 skins snips (see Supplementary Methods). No consideration is given to inter-participant variation in treatment responses73 (PD variation) which would inflate sample sizes.
The comparatively large required sample sizes and long follow-up times for the hypothetical MOM represents a general challenge to the evaluation of novel or repositioned antifilarial drugs within a clinical trial structure. It is conceivable that sustained suppression of mf elicited by drugs with even only moderate (60%) macrofilaricidal activity is at least as beneficial to patients than the rapid but transient clearance of mf elicited by many microfilaricides (e.g. ivermectin and DEC). To demonstrate this with clinical outcome measures (such as the prevalence of pruritus or troublesome itch, other skin pathologies and ocular pathologies) that typically lag behind parasitological indicators of infection74, would require prohibitively long follow-up periods that would be difficult to justify ethically when the de facto standard of treatment for people living in endemic areas is annual MDA. Indeed, on this basis, proposed trials with follow-up times greater than 12 months may face ethical challenges and require that ivermectin (for onchocerciasis) or ivermectin with albendazole or DEC (for LF) be offered to participants 1 year after treatment or as ‘rescue’ medication if infection is detected.
A seemingly natural solution to this problem is to design trials that concomitantly deliver the standard annual antifilarial therapy and compare outcomes in groups treated (not necessarily at the same time) with a macrofilaricide and a standard MDA treatment or treated with standard MDA alone. This type of strategy has been used in trials of anti-Wolbachia therapies for onchocerciasis and LF which elicit a similarly protracted decline in mf (caused by female worm sterilisation and eventual death following depletion of endosymbiotic Wolbachia), when used as monotherapy53, to the hypothetical MOM considered here, but which effect lasting suppression and lower rates of microfilarial repopulation after subsequent rounds of ivermectin treatment. Whether a MOM would be given at the same time as ivermectin, or with sufficient time before or after MDA rounds, would depend on the safety of co-administration and on whether or not it would be desirable to have a MOM registered exclusively as a component of a combination therapy with ivermectin.
Trials combining a MOM and ivermectin (whether or not as a combination therapy), however, may be challenging in areas co-endemic with the filarial parasite Loa loa because the killing of L. loa mf by microfilaricides in heavily microfilaraemic individuals can lead to severe and sometimes fatal severe adverse events (SAEs)29. Indeed, the disruption to onchocerciasis and LF control caused by SAEs in communities co-endemic with loiasis is a key driver behind the current push to develop safe antifilarial drugs for loiasis-infected patients32 and test-and(not)-treat strategies75. In many such communities, individuals with high intensities of L. loa microfilaraemia must be identified and excluded from receiving microfilaricidal drugs (i.e., by test-and-not-treat strategies)75. Hence, there remains a potential use case for MOM monotherapy (assuming a MOM does not affect L. loa mf) or indeed anti-Wolbachia therapies (that do not affect L. loa because they do not harbour Wolbachia endosymbionts) in onchocerciasis-loiasis co-endemic communities.
An alternative approach to earlier identification of macrofilaricidal activity is to collect interim parasitological (microfilarial) data before the indicated optimal follow-up time. While these data may not indicate superiority compared to ivermectin, model-based interpretation of the data (for example by fitting the CTS or related transmission dynamics models)8,59 will give an indication of the underlying activity and efficacy of the trialled drug. This may give important early indications to support ‘go / no go’ decisions and/or inform refinement or adaption of the trial design. For example, measuring mf from patients at interim time points—before the initially-proposed most opportune follow-up time—would permit the CTS to be fitted to the data to achieve an early indication/estimate of macrofilaricidal activity and accompanying microfilaricidal activity. Decisions could then be made on whether to continue the trial (e.g., depending on how the early estimate of macrofilaricidal activity compares to the desired TPP) and when the final follow up should be made (e.g., depending on the indicated level of microfilaricidal activity). The efficiency gains associated with such adaptive (as opposed to ‘fixed’) trial designs is well recognised and has led to their increased use across the clinical medicine domain76,77. Collection of interim longitudinal repeated measurements also confers added statistical power to post hoc analyses and can supplement the final comparison of trialled treatments.
Conducting antifilarial drug trials in the current global intervention landscape of onchocerciasis and LF, where many moderate to high intensity endemic communities have been undergoing MDA for many years, poses significant logistical and inferential challenges to trial design. For example, the use of a high minimum infection inclusion criterion will make it harder to find sufficient numbers of eligible participants (see Supplementary Fig. 4) within single communities or transmission foci with similar intensities of transmission (driven by local density of vectors). Hence, if choosing microfilarial intensity as the desired outcome measure, there is a trade-off between the benefit of reducing variability in treatment responses (and lower sample sizes) by selecting participants with more similar (and higher) infection intensities and the challenge of recruiting sufficient numbers. Moreover, in communities where awareness of onchocerciasis has diminished—following years of MDA that has effectively controlled the disease as a public health problem—the challenges of recruiting and retaining participants during the trial may increase.
Designing trials in communities with long histories of MDA adds further complexity and additional uncertainty. For example, even given at annual MDA frequencies, ivermectin exerts notable (but uncertain) macrofilariacidal effects on O. volvulus worms and cumulative reductions in female worm fertility8 which will propagate into the projected response dynamics following treatment. Hence, assumptions on the cumulative effect on female O. volvulus of multiple exposures to ivermectin will likely have a substantial effect on projected response dynamics. Moreover, obtaining accurate and reliable information on how many prior rounds of treatment individual participants have received is a challenge, although information on how many rounds of MDA have been distributed at a population level is more readily available. Hence, even if trials cannot be conducted in treatment-naïve communities, we suggest that efforts should be made to select participants with as few as possible previous antifilarial treatments.
Notwithstanding these challenges, the CTS presented here can in principle be used to simulate trials conducted in a variety of epidemiological settings, with different histories of MDA. Parameters relating to the core transmission dynamics of onchocerciasis have been estimated and refined in numerous previous studies45,47,78,79 and capture well the observed epidemiological relationship between ABR and microfilarial prevalence and intensity45. Consequently, the CTS can reflect transmission conditions across the wide spectrum of endemic settings by varying the annual biting rate (ABR) of blackfly vectors. It can also be used, more cautiously, to simulate trials conducted in a backdrop of MDA by varying parameters that control the number, frequency and coverage of past and ongoing mass treatments with ivermectin45. Installation and use of the CTS and examples of simulating trials in a variety of epidemiological contexts are given in the README.html file at https://mrc-ide.github.io/EPIONCHO-IBM-CTS/README.html. The README.html also includes instructions on how to vary parameters relevant to the trial design, such as those varied in this work (Table 1), and additional parameters, such as the participant dropout rate (which was here set to a nominal 10% per year).
We have illustrated how a CTS can be used to inform the design of antifilarial drugs, using as an example a simple two-arm (phase IIb) trial of a hypothetical macrofilaricide compared to ivermectin for the treatment of onchocerciasis. The approach helps to maximise the efficiency of trials, indicating opportune follow-up times for detecting desired drug properties and aiding decision making on TPPs, participant eligibility criteria and sampling protocols. The CTS developed here could be extended to simulate more complex trials, including trials with multiple comparator arms, combinations of therapies either given concurrently or intermittently to meet existing standards of regular MDA-based treatment (in addition to the existing capability to project responses to treatment in communities with past and ongoing MDA). Because the CTS presented here is based on a full transmission model of infection, it is readily extendable to project the potential wider epidemiological impact of new antifilarial drugs or combinations, an approach that has been used to support the registration of moxidectin for the treatment of onchocerciasis80 and the recent recommendation by the World Health Organization (WHO) to endorse the IDA (ivermectin, DEC and albendazole) triple therapy for LF81. We believe that the resource-saving payoffs of prospective trial simulation make them an essential tool for designing drug trials in the resource-limited context of filarial infections and other NTDs.
We developed a CTS from the individual-based onchocerciasis transmission model EPIONCHO-IBM45 to simulate a trial conducted in an ivermectin-naïve mesoendemic community with a microfilarial prevalence in those aged ≥5 years of either 40% or 50%. A full mathematical description of the model is given in Hamley et al45. and also in the Supplementary Methods. Briefly, EPIONCHO-IBM is an analogue of the population-based EPIONCHO model47,49 tracking the number of adult Onchocerca volvulus worms of both sexes and microfilariae (mf) within individual (human) hosts (Fig. 2a). Host births and deaths are based on the typical demography of rural low-income communities in Africa (Fig. 2b) and individuals are differentially exposed to blackfly bites, driving in a mechanistic fashion the typically overdispersed (aggregated) distribution of parasites among hosts (Fig. 2c). Exposure to blackfly bites varies with age and between males and females, following epidemiological patterns typically found in West Africa78 (Fig. 2d). Sexual reproduction of O. volvulus is modelled by assuming that only female worms in hosts concurrently infected with at least one male worm will produce mf. The age, sex, pregnancy and breastfeeding status (assuming that women between 16 and 40 may be pregnant or breastfeeding for 2 years; i.e., after a 9-month pregnancy and 1 year and 3 months of breastfeeding) of each human in the population is modelled (Fig. 2b).
Participant eligibility and randomisation
We assumed that everyone aged ≥18 years in a population of 1000 individuals who were not pregnant or breastfeeding were screened for mf (by skin snipping). We further assumed that a set (target) number of eligible individuals consented to participate (we targeted 50 participants per cohort for the purpose of approximating the mean and variance among individual response dynamics to estimate sample sizes). We randomly assigned consenting participants to receiving either a hypothetical macrofilaricidal treatment (the ‘test’ group) or ivermectin (the ‘control’ group, Fig. 1). The design most closely mirrors a phase IIb trial that is focused on comparing the efficacy of a new drug (a macrofilaricide) with an existing one (ivermectin) but is more limited in size than a typical phase III trial (see for examples the phase II and III trials of moxidectin for the treatment of onchocerciasis)50,52.
The hypothetical macrofilaricides were assumed to be either purely macrofilaricidal, with no effect on mf, or macrofilaricidal and microfilaricidal. These are referred to, respectively, as macrofilaricidal-only macrofilaricides (MOMs) or macrofilaricidal and microfilaricidal macrofilaricides (MAMMs). Macrofilaricides were assumed to kill a fraction of adult worms over three months that was varied between 60% and 90% (Table 1). The MAMMs were assumed to have microfilaricidal effects identical to the microfilaricidal dynamics (but excluding the temporary sterilising or embryostatic effect) of ivermectin, i.e., rapid depletion of mf by 98–99% after 1–2 months7.
Simulated response dynamics
Parasitological (mf) responses to ivermectin and hypothetical macrofilaricides in individual participants were simulated for 36 months after treatment. We incorporated a statistical model for the sampling of mf by skin snipping, assuming an aggregated distribution of mf within the skin to capture the relatively poor sensitivity of skin snipping, particularly at low intensities of (adult worm) infection54. The infection status (positive or negative by skin snip, >0 mf/mg skin) or intensity (>4 or >8 mf/mg skin) that defined eligibility as measured by taking 2 or 4 skin snips was varied (Table 1).
We repeated 1,000 simulations, with each simulation targeting recruitment of two 50-participant cohorts (note that for an increasing minimum infection intensity inclusion criterion, the chance of recruiting 50 eligible participants decreases, see Supplementary Fig. 4), for each parameter combination indicated in Table 1 (72 parameter combinations; 72,000 simulations). For each simulation, we calculated the mean difference between outcome measures (i.e., mean number of mf/mg of skin per participant or mean percentage of participants positive for mf) in the (macrofilaricide-treated), test, and (ivermectin-treated), control groups at time \(\tau\), \(\hat D\left( \tau \right)\) (i.e., the mean response in the control group subtracted from the mean response in the test group, e.g., Fig. 4), and the standard deviation within each group, \(\hat \sigma _T\left( \tau \right)\) and \(\hat \sigma _C\left( \tau \right)\) (T = test, C = control).
Sample size estimation
From the estimates of \(\hat D\left( \tau \right)\), \(\hat \sigma _T\left( \tau \right)\) and \(\hat \sigma _C\left( \tau \right)\) (one estimate per simulation) we calculated Welch’s t-statistic and the expected ‘true’ value of each parameter, \(D\left( \tau \right)\), \(\sigma _T\left( \tau \right)\) and \(\sigma _C\left( \tau \right)\) to approximate the non-centrality and degrees of freedom parameters for the non-central t-distribution (assuming unequal variances). We confirmed that these (non-centrality; degrees of freedom) parameters approximated adequately the simulated distributions of Welch’s t-statistic (Supplementary Figs. 5–7) and proceeded to estimate sample sizes (to the nearest 25) required to achieve an 80% probability (power) of detecting a superior response (positive difference) in macrofilaricide-treated, test participants compared to ivermectin-treated controls, assuming a type I error (false rejection of the null hypothesis of no positive difference) of 5% and 10% drop out per year of recruited participants.
Our approach to estimating sample sizes assumes that the simulated target of 50 participants per cohort provide an adequate approximation to the ‘true’ average response and that these quantities (mean and inter-participant variance) are consistent across changing sample sizes. In essence, this assumption rests on the trial itself having limited immediate impact on community-wide transmission (and therefore rates of reinfection). Sample sizes are thus interpreted qualitatively in terms of the directional (increasing/decreasing) influence of changing design-relevant parameter values. Further details on the sample size estimation approach are given in Supplementary Methods.
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
No external data were used. The individual-level simulated data generated during this study are available from the corresponding author on reasonable request.
The model code is freely available at https://github.com/mrc-ide/EPIONCHO-IBM-CTS. Instructions for installing and running the model in R (version 3.6.2) are available in the README.html file which can be accessed at https://mrc-ide.github.io/EPIONCHO-IBM-CTS/README.html.
African Programme for Onchocerciasis Control. Eighteenth Session of the Joint Action Forum, http://www.who.int/apoc/about/structure/jaf/Final_Communique_JAF_18_English_final_with_annexes.pdf (2012).
World Health Organization. Accelerating work to overcome the global impact of neglected tropical 13. diseases – a roadmap for implementation executive summary (World Health Organization, Geneva, Switzerland, 2012).
Pion, S. D. S. et al. Effect of 3 years of biannual mass drug administration with albendazole on lymphatic filariasis and soil-transmitted helminth infections: a community-based study in Republic of the Congo. Lancet Infect. Dis. 17, 763–769 (2017).
King, C. L. et al. A trial of a triple-drug treatment for lymphatic filariasis. N. Engl. J. Med. 379, 1801–1810 (2018).
World Health Organization. Progress report on the elimination of human onchocerciasis, 2017-2018. Wkly. Epidemiol. Rec. 47, 633–648 (2018).
World Health Organization. Global programme to eliminate lymphatic filariasis: progress report, 2017. Wkly. Epidemiol. Rec. 93, 589–604 (2018).
Basáñez, M. G. et al. Effect of single-dose ivermectin on Onchocerca volvulus: a systematic review and meta-analysis. Lancet Infect. Dis. 8, 310–322 (2008).
Walker, M. et al. Macrofilaricidal efficacy of repeated doses of ivermectin for the treatment of river blindness. Clin. Infect. Dis., https://doi.org/10.1093/cid/cix616 (2017).
Bockarie, M. J. et al. Efficacy of single-dose diethylcarbamazine compared with diethylcarbamazine combined with albendazole against Wuchereria bancrofti infection in Papua New Guinea. Am. J. Trop. Med. Hyg. 76, 62–66 (2007).
Ichimori, K. et al. Global programme to eliminate lymphatic filariasis: the processes underlying programme success. PLoS Negl. Trop. Dis. 8, e3328 (2014).
Irvine, M. A. et al. Modelling strategies to break transmission of lymphatic filariasis-aggregation, adherence and vector competence greatly alter elimination. Parasite Vector 8, 547 (2015).
Turner, H. C., Walker, M., Churcher, T. S. & Basáñez, M. G. Modelling the impact of ivermectin on river blindness and its burden of morbidity and mortality in African Savannah: EpiOncho projections. Parasite Vector 7, 241 (2014).
Coffeng, L. E. et al. African Programme For Onchocerciasis Control 1995-2015: model-estimated health impact and cost. PLoS Negl. Trop. Dis. 7, e2032 (2013).
West, S., Munoz, B. & Sommer, A. River blindness eliminated in Colombia. Ophthalmic Epidemiol. 20, 258–259 (2013).
Lovato, R. et al. Interruption of infection transmission in the onchocerciasis focus of Ecuador leading to the cessation of ivermectin distribution. PLoS Negl. Trop. Dis. 8, e2821 (2014).
Convit, J. et al. Interruption of Onchocerca volvulus transmission in Northern Venezuela. Parasite Vector 6, 289 (2013).
Rodríguez-Pérez, M. A. et al. Elimination of onchocerciasis from Mexico. PLoS Negl. Trop. Dis. 9, e0003922 (2015).
World Health Organization. Progress towards eliminating onchocerciasis in the WHO Region of the Americas: verification of elimination of transmission in Guatemala. Wkly. Epidemiol. Rec. 91, 501–516 (2016).
Tekle, A. H. et al. Impact of long-term treatment of onchocerciasis with ivermectin in Kaduna State, Nigeria: first evidence of the potential for elimination in the operational area of the African Programme for Onchocerciasis Control. Parasite Vector 5, 28 (2012).
Diawara, L. et al. Feasibility of onchocerciasis elimination with ivermectin treatment in endemic foci in Africa: first evidence from studies in Mali and Senegal. PLoS Negl. Trop. Dis. 3, e497 (2009).
Traoré, M. O. et al. Proof-of-principle of onchocerciasis elimination with ivermectin treatment in endemic foci in Africa: final results of a study in Mali and Senegal. PLoS Negl. Trop. Dis. 6, e1825 (2012).
Higazi, T. B. et al. Interruption of Onchocerca volvulus transmission in the Abu Hamed focus, Sudan. Am. J. Trop. Med Hyg. 89, 51–57 (2013).
Verver, S. et al. How can onchocerciasis elimination in Africa be accelerated? Modelling the impact of increased ivermectin treatment frequency and complementary vector control. Clin. Infect. Dis. 66, S267–S274 (2018).
Katabarwa, M. N. et al. Fifteen years of annual mass treatment of onchocerciasis with ivermectin have not interrupted transmission in the west region of cameroon. J. Parasitol. Res. 2013, 420928 (2013).
Katabarwa, M. N. et al. Transmission of Onchocerca volvulus continues in Nyagak-Bondo focus of northwestern Uganda after 18 years of a single dose of annual treatment with ivermectin. Am. J. Trop. Med. Hyg. 89, 293–300 (2013).
Lamberton, P. H. et al. Onchocerciasis transmission in Ghana: persistence under different control strategies and the role of the simuliid vectors. PLoS Negl. Trop. Dis. 9, e0003688(2015).
Wanji, S. et al. Situation analysis of parasitological and entomological indices of onchocerciasis transmission in three drainage basins of the rain forest of South West Cameroon after a decade of ivermectin treatment. Parasite Vector 8, 202 (2015).
Zouré, H. G. et al. The geographic distribution of Loa loa in Africa: results of large-scale implementation of the Rapid Assessment Procedure for Loiasis (RAPLOA). PLoS Negl. Trop. Dis. 5, e1210 (2011).
Gardon, J. et al. Serious reactions after mass treatment of onchocerciasis with ivermectin in an area endemic for Loa loa infection. Lancet 350, 18–22 (1997).
Frempong, K. K. et al. Does increasing treatment frequency address suboptimal responses to ivermectin for the control and elimination of river blindness? Clin. Infect. Dis. 62, 1338–1347 (2016).
Doyle, S. R. et al. Genome-wide analysis of ivermectin response by Onchocerca volvulus reveals that genetic drift and soft selective sweeps contribute to loss of drug sensitivity. PLoS Negl. Trop. Dis. 11, e0005816 (2017).
Kuesel, A. C. Research for new drugs for elimination of onchocerciasis in Africa. Int J. Parasitol. Drugs Drug Resist. 6, 272–286 (2016).
Hopkins, A. D. Ivermectin and onchocerciasis: is it all solved? Eye (Lond.) 19, 1057–1066 (2005).
Alley, W. S. et al. Macrofilaricides and onchocerciasis control, mathematical modelling of the prospects for elimination. BMC Public Health 1, 12 (2001).
World Health Organization Consultative Expert Working Group (CEWG) on Research & Development. Financing & incentives for neglected disease R&D: Opportunities and challenges (Drug for Neglected Diseases intiative, Geneva, 2011).
Dimitri, N. R&D incentives for neglected diseases. PLoS ONE 7, e50835 (2012).
Taylor, M. J., Hoerauf, A., Townson, S., Slatko, B. E. & Ward, S. A. Anti-Wolbachia drug discovery and development: safe macrofilaricides for onchocerciasis and lymphatic filariasis. Parasitology 141, 119–127 (2014).
Drugs for Neglected Diseases initiative. An innovative approach to R&D for nelgected patients: tends years of experience and lessions learned by DNDi, https://www.dndi.org/wp-content/uploads/2009/03/DNDi_Modelpaper_2013.pdf (2013).
Holford, N., Ma, S. C. & Ploeger, B. A. Clinical trial simulation: a review. Clin. Pharm. Ther. 88, 166–182 (2010).
Vegvari, C. et al. Using clinical trial simulators to analyse the sources of variance in clinical trials of novel therapies for acute viral infections. PLoS ONE 11, e0156622 (2016).
Kimko, H. & Pinheiro, J. Model-based clinical drug development in the past, present and future: a commentary. Br. J. Clin. Pharm. 79, 108–116 (2015).
Hollingsworth, T. D. et al. Quantitative analyses and modelling to support achievement of the 2020 goals for nine neglected tropical diseases. Parasite Vector 8, 630 (2015).
Anderson, R. et al. Assessing the interruption of the transmission of human helminths with mass drug administration alone: optimizing the design of cluster randomized trials. Parasite Vector 10, 93 (2017).
Truscott, J. E. et al. Identifying optimal threshold statistics for elimination of hookworm using a stochastic simulation model. Parasite Vector 10, 321 (2017).
Hamley, J. I., Milton, P., Walker, M. & Basáñez, M.-G. Modelling exposure heterogeneity and density dependence in onchocerciasis using a novel individual-based transmission model, EPIONCHO-IBM: implications for elimination and data needs. PLoS Negl. Trop. Dis. 13, e0007557 (2019).
Hamley, J. I. D. et al. Structural uncertainty in onchocerciasis transmission models influences the estimation of elimination thresholds and selection of age groups for seromonitoring. J. Infect. Dis., https://doi.org/10.1093/infdis/jiz674 (2020).
Basáñez, M. G. et al. River blindness: mathematical models for control and elimination. Adv. Parasitol. 94, 247–341 (2016).
NTD Modelling Consortium Onchocerciasis Group. The World Health Organization 2030 goals for onchocerciasis: Insights and perspectives from mathematical modelling: NTD Modelling Consortium Onchocerciasis Group. Gates Open Res 3, 1545 (2019).
Walker, M. et al. Modelling the elimination of river blindness using long-term epidemiological and programmatic data from Mali and Senegal. Epidemics 18, 4–15 (2017).
Awadzi, K., Opoku, N. O., Attah, S. K., Lazdins-Helds, J. & Kuesel, A. C. A randomized, single-ascending-dose, ivermectin-controlled, double-blind study of moxidectin in Onchocerca volvulus infection. PLoS Negl. Trop. Dis. 8, e2953 (2014).
Batsa Debrah, L. et al. Comparison of repeated doses of ivermectin versus ivermectin plus albendazole for treatment of onchocerciasis - a randomized open-label clinical trial. Clin. Infect. Dis., https://doi.org/10.1093/cid/ciz889 (2019).
Opoku, N. O. et al. Single dose moxidectin versus ivermectin for Onchocerca volvulus infection in Ghana, Liberia, and the Democratic Republic of the Congo: a randomised, controlled, double-blind phase 3 trial. Lancet 392, 1207–1216 (2018).
Turner, J. D. et al. Macrofilaricidal activity after doxycycline only treatment of Onchocerca volvulus in an area of Loa loa co-endemicity: a randomized controlled trial. PLoS Negl. Trop. Dis. 4, e660 (2010).
Bottomley, C. et al. Modelling neglected tropical diseases diagnostics: the sensitivity of skin snips for Onchocerca volvulus in near elimination and surveillance settings. Parasite Vector 9, 343 (2016).
Bockarie, M. J. et al. Randomised community-based trial of annual single-dose diethylcarbamazine with or without ivermectin against Wuchereria bancrofti infection in human beings and mosquitoes. Lancet 351, 162–168 (1998).
Thomsen, E. K. et al. Efficacy, safety, and pharmacokinetics of coadministered diethylcarbamazine, albendazole, and ivermectin for treatment of bancroftian filariasis. Clin. Infect. Dis. 62, 334–341 (2016).
Colebunders, R. et al. Ivermectin treatment in patients with onchocerciasis-associated epilepsy: protocol of a randomized clinical trial. JMIR Res. Protoc. 6, e137 (2017).
Hoerauf, A. Filariasis: new drugs and new opportunities for lymphatic filariasis and onchocerciasis. Curr. Opin. Infect. Dis. 21, 673–681 (2008).
Walker, M. et al. Therapeutic efficacy and macrofilaricidal activity of doxycycline for the treatment of river blindness. Clin. Infect. Dis. 60, 1199–1207 (2015).
Mand, S. et al. Frequent detection of worm movements in onchocercal nodules by ultrasonography. Filaria J. 4, 1, https://doi.org/10.1186/1475-2883-4-1 (2005).
Weil, G. J. et al. A rapid-format antibody card test for diagnosis of onchocerciasis. J. Infect. Dis. 182, 1796–1799 (2000).
Vincent, J. A., Lustigman, S., Zhang, S. & Weil, G. J. A comparison of newer tests for the diagnosis of onchocerciasis. Ann. Trop. Med. Parasitol. 94, 253–258 (2000).
Belard, S. et al. Point-of-care ultrasound assessment of tropical infectious diseases-a review of applications and perspectives. Am. J. Trop. Med. Hyg. 94, 8–21 (2016).
Weil, G. J. et al. Laboratory and field evaluation of a new rapid test for detecting Wuchereria bancrofti antigen in human blood. Am. J. Trop. Med. Hyg. 89, 11–15 (2013).
Weil, G. J., Lammie, P. J. & Weiss, N. The ICT Filariasis Test: a rapid-format antigen test for diagnosis of bancroftian filariasis. Parasitol. Today 13, 401–404 (1997).
Debrah, A. Y. et al. Doxycycline reduces plasma VEGF-C/sVEGFR-3 and improves pathology in lymphatic filariasis. PLoS Pathog. 2, e92 (2006).
El Setouhy, M. et al. A randomized clinical trial comparing single- and multi-dose combination therapy with diethylcarbamazine and albendazole for treatment of bancroftian filariasis. Am. J. Trop. Med. Hyg. 70, 191–196 (2004).
Gardon, J. et al. Effects of standard and high doses of ivermectin on adult worms of Onchocerca volvulus: a randomised controlled trial. Lancet 360, 203–210 (2002).
Klarmann-Schulz, U. et al. Comparison of doxycycline, minocycline, doxycycline plus albendazole and albendazole alone in their efficacy against onchocerciasis in a randomized, open-label, pilot trial. PLoS Negl. Trop. Dis. 11, e0005156 (2017).
Coffeng, L. E. et al. Onchocerciasis: the pre-control association between prevalence of palpable nodules and skin microfilariae. PLoS Negl. Trop. Dis. 7, e2168 (2013).
Duerr, H. P., Dietz, K., Buttner, D. W. & Schulz-Key, H. A stochastic model for the aggregation of Onchocerca volvulus in nodules. Parasitology 123, 193–201 (2001).
Globisch, D. et al. Onchocerca volvulus-neurotransmitter tyramine is a biomarker for river blindness. Proc. Natl Acad. Sci. USA 110, 4218–4223 (2013).
Churcher, T. S. et al. Identifying sub-optimal responses to ivermectin in the treatment of River Blindness. Proc. Natl Acad. Sci. USA 106, 16716–16721 (2009).
Turner, H. C., Walker, M., Churcher, T. S. & Basanez, M. G. Modelling the impact of ivermectin on River Blindness and its burden of morbidity and mortality in African Savannah: EpiOncho projections. Parasite Vectors 7, 241 (2014).
Kamgno, J. et al. A test-and-not-treat strategy for onchocerciasis in loa loa-endemic areas. N. Engl. J. Med. 377, 2044–2052 (2017).
Pallmann, P. et al. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC Med. 16, 29 (2018).
Thorlund, K., Haggstrom, J., Park, J. J. & Mills, E. J. Key design considerations for adaptive clinical trials: a primer for clinicians. BMJ 360, k698 (2018).
Filipe, J. A. et al. Human infection patterns and heterogeneous exposure in river blindness. Proc. Natl Acad. Sci. USA 102, 15265–15270 (2005).
Basáñez, M. G. & Boussinesq, M. Population biology of human onchocerciasis. Philos. Trans. R. Soc. Lond. B Biol. Sci. 354, 809–826 (1999).
Medicines Development for Global Health. Medicines Development for Global Health Announces Submission of the Moxidectin for River Blindness NDA to the FDA and Priority Review Designation, https://www.medicinesdevelopment.com/assets/pdf/mdl-press-release-171217.pdf (2017).
World Health Organization. Guideline: alternative mass drug administration regimens to eliminate lymphatic filariasis. Report No. WHO/HTM/NTD/PCT/2017.07, (World Health Organization, Geneva, 2017).
M.W., J.I.D.H., and M.G.B. gratefully acknowledge funding from the NTD Modelling Consortium (https://www.ntdmodelling.org, grant number OPP1053230) by the Bill and Melinda Gates Foundation (https://www.gatesfoundation.org/) in partnership with the Task Force for Global Health (https://www.taskforce.org). M.W. and M.G.B. also acknowledge financial support from the Drugs for Neglected Diseases initiative (DNDi, https://www.dndi.org). P.M. is supported by a UK Medical Research Council doctoral training award. M.G.B. acknowledges joint Centre funding from the UK Medical Research Council and Department for International Development (grant number MR/R015600/1).
F.M. and B.P. work at the organisation (DNDi) that sponsored this study. However, the study sponsor did not have any influence in the study design, analysis, interpretation of results, the writing of the manuscript, or the decision to submit the paper for publication, other than critical, independent and scientific contribution. No payment was received from any other funding sources, or pharmaceutical company. The corresponding author had final responsibility for decision to submit for publication. The remaining authors declare no competing interests.
Peer review information Nature Communications thanks Luc Coffeng and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Walker, M., Hamley, J.I.D., Milton, P. et al. Designing antifilarial drug trials using clinical trial simulators. Nat Commun 11, 2685 (2020). https://doi.org/10.1038/s41467-020-16442-y