Protocol | Open | Published:

Investigating the accuracy, risk impact, and cost-effectiveness of component-resolved diagnostic test for food allergy: a systematic review protocol

Background

Food allergy—particularly immunoglobulin E (IgE)-mediated food allergy—is now a global public health problem. It results in considerable morbidity, healthcare utilisation, and impairment in quality of life.1,2,3,4,5,6 Food allergy reactions range in severity from relatively mild features to life-threatening anaphylaxis.2, 3 Estimates of the prevalence of food allergy vary, but overall lifetime prevalence has been estimated as affecting up to 7% of children and 6% of adults.4, 5

Careful avoidance of offending foods is the mainstay preventive strategy for food allergy.2, 3 Accurate diagnosis is essential in order to provide appropriate, potentially life-saving advice on how to prevent and manage reactions. This will also help to prevent unwarranted dietary restrictions.2, 3 The diagnosis of food allergy is typically based on a combination of clinical history and an objective marker of allergic sensitisation, namely, skin prick tests (SPT) and/or immunoassays of serum-specific IgE levels. While these approaches have reasonable sensitivity, they have sub-optimal specificity and are in general poorly predictive of the severity of reactions. Further diagnostic confirmation with a double-blinded placebo-controlled food challenge (DBPCFC)—the gold standard diagnostic test—is therefore often required.2, 3, 7 DBPCFC is however costly, technically challenging, time-consuming, labour-intensive, and associated with important safety risks as the procedure can trigger anaphylaxis.2, 3, 8 Nevertheless, although risky, DBPCFCs offer a reliable diagnosis, which in turn increases patients’ quality of life.9

The limitations of conventional methods for diagnosing food allergy have stimulated promising developments in molecular-based diagnostic techniques, collectively referred to as component-resolved diagnosis (CRD).2, 8, 10 Molecular diagnosis of food allergy involves examining the specific proteins in foods, primarily at the molecular level.8 In this case, rather than providing a summary of all the allergen proteins in a particular food (e.g., peanuts), molecular-based methods quantify the individual proteins within a food that may be responsible for allergic reactions.8 In CRD, specific IgE responses are evaluated against individual allergenic molecules or the epitopes of those allergens. Therefore, CRD techniques have the potential to enhance the specificity and sensitivity of serum-specific IgE responses to foods. They may also: facilitate our ability to determine specific food allergy phenotypes; help improve compilation of a patient-tailored risk profile to specific food allergens, given that IgE antibodies to food molecules vary from patient to patient and also geographically; and boost the ability to distinguish between primary and secondary sensitisers.2, 8, 10 Importantly, in CRD approaches, diagnosis can be undertaken either in single test formats or in a microarray by simultaneously evaluating a range of allergens.2, 8, 10

There is now a substantial body of evidence on using CRD to diagnose food allergy, which needs to be synthesised in order to generate robust estimates of diagnostic accuracy and assess cost-effectiveness in comparison with conventional approaches. Furthermore, a synthesis of the underlying evidence will help to inform deliberations on whether and how CRD should be deployed for (i) diagnosing food allergy, and (ii) assessing patient risk through the prediction of food allergy severity (i.e., the likelihood of life-threatening anaphylaxis as opposed to relatively mild features) across differing healthcare service contexts.

Aims

We seek to identify, critically appraise, and undertake meta-analyses of studies using CRD for the diagnosis of food allergy. Specifically, we aim to:

  1. a.

    Determine the accuracy (i.e., sensitivity, specificity, positive and negative predictive values) of CRD for diagnosis of cow’s milk, wheat, egg, peanut, soy, tree nuts, fish, and shellfish allergy.

  2. b.

    Summarise the evidence on the cost and cost-effectiveness of CRD in comparison with conventional techniques for the diagnosis of cow’s milk, wheat, egg, peanut, soy, tree nuts, fish, and shellfish allergy.

  3. c.

    Summarise the evidence on the ability of CRD to predict the severity of cow’s milk, wheat, egg, peanut, soy, tree nuts, fish, and shellfish allergy.

Methods

The Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) checklist has been used to guide the reporting of this protocol.11

Study eligibility criteria

Types of studies

We will include prospective, retrospective, and cross-sectional studies. Studies must have sufficient data to calculate the relevant diagnostic measures, including sensitivity, specificity, and positive and negative predictive values. All studies must have a defined study population, with either consecutive or random sampling of participants. If the recruitment technique used to select participants is not indicated in a study, we will contact the authors to request further information about their study. In the case we do not receive a response from authors, we will include such study and undertake relevant sensitivity analyses to assess their impact on the overall test performance.

Types of participants

We will include studies that have examined patients with suspected food allergy of any age.

Target conditions

We will include studies examining the CRD diagnostic accuracy of allergenic molecules of the eight most common IgE-mediated food allergies, namely, cow’s milk, egg, wheat, soy, peanut, tree nuts (including, but not limited to hazelnut, walnut, cashew, brazil nut, pistachio, almond), fish (including, but not limited to cod and carp), and shellfish (shrimp).

Index test

We will include studies that have utilised molecular diagnostic techniques either based on allergenic molecules (using CRD) or the epitopes of those allergens (using epitope mapping or profiling).

Reference standard

We will use the DBPCFC as the gold standard for evaluating test accuracy. We will include studies in which DBPCFC has been undertaken in at least 50% of subjects in order to provide sufficient sample to strengthen the internal validity of each study. Secondarily, with regard to evaluating impact on decision-making, we will also compare CRD performance with current standard practice (i.e., clinical assessment plus SPT and/or specific IgE).

Exclusion criteria

We will exclude the following reports: reviews, discussion papers, non-research letters and editorials; qualitative studies; case studies, case series; animal studies; and studies that include participants on the basis of a positive food allergy test result.

Search strategy

We will search the following databases from 1 January 2000 to 31 July 2016 for studies of diagnostic tests for food allergy: AMED (Ovid), CAB Abstracts (Ovid), the Cochrane Library, CINAHL (EBSCO), Embase (Ovid), Global Health (Ovid), MEDLINE (Ovid), PsycINFO (Ovid), Web of Science Core Collection (Thomson Reuters), WHO’s Global Health Library, and the Health Economic Evaluations Database. Although CRD methods for food allergy were already described in the 1990s,12 their application for food allergy diagnosis came into force fully in the 2000s, hence we have chosen the beginning of 2000 as a reasonable starting time for the literature search. We will obtain additional references by searching the references cited in identified studies, by contacting international experts and authors who have published in the field (we have compiled a preliminary list of experts to contact), and by searching the ISI Conference Proceedings Citation Index. We will search trial registries, such as Current Controlled Trials (http://www.controlled-trials.com), ClinicalTrials.gov (http://www.clinicaltrials.gov), the Australian and New Zealand Clinical Trials Registry (http://www.anzctr.org.au), and WHO’s International Clinical Trials Registry Platform (http://www.who.int/ictrp/en/) to identify ongoing studies. Using the Ovid interface for MEDLINE, we have developed a search strategy (Appendix 1) to identify and retrieve relevant studies for the review and this will be adapted in searching the other databases. There are no language restrictions for included studies: literature in languages other than English will be translated where possible, and any literature that we are unable to translate will be reported.

Data management and selection process

We will export retrieved records from all databases to Endnote Library for study screening, de-duplication, and management of the retrieved records. Titles and abstracts of retrieved records will be screened and full text copies of potentially eligible studies will be assessed by two independent reviewers; a third reviewer will arbitrate any discrepancies.

Data extraction

We will develop and pilot a data extraction form that will be used to collect relevant data from eligible studies. Two reviewers will independently extract relevant study data from included studies onto the form; a third reviewer will arbitrate any discrepancies.

Data items

We will produce descriptive tables to tabulate and summarise relevant data from included studies. We will capture the following minimum set of data items from included studies: study author, country of study, year of publication, type of study design, study size, source of study population, type of food allergy, type of CRD used to diagnosed food allergy, key summary results of diagnostic accuracy, any reported risk assessment measures. For cost-effectiveness analyses, the following minimum set of data items will be extracted: competing tests analysed, economic study design type, economic perspective, test cost, measured outcome and its value, and future costs of the outcome and the test. We will use the PRISMA checklist to guide the reporting of the systematic review.13

Quality assessment of studies

Risk of bias in eligible studies will be assessed by two reviewers; a third reviewer will arbitrate any discrepancies. We will assess the quality of included studies using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool.14 We will quality assess the economic studies using the Drummond criteria.15 For all studies, we will quality assess the following components of each study: patient population; index test used and interpretation; type of reference standard used; and data analysis. The quality of each of these components will be graded as high, moderate, or low.

Data syntheses

As a first step of synthesising the evidence from included studies, we will graph the diagnostic test accuracy of the individual studies. The paired results for sensitivity and specificity will be plotted as receiver operating characteristic (ROC) curves, using these to highlight the covariation between the sensitivity and specificity in the individual studies. These initial graphical representations will also enable visual assessment of the variation between studies and facilitate subgroup analyses for exploring the effect of certain characteristics (e.g., sex, age, country/geographical region) on test performance. Expectedly, the cut-offs used to define test positivity may vary across studies; therefore, to summarise and compare the accuracy of the test across studies for each endpoint, we will employ the hierarchical summary ROC (HSROC) model.16 Through the inclusion of random effects, the HSROC model accounts for the variability across studies. The model uses study-specific estimates of the true positive rate (sensitivity) and the false positive rate (1—specificity) to estimate a summary ROC curve. Where studies have used a common or similar cut-off and have analysed populations with similar characteristics, we will use parameter estimates from the models to compute summary sensitivities and specificities with 95% confidence intervals. We will investigate between-study heterogeneity with the HSROC model using the following covariates to evaluate the association between study (type of study design, sampling methods employed, country of origin, cut-offs for test positivity) and patient characteristics (age, sex, disease severity) and test performance. The results from the quality assessment will be used to undertake sensitivity analyses by evaluating whether the quality of studies (low, medium, high quality) has any impact on the overall conclusion. All analyses will be performed with Stata version 14.0 (StataCorp LP, College Station, TX, USA). A narrative synthesis of the data will also be undertaken and will be the approach particularly employed in summarising the evidence pertaining to risk prediction and cost-effectiveness.

Publication bias

We will evaluate publication bias by using funnel plots and Begg and Egger tests.17, 18

Evaluating confidence in the overall evidence

We will evaluate the strength and quality of the overall evidence by using the GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach.19 The GRADE system is useful for evaluating the quality of evidence and strength of recommendations.19

Protocol registration

A detailed protocol for the review will be registered with the International Prospective Register of Systematic Reviews (PROSPERO): http://www.crd.york.ac.uk/prospero/ prior to commencing the review.

Discussion

The major allergens in different food allergies have now been measured using the CRD technique across different settings.8, 10, 20,21,22,23 For example, Ara h 2 for peanut allergy, omega-5-gliadin for wheat allergy, rGly m 4 for soy milk allergy, and a number of tree nuts, fruits, vegetables, and fish have now been established.8, 10, 20,21,22,23 Despite the potential of CRD in improving diagnosis of food allergy, a number of important questions regarding its clinical application remain. These include a clear determination of whether these tests offer benefit over-and-above existing procedures and, if so, where in the clinical pathway CRD fits—whether as a screening tool or confirmatory method; an assessment of the impact of CRD diagnosis on the risk profile of patients; and a clear appreciation of the cost implications for its use in clinical practice in comparison with current approaches. Addressing these questions will provide a strong basis for deciding on the significance of CRD for the diagnosis of food allergy in the clinical setting. This is the first systematic review of the diagnostic accuracy of CRD for food allergy: in addition to synthesising the evidence on the diagnostic measures of the eight most common food allergies (cow’s milk, egg, wheat, soy, peanut, tree nuts, fish, and shellfish), we will, where possible, undertake risk assessment of CRD on patients, and summarise the estimates of the cost-effectiveness of CRD for diagnosing these food allergies.

References

  1. 1.

    Allen, J. K. & Koplin, J. J. The epidemiology of IgE-mediated food allergy and anaphylaxis. Immunol. Allergy Clin. N. Am. 32, 35–50 (2012).

  2. 2.

    Muraro, A. et al. EAACI food allergy and anaphylaxis guidelines: diagnosis and management of food allergy. Allergy 69, 1008–1025 (2014).

  3. 3.

    Sicherer, S. H. & Sampson, H. A. Food allergy: epidemiology, pathogenesis, diagnosis, and treatment. J. Allergy Clin. Immunol. 133, 291–307 (2014).

  4. 4.

    Nwaru, B. I. et al. The epidemiology of food allergy in Europe: a systematic review and meta-analysis. Allergy 69, 62–75 (2014).

  5. 5.

    Rona, R. J. et al. The prevalence of food allergy: a meta-analysis. J. Allergy Clin. Immunol. 120, 638–646 (2007).

  6. 6.

    Muraro A., Roberts G. (ed). Food Allergy and Anaphylaxis Guidelines. (The European Academy of Allergy and Clinical Immunology (EAACI), 2014).

  7. 7.

    Soares-Weiser, K. et al. The diagnosis of food allergy: a systematic review and meta-analysis. Allergy 69, 76–86 (2014).

  8. 8.

    Hoffmann-Sommergruber, K., Pfeifer, S. & Bublin, M. Applications of molecular diagnostic testing in food allergy. Curr. Allergy Asthma Rep. 15, 56 (2015).

  9. 9.

    van der Velde, J. L. et al. Food allergy-related quality of life after double-blind, placebo-controlled food challenges in adults, adolescents, and children. J. Allergy Clin. Immunol. 130, 1136–1143 (2012).

  10. 10.

    Eller, E. & Bindslev-Jensen, C. Clinical value of component-resolved diagnostics in peanut-allergic patients. Allergy 68, 190–194 (2013).

  11. 11.

    Shamseer, L. et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. Br. Med. J. 349, g7647 (2015).

  12. 12.

    Valenta, R., Lidholm, J., Niederberger, V., Hayek, B., Kraft, D. & Grönlund, H. The recombinant allergen-based concept of component-resolved diagnostics and immunotherapy. Clin. Exp. Allergy 29, 896–904 (1999).

  13. 13.

    Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 6, e1000097 (2009). The PRISMA Group.

  14. 14.

    Whiting, P. F. et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann. Intern. Med. 155, 529–536 (2011).

  15. 15.

    Drummond, M. F., Sculpher, M. J., Torrance, G. W., O’Brien, B. J. & Stoddart, G. L. Methods for the Economic Evaluation of Health Care Programmes. 3rd edn. (Oxford University Press, 2005).

  16. 16.

    Wang, F. & Gatsonis, C. A. Hierarchical models for ROC curve summary measures: design and analysis of multi-reader, multi-modality studies of medical tests. Stat. Med. 27, 243–256 (2008).

  17. 17.

    Begg, C. B. & Mazumdar, M. Operating characteristics of a rank correlation test for publication bias. Biometrics 50, 1088–1101 (1994).

  18. 18.

    Egger, M., Smith, G. D., Schneider, M. & Minder, C. Bias in meta-analysis detected by a simple, graphical test. Br. Med. J. 315, 629–634 (1997).

  19. 19.

    Schunemann, H. J. et al. Grading quality of evidence and strength of recommendation for diagnostic tests and strategies. Br. Med. J. 336, 1106 (2008).

  20. 20.

    Ballmer-Weber, B. K. & Hoffmann-Sommergruber, K. Molecular diagnosis of fruit and vegetable allergy. Curr. Opin. Allergy Clin. Immunol. 11, 229–235 (2011).

  21. 21.

    Caubet, J. C., Kondo, Y., Urisu, A. & Nowak-Wegrzyn, A. Molecular diagnosis of egg allergy. Curr. Opin. Allergy Clin. Immunol. 11, 210–215 (2011).

  22. 22.

    Fiocchi, A., Bouygue, G. R., Albarini, M. & Restani, P. Molecular diagnosis of cow’s milk allergy. Curr. Opin. Allergy Clin. Immunol. 11, 216–221 (2011).

  23. 23.

    Nicolaou, N. & Custovic, A. Molecular diagnosis of peanut and legume allergy. Curr. Opin. Allergy Clin. Immunol. 11, 222–228 (2011).

Download references

Acknowledgements

We are thankful to Marshall Dozier, Senior Liaison Librarian and Liaison Director for the College of Medicine and Veterinary Medicine at the University of Edinburgh, for assistance in developing the search strategy. This work is funded by the Chief Scientist Office, Edinburgh (HIPS/16/42). It is part of J.F.K. dissertation for the award of MPH degree at the University of Edinburgh. B.N. is supported by a fellowship from the University of Tampere, Finland, with additional support from the Farr Institute and Asthma UK Centre for Applied Research.

Author information

A.S. conceived the idea for this work. It was drafted by J.F.K. and B.N. and was then revised after several rounds of critical comments from N.M., A.St., and A.S.

Correspondence to Aziz Sheikh.

Ethics declarations

Competing interests

A.S. is Joint Editor-in-Chief of npj Primary Care Respiratory Medicine, but was not involved in the editorial review of, nor the decision to publish, this article. The remaining authors declare no competing interests.

Electronic supplementary material

Appendix 1

Rights and permissions

This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Further reading