Abstract
The development of multiplex polymerase chain reaction and microarray assays is challenging due to primer dimer formation, unspecific hybridization events, the generation of unspecific by-products, primer depletion, and thus lower amplification efficiencies. We have developed a software workflow with three underlying algorithms that differ in their use case and specificity, allowing the complete in silico evaluation of such assays on user-derived data sets. We experimentally evaluated the method for the prediction of oligonucleotide hybridization events including resulting products and probes, self-dimers, cross-dimers and hairpins at different experimental conditions. The developed method allows explaining the observed artefacts through in silico WGS data and thermodynamic predictions. PRIMEval is available publicly at https://primeval.ait.ac.at.
Similar content being viewed by others
Introduction
The specificity of oligonucleotides is essential in nucleic acid techniques such as DNA amplification and detection technologies1,2. While classical microbiological methods are commonly used for the identification and characterization of pathogens, cultivation-independent genetic methods such as (real-time) polymerase chain reaction (PCR) and DNA microarrays are on the rise3. These methods are only cost-effective if they are highly multiplexed, which is challenging due to primer dimer formation, the formation of unwanted by-products, the resulting lower amplification efficiencies and thus, lower sensitivity due to primer depletion and accumulation of unspecific DNA4,5. While singleplex (e.g. Primer3, Primer-BLAST6,7) and multiplex (e.g. oli2go8) primer design tools include specificity and/or primer dimer checks, we are not aware of a software application which performs in silico specificity checks for combined multiplex amplification and detection assays, allows user-uploaded databases, and uses thermodynamic data to predict hybridization events including thermodynamically stable but mismatched oligonucleotides. It is crucial to consider thermodynamic data since mismatches can contribute significantly to the stabilization of DNA hybrids9,10,11. As established tools (e.g. FastPCR, MFEprimer, and Primer-BLAST6,12,13) either rely only on single heuristic algorithms, do not support multiplexing or do not allow combined searching for primers and probes (Supplementary Table S1), none of them covers the complete feature set. Here we present PRIMEval, a software workflow addressing these issues with multiple underlying algorithms accessible through a public web server.
Results
PRIMEval is a pipeline for the in silico evaluation of multiplex assays involving amplification and detection steps, hence significantly simplifying these tasks and lowering the associated costs. The software predicts all combinations of primers and probes, such as only one primer binding (Fig. 1a,b), multiple primers in one sense, but only one primer in the anti-sense (Fig. 1c), multiple sense and anti-sense primers overlapping (Fig. 1d) and single and multiple probes binding to products generated by the primers (Fig. 1e,f). Additionally, ΔG values and melting temperatures (Tm) are reported to the user to predict self-dimers, cross-dimers and hairpins (Fig. 1g–i) in a given set of oligonucleotides. The workflow is represented in Fig. 1j. Using our server-stored databases (i.e. common eukaryotic model organisms), it is possible to efficiently screen a primer set for off-target hits like human background DNA.
We evaluated the three underlying methods for the number of retrieved alignments, hits (filtered for mismatches), corresponding results (filtered for proximity and probes) and for the special case of oligonucleotides with degenerated bases. The parameters retrieving the most hits for the different number of mismatches are used in the software workflow (Supplementary Tables S2–S6). Bowtie 1.2.2 is implemented because it is better suited for short, ungapped alignments compared to Bowtie 214. If only hits without mismatches should be reported, all methods perform equally well and the non-heuristic Aho-Corasick algorithm is the fastest method. However, for 1–3 mismatches, BLAST produces a huge amount of insignificant hits, thereby increasing the computation time. The greedy Bowtie algorithm produces more significant hits than the BLAST algorithm for 1 and 2 mismatches, but less than the Aho-Corasick algorithm. With the Aho-Corasick algorithm, every reference sequence is only matched once, which is critical with degenerated oligonucleotides. At 3 mismatches, the Aho-Corasick algorithm produces the most hits, but at the huge cost of running time. Hence, we recommend using the Bowtie algorithm in most use cases or the Aho-Corasick algorithm if a small number of mismatches and no degenerate oligonucleotides are used (Fig. 2a–e).
We experimentally verified the predicted products and correlated them with the calculated nearest-neighbour thermodynamic data at low (Fig. 2f, Supplementary Table S7 and the full-length gel image in Supplementary Fig. S1) and high magnesium chloride concentration (Fig. 2g, Supplementary Table S8 and the full-length gel image in Supplementary Fig. S2). For strain 1, the product at 101 bp is missing, and in strain 2 and 3, the expected single and double bands are faint or missing. In strain 4 (at 84 and 168 bp), 5 (at 121 bp) and 6 (at 145 bp), amplicons are missing, but the by-products in these strains are correctly predicted at 823 bp, 1048 bp and 1184 bp, respectively. Strain 7 and 8 show all expected bands, while products of strain 9 and 10 are missing. Raising the magnesium chloride concentration decreases the ΔG values and increases the Tm, hence allowing amplification of these products. From this small dataset, we observe a ΔG threshold at −10.5 kcal/mol of at least one primer (previously published at −11 kcal/mol15). This implies that our tool is useful both for the optimization of oligonucleotides and experimental buffer conditions.
Secondary structures are calculated using established methods and reported for ΔG values stronger than −9 kcal/mol or −5 kcal/mol for cross- or self-dimers and hairpins, respectively7,8,13. For the automatic screening of large datasets, users can upload a comma-separated file to match primers and internal oligonucleotides with gene names, expected product sizes and an arbitrary number of information fields (such as phenotypes or antibiotic resistance genes). PRIMEval can also be used to extract sequence data and to determine the position of target sequences in genomes.
Discussion
PRIMEval was tested and used by several members of our research unit over the last two years for the optimization of multiplex assays. It helped significantly to reduce evaluation costs, to explain unclear observations and to facilitate decisions on how to optimize multiplex oligonucleotide sets. Many in vitro observed artefacts can be explained through in silico WGS data and thermodynamic predictions. The incorporated methods were evaluated, and the highest recovery rates were obtained using the Bowtie algorithm or the Aho-Corasick algorithm if the oligonucleotides do not contain degenerated bases. Other methods such as BIGSI are currently not suited because reconstructions from such data structures are not possible and coverage information is not stored16. Therefore, the implemented string searching algorithms are the limiting factors and it would not be possible to screen efficiently using thermodynamic data only (i.e. with unlimited mismatches) on huge datasets. Also at the current stage, the mismatch positions in oligonucleotides are visualized and left open to user interpretation as published methods are not clearly interpretable11,17,18. Therefore, we included thermodynamic data as e.g. G-G mismatches can contribute up to −2.2 kcal/mol to the stabilization of the duplex whereas other mismatches can be highly destabilizing9,10. The possibility of using user-defined reference sequences is currently unique and user-defined mapping files allow the application of PRIMEval for many use cases (e.g. screening for antibiotic resistance genes or virulence factors).
Methods
Input
The web service allows the user to upload own reference sequences, primer sets and probe (internal oligonucleotide) sets in the FASTA format. Matching probes can be marked by a correct filename terminology. Alternatively, users can select server-stored Bowtie indices of common eukaryotic model organisms instead of uploading own sequences. The user selects the underlying search algorithm, a maximum number of mismatches in primers and probes, and a maximum product length. For thermodynamic analyses and for optional secondary structure checks, annealing temperatures and salt concentrations must be indicated for the amplification and hybridization steps (Supplementary Fig. S3).
Searching algorithms
Oligonucleotides are mapped to the reference sequences using BLAST+ 2.7.119,20, Bowtie 1.2.221 or the Aho-Corasick algorithm22. BLAST (qcov_hsp_perc, perc_identity, word_size), Bowtie (seedlen, maqerr, seedmms) and Aho-Corasick were evaluated experimentally for different parameters in terms of run time and the number of retrieved hits on four 45-plex primer sets (Supplementary Tables S9-S12) targeting antibiotic resistances on 91 bacterial genomes (Supplementary Table S13).
Predicting PCR products
The hits obtained from the different algorithms are converted to the same file format in order to use the same downstream pipeline. Hits meeting the mismatch criteria are checked against each other for proximity (product length). Primer pairs are created if the hits are in accordance with the described criteria. If one or more probes fall into the amplicon region, the probes are added to the oligonucleotide pair.
Secondary structure check
Hairpins and cross-dimers of all sequences from each oligonucleotide set are predicted using a Python implementation of the primer3 core (primer3-py). SantaLucia’s model using salt correction is used to predict Tm and ΔG values10.
Output
A visual representation of primers, probes, and products allows an intuitive inspection whether primers might overlap or multiple probes binding to an amplicon. Lists of matching primers including probes are given as well as single hits alone (e.g. single primer, probe without primers, etc.). Dimer checks are represented as heat maps and possible candidates reported if ΔG ≤ −9 kcal/mol or Tm + 3 ≥ step Tm for hairpins. All files can be downloaded in the CSV file format including a summary of oligonucleotides containing degenerated bases. These files include the contig positions, oligonucleotide set, product sizes, the number of mismatches and representations thereof, ΔG and Tm values for oligonucleotides, the Tm of the product and the product itself (Supplementary Fig. S4).
Implementation
The server runs on Ubuntu 16.04 LTS on a machine containing four 16-core processors and 384 GB RAM. The applications are written in Python 3.4.3 and additionally make use of Biopython23, Pandas24, and the Redis/RQ queue management system.
Experimental evaluation
A 45-plex set of primers (Supplementary Table S14) targeting antibiotic resistance genes was experimentally evaluated on ten sequenced clinical bacterial strains and correlated with the in silico data. The reaction mixture (20 µl) comprised Molzym PCR buffer (1.5 mM MgCl2), 200 µM of each dNTP, 1 unit of Hot MolTaq DNA-free polymerase (Molzym), 111 nM of each primer, 10 ng of target DNA and additionally 1.5 mM MgCl2 in a second PCR for comparison. The reaction was incubated as follows: 5 min at 94 °C, 30 cycles of 30 s each at 94 °C, 55 °C and 72 °C, and 7 min at 72 °C. The products were separated and visualized on a 2% agarose gel. Brightness and contrast were adjusted, and the gel image was inverted using ImageJ.
Data availability
The code implementing the main method can be found at https://github.com/rczms/primeval and is under the MIT license. The public PRIMEval web server is available under https://primeval.ait.ac.at/.
References
Andreson, R., Möls, T. & Remm, M. Predicting failure rate of PCR in large genomes. Nucleic acids research 36, e66, https://doi.org/10.1093/nar/gkn290 (2008).
Cisse, I. I., Kim, H. & Ha, T. A rule of seven in Watson-Crick base-pairing of mismatched sequences. Nature structural & molecular biology 19, 623–627, https://doi.org/10.1038/nsmb.2294 (2012).
Sinha, M. et al. Emerging Technologies for Molecular Diagnosis of Sepsis. Clinical microbiology reviews 31; https://doi.org/10.1128/CMR.00089-17 (2018).
Rychlik, W. Selection of primers for polymerase chain reaction. Methods in molecular biology (Clifton, N.J.) 15, 31–40, https://doi.org/10.1385/0-89603-244-2:31 (1993).
Satterfield, B. C. Cooperative primers: 2.5 million-fold improvement in the reduction of nonspecific amplification. The Journal of molecular diagnostics: JMD 16, 163–173, https://doi.org/10.1016/j.jmoldx.2013.10.004 (2014).
Ye, J. et al. Primer-BLAST: a tool to design target-specific primers for polymerase chain reaction. BMC bioinformatics 13, 134, https://doi.org/10.1186/1471-2105-13-134 (2012).
Untergasser, A. et al. Primer3–new capabilities and interfaces. Nucleic acids research 40, e115, https://doi.org/10.1093/nar/gks596 (2012).
Hendling, M. et al. Oli2go: an automated multiplex oligonucleotide design tool. Nucleic acids research 46, W252–W256, https://doi.org/10.1093/nar/gky319 (2018).
SantaLucia, J. Physical principles and visual-OMP software for optimal PCR design. Methods in molecular biology (Clifton, N.J.) 402, 3–34, https://doi.org/10.1007/978-1-59745-528-2_1 (2007).
SantaLucia, J. & Hicks, D. The thermodynamics of DNA structural motifs. Annual review of biophysics and biomolecular structure 33, 415–440, https://doi.org/10.1146/annurev.biophys.32.110601.141800 (2004).
Kwok, S. et al. Effects of primer-template mismatches on the polymerase chain reaction: human immunodeficiency virus type 1 model studies. Nucleic acids research 18, 999–1005, https://doi.org/10.1093/nar/18.4.999 (1990).
Kalendar, R., Khassenov, B., Ramankulov, Y., Samuilova, O. & Ivanov, K. I. FastPCR: An in silico tool for fast primer and probe design and advanced sequence analysis. Genomics 109, 312–319, https://doi.org/10.1016/j.ygeno.2017.05.005 (2017).
Qu, W. & Zhang, C. Selecting specific PCR primers with MFEprimer. Methods in molecular biology (Clifton, N.J.) 1275, 201–213, https://doi.org/10.1007/978-1-4939-2365-6_15 (2015).
Langmead, B. & Salzberg, S. L. Fast gapped-read alignment with Bowtie 2. Nature methods 9, 357–359, https://doi.org/10.1038/nmeth.1923 (2012).
Rychlik, W. Priming efficiency in PCR. BioTechniques 18(84-6), 88–90 (1995).
Bradley, P., den Bakker, H. C., Rocha, E. P. C., McVean, G. & Iqbal, Z. Ultrafast search of all deposited bacterial and viral genomic data. Nature biotechnology 37, 152–159, https://doi.org/10.1038/s41587-018-0010-1 (2019).
Miura, F., Uematsu, C., Sakaki, Y. & Ito, T. A novel strategy to design highly specific PCR primers based on the stability and uniqueness of 3′-end subsequences. Bioinformatics (Oxford, England) 21, 4363–4370, https://doi.org/10.1093/bioinformatics/bti716 (2005).
Onodera, K. & Melcher, U. Selection for 3′ end triplets for polymerase chain reaction primers. Molecular and cellular probes 18, 369–372, https://doi.org/10.1016/j.mcp.2004.05.007 (2004).
Altschul, S. F., Gish, W., Miller, W., Myers, E. W. & Lipman, D. J. Basic local alignment search tool. Journal of molecular biology 215, 403–410, https://doi.org/10.1016/S0022-2836(05)80360-2 (1990).
Camacho, C. et al. BLAST+: architecture and applications. BMC bioinformatics 10, 421, https://doi.org/10.1186/1471-2105-10-421 (2009).
Langmead, B., Trapnell, C., Pop, M. & Salzberg, S. L. Ultrafast and memory-efficient alignment of short DNA sequences to the human genome. Genome biology 10, R25, https://doi.org/10.1186/gb-2009-10-3-r25 (2009).
Aho, A. V. & Corasick, M. J. Efficient string matching: an aid to bibliographic search. Commun. ACM 18, 333–340, https://doi.org/10.1145/360825.360855 (1975).
Cock, P. J. A. et al. Biopython: freely available Python tools for computational molecular biology and bioinformatics. Bioinformatics (Oxford, England) 25, 1422–1423, https://doi.org/10.1093/bioinformatics/btp163 (2009).
McKinney, W. In Proceedings of the 9th Python in Science Conference, edited by S. van der Walt & J. Millman, pp. 51–56 (2010).
Acknowledgements
We thank Branka Bedenić (University Hospital Center Zagreb, Zagreb, Croatia) and Inge Gyssens (Radboud University Medical Center, Nijmegen, Netherlands) for providing the clinical strains. This project was funded by the EU H2020 research and innovation program under grant agreement number 634137. Funding for open access charge: EU H2020 under grant agreement number 634137.
Author information
Authors and Affiliations
Contributions
R.C. developed the software, implemented the web server, did the experimental evaluation in silico and in vitro, and wrote the manuscript. M.H. provided parts of the code for the implementation of the search algorithms and calculation of the thermodynamic parameters and did testing of the software. S.P. provided code and help for the implementation of the Bowtie method. I.B. supervised the project, tested the software and revised the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Conzemius, R., Hendling, M., Pabinger, S. et al. PRIMEval: Optimization and screening of multiplex oligonucleotide assays. Sci Rep 9, 19286 (2019). https://doi.org/10.1038/s41598-019-55883-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-019-55883-4
This article is cited by
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.