Abstract
The algorithms commonly used to select the best stable reference gene in RT-qPCR data analysis have their limitations. We showed that simple selection of the reference gene or pair of genes with the lowest stability value from the pool of potential reference genes—a commonly used approach—is not sufficient to accurately and reliably normalize the target gene transcript and can lead to biologically incorrect conclusions. For reliable assessment of changes in a target gene expression level, we propose our innovative GenExpA software, which works in a manner independent of the experimental model and the normalizer used. GenExpA software selects the best reference by combining the NormFinder algorithm with progressive removal of the least stable gene from the candidate genes in a given experimental model and in the set of daughter models assigned to it. The reliability of references is validated based on the consistency of the statistical analyses of normalized target gene expression levels through all models, described by the coherence score (CS). The use of the CS value imparts a new quality to qPCR analysis because it clarifies how low the stability value of reference must be in order for biologically correct conclusions to be drawn. We tested our method on qPCR data for the B4GALT genes family in melanoma, which is characterized by a high mutation rate, and in melanocytes. GenExpA is available at https://github.com/DorotaHojaLukowicz/GenExpA or https://www.sciencemarket.pl/baza-programow-open-source#oferty.
Similar content being viewed by others
Introduction
Achieving reliable results for normalization of the transcript level of a target gene requires an internal reference gene or pair of genes (housekeeping genes, HKGs) with stable expression between the analyzed samples and under different experimental conditions. Moreover, it is believed that the transcript levels of the reference and target genes should be expressed at roughly the same level1. However, the transcript levels of many of the HKGs typically used as references may change significantly under physiological or pathological conditions as well as across tissue types and experimental conditions1,2,3,4,5,6,7,8. Therefore the selection and validation of the normalizer are the most critical stages in qPCR data analysis. Typically, one or more of five algorithms (geNorm3, NormFinder9, BestKeeper10, the comparative ΔCt method11 and RefFinder; http://150.216.56.64/referencegene.php) are used to select the best stable single or combination of reference genes from a panel of candidate genes, although there are also other proposed algorithms12. The normalizer with the lowest stability value is considered the best and is then used for calculation of target gene expression in a group of samples. We have recently shown that this commonly accepted approach seems not enough for accurate and reliable target gene transcript normalization and that it may lead to biologically incorrect conclusions13. We demonstrated that beyond the parent model of samples of interest (experimental model), it is necessary to construct daughter models (auxiliary models built from the same samples as the experimental model but with fewer samples—combinations of samples of interest without repetition), followed by selection and validation of an appropriate normalizer for each model. Here we have shown that validation of the normalizer is done by determining the coherence score for target gene expression analyses performed for all given models (experimental and daughter models). If the statistical analysis produces inconsistent results for the expression level of a target gene based on a comparison of individual sets of two samples through all models, we have to search for new references with improved stability values via progressive removal of the least stable candidate reference gene in each sample, followed by re-selection and re-validation of new normalizers each time13. However, this proposed approach of RT-qPCR data analysis has been a very time-consuming task, requiring the use of several specialist software packages. This problem led us to automate these calculations by developing the GenExpA tool (Gene Expression Analyzer). It is a comprehensive tool based on a previously described workflow for quantified as well as raw qPCR data13. Based on the selected reference gene or pair of genes, GenExpA calculates the relative target gene expression level, performs statistical analyses and generates results in the form of graphs and tables. The innovative aspect of GenExpA is that it estimates the coherence of results for each target gene in all designed models. It determines the robustness of normalization and works out the coherence score for the individual target gene. The advantage of this strategy is its ability to determine relative target gene expression based on the consistency of the results in all tested samples, regardless of the experimental model and the reference gene or pair of genes used. Here, based on qPCR data for B4GalT1–B4GalT7 transcripts in melanocytes and melanoma cells, we show how to perform the analysis step by step, and how to solve problems using this new methodological approach.
Results
A flow chart of target gene expression and statistical analysis of qPCR data using the GenExpA tool is shown in Fig. 1. At the beginning, we uploaded raw qPCR data for candidate reference (HPRT1, PGK1, RPS23, SNRPA; set 1) and target (B4GALT1–B4GALT7) genes (Supplementary Table S1) as well as quantified qPCR data for candidate reference genes (Supplementary Table S2) obtained for five human cell lines (melanocytes and melanoma cells from different stages of oncogenic progression) comprising the experimental model. It is important to note that here “cell line” means “sample”. Since all PCR reactions were performed in three technical repeats for every one of the three biological replicates, therefore a set of three mean Ct values (for each of the genes) and a set of three means quantified values (for each of the candidate reference genes) were used as inputs for a given cell line. The uploaded quantified values were calculated based on the calibration curve previously prepared for all candidate reference genes in all analyzed cell lines. Working with the GenExpA interface, the potential reference genes were selected from the pool of all analyzed genes presented in the ‘Available reference genes’ window, and a panel of 26 possible models (the experimental model and 25 daughter models which are combinations, without repetition, of 5 cell lines taken 2 or 3 or 4 or 5 at a time) was automatically designed using the ‘Generate combinations’ option. Because of the normal data distribution (data not shown), the Pairwise t-test, Holm adjustment test was chosen from the ‘Statistical model’ bar. Finally, 0 was set in the ‘Remove repetitions’ box that means all four potential reference genes (set 1) were used by NormFinder. The ‘Confidence’ box was set by default at 0.05. The ‘Select best remove for model’ option was left unselected. After clicking on ‘Run calculation’, the GenExpA tool started the analysis. First, the implemented NormFinder algorithm determined the most stable reference gene or pair of genes from four candidate reference genes in each of the 26 models (Table 1, part A; remove repetition level 0). The stability value for the selected reference gene pair RPS23/SNRPA in the experimental model (model No. 26) was 0.364, and the reference stability values for auxiliary models ranged from 0.077 for reference gene pair HPRT1/RPS23 in model No. 7 to 0.504 for reference gene pair RPS23/SNARPA in model No. 16 (Table 1, part A). Then the relative expression levels of target genes B4GALT1–B4GALT7 were determined as relative quantification (RQ) values in each of the 26 models via normalization to the reference gene/genes assigned for these models. After clicking on ‘Export results’, the GenExpA software generated tables summarizing the calculated reference genes’ stability values, the obtained RQ values and the statistical test results, as well as attributed coherence values (Supplementary Table S3). By choosing the ‘Export graph’ option, box-plots representing the medians of the obtained RQ values with statistical significance bars were generated as .png files, each representing a set of target genes in one of the analyzed models (graphs for all models are compiled in Supplementary Fig. S1). In this analysis, GenExpA calculated the coherence score at level 0.90 for four target genes (B4GALT3, B4GALT5, B4GALT6, B4GALT7). This value resulted from unreliable/uncertain normalization. GenExpA calculated also the average coherence score at level 0.94 (Supplementary Fig. S2).
Next, to improve the estimation of the expression of these target genes, the least stable reference gene in each model was removed by setting 1 in the ‘Remove repetitions’ box. Also, marking ‘Select best remove for models’ caused GenExpA to choose the reference from the level of removal for which the stability value was lower in a given model. This approach raised the average coherence score of the analyses of all B4GALT target genes from 0.94 to 0.99 and gave lower stability values of the normalizers in 15 of the 26 models. Now these stability values ranged between 0.056 for HPRT1/SNRPA in model No. 6 and 0.300 for HPRT1/PGK1 in model No. 16 (Table 1, part A; remove repetition level 1). The stability value of the normalizer (HPRT1/SNRPA) for the experimental model (model No. 26) also was improved: 0.267. The coherence scores for B4GALT1, B4GALT2 and B4GALT4 were kept at 1, and for genes B4GALT3, B4GALT5 and B4GALT7 reached the value 1, confirming the consistency of the analysis of the expression levels of these genes. At this point of the analysis, the coherence score for gene B4GALT6 was below 1 (Supplementary Fig. S3), suggesting that the selected references are not suitable for accurate and reliable normalization of the B4GALT6 transcript level (Supplementary Table S4 contains the tables and Supplementary Fig. S4 the box-plots generated in this analysis). Executed removal of the least stable gene reduced the pool of potential reference genes to three, that is, the minimum number of genes required for NormFinder selection9, thus ending the possibility of removing the next-weakest reference gene. To continue the analysis, we enlarged the pool of candidate reference genes by adding a new HKG, GUSB (inputs with mean Ct and quantified qPCR data are presented in Supplementary Tables S5 and S6). Then the best reference gene or pair of genes from five candidate HKGs was selected (digit 0 entered in the ‘Remove repetitions’ box and without choosing ‘Select best remove for models’ box). The selected references possessed stability values ranging from 0.031 for GUSB/RPS23 (auxiliary model No. 6) to 0.394 for HPRT1 (auxiliary model No. 24), and 0.330 in the experimental model (model No. 26) (Table 1, part B; remove repetition level 0). Validation of the selected references confirmed the consistency of expression analysis for genes B4GALT1–B4GALT3 and B4GALT5 (Supplementary Fig. S5, Supplementary Table S7, Supplementary Fig. S6). Removing the least stable gene from five candidate reference genes (digit 1 entered in ‘Remove repetitions’ box and choosing ‘Select best remove for models’ box) (Table 1, part B; remove repetition level 1; Supplementary Fig. S7) allowed us to assign better stability values to 11 of the 26 models (Table 1, part B; remove repetition level 1), however, the coherence score for B4GALT4 was still below 1 (Supplementary Table S8; Supplementary Fig. S8). Sequential removal of the two least stable potential reference genes (digit 2 entered in ‘Remove repetitions’ box and choosing ‘Select best remove for models’ box) did not complete the analysis for B4GALT4 (Supplementary Fig. S9). Supplementary Table S9 contains the tables and Supplementary Fig. S10 the box-plots corresponding to this analysis. At this point of the analysis, however, the coherence score dropped to 0.9 for gene B4GALT6.
Having the Ct values for five potential reference genes, we conducted similar selections of references from four other possible combinations of 4 candidate reference genes: RPS23, SNRPA, HPRT1 and GUSB (set 2); SNRPA, HPRT1, GUSB and PGK1 (set 3); HPRT1, GUSB, PGK1 and RPS23 (set 4); and GUSB, PGK1, RPS23 and SNRPA (set 5), before and after rejection of the weakest reference genes. The results obtained from normalization of target gene expression in the 26 models were exported from the GenExpA tool as Supplementary Tables S10–S17 and corresponding Supplementary Fig. S11–S18. A summary of all target gene expression analyses in the experimental model of interest, based on the selection of references from four (sets 1–5) and five candidate reference genes, is presented in Supplementary Fig. S19. Based on it, we concluded that if, at different levels of rejection of the weakest reference gene from sets of four or five candidate reference genes, the analysis of the expression of a given target gene ended with CS = 1, the obtained results do not contradict each other (for example, compare the expression levels of B4GALT1 in sets 1–5 and the set of five candidate reference genes—box-plots 1–13 in Supplementary Fig. S19). However, starting the analysis with a higher number of potential reference genes creates an opportunity to select the reference gene with a lower stability value in the experimental model as well as auxiliary models, and therefore gives a more robust analysis of target gene expression. For example, the use of a set of five candidate reference genes (PGK1, RPS23, SNRPA, HPRT1, GUSB) with sequential removal of the two least stable potential reference genes gave the lowest stability value of the selected reference gene for the experimental model (0.215) and auxiliary models (0.010–0.239). On the other hand, we noticed that box-plots 13 and 91 show exactly the same results as, respectively, box-plots 2, 5, 6, 10, 12 and 80, 83, 84, 90 (compare the medians of relative quantity (RQ) and statistical significance between samples in Supplementary Fig. S19). It means that in the case of B4GALT1 and B4GALT7 gene expression analysis, the use of four HKGs from sets 2 or 5 with rejection of the most unstable HKG, or from set 3, is sufficient. The same is true for genes B4GALT2 and B4GALT3 and set 3 (compare box-plots 26 and 39 with 18, 19 and 31, 32, respectively, in Supplementary Fig. S19). Similar relationships occur for gene B4GALT5 and sets 3 and 1 after rejection of the most unstable HKG (compare box-plots 78 with 57, 58 and 54 in Supplementary Fig. S19). Therefore, adding a fifth housekeeping gene is mandatory to confirm the robustness of an analysis conducted with the above-mentioned sets of four candidate reference genes. Interestingly, the lower the HKG stability value, the better the CS value, that is, the more robust the analysis, potentially much more correct biologically.
On the other hand, selection of the normalizer based on five potential reference genes and with ‘Remove repetition’ set at 2 led to an inconsistent analysis for the relative expression of gene B4GALT6 (box-plot 78 in Supplementary Fig. S19), although the same box-plots were generated with ‘Remove repetition’ set at 1 as well as in the case of set 3 with ‘Remove repetition’ set at 0 or 1 (compare box-plots 70, 71, 77 and 78 in Supplementary Fig. S19), and the reference stability values for the experimental model remained the same (0.215). It means that if a more robust analysis is needed, to improve its consistency another HKG/s should be introduced into the pool of candidate reference genes. Another approach may be to complete the analysis with ‘Remove repetition’ set at 1 (box-plot 77 in Supplementary Fig. S19) with indication of the CS values and stability parameters for the reference genes selected in the experimental and auxiliary models.
We want to emphasize that simple application of the NormFinder algorithm (‘Remove repetition’ 0) may lead to a biological misinterpretation of the obtained results, as it strongly depends on the choice of a set of potential reference genes. For example, sets 1 and 5 showed significantly higher relative expression of gene B4GALT6 in WM793 cells than in WM266-4 cells. In turn, sets 2, 4 and the set of five HKGs showed, in these two cell lines, an inverse relationship between the B4GALT6 gene expression that was also statistically significant (compare box-plots 66 and 74 with box-plots 68, 72 and 76 in Supplementary Fig. S19). Moreover, the relative expression levels of B4GALT5, B4GALT6 and B4GALT 7 were significantly lower in cell line WM35 than in cell line WM266-4, as shown in sets 2 and 5 of candidate reference genes (compare box-plots 55, 63 and 68, 76 and 81, 89 with 59 and 72 and 85 in Supplementary Fig. S19), or significantly higher as shown in set 4 (box-plot 72 in Supplementary Fig. S19).
Confusing results are also observed for gene B4GALT3: in sets 1 (box-plot 27 in Supplementary Fig. S19), 2 (box-plot 29 in Supplementary Fig. S19), 3 (box-plot 31 in Supplementary Fig. S19), 5 (box-plot 35 in Supplementary Fig. S19) and in set of five candidate reference genes (box-plot 37 in Supplementary Fig. S19) its relative expression level was significantly lower in cell line WM35 than in cell line WM793, but in set 4 the relationship was the reverse (box-plot 33 in Supplementary Fig. S19). Similar for the gene B4GALT6: in sets 1 (box-plot 66 in Supplementary Fig. S19) and 5 (box-plot 74 in Supplementary Fig. S19) its relative expression level was significantly lower in cell line WM35 than in cell line WM793, but in set 4 the relationship was the reverse (box-plot 72 in Supplementary Fig. S19). In addition, a larger pool of candidate reference genes does not always lead to selecting the better normalizer in simple application of the NormFinder algorithm (compare the reference stability values for the experimental model and auxiliary models in set 3 and the set of five candidate reference genes; ‘Remove repetition’ 0). In contrast, our method based on gradual removal of the gene with the highest variability of expression leads to selection of a normalizer with a lower stability value (compare the reference stability values for the experimental model and auxiliary models in sets 1–5 with ‘Remove repetition’ 1 and the set of five candidate reference genes with ‘Remove repetition’ 2).
Figure 2 shows the results of GenExpA analysis for the expression levels of target genes B4GALT1–B4GALT7 in the analyzed experimental model. We obtained consistent and complete analyses for all target genes under the given stability values for the experimental and auxiliary models. These presented results demonstrate that in melanoma cells, in particular metastatic melanoma cell line WM266-4, the expression of all B4GALT genes decreases relative to that of melanocytes. An exception is melanoma cell line WM793, in which the expression levels of genes B4GALT2 and B4GALT4 show no significant differences as compared to those for melanocytes.
Discussion
Obtaining reliable results from the PCR reaction is the outcome of many factors related to handling of the material, beginning with the step of RNA/DNA isolation and ending in analysis of the results. That is why the MIQE guidelines were proposed for transparent reporting of experimental details in all publication prepared with the use of qPCR technique14. The reaction needs to be standardized in molecular analyses of all kinds of biological materials15,16,17,18. Over the past decade the MIQE guidelines have not come into common use. Dijkstra et al.15 made a critical analysis of qPCR result normalization in 179 publications regarding colorectal cancer. They showed that only 3% of these studies applied qPCR methodology based on the use and validation of multiple reference genes. Several statistical are used to select the best stable single gene or combination of reference genes from a panel of candidate genes. It should be stressed that each of these algorithms has its limitations which affect the ranking of candidate reference genes and finally the selection of the best normalizer19,20. Recent studies have proposed the use of at least three different methods, but the problem of how to interpret conflicting results obtained from the use of different statistical methods still puzzles researchers. They try to integrate a few algorithms to average the stability ranks; for example, the RefFinder algorithm calculates the geometric mean of ranking values obtained by four other algorithms19. But these statistical methods differ from each other; averaging the ranks can lead to a suboptimal assessment of stable reference genes20. It is commonly accepted that the lower the stability value of the reference, the greater the certainty of correct determination of the relative expression of the target gene. Yet it has not been clarified how low the stability value must be. In this paper we showed that the procedure for choosing a suitable reference involves two steps: applying an algorithm for best reference gene selection (here, NormFinder), and checking whether the stability level of the selected reference is low enough to lead to a correct biological interpretation of relative target gene expression (here, determination of CS for the analysis). Through the application of these two steps, our method validates the chosen reference based on determination of the coherence score for the normalized target gene. In our method we used the model-dependent NormFinder algorithm, and by simulating the removal of the least stable gene from a set of candidate genes in the experimental as well as daughter models we were able to obtain more stable normalizers for each model. Previously, this approach helped us to exclude incorrect normalizations and biological misinterpretations concerning the alteration of ERAP1 gene expression during melanoma progression13. We chose the NormFinder algorithm because it calculates the stability of a reference gene or pair of genes by analysing the variation of its expression within and between samples. However, genes with high overall variation influence the stability ranking of candidate reference genes. Herein we have demonstrated that simple application of NormFinder (‘Remove repetition’ 0) may lead to biological misinterpretation of the results, because it depends on the HKG set used to select the reference. Our method eliminates the influence of the most variable gene or genes on the stability rankings of all other candidate reference genes. In addition, breaking down the experimental model into daughter models (auxiliary models) allows us to check whether a uniform trend of target gene expression among particular cell lines is maintained. This trend decides the consistency of the analysis and is described by coherence score CS = 1. Obtaining full consistency of the analysis is tantamount to its completion. As we suggest here, based on our B4GALT gene expression analysis, the lower the stability value, the better the coherence of the obtained results, which, we propose, is related to their biological correctness. If, despite the application of our strategy, a uniform trend of target gene expression among particular cell lines has not been achieved, introducing a successive HKG/s, along with repeated rejection of the weakest gene, can lead to selection of the better reference and, in turn, biologically correct conclusions. It is important to note that once selected, a reference for a given model will not necessarily be selected once again in an experiment repeated for this model after some time, even if the pool of candidate reference genes used is exactly the same. This is because the gene expression pattern at the time point of sample collection depends on the current rate of cell mass growth and on microenvironmental conditions21,22.
Conclusions
Here we have presented an expanded version of our already published method for RT-qPCR data analysis implemented in the GeneExpA tool—software for reference gene validation and automatic calculation of target gene expression. GenExpA will assign a CS value ranging from 0 to 1 to each analysis; a fully coherent analysis is described by a CS value of 1. We suggest starting the analysis with a set of at least four potential HKGs. If the results are not satisfactory—if the CS value is below 1—introducing another candidate HKG/s to the set of candidate reference genes may improve them. However, even if CS is equal to 1 for a given target gene, enlarging the pool of candidate reference genes can lead to an analysis that is more robust in terms of between-sample statistical significance in the experimental model. Interestingly, our workflow, including full target gene analysis in order to validate normalizer, shows that the lower stability value of the selected reference gene or pair of genes is related to the biological correctness of the results. Moreover, our workflow is the first one that allows the user to define the required stability value needed to draw biologically correct conclusions. For clarity of the biological conclusions drawn, the description of the results should give stability values assigned to the experimental model and auxiliary models; this may help other researchers to compare their results and understand any differences between their outcomes and yours. GenExpA software can carry out an analysis of many genes independently at the same time.
Materials and methods
Cell culture
Human epidermal melanocytes (adult, HEMa-LP) were obtained from Gibco (Life Technologies). Human melanoma cell lines Mel202 (uveal primary), WM793 (cutaneous primary, vertical growth phase) and WM266-4 (skin metastasis) were from the ESTDAB Melanoma Cell Bank (Tübingen, Germany). Human melanoma cell line WM35 (cutaneous primary, radial/vertical growth phase) was kindly donated by Prof. A. Mackiewicz of the Department of Cancer Immunology, University School of Medical Sciences, Greater Poland Cancer Center, Poznań, Poland. Cell lines were cultured as described previously12. All cultures were verified mycoplasma-free using the MycoAlert mycoplasma detection kit (Lonza).
Reverse transcription qPCR
Total RNA extraction, the reverse-transcription reaction and real-time qPCR reactions were performed as previously described12. RNA and cDNA concentrations as well as their quality were assessed with a NanoDrop 2000 spectrophotometer (Supplementary Data). Housekeeping (GUSB, HPRT1, PGK1, RPS23, SNRPA) and target (B4GALT1–7) gene-specific mRNAs were amplified with the use of TaqMan Gene Expression Assays, as listed in Table 2. All reactions were performed in three biological and three technical replicates. The reaction results were analyzed with StepOne Software ver. 2.0. Raw Ct values were calculated using StepOne ver. 2.0, applying automatic threshold and baseline settings.
RT-qPCR data analysis
The GenExpA tool was used for fully automated qPCR data analysis. The gene or combination of two HKGs with the lowest stability value were selected as the best reference by combining the model-based variance estimation with progressive removal of the least stable reference gene. For statistical analysis, the pairwise t-test with Holm adjustment was used. P values less than 0.05 were taken to indicate statistical significance (P < 0.05).
Data availability
The data used to support the findings of this study are included within the article.
References
Bustin, S. A. Absolute quantification of mRNA using real-time reverse transcription polymerase chain reaction assays. J. Mol. Endocrinol. 25, 169–193 (2000).
Goidin, D. et al. Ribosomal 18S RNA prevails over glyceraldehyde-3-phosphate dehydrogenase and β-actin genes as internal standard for quantitative comparison of mRNA levels in invasive and noninvasive human melanoma cell subpopulations. Anal. Biochem. 295, 17–21 (2001).
Vandesompele, J. et al. Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome Biol. 3(7), 0034 (2002).
Yperman, J. et al. β-actin cannot be used as a control for gene expression in ovarian interstitial cells derived from heart valves. J. Heart Valve Dis. 13, 848–853 (2004).
Ryu, B. et al. Comprehensive expression profiling of tumor cell lines identifies molecular signatures of melanoma progression. PLoS ONE 2(7), e594. https://doi.org/10.1371/journal.pone.0000594 (2007).
Ling, D. et al. Robust RT-qPCR data normalization: Validation and selection of internal reference genes during post-experimental data analysis. PLoS ONE 6(3), e17762. https://doi.org/10.1371/journal.pone.0017762 (2011).
Das, R. K. et al. Extensive sex- and/or hormone-dependent expression of rat housekeeping genes. Endocr. Res. 38(2), 105–111 (2013).
Zhang, Q.-L. et al. Selection of reliable reference genes for normalization of quantitative RT-PCR from different developmental stages and tissues in amphioxus. Sci. Rep. 6, 37549–37559 (2016).
Andersen, C. L. et al. Normalization of real-time quantitative reverse transcription-PCR data: A model-based variance estimation approach to identify genes suited for normalization, applied to bladder and colon cancer data sets. Cancer Res. 64, 5245–5250 (2004).
Pfaffl, M. W. et al. Determination of stable housekeeping genes, differentially regulated target genes and sample integrity: BestKeeper: Excel-based tool using pair-wise correlations. Biotech. Lett. 26, 509–515 (2004).
Silver, N. et al. Selection of housekeeping genes for gene expression studies in human reticulocytes using real-time PCR. BMC Mol. Biol. 7, 33–41. https://doi.org/10.1186/1471-2199-7-33 (2006).
Curis, E. et al. Selecting reference genes in RTqPCR based on equivalence tests: A network based approach. Sci. Rep. 9, 16231–16238. https://doi.org/10.1038/s41598-019-52217-2 (2019).
Janik, M. E. et al. RT-qPCR analysis of human melanoma progression-related genes: A novel workflow for selection and validation of candidate reference genes. Int. J. Biochem. Cell Biol. 101, 12–18 (2018).
Bustin, S. A. et al. MIQE précis: Practical implementation of minimum standard guidelines for fluorescence-based quantitative real-time PCR experiments. BMC Mol. Biol. 11, 74–78. https://doi.org/10.1186/1471-2199-11-74 (2010).
Bustin, S. & Nolan, T. Talking the talk, but not walking the walk: RT-qPCR as a paradigm for the lack of reproducibility in molecular research. Eur. J. Clin. Invest. 47(10), 756–774. https://doi.org/10.1111/eci.12801 (2017).
Dijkstra, J. R. et al. Critical appraisal of quantitative PCR results in colorectal cancer research: can we rely on published qPCR results?. Mol. Oncol. 8(4), 813–818 (2014).
LaTaylor, S. C. & Mrkusich, E. M. The state of RT-quantitative PCR: Firsthand observations of implementation of minimum information for the publication of quantitative real-time PCR experiments (MIQE). J. Mol. Microbiol. Biotechnol. 24(1), 46–52. https://doi.org/10.1159/000356189 (2014).
Remans, T. et al. Reliable gene expression analysis by reverse transcription-quantitative PCR: Reporting and minimizing the uncertainty in data accuracy. Plant Cell 26(10), 3829–3837. https://doi.org/10.1105/tpc.114.130641 (2014).
Sarker, N. et al. Identification of stable reference genes for quantitative PCR in koalas. Sci. Rep. 8, 3364–3371. https://doi.org/10.1038/s41598-018-21723-0 (2018).
Sundaram, V. K. et al. Optimal use of statistical methods to validate reference gene stability in longitudinal studies. PLoS ONE 14(7), e0219440. https://doi.org/10.1371/journal (2019).
Kimmerling, R. J. et al. Linking single-cell measurements of mass, growth rate, and gene expression. Genome Biol. 19, 207–219 (2018).
Lemma, S. et al. Validation of suitable housekeeping genes for the normalization of mRNA expression for studying tumor acidosis. Int. J. Mol. Sci. 19, 2930–2944. https://doi.org/10.3390/ijms19102930 (2018).
Hellemans, J. & Vandesompele, J. qPCR data analysis: Unlocking the secret to successful results. in PCR Troubleshooting and Optimization: The Essential Guide (Caister Academic Press) ISBN 978-1-904455-72-1 (2011).
Acknowledgements
Michael Jacobs line-edited the paper for submission. This work was supported by the National Science Centre, Poland (Grant Number 2016/21/B/NZ3/00348) to D.H.-Ł.; the Institute of Zoology and Biomedical Research, Jagiellonian University (Grant Number N18/DBS/000007). The open-access publication of this article was funded by the programme “Excellence Initiative – Research University” at the Jagiellonian University in Kraków, Poland. We thank Małgorzata Dutka (Department of Molecular Biophysics, Faculty of Biochemistry, Biophysics and Biotechnology of the Jagiellonian University) for reading the manuscript and valuable comments.
Author information
Authors and Affiliations
Contributions
D.H.-Ł. and M.E.J. wrote the manuscript, supervised the writing of the software, tested the software and performed experiments. D.M. wrote the software and the user manual. D.H.-Ł. prepared figures and acquired the financial support. P.K. designed the statistical method. All authors have given approval to the final version of the manuscript.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Hoja-Łukowicz, D., Maciążek, D., Kościelniak, P. et al. Innovative GenExpA software for selecting suitable reference genes for reliable normalization of gene expression in melanoma. Sci Rep 12, 3331 (2022). https://doi.org/10.1038/s41598-022-07257-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-07257-6
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.