Article | Open | Published:

Assessment of brain reference genes for RT-qPCR studies in neurodegenerative diseases

Scientific Reports volume 6, Article number: 37116 (2016) | Download Citation


Evaluation of gene expression levels by reverse transcription quantitative real-time PCR (RT-qPCR) has for many years been the favourite approach for discovering disease-associated alterations. Normalization of results to stably expressed reference genes (RGs) is pivotal to obtain reliable results. This is especially important in relation to neurodegenerative diseases where disease-related structural changes may affect the most commonly used RGs. We analysed 15 candidate RGs in 98 brain samples from two brain regions from Alzheimer’s disease (AD), Parkinson’s disease (PD), Multiple System Atrophy, and Progressive Supranuclear Palsy patients. Using RefFinder, a web-based tool for evaluating RG stability, we identified the most stable RGs to be UBE2D2, CYC1, and RPL13 which we recommend for future RT-qPCR studies on human brain tissue from these patients. None of the investigated genes were affected by experimental variables such as RIN, PMI, or age. Findings were further validated by expression analyses of a target gene GSK3B, known to be affected by AD and PD. We obtained high variations in GSK3B levels when contrasting the results using different sets of common RG underlining the importance of a priori validation of RGs for RT-qPCR studies.


Reverse transcription quantitative real-time polymerase chain reaction (RT-qPCR) is one of the most widely used methods for analysis of gene expression levels due to its methodological accessibility and high sensitivity. Studies on neurodegenerative diseases are no exceptions, and RT-qPCR have helped to identify gene expression changes and thereby disease-associated genes in several disorders, e.g. Alzheimer’s disease (AD)1,2,3,4, and Parkinson’s disease (PD)5,6,7. Identification of small, dynamic changes in gene expression is important for understanding of the mechanisms underlying neurodegenerative events. An essential step in the development of RT-qPCR assays is identification of appropriate reference genes (RGs) to be used as endogenous controls in data normalization. Housekeeping genes (HKGs) are often the most obvious choice as constitutive RGs since HKGs are important for basal cellular functions and should therefore exhibit stable levels under normal and pathophysiological conditions. However, it has been shown that expression levels of many HKGs can also be affected by disease-mediated pathological changes in, e.g., cell homeostasis and metabolism8,9. Thus, the selection of stable RGs is critical in order to avoid methodological errors. For many years, glyceraldehyde 3-phospate dehydrogenase (GAPDH) and beta(β)-actin (ACTB) have been the primary choices as RGs. Though, in the last decade a vast number of studies have documented that these genes should be used with caution since they may display variable expression levels across various cell types and disease states10,11,12,13,14.

Descriptive statistics is the most straightforward way for comparing RG expression stability. Even though widely applied, this approach has its pitfalls due to its simplicity. There are several more advanced methods available that address the problem of RG transcription stability taking into account multiple parameters. The four most common are the ΔCt-method15 and the three algorithms Genorm16, BestKeeper17, and NormFinder18 (reviewed elsewhere19). RefFinder, a free online software platform for identification of stable RGs, derives a comprehensive ranking based on the geometric mean of the scores from Genorm, BestKeeper, NormFinder, and the ΔCt-method in order to extract the best RGs based on the different mathematical approaches20. Although these methods differ in their mathematical design, studies have shown only small variations in the outcomes for Genorm, NormFinder, and BestKeeper, and also between the stand-alone applications for Genorm, NormFinder, and BestKeeper, and RefFinder, making these methods comparable21,22.

The overall aim for this study was to evaluate putative RGs for use in gene expression studies on the human brains in diverse, but pathologically related neurodegenerative diseases. Here, we report on 15 candidate RGs that potentially can be used for normalization of gene expression data in brain samples from patients diagnosed with AD, PD, Multiple System Atrophy (MSA), or Progressive Supranuclear Palsy (PSP) compared with normal, non-neurological affected controls (NCs). We selected RG candidates based on their extensive use in RT-qPCR studies from the literature as well as their presence in ready to use commercial kits for RG selection. Several of the RG candidates have previously been investigated under different conditions10,12,23,24,25,26, and a few have been tested in AD and/or PD11,27,28. MSA and PSP are atypical parkinsonian disorders and have a clinical manifestation highly similar to PD29. To our knowledge, no study on RG selection has been performed on MSA or PSP thus far. Hence, assessment of stable RGs for comparative studies on PD, MSA, and PSP is highly relevant in order to strengthen the reliability of the experimental outcome. Furthermore, although PSP is clinically comparable to PD, the pathological events in PSP are similar to AD30. We investigated two disease-affected brain regions, the medial frontal gyrus of the prefrontal cortex (PFC), and the cerebellum (CB), in order to define the most stable set of RGs for comparative gene expression studies in PD, MSA, PSP, and AD brains. The following genes were investigated (Table 1): GAPDH, ACTB, ribosomal protein large 13 (RPL13), hypoxanhine phosphoribosyl transferase (HPRT1), cytrochrome C1 (CYC1), topoisomerase 1 (TOP1), eukaryotic translation initiation factor 4A2 (EIF4A2), β-2-microglobulin (B2M), pumilio-homolog 1 (PUM1), TATA-box binding protein (TBP), ubiquitin C (UBC), cyclophilin A (PPIA), succinate dehydrogenase complex subunit A (SDHA), ATP synthase H+ transporting mitochondrial F1 complex beta polypeptide (ATP5B), and ubiquitin-conjugating enzyme E2D2 (UBE2D2). Further, glycogen synthase kinase 3β (GSK3B) was included as a Gene of Interest (GOI) to validate the impact of the RG selection on normalization of gene expression data.

Table 1: Overview of genes and corresponding primer pairs for reverse transcriptase quantitative real-time PCR.


RT-qPCR primer amplification efficiencies

Primer efficiencies were calculated for each candidate RG and ranged between 90.4% and 107.6% using a minimum of four points on the standard curve with R2-values ranging from 0.992 to 1.000 (Table 1). Each reaction ended with a melting curve analysis between 55 and 95 °C for PCR product evaluation (Fig. S1). If melting curve analysis identified presence of primer dimers, an additional acquisition step was added in each PCR cycle (Table 1) since primer dimers do not generate signal in fluorescence captured over 76 °C. Due to low expression levels in both brain regions (cycle threshold (Ct)mean > 35) and since it was not possible to obtain good efficiency for HPRT1 and SDHA, the genes were not included in the subsequent stability measurements.

Descriptive statistics of candidate RGs

Almost all candidate RGs showed significantly aberrant expression levels between the disease groups in both brain regions with the exception of RPL13, EIF4A2, B2M, and UBC in the PFC which showed no significant differences between groups (Fig. 1). Ct-values for the 13 included candidate RGs in the PFC and CB for all five groups ranged between 19.9 and 38.7 (Fig. 1, Table 2). The standard deviations (SDs) ranged between 0.66 and 3.09 (Table 2). In the PFC, EIF4A2 had the lowest expression levels (mean Ct (Ctmean) = 32.6) followed by TBP (Ctmean = 31.5), and B2M (Ctmean = 30.3). In the CB PUM1 (Ctmean = 32.8), TOP1 (Ctmean = 31.0), and TBP (Ctmean = 30.9) exhibited the lowest expression levels. The genes with the highest expression levels were in both brain regions RPL13 (Ctmean, PFC = 25.0 and Ctmean, CB = 23.5), and PPIA (Ctmean, PFC = 25.7 and Ctmean, CB = 27.1). In all groups, EIF4A2 showed the most variable expression levels in both regions reflected by the mean SD (SDmean, PFC = 2.18 and SDmean, CB = 1.80). In both brain regions, the RG candidates that exhibited the lowest variability in expression levels were TBP (SDmean, PFC = 1.21 and SDmean, CB = 1.09), PUM1 (SDmean, PFC = 1.24 and SDmean, CB = 1.05), and RPL13 (SDmean, PFC = 1.33 and SDmean, CB = 1.24).

Figure 1: Thirteen candidate reference gene Ct-value distributions in both brain areas.
Figure 1

Box and whisker plots showing RT-qPCR mRNA expression levels depicted as raw Ct-values in the prefrontal cortex (A) and the cerebellum (B) for all Alzheimer’s disease (AD), Parkinson’s disease (PD), Multiple System Atrophy (MSA), Progressive Supranuclear Palsy (PSP), and normal, non-demented controls (NCs). Boxes depict the 25th, 50th and 75th percentiles; whiskers show the minimum and maximum values for each RG. p-values indicate the ANOVA significance levels.

Table 2: Mean raw Ct-values and standard deviations (SDs) for each disease group and controls in both the prefrontal cortex, and the cerebellum.

Summarized comprehensive ranking

Based on the outcome from the RefFinder software (for all results, see Excel S1), candidate RGs were assigned a rank from 1 to 13 (1 being the most stable RG in the given combination of disease groups and 13 being the least stable; Excel S1). When integrating all different combinations for all disease groups included in the study, we found that in both brain regions CYC1 and UBE2D2 were the most stable RGs (Fig. 2). The least stable RG candidates in the PFC were GAPDH and EIF4A2, while EIF4A2 and TOP1 were ranked the least stable in the CB. Further, the summarized, comprehensive rankings for both brain regions and all individuals were considered collectively. CYC1, UBE2D2, and RPL13 were ranked among the top six most stable RGs as illustrated in Fig. 3A. Of the seven most unstable RGs, EIF4A2, B2M, UBC, and ACTB were identified in both the PFC and CB (Fig. 3B). The overall three most stable RGs identified in this study are CYC1, UBE2D2, and RPL13 (Fig. 3).

Figure 2
Figure 2

Summarized gene stability ranking for all individuals in the prefrontal cortex (A) and the cerebellum (B). Summarized rankings from RefFinder. Lower ranking indicates higher stability.

Figure 3
Figure 3

Ven diagram showing the overlap of the six most stable (A) and seven least stable (B) reference genes in both the prefrontal cortex (light gray) and the cerebellum (dark gray). The ven diagram is based on the summarized comprehensive rankings from RefFinder.

Reference gene validation

In order to demonstrate the impact of the RG choice on RT-qPCR data normalization, target gene GSK3B expression levels were analysed in both the PFC and the CB, between NCs and AD (Fig. 4A,B), NCs and PD (Fig. 4C,D), as well as between all groups (Fig. 4E–J). For each combination of disease groups, data were normalized to three distinct sets of RGs: 1) GAPDH and ACTB, the two most commonly used RGs; 2) the two RG candidates that in our analyses displayed the lowest stability for the given combination of disease groups; and 3) the three most stable RG candidates that in our analysis displayed the highest stability for the given combination of disease groups. The gene expression levels measured for GSK3B were significantly influenced by the choice of RGs used for normalization (Fig. 4, summarized in Table 3).

Figure 4: Expression levels of GSK3B normalized to different reference genes (RGs).
Figure 4

GSK3B expression levels were analyzed using the common RG choices (GAPDH and ACTB) in combination, using the two lowest ranked genes in combination, and using the three best ranked genes in combination. (A) and B) shows comparison of RG choice for normal, non-demented controls (NCs) and Alzheimer’s disease (AD) patients, (C) and (D) for NCs and Parkinson’s disease (PD) patients, (E–H) for all groups. (A,C,E,G) and (I) show comparisons for the prefrontal cortex, and (B,D,F,H) and (J) for the cerebellum. All data are presented as the relative expression levels normalized to the most stable RGs calculated for each combination of disease groups in the respective areas, and data are shown in relation to expression levels in NCs. MSA: Multiple System Atrophy patients; PSP: Progressive Supranuclear Palsy patients. Data are presented as mean ± SEM. *p < 0.05, **p < 0.01, ***p < 0.001.

Table 3: Results from GSK3B expression comparison.

The greatest effect on the results is seen for the analysis of data from NCs vs AD. The expression of GSK3B is significantly upregulated in AD when normalized to the most common RGs and the least stable RGs in the PFC (Fig. 4A), and to the most common RGs in the CB (Fig. 4B). However, when we normalized the GSK3B expression levels to the most stable RGs obtained by our analyses, the relative significance between the groups disappeared in PFC (Fig. 4A) or is swapped in CB (Fig. 4B). For NCs vs PD normalization to the most common, and the most stable RGs resulted in similar outcomes, however, SDs when using the most stable RGs were decreased (Fig. 4C,D). When all groups were analysed together and GSK3B levels were normalized to the most stable RGs we observed the most equal, least diverging results between groups (Fig. 4I,J). A high increase of GSK3B levels in the AD group vs. other groups was observed in the PFC for data normalized to both the least stable RGs (Fig. 4G) and the most common RGs (Fig. 4E). Conversely, decreased levels of GSK3B were observed in the AD patients compared to NCs when the least stable RGs were used for data normalization in the CB (Fig. 4H), whereas no differences were identified in the CB for the most stable RGs (Fig. 4J).

Correlation analyses

Significant differences in RNA integrity number (RIN) values, age, and post-mortem intervals (PMIs) were observed between groups (Table 4). To evaluate the impact of these factors on expression of GSK3B, raw Ct-values, and Ct-values normalized to the most stable RGs were correlated to RIN-values, age, and PMIs (Table S3). None of the viable factors showed significant correlation to the expression of GSK3B.

Table 4: Main clinical and neuropathological data for patient groups in the prefrontal cortex, and the cerebellum.


Our study is the first to provide a comprehensive evaluation of commonly used RGs for RT-qPCR for comparative studies of four neurodegenerative diseases: Two highly investigated diseases, AD and PD, along with two rare diseases, MSA and PSP. There is a general consensus on the use of HKGs as RGs, however, it has become more evident that the assumption of RG stability is not consistent when experimental conditions are altered. Therefore, we agree with others that, optimally, selection of the most valid RGs should be performed individually for each experimental setup31 as well as the investigated tissue, organ and region, disease, species and so forth11. Additional factors such as primer efficiencies, primer sequences, cDNA synthesis protocols, and basic experimental differences could also influence the outcome in RG stability, and therefore should also be considered. Several other factors have also been shown to influence the output of mRNA studies including degree of degradation32,33, PMIs34, and subject age35. As suggested by the minimum information for publication of quantitative real-time experiments (MIQE) guidelines36 RNA fragmentation should be obtained for every mRNA sample used for RT-qPCR. One way to obtain this is by determining the RIN-values37. It is important to obtain RIN-values as high as possible, as done in this study, with a threshold of 3.95 recommended for human post-mortem studies38. However, short amplicons (below 250 base pairs) are less dependent on RIN-values33. Further, some of the problems associated with low RIN-values can be circumvented using internal RGs for data normalization together with expressing result values relative to an internal standard (the ΔΔCt method39) with correction for PCR efficiency32. RIN-values have been shown to correlate negatively with PMIs34, however, we did not identify an influence of either PMIs or age on RIN-values (Fig. S2). We further corroborated that the raw or normalized Ct-values for GSK3B expression levels did not correlate with any of those factors in both brain regions. Thus, we can conclude that by applying the recommendations from the MIQE guidelines, and by implementing the precautions in the experimental design as described here, we were able to perform relative quantification of gene expression levels with a minimum risk of false interpretation of the results.

As mentioned above, PMIs varied significantly between groups. The samples used in this study originated from three different brain banks placed in Denmark, the Netherlands, and the USA. The variations in PMIs are primarily due to differences in national legislations regarding PMIs after which the extraction of human brains is allowed, and this is therefore difficult to circumvent. Since our findings did not show any significant correlations between PMI and RIN, age, raw Ct-values, or normalized Ct-values, this study moreover supports that inclusion of human brain samples from different sources is feasible even in the case of large differences in PMIs.

We applied the RefFinder software in this study for data analysis. The software combines four of the most commonly used algorithms for determination of the stability of gene expression (Genorm, NormFinder, BestKeeper and the ΔCt-method), but RefFinder does not share all of the features that are included in the stand-alone applications. E.g., the capability of Genorm to define the optimal number of RGs using a predetermined cut-off value that determines how much adding another RG to the analyses affects the grouped stability of the best ranked RGs16. However, as already stated elsewhere16,40, using a minimum of three RGs should be appropriate, and we therefore do not consider the absence of this feature in RefFinder to be of relevance for our analysis. RefFinder does not take primer efficiencies into account, a feature included in the Genorm, NormFinder and BestKeeper stand-alone applications. In order to correct for this, we manually adjusted the raw Ct-values for efficiencies before analysis. This has previously proved to make results obtained with the RefFinder software comparable to those obtained with the stand-alone applications22. Similar and comparable evaluations are obtained from the Genorm, NormFinder, and the ΔCt-methods, with deviations for some genes obtained from BestKeeper. This is surprising as earlier findings showed equal stability rankings for Genorm, NormFinder, and BestKeeper21,22. An explanation could be the so-called BestKeeper index, a tool that only BestKeeper applies. This index is the geometric mean of the Ct-values of all candidate RGs grouped together. Thus, the gene with the highest coefficient of correlation with the index indicates the highest stability. Despite of these small discrepancies, results regarding the best RG candidates were consistent between the different applied methods.

In this study we have used different approaches to assess RG candidate stabilities. Had we only used descriptive statistics with the only criteria applied being minimal variation in the expression levels in each group followed by low differences between disease groups, TBP, PUM1, and RPL13 would be the preferable choices in both the PFC and CB in this study. Although RPL13 ranks among the four most stable RGs according to the summarized rankings, TBP ranks among the three least stable RGs and it would therefore be inadvisable to use, whereas PUM1 seems to be an intermediate RG. Thus, in order to evaluate candidate RGs based on a wide range of equally important parameters more advanced methodical and statistical approaches are needed.

According to our analyses using RefFinder, CYC1, UBE2D2, and RPL13 were ranked among the top six most stable RGs, while EIF4A2, B2M, UBC, and ACTB were among the most unstable RGs. CYC1 and UBE2D2 proteins are affected in at least AD and/or PD41,42,43, but this is apparently irrelevant to the gene expression stability. The CYC1 protein is part of the mitochondrial electron transport chain and is thus crucial for cellular respiration44. UBE2D2 protein is a ubiquitin-conjugating enzyme that has been proposed as a general HKG along with proteins with similar functions45. Our results for UBE2D2 find support elsewhere27. To our knowledge, neither gene transcription nor protein levels of the ribosomal 60S-subunit RPL13 have been reported to be affected in any of the diseases included in this study.

As suspected, GAPDH and ACTB did not show up as stable RGs in our analyses. GAPDH protein is a catalytic enzyme involved in glycolysis and is therefore important for cell metabolism46. Most likely due to this vital function, GAPDH has been one of the primary choices as RG in RT-qPCR studies for more than two decades. However, GAPDH protein and its activity has been shown to be affected in AD8 and PD9, and general GAPDH transcription levels have been shown to vary highly between different tissue compartments47. Our data indicate that GAPDH is not a stable RG in neither the PFC (ranked 12th) nor the CB (ranked 6th). ACTB protein is one of six different human actin isoforms and is one of the two non-muscle cytoskeletal actins48. ACTB has also been used extensively as an RG for several years. In our studies ACTB is ranked 7th and 9th in the PFC and CB, respectively, and it is therefore not recommended for use as a RG in similar experimental setups.

Finally, in order to validate how the choice of RGs influences RT-qPCR results, we compared GSK3B mRNA levels between different combinations of disease groups. GSK3B is regulating several different cellular processes, and GSK3B dysregulation have been implicated in the pathogenesis of both AD and PD49. Substantial divergences occurred in the relative transcript abundance of GSK3B when normalized to different sets of reference genes. Generally, large variations in the relative expression of GSK3B are seen when the most common, GAPDH and ACTB, or the least stable RGs are used for normalization. Conversely, when the most stable RGs are used, relative differences in mRNA levels between the groups become minimized. Bearing in mind that GAPDH and ACTB proved to be unstable RGs, the spread between these observations confirm the importance of using the adequate RGs in order to avoid false results.

In summary, the expression profiles and stability of 13 commonly used RGs in brain samples from four different neurodegenerative disorders (AD, PD, MSA and PSP) and NCs in two distinct brain regions (PFC and CB) were investigated using six different statistical approaches (descriptive statistics, Genorm, NormFinder, BestKeeper, ΔCt-method, and RefFinder). Furthermore, the relative expression of the disease associated gene GSK3B was assessed using different sets of RGs. This approach validated the impact that the choice of RGs has on the study outcome and underlined the importance of selecting the most stable RGs to correctly quantify gene expression levels. We suggest performing thorough analyses on RG selection for each tissue, disease, and experimental setup prior to the main experiment. Based on the results from this study we recommend using UBE2D2, CYC1, and RPL13 in combination for studies related to brain tissue and to the diseases included here. Further, we have provided several important considerations regarding the choice and the assessment of RGs in RT-qPCR studies. This report should therefore be regarded as a guideline on how to perform RG validation in order to reinforce the reliability of RT-qPCR results.


Source of human brain tissue

Post-mortem brain samples from the medial frontal gyrus of the PFC and the CB (Tables S1 and S2) were generously donated by the Brain Bank at Bispebjerg-Frederiksberg Hospital (University of Copenhagen; approved by the Danish Data Protection Agency, BBH-2010-06, I-suite 00971), the Netherlands Brain Bank (Netherlands Institute for Neuroscience), and the Harvard Brain Tissue Resource Center (Harvard Medical School Teaching Hospital) (Table S1). All samples were histologically investigated to confirm pathology and diagnosis. A significant difference in age in the MSA group is observed due to their earlier disease onset and death (Table 4). All brain samples were collected, and handled in accordance with Danish ethical standards, and the Danish Health and Medicine Authorities. This project was approved by the Regional ethical committee of Region Hovedstaden, journal no. H-16025196. Informed consent was obtained from all donors. Samples were stored at −80 °C prior to total RNA extraction.

RNA isolation and cDNA synthesis

The RNA isolation and the subsequent RT-qPCR reactions were performed according to the MIQE guidelines36. Total RNA extraction was performed using either Qiagen RNeasy Lipid Tissue Mini Kit or Qiagen AllPrep DNA/RNA/miRNA Universal Kit according to manufacturer’s instructions. Prior to RNA extraction, brain samples were homogenized using a MagNA Lyser instrument (Roche Diagnostics) and the related MagNA Lyser green beads (Roche) at 2 × 6.5 k rpm for 25 seconds in 1 ml pre-cooled Qiazol reagent supplied with the extraction kit. RNA quality and concentrations were assessed using the 2100 Agilent Bioanalyzer (Agilent Technologies) using RNA 6000 Nano kits (Agilent Technologies) following the manufacturer’s instructions. RNA purity was assessed using a NanoDrop 2100 (Thermo Scientific). RNA concentrations ranged from 0.04–1.10 μg/μl and RIN-values from 4.0–7.8. A cut-off threshold of RIN = 3.95 based on34,38, and an optical density at wavelength 260/280 nm range of 1.8–2.2 were chosen for this study36. All RNA samples were subjected to DNase digestion using the Turbo DNA-freeTM Kit (Ambion) and subsequently tested for DNA contamination in RT-qPCR using the GAPDH primer set (Table 1). Single-stranded cDNA was synthesized from 100 ng of total RNA using qScript cDNA SuperMix kit (Quanta) following the manufacturer’s instructions. cDNA concentrations were measured on a NanoDrop 2000 and diluted to 100 ng/μl in RNase-free H2O.

Selection of candidate reference genes and PCR primer design

15 putative RGs were selected for evaluation of their stability in each patient group and in comparisons of patient groups. The RGs were selected based on their vast usage in the literature and in commercial gene array kits. Six primer pairs were adapted from the literature: ATP5B50, TOP151, PPIA52, PUM153, TBP and UBE2D254. For all other genes primer pairs were designed de novo using Primer-BLAST (NCBI) and Oligo 7 (Molecular Biology Insight, Inc.). Primers were synthesized by TAG Copenhagen A/S. For each primer pair (Table 1), the optimal annealing temperature, the amplification efficiency, and R2 were determined and calculated using the MxPro software package (Agilent Technologies).

Reverse Transcriptase Semi-Quantitative Real-time PCR (RT-qPCR)

All samples were run in duplicates. Briefly, RT-qPCR reactions were carried out using Fast SYBR Green Master Mix (Applied Biosystems) on a Stratagene Mx3005p qPCR System (Agilent Technologies). The final volume for each reaction was 10 μl with 300 nM (400 nM for TOP1) of corresponding gene specific primers (Table 1), and 1 μl of total cDNA. A positive control/calibrator cDNA sample synthesized from commercial available Human Universal Reference Total RNA (hRNA; Clontech) was included on each plate. A negative water control was included in each run. The thermal cycling was initiated at 95 °C for 20 s followed by 40 cycles of 5 s at 95 °C and 30 s at the optimal annealing temperature for each gene (Table 1). If primer dimers were observed, an additional acquisition step for 15 s in each cycle was added to avoid primer dimers detection (Table 1 and Fig. S1). Dissociation curve analyses were carried out at the end of each run for PCR product verification (Fig. S1).

Data analysis

The stabilities of the RG candidates were accessed using four methods: Genorm16, NormFinder18, BestKeeper17 and the comparative ΔCt method15 combined in the online package RefFinder which includes an overall comprehensive analyses of the four methods20 ( The mean Ct-values for each sample were normalized using a Human Universal Reference cDNA as a calibrator as described by39. Furthermore, the Ct-values were corrected for the efficiencies for each gene. Relative quantities were calculated using geometric averaging of multiple reference genes55.


Data are displayed as mean ± SEM. Gaussian distribution was evaluated using the D’Agostino-Pearson omnibus normality test. Homogeneity of variance was evaluated using Levene’s test. Outliers were removed using the ROUT procedure with maximum false discovery rate (FDR) Q = 1%. Statistical analyses were conducted in GraphPad Prism 6.01 (GraphPad Software) and the Real Statistics Resource Pack software v. 4.8 using non-paired parametric Student’s t-test, Welch’s t-test for unequal variances, one-way ANOVA followed by Tukey’s multiple comparison range test, Welch’s ANOVA followed by Games-Howell post hoc test, and Bonferroni corrected Pearson product-moment correlation or Mann-Whitney U test, and Bonferroni corrected Spearman rank correlation. Chi-square test was used to assess the gender frequency. p-values below 0.05 were considered statistically significant.

Additional Information

Accession codes: ATP5B (NM_001686), B2M (NM_004048), PPIA (NM_021130), CYC1 (NM_001916), EIF4A2 (NM_001967), GAPDH (NM_002046), PUM1 (NM_014676), RPL13 (NM_000977), TBP (NM_003194), TOP1 (NM_003286), UBC (NM_021009), UBE2D2 (NM_003339), ACTB (NM_001101), GSK3B (NM_002093).

How to cite this article: Rydbirk, R. et al. Assessment of brain reference genes for RT-qPCR studies in neurodegenerative diseases. Sci. Rep. 6, 37116; doi: 10.1038/srep37116 (2016).

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.


  1. 1.

    et al. Deficiency in LRP6-mediated Wnt signaling contributes to synaptic abnormalities and amyloid pathology in Alzheimer’s disease. Neuron 84, 63–77, doi: 10.1016/j.neuron.2014.08.048 (2014).

  2. 2.

    , , & Aberrant Wnt signaling pathway in medial temporal lobe structures of Alzheimer’s disease. J Neural Transm 122, 1303–1318, doi: 10.1007/s00702-015-1375-7 (2015).

  3. 3.

    et al. Altered NR4A Subfamily Gene Expression Level in Peripheral Blood of Parkinson’s and Alzheimer’s Disease Patients. Neurotox Res. 1–7, doi: 10.1007/s12640-016-9626-4 (2016).

  4. 4.

    et al. Concerted changes in transcripts in the prefrontal cortex precede neuropathology in Alzheimer’s disease. Brain 133, 3699–3723, doi: 10.1093/brain/awq258 (2010).

  5. 5.

    et al. Altered α‐synuclein, parkin, and synphilin isoform levels in multiple system atrophy brains. J Neurochem 136, 172–185, doi: 10.1111/jnc.13392 (2016).

  6. 6.

    et al. Gene Expression Differences in Peripheral Blood of Parkinson’s Disease Patients with Distinct Progression Profiles. PLoS One 11, e0157852, doi: 10.1371/journal.pone.0157852 (2016).

  7. 7.

    , & Specific splice variants are associated with Parkinson’s disease. Mov Disord 28, 1724–1727, doi: 10.1002/mds.25635 (2013).

  8. 8.

    , & Oxidatively modified glyceraldehyde-3-phosphate dehydrogenase (GAPDH) and Alzheimer’s disease: many pathways to neurodegeneration. J Alzheimers Dis 20, 369–393, doi: 10.3233/JAD-2010-1375 (2010).

  9. 9.

    , , , & Transfection-enforced Bcl-2 overexpression and an anti-Parkinson drug, rasagiline, prevent nuclear accumulation of glyceraldehyde-3-phosphate dehydrogenase induced by an endogenous dopaminergic neurotoxin, N-methyl(R)salsolinol. J Neurochem 78, 727–735, doi: 10.1046/j.1471-4159.2001.00448.x (2001).

  10. 10.

    et al. Identification of accurate reference genes for RT-qPCR analysis of formalin-fixed paraffin-embedded tissue from primary non-small cell lung cancers and brain and lymph node metastases. Lung Cancer 81, 180–186, doi: 10.1016/j.lungcan.2013.04.007 (2013).

  11. 11.

    et al. Identification of valid reference genes for the normalization of RT qPCR gene expression data in human brain tissue. BMC Mol Biol 9, 46, doi: 10.1186/1471-2199-9-46 (2008).

  12. 12.

    , & Reference genes for normalization: a study of rat brain tissue. Synapse 62, 302–309, doi: 10.1002/syn.20496 (2008).

  13. 13.

    et al. Selection of reference genes for RT-qPCR analysis in a predatory biological control agent, Coleomegilla maculata (Coleoptera: Coccinellidae). Sci Rep 5, 18201, doi: 10.1038/srep18201 (2015).

  14. 14.

    , , & Reference gene selection for normalization of RT-qPCR gene expression data from Actinidia deliciosa leaves infected with Pseudomonas syringae pv. actinidiae. Sci Rep 5, 16961, doi: 10.1038/srep16961 (2015).

  15. 15.

    , , & Selection of housekeeping genes for gene expression studies in human reticulocytes using real-time PCR. BMC Mol Biol 7, 33, doi: 10.1186/1471-2199-7-33 (2006).

  16. 16.

    et al. Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome Biol 3, RESEARCH0034 (2002).

  17. 17.

    , , & Determination of stable housekeeping genes, differentially regulated target genes and sample integrity: BestKeeper–Excel-based tool using pair-wise correlations. Biotechnol Lett 26, 509–515 (2004).

  18. 18.

    , & Normalization of real-time quantitative reverse transcription-PCR data: a model-based variance estimation approach to identify genes suited for normalization, applied to bladder and colon cancer data sets. Cancer Res 64, 5245–5250, doi: 10.1158/0008-5472.can-04-0496 (2004).

  19. 19.

    , & A comprehensive approach to identify reliable reference gene candidates to investigate the link between alcoholism and endocrinology in Sprague-Dawley rats. PLoS One 9, e94311, doi: 10.1371/journal.pone.0094311 (2014).

  20. 20.

    , , , & miRDeepFinder: a miRNA analysis tool for deep sequencing of plant small RNAs. Plant Mol Biol, doi: 10.1007/s11103-012-9885-2 (2012).

  21. 21.

    et al. Exercise induced stress in horses: Selection of the most stable reference genes for quantitative RT-PCR normalization. BMC Mol Biol 9, 49, doi: 10.1186/1471-2199-9-49 (2008).

  22. 22.

    et al. Reference gene validation for RT-qPCR, a note on different available software packages. PLoS One 10, e0122515, doi: 10.1371/journal.pone.0122515 (2015).

  23. 23.

    , , & Selection of reference genes for gene expression studies in pig tissues using SYBR green qPCR. BMC Mol Biol 8, 67, doi: 10.1186/1471-2199-8-67 (2007).

  24. 24.

    , , & Identification of genes for normalization of real-time RT-PCR data in breast carcinomas. BMC Cancer 8, 20, doi: 10.1186/1471-2407-8-20 (2008).

  25. 25.

    & Robust RT-qPCR data normalization: validation and selection of internal reference genes during post-experimental data analysis. PLoS One 6, e17762, doi: 10.1371/journal.pone.0017762 (2011).

  26. 26.

    et al. Exploring valid reference genes for quantitative real-time PCR analysis in Plutella xylostella (Lepidoptera: Plutellidae). Int J Biol Sci 9, 792–802, doi: 10.7150/ijbs.5862 (2013).

  27. 27.

    , , & Normalization of gene expression using SYBR green qPCR: a case for paraoxonase 1 and 2 in Alzheimer’s disease brains. J Neurosci Methods 200, 14–19, doi: 10.1016/j.jneumeth.2011.05.026 (2011).

  28. 28.

    et al. Selection of candidate housekeeping genes for normalization in human postmortem brain samples. Int J Mol Sci 12, 5461–5470, doi: 10.3390/ijms12095461 (2011).

  29. 29.

    et al. When DLB, PD, and PSP masquerade as MSA: an autopsy study of 134 patients. Neurology 85, 404–412, doi: 10.1212/wnl.0000000000001807 (2015).

  30. 30.

    et al. Progressive supranuclear palsy: a systematic review. Neurobiol Dis 20, 179–186, doi: 10.1016/j.nbd.2005.03.013 (2005).

  31. 31.

    et al. RefGenes: identification of reliable and condition specific reference genes for RT-qPCR data normalization. BMC genomics 12, 156, doi: 10.1186/1471-2164-12-156 (2011).

  32. 32.

    et al. Comparison of relative mRNA quantification models and the impact of RNA integrity in quantitative real-time RT-PCR. Biotechnol Lett 28, 1601–1613, doi: 10.1007/s10529-006-9127-2 (2006).

  33. 33.

    & RNA integrity and the effect on the real-time qRT-PCR performance. Mol Aspects Med 27, 126–139, doi: 10.1016/j.mam.2005.12.003 (2006).

  34. 34.

    , , , & RNA integrity in post-mortem samples: influencing parameters and implications on RT-qPCR assays. Int J Legal Med 125, 573–580, doi: 10.1007/s00414-011-0578-1 (2011).

  35. 35.

    et al. Effects of antemortem and postmortem variables on human brain mRNA quality: a BrainNet Europe study. J Neuropathol Exp Neurol 69, 70–81, doi: 10.1097/NEN.0b013e3181c7e32f (2010).

  36. 36.

    et al. The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem 55, 611–622, doi: 10.1373/clinchem.2008.112797 (2009).

  37. 37.

    et al. The RIN: an RNA integrity number for assigning integrity values to RNA measurements. BMC Mol Biol 7, doi: 10.1186/1471-2199-7-3 (2006).

  38. 38.

    et al. Quality control for microarray analysis of human brain samples: The impact of postmortem factors, RNA characteristics, and histopathology. J Neurosci Methods 165, 198–209, doi: 10.1016/j.jneumeth.2007.06.001 (2007).

  39. 39.

    A new mathematical model for relative quantification in real-time RT–PCR. Nucleic Acids Res 29, e45 (2001).

  40. 40.

    et al. Identification and validation of reference genes for gene expression analysis using quantitative PCR in Spodoptera litura (Lepidoptera: Noctuidae). PLoS One 8, e68059, doi: 10.1371/journal.pone.0068059 (2013).

  41. 41.

    et al. Parkinson phenotype in aged PINK1-deficient mice is accompanied by progressive mitochondrial dysfunction in absence of neurodegeneration. PLoS One 4, e5777, doi: 10.1371/journal.pone.0005777 (2009).

  42. 42.

    , , & The ubiquitin-conjugating enzymes UBE2N, UBE2L3 and UBE2D2/3 are essential for Parkin-dependent mitophagy. J Cell Sci 127, 3280–3293, doi: 10.1242/jcs.146035 (2014).

  43. 43.

    , & Variations in the transcriptome of Alzheimer’s disease reveal molecular networks involved in cardiovascular diseases. Genome Biol 9, R148, doi: 10.1186/gb-2008-9-10-r148 (2008).

  44. 44.

    et al. Significance of respirasomes for the assembly/stability of human respiratory chain complex I. J Biol Chem 279, 36349–36353, doi: 10.1074/jbc.m404033200 (2004).

  45. 45.

    et al. A comprehensive functional analysis of tissue specificity of human gene expression. BMC Biology 6, 49, doi: 10.1186/1741-7007-6-49 (2008).

  46. 46.

    Role of the glycolytic protein, glyceraldehyde-3-phosphate dehydrogenase, in normal cell function and in cell pathology. J Cell Biochem 66, 133–140 (1997).

  47. 47.

    , , & GAPDH as a housekeeping gene: analysis of GAPDH mRNA expression in a panel of 72 human tissues. Physiol Genomics 21, 389–395, doi: 10.1152/physiolgenomics.00025.2005 (2005).

  48. 48.

    & Actin out: regulation of the synaptic cytoskeleton. J Biol Chem 290, 28613–28622, doi: 10.1074/jbc.R115.655118 (2015).

  49. 49.

    , , & GSK-3 in Neurodegenerative Diseases. Int J Alzheimers Dis 2011, 189246, doi: 10.4061/2011/189246 (2011).

  50. 50.

    et al. Validation of reference genes in human testis and ejaculate. Andrologia 43, 361–367, doi: 10.1111/j.1439-0272.2010.01076.x (2011).

  51. 51.

    et al. Quantitative PCR pitfalls: the case of the human placenta. Mol Biotechnol 52, 234–243, doi: 10.1007/s12033-012-9539-2 (2012).

  52. 52.

    , , & Nuclear receptors in human immune cells: expression and correlations. Mol Immunol 44, 1436–1445, doi: 10.1016/j.molimm.2006.04.021 (2007).

  53. 53.

    et al. Promoter methylation and expression changes of CDH1 and P16 genes in invasive breast cancer and adjacent normal breast tissue. Neoplasma 57, 465–472, doi: 10.4149/neo_2010_05_465 (2010).

  54. 54.

    et al. Proof of concept study to assess fetal gene expression in amniotic fluid by nanoarray PCR. J Mol Diagn 13, 565–570, doi: 10.1016/j.jmoldx.2011.05.008 (2011).

  55. 55.

    , , , & qBase relative quantification framework and software for management and automated analysis of real-time quantitative PCR data. Genome Biol 8, R19, doi: 10.1186/gb-2007-8-2-r19 (2007).

Download references


The authors are grateful to Hans-Jørgen Jensen for help with the conduction of the experiments. Harvard Brain Bank is supported in part by PHS grant no. R24MH068855. This work has been supported by the Jascha Foundation, the Parkinson Foundation Denmark, the Lundbeck Foundation, the Research Foundation of Bispebjerg-Frederiksberg Hospital, the Danish National Association for Multiple System Atrophy, and Danmodis.

Author information


  1. Research Laboratory for Stereology and Neuroscience, Bispebjerg-Frederiksberg Hospital, University Hospital of Copenhagen, Bispebjerg Bakke 23, DK-2400, Copenhagen, Denmark

    • Rasmus Rydbirk
    • , Jonas Folke
    • , Susana Aznar
    • , Bente Pakkenberg
    •  & Tomasz Brudek
  2. Bispebjerg Movement Disorder Biobank, Bispebjerg-Frederiksberg Hospital, University Hospital of Copenhagen, Bispebjerg Bakke 23, DK-2400, Copenhagen, Denmark

    • Kristian Winge
  3. Department of Neurology, Bispebjerg-Frederiksberg Hospital, University Hospital of Copenhagen, Bispebjerg Bakke 23, DK-2400, Copenhagen, Denmark

    • Kristian Winge
  4. Institute of Clinical Medicine, Faculty of Health, University of Copenhagen, Blegdamsvej 3B, DK-2200, Copenhagen, Denmark

    • Kristian Winge
    •  & Bente Pakkenberg


  1. Search for Rasmus Rydbirk in:

  2. Search for Jonas Folke in:

  3. Search for Kristian Winge in:

  4. Search for Susana Aznar in:

  5. Search for Bente Pakkenberg in:

  6. Search for Tomasz Brudek in:


R.R. and J.F. conceived and designed the research, conducted the experiments, analysed the data, interpreted results, wrote the main manuscript text, and prepared the figures and tables. K.W. recruited donors for the study. S.A., B.P. and T.B. interpreted results and elaborated the manuscript. All authors reviewed the manuscript.

Competing interests

The authors declare no competing financial interests.

Corresponding author

Correspondence to Rasmus Rydbirk.

Supplementary information

About this article

Publication history





Further reading


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.