Abstract
C-reactive protein (CRP) is an acute-phase plasma protein that can be used as a biomarker for activation of the immune system. A spectral analysis of CRP level over time for patients with gynaecological tumours has been reported by Madondo et al., using a periodogram method, suggesting that there is no significant periodicity in the data. In our study, we investigate the impact of low sample number on periodogram analysis, for non-uniform sampling intervals—we conclude that data of Madondo et al. cannot rule out periodic behaviour. The search for patterns (periodic or otherwise) in the CRP time-series is of interest for providing a cue for the optimal times at which cancer therapies are best administered. In this paper we show (i) there is no evidence to rule out periodicity in CRP levels, and (ii) we provide a prescription for the minimum data sample rate required in future experiments for improved testing of a periodic CRP signal hypothesis. The analysis we provide may be used for establishing periodicity in any short time-series signal that is observed without a priori information.
Similar content being viewed by others
Introduction
It has been proposed that the immune system exhibits fluctuation in its activity over time and that this can be characterised by oscillation of bio-markers that can measure inflammation, such as acute-phase serum markers and possibly body temperature1,2.
C-reactive protein (CRP), a widely used acute-phase protein, is a relatively sensitive objective serum bio-marker for systemic inflammation arising from immune system stimulation3. Inflammation can arise from conditions that stimulate the immune system such as infection and tissue damage, and has also been associated with advanced cancer in humans1.
There is a substantial body of literature describing the association between prognosis and C-reactive protein in patients with cancer. Note that CRP is widely reported in oncology as a marker for survival4,5,6,7,8,9,10,11,12,13,14, an indicator of cancer risk15,16,17,18,19,20,21, as a biomarker for tumour recurrence22,23,24,25,26,27,28,29,30,31, and as a reliable tool for making critical decisions in treatment1,32,33.
In a melanoma study, Coventry et al. suggested that CRP levels oscillate about a mean with a periodicity of approximately six-to-seven days1. The authors hypothesised that the CRP oscillations are part of a homeostatic immune response to advanced malignancy from preliminary data linking the timing of therapy to treatment success1.
Complete response (CR), where no cancer is detectable after therapy, is reported to be low after chemotherapy for most cancer types, with CR rates being of the order of 0–10%34. Establishing the character of the fluctuations associated with CRP might reveal a regular periodicity, which could provide an opportunity for exploring the efficacy of cancer-based therapies as a function of their timing relative to the patient’s own immune response oscillatory pattern1.
In another study, chemotherapy was initiated at the estimated peak of a CRP cycle and it was estimated that all patients exhibited oscillating CRP levels with an average periodicity of 7.8 days35. They conducted a pilot clinical study of twelve patients with metastatic melanoma who underwent serial CRP measurements every 2–3 days for two weeks. Both studies1,35 highlighted that the timing of either a vaccine-based therapy or cytotoxic chemotherapy relative to specific phases in the immune response cycle of a patient may possibly exert an impact on clinical outcome.
In order to establish the periodicity of CRP data, Madondo et al.36 employed a frequency domain analysis on a small number of CRP samples obtained at seven time-points over an interval of twelve days from a cohort of patients with gynaecological cancers. From individual patient serum CRP level data, periodograms were calculated and normalized to have the sum of squares equal to one, then averaged pointwise. The study was carried out under the null hypothesis that there was no consistent period to the CRP concentration, which implies no peaks in the mean periodogram beyond noise.
In contrast to the previous studies1,35, Madondo et al.36 concluded that CRP might not be a convenient bio-marker for the timing of cancer therapies, as their CRP data did not appear to oscillate periodically.
As will be shown, we find Madondo’s data does not contain enough number of data points to conclude whether the CRP data is periodic or not particularly for a hypothesised period of 7 days1. In our study, we perform a detailed statistical analysis because data is sampled in non-uniform time intervals in a signal where we have no a priori knowledge of periodicity, rather than utilising a simplistic application of Nyquist’s sampling theorem37 that does not apply to this case.
The rest of paper is organized as follows. In the next section we outline our statistical approach. Next, we study the impact of undersampling of a known sine wave on its corresponding periodogram. Moreover, we demonstrate use of the Scargle’s significance test for examining the significance of the period obtained from the peak of a periodogram.
Periodogram analysis of CRP
There are numerous mathematical methods for extracting the periodicity of a biological signal; however, dealing with an unevenly sampled biological signal that is contaminated with noise is challenging. Moreover, when there is no a priori information on whether the signal is periodic or not, this adds to the difficulty.
The periodogram is a convenient method for estimating spectral density of a signal, and it is widely used for detecting spectral information in signals with noisy conditions. However, studies show that the periodogram has limitations in handling non-sinusoidal waveforms and sparse signals38.
A periodogram analysis on the variation of CRP over time for patients with gynaecological tumours has been reported, suggesting that there is no periodicity in CRP data36. In that study, by Madondo et al., CRP samples were collected from a cohort of nineteen patients, logging only seven CRP data points over an interval of twelve days. We suggest that seven samples is too small a sample quantity to capture the hypothesized periodicity1 over twelve days.
A sinusoid models an ideal periodic signal and this is often seen in the bio-signal processing literature39,40. In order to demonstrate our assertion that the CRP time-series of Madondo et al. is undersampled, we first examine a known ideal sine wave. We randomly sample the sine wave with two randomly placed samples in a period and then estimate the period using a periodgram–we then repeat this using three random samples and so on up to 40 random samples.
Noisy and under-sampled data produce noisy periodograms with spurious peaks. Therefore, the peaks may not be due to the presence of any actual periodic component. Spurious peaks can be surprisingly large, thus it is vital to apply a reliable test in order to detect actual periodicity. Periodogram’s peaks significance assessment methods such as Fisher g-test41,42 and Scargle’s significance40 tests have been used to investigate periodic components in time-series. The general approach of Fisher’s g-test together with multiple testing correction for the detection of periodic time-series is followed in a gene expression study43. Moreover, the combination of a Scargle test statistic and a multiple hypothesis testing procedure is suggested to detect significant periodic gene expression patterns40. The tests determine the significance of the estimated period that allows one to distinguish periodic from purely random processes. In this paper, we use Scargle’s significance test in each case to assess the periodogram peaks.
Periodogram of unevenly sampled sine waves
Different types of periodograms are introduced by previous studies for examining frequency-domain models of time-series. In the paper by Madondo et al.36 the type of periodogram used is unspecified, however, the Lomb-Scargle periodogram44 is applied in our work. One limitation of a basic periodogram is that it requires uniformly sampled data45. The data produced by the patient sampling in Madondo’s study are unevenly spaced in time. This is addressed by use of the Lomb-Scargle periodogram that is a convenient approach for finding periodicity in non-uniformly sampled time-series.
In order to investigate the impact of periodogram undersampling, Fig. 1 shows the periodogram of a sine wave with N = 5, 10 and 40 samples respectively, in a period. For a sample size of N = 5, the peaks in the periodogram are not significant. It may be seen that with larger sample sizes the peaks in the periodogram become more pronounced.
To examine the impact of sampling number, the periodogram method is applied to ideal sine waves with different numbers of samples in a period (two to 40) and period of seven days. The result is shown in Fig. 2. The random sampling procedure is carried out twenty times for each individual number of samples. Considering Fig. 2, an increase in the number of samples in a period results in reduced error of the estimated period. In fact, the figure reveals the periodogram is sensitive to unevenly sampled data with low numbers of samples in a period. This indicates that the CRP data36 suffers from an insufficient sampling rate. In other words, the CRP data in36 does not have enough number of samples to conclude whether the CRP time-series is periodic or not.
Significance test
Spurious peaks arise in periodograms of the data, not because of any periodic component in the data, but because of the noise components. Thus it is essential to apply a reliable test, to determine whether the peaks are significant. In this section, the relevance of periodogram peaks and impact of number of samples on the peaks is assessed, and in particular the Scargle’s significance test is used to test significance.
The null distribution of the Lomb-Scargle periodogram Zj = P(ωj) at a given frequency ωj is exponentially distributed46, i.e. the cumulative distribution function (CDF) of Zj is
for j = 1, 2, 3, …, M (the number of test frequencies). The null hypothesis is that there is no consistent period in the data, versus the alternative that the data is periodic.
In the case, that the peak in the periodogram is attained at frequency ωk among M independent frequencies, we denote such a peak by X = maxjP(ωj) = P(ωk). Then, for independently normally distributed noise, if there were M independent frequencies to test, the probability that the peak periodogram X is smaller than x is obtained by
Therefore, the statistical significance level, the p-value, for testing the null hypothesis that such a peak in periodogram is due to chance is given by
The function is proposed as a false alarm probability function by Scargle46. Therefore, for each individual periodogram, Equation 3 generates a p-value that allows us to test whether it exhibits any periodicity, i.e. whether the maximum peak in the periodogram is significant.
In summary, the time-series methodology proposed here consists of the following steps:
-
Apply the periodogram method to check graphically whether the data are periodic or not.
-
Apply the Scargle’s significance test in each case, and calculate the corresponding p-value for each test.
-
The p-values under 0.05 reject the null hypothesis that the data are random, i.e. the obtained periodicity is significant.
Figure 3 demonstrates corresponding p-values for the periodogram of an ideal sine wave with different numbers of samples in a period (two to 40) that is shown in Fig. 2. In this case the level of significance is set at p = 0.05.
The points under the green dotted line in Fig. 3 reject the null hypothesis. It can be seen that an increase in the numbers of samples in a period results in reduced p-value to zero. In fact, the significance test demonstrates that the periodogram is dramatically sensitive to the unevenly sampled signal with low numbers of samples in a period. This shows that in the periodogram study of Madondo et al.36 using the methodology described, the resulting data suffers from an insufficient sampling rate when attempting to detect periods.
The following question can be posed: Can the sampling pattern in the Madondo et al. study detect hidden periodicity more or less than seven days? To find the answer, we investigate sine waves with varying periods from 2 to 15 days with the sampling pattern used in Madondo’s study, and carry out the periodogram analysis and the Scargle significant test.
The corresponding p-value for the sine waves with different periods from 2 to 15 days is shown in Fig. 4. To simulate Madondo’s data set, the samples are selected on days 1, 3, 5, 6, 8, 10 and 12. From Fig. 4 it is obvious that the p-values for all the periods are not able to reach the significance level (the green dotted line).
Mean periodogram
Before applying a significance test, Madondo et al.36 averaged the periodograms. The mean periodogram is a simple extension of the standard periodogram, and it is widely used in time-series analysis41. However, the mean periodogram is a method for dealing with a large number of signals, yielding accurate results only when a number of the time-series exhibit identical periodic behaviour. Moreover, it has been demonstrated that the mean periodogram is sensitive to sample size, and the tool cannot estimate the dominant periodicity with a low number of samples41.
To examine the impact of variation in periodic behaviour, the mean periodogram is applied to two sets of test data consisting of 19 time-series with (i) random samples and with (ii) purely sinusoidal values. The particular value, of 19 samples, is chosen to simulate Madondo’s data set containing 19 patients. The random series possess a normal distribution, and the sinusoidal series possess varying periods with an average of seven days and standard deviation of three days. In accordance with Madondo’s study, individual periodograms are calculated and standardised to have a sum of squares equal to 1 then averaged pointwise.
The lower one-sided 95% confidence bound for the mean periodogram is calculated. Figure 5 shows that the one sided lower 95% confidence indicated with red line is under the green dotted line for both random series and ideal sine waves. The null hypothesis that there is no periodicity, is not rejected if the red line is below the green dotted line in Fig. 5. Thus, mean periodogram analysis with the sampling pattern used in Madondo’s study may not be able to determine periodicity from 19 pure sine waves with varying periods.
Conclusion
Although CRP has been used as a biomarker of infection, inflammation and tissue damage, multiple sequential measurements of CRP close together in time are essential for the understanding of its behaviour as a function of time. It seems likely that immunotherapy and chemotherapy treatments can be optimized, by correctly estimating the times of the treatments. It will assist optimization of these times if cyclic behavior is correctly and accurately identified, and those cycles cannot be correctly identified without a sufficient number of samples within a defined measurement period.
In our simulation studies we investigate the periodogram-based CRP study of Madondo et al.36, and we show that the periodogram approach of Madondo is sensitive to sparse sampling and that there are an insufficient number of samples for establishing the existence of periods using their methodology as described.
Moreover, the number of samples in Quevedo’s study35 is insufficient to confirm 7-day periodicity. Thus, the 7-day hypothesis has neither been statistically confirmed nor ruled out.
In our study, the Lomb-Scargle periodogram is applied to a non-uniformly sampled ideal sine wave. Application of the Scargle’s significance test and the calculation of p-values clearly shows that the accuracy of the periodogram analysis is dramatically sensitive to low sample size.
The significance of establishing the presence of CRP cycles is that it opens up avenues for exploring the efficacy of cancer-based therapies as a function of their timing relative to the biological fluctuations in the immune response occurring in the individual cancer patient. Furthermore, CRP measurement is a low-cost and rapid approach and can be performed conveniently, potentially leading to significantly improved outcomes related to the timing of cancer therapies.
Finally, our results provide a prescription for future CRP studies showing how many samples are required to establish any hypothesized periodicity. For 95% confidence, as many as 14 samples per period are required. For the case of CRP, such a large number of samples is presently difficult to carry out at the clinical level principally for practical reasons. However, this may become possible in the future when improvements in technology can provide continuous point-of-care CRP measurement, or with alternative means of continuous or near continuous in vivo techniques of measurement of immune system activity in a clinical setting.
References
Coventry, B. J. et al. CRP identifies homeostatic immune oscillations in cancer patients: a potential treatment targeting tool? J Transl Med 7, 102, https://doi.org/10.1186/1479-5876-7-102 (2002).
Rudnicka, A. R., Rumley, A., Lowe, G. D. O. & Strachan, D. P. Diurnal, seasonal, and blood-processing patterns in levels of circulating fibrinogen, fibrin D-dimer, C-reactive protein, tissue plasminogen activator, and von Willebrand factor in a 45-year-old population. Circ. 2007(115), 996–1003 (2002).
Pepys, M. B. The acute phase response and C-reactive protein. Oxf. Univ. Press. second edition, 1527–1533 (1995).
Szkandera, J. R., Stotz, M. & Absenger, G. Validation of C-reactive protein levels as a prognostic indicator for survival in a large cohort of pancreatic cancer patients. Br J Cancer 110(1), 183–188 (2014).
Fang, S., Wang, Y. & Sui, D. C-reactive protein as a marker of melanoma progression. J Clin Oncol. 33(12), 1389–96 (2015).
Janik, S., Bekos, C. & Hacker, P. Elevated CRP levels predict poor outcome and tumor recurrence in patients with thymic epithelial tumors: A pro- and retrospective analysis. Oncotarget 47090–47102 (2017).
He, S., Wang, Y. & Chen, H. C-reactive protein/albumin ratio (CAR) as a prognostic factor in patients with non-metastatic nasopharyngeal carcinoma. J Cancer 7, 2360–6 (2017).
Fang, Y., Xu, C. & Wu, P. Prognostic role of C-reactive protein in patients with nasopharyngeal carcinoma: A meta-analysis and literature review. Medicine (Baltimore) 96(45) (2017).
Ni, X. F., Wu, J. & Ji, M. Prognostic value of C-reactive protein/albumin ratio in patients receiving first-line palliative chemotherapy with unresectable stage IV gastric cancer. Int. J. Clin. Exp. Pathol. 9(12), 12785–12796 (2016).
Li, X. C., Tian, F. & Wang, F. Serum C-reactive protein and overall survival of patients with osteosarcoma. Tumor Biol. 36(7), 5663–5666, https://doi.org/10.1007/s13277-015-3240-6 (2015).
Lindenmann, J., Fink-Neuboeck, N. & Koesslbacher, M. The influence of elevated levels of C-reactive protein and hypoalbuminemia on survival in patients with advanced inoperable esophageal cancer undergoing palliative treatment. J Surg Oncol. 110, 645–50 (2014).
Chiu, H. M., Lin, J. T. & Chen, T. H. Elevation of C-reactive protein level is associated with synchronous and advanced colorectal neoplasms in men. Am J Gastroenterol 103(9), 2317–25 (2008).
Groblewska, M., Mroczko, B. & Wereszczyska-Siemiatkowska, B. Serum interleukin 6 (IL-6) and C-reactive protein (CRP) levels in colorectal adenoma and cancer patients. Clin Chem Lab Med 46(10), 1423–8 (2008).
Saito, K. & Kihara, K. Role of C-reactive protein in urological cancers: a useful biomarker for predicting outcomes. Int J Urol 20(2), 161–71 (2013).
Ridker, P. M., Rifai, N. & Rose, L. Comparison of Creactive protein and low-density lipoprotein cholesterol levels in the prediction of first cardiovascular events. N Engl J Med 347, 1557–65 (2002).
Wilson, A. M., Ryan, M. C. & Boyle, A. J. The novel role of C-reactive protein in cardiovascular disease: risk marker or pathogen. Int J Cardiol 106(3), 291–7 (2006).
Ridker, P. M. Clinical application of C-reactive protein for cardiovascular disease detection and prevention. Circ. 107, 363–9 (2003).
Danesh, J., Collins, R. & Appleby, P. Association of fibrinogen, C-reactive protein, albumin, or leukocyte count with coronary heart disease: meta-analyses of prospective studies. JAMA 279, 1477–82 (1998).
Cao, J. J., Thach, C. & Manolio, T. A. C-reactive protein, carotid intimamedia thickness, and incidence of ischemic stroke in the elderly: the cardiovascular health study. Circ. 108, 166–70 (2003).
Curb, J. D., Abbott, R. D. & Rodriguez, B. L. C-reactive protein and the future risk of thromboembolic stroke in healthy men. Circ. 107, 2016–20 (2003).
Heikkila, K., Harris, R. & Lowe, G. Associations of circulating C-reactive protein and interleukin-6 with cancer risk: findings from two prospective cohorts and a meta-analysis. Cancer Causes Control 20(1), 15–26 (2009).
Wigmore, S. J., McMahon, A. J. & Sturgeon, C. M. Acutephase protein response, survival and tumour recurrence in patients with colorectal cancer. Br J Surg 88, 255–260 (2001).
Falconer, J. S., Fearon, K. C. & Ross, J. A. Acute-phase protein response and survival duration of patients with pancreatic cancer. Cancer 75, 2077–2082 (1995).
Cooper, E. H. & Stone, J. Acute phase reactant proteins in cancer. Adv Cancer Res 30, 1–44 (1979).
McMillan, D. C., Wotherspoon, H. A. & Fearon, K. C. A prospective study of tumor recurrence and the acute-phase response after apparently curative colorectal cancer surgery. Am J Surg 170, 319–322 (1995).
Mahmoud, F. A. & Rivera, N. I. The role of C-reactive protein as a prognostic indicator in advanced cancer. Curr Oncol Rep 4, 250–255 (2002).
Ito, K., Yoshii, H. & Asakuma, J. Clinical impact of the presence of the worst nucleolar grade in renal cell carcinoma specimens. Jpn J Clin Oncol 39(9), 588–94 (2009).
Ito, K., Asano, T. & Yoshii, H. Impact of thrombocytosis and C-reactive protein elevation on the prognosis for patients with renal cell carcinoma. Int J Urol 13(11), 1365–70 (2006).
Hashimoto, K., Ikeda, Y. & Korenaga, D. The impact of preoperative serum C-reactive protein on the prognosis of patients with hepatocellular carcinoma. Cancer 103(9), 1856–64 (2005).
Koike, Y., Miki, C. & Okugawa, Y. Preoperative C-reactive protein as a prognostic and therapeutic marker for colorectal cancer. J Surg Oncol 98(7), 540–4 (2005).
Kim, E. S., Kim, S. Y. & Koh, M. C-reactive protein binds to integrin α2 and Fcγ receptor I, leading to breast cell adhesion and breast cancer progression. Oncogene 37(1), 28–38 (2018).
Brustugun, O. T., Sprauten, M. & Helland, A. C-reactive protein (CRP) as a predictive marker for immunotherapy in lung cancer. J Clin Oncol 38 (2016).
Ramsey, S. The role of the systemic inflammatory response as a biomarker in immunotherapy for renal cell cancer. Mol Diagn Ther 13(5), 277–81 (2009).
Ashdown, M. L. et al. Chemotherapy for late-stage cancer patients: meta-analysis of complete response rates. F1000Res 4, 232, https://doi.org/10.12688/f1000research.6760.1 (2015).
Quevedo, F., Ashdown, M. L, Suman, V. J., Robinson, A. & Kottschade, L. A. Possible therapeutic reversal of immune suppression in patients with metastatic melanoma by timed delivery of temozolomide chemotherapy: a pilot study. J. Clin. Oncol. 27, https://doi.org/10.1200/jco.2009.27.15s.e20013 (2009).
Madondo, M. T., Tuyaerts, S., Turnbull, B. & Vanderstraeten, A. Variability in CRP, regulatory T cells and effector T cells over time in gynaecological cancer patients: a study of potential oscillatory behaviour and correlations. J. Transl. Medicine 12, 179 (2014).
Maciejewski, M. W., Qui, H. Z., Mobli, M. & Hoch, J. C. Nonuniform sampling and spectral aliasing. J. Magn. Reson. 199(1), 88–93, https://doi.org/10.1016/j.jmr.2009.04.006 (2009).
Schimmel, M., Tuyaerts, S., Turnbull, B. & Vanderstraeten, A. Emphasizing difficulties in the detection of rhythms with Lomb-Scargle periodograms. Biol. Rhythm. Res. 32, 341–345 (2001).
Ueda, H. R., Matsumoto, A., Kawamura, M. & Iino, M. Genome-wide transcriptional orchestration of Circadian. J. Biol. Chem. 277, 14048–14052 (2002).
Glynn, E. F., Chen, J. & Mushegian, A. R. Detecting periodic patterns in unevenly spaced gene expression time series using Lomb-Scargle periodograms. Bioinformatics 22(3), 310–316, https://doi.org/10.1093/bioinformatics/bti789 (2006).
Wichert, S., Fokianos, K. & Strimmer, K. Identifying periodically expressed transcripts in microarray time series data. Bioinformatics 20, 5–20 https://doi.org/10.1093/bioinformatics/btg364.
Fisher, R. A. Tests of significance in harmonic analysis. Proc. R. Soc 125, 54–59 (1929).
Ahdesmaki, M., Lahdesmaki, H., Gracey, A. & Shmulevich, L. Robust regression for periodicity detection in nonuniformly sampled time-course gene expression data. BMC Bioinf. 8(1), 54–59, https://doi.org/10.1186/1471-2105-8-233 (2007).
Lomb, N. R. Least-squares frequency analysis of unequally spaced data. Astrophys. Space Sci. 39(2), 447–462, https://doi.org/10.1007/BF00648343 (1976).
Priestley, M. B. Spectral analysis and time series. Acad. Press. 447–462 (1981).
Scargle, J. D. Statistical aspects of spectral analysis of unevenly spaced data. Astrophys. J. 263, 835–853 (1982).
Acknowledgements
We acknowledge helpful discussions with Dr. Mutsa Madondo.
Author information
Authors and Affiliations
Contributions
M.D. performed the analysis; M.D. and A.F. wrote the paper; D.A., A.A., and M.D. conceived the signal analysis approach; B.J.C. conceived the overall study; D.A., A.A., and B.J.C. supervised the study; S.J.S. assisted with the analysis, and all authors proofed the manuscript. All authors contributed to interpretation of results.
Corresponding author
Ethics declarations
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Dorraki, M., Fouladzadeh, A., Salamon, S.J. et al. On detection of periodicity in C-reactive protein (CRP) levels. Sci Rep 8, 11979 (2018). https://doi.org/10.1038/s41598-018-30469-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-018-30469-8
This article is cited by
-
The development of tumour vascular networks
Communications Biology (2021)
-
C-reactive protein in gallbladder diseases: diagnostic and therapeutic insights
Biophysics Reports (2020)
-
Selective single-molecule analytical detection of C-reactive protein in saliva with an organic transistor
Analytical and Bioanalytical Chemistry (2019)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.