Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • This Month
  • Published:

Points of significance

Comparing classifier performance with baselines

Nature Methods volume 21, pages 546–548 (2024)Cite this article

All animals are equal, but some animals are more equal than others. —George Orwell

This is a preview of subscription content, access via your institution

Access options

Buy this article

  • Purchase on SpringerLink
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Three baseline classifiers applied to an imbalanced dataset with 10 diseased and 30 normal cells.
Fig. 2: Performance metrics of various baselines.
Fig. 3: Distribution of uniform and proportional baseline performance metrics for an imbalanced dataset.
Fig. 4: Two baselines (uniform and proportional) and LDA sensitivity for each fetal health class.

References

  1. Lever, J., Krzywinski, M. & Altman, N. Nat. Methods 13, 541–542 (2016).

    Article  CAS  Google Scholar 

  2. Krzywinski, M. & Altman, N. Nat. Methods 14, 757–758 (2017).

    Article  CAS  Google Scholar 

  3. Bzdok, D., Krzywinski, M. & Altman, N. Nat. Methods 15, 5–6 (2018).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Lever, J., Krzywinski, M. & Altman, N. Nat. Methods 13, 603–604 (2016).

    Article  CAS  Google Scholar 

  5. Megahed, F. M. et al. Nat. Methods 18, 1270–1272 (2021).

    Article  CAS  PubMed  Google Scholar 

  6. Altman, N. & Krzywinski, M. Nat. Methods 12, 999–1000 (2015).

    Article  CAS  PubMed  Google Scholar 

  7. Ayres-de Campos, D., Bernardes, J., Garrido, A., Marques-de-Sá, J. & Pereira-Leite, L. J. Matern. Fetal Med. 9, 311–318 (2000).

    Article  CAS  PubMed  Google Scholar 

  8. Fricker, R. D. Jr., Rigdon, S. E. & Montgomery, D. C. Introduction to Probability, Statistics, and Data Science with R (Cambridge Univ. Press, 2023).

Download references

Author information

Authors and Affiliations

  1. Farmer School of Business, Miami University, Oxford, OH, USA

    Fadel M. Megahed & L. Allison Jones-Farmer

  2. Department of Mathematics, University of Dayton, Dayton, OH, USA

    Ying-Ju Chen

  3. College of Public Health and Social Justice, Saint Louis University, Saint Louis, MO, USA

    Steven E. Rigdon

  4. Canada’s Michael Smith Genome Sciences Centre, Vancouver, British Columbia, Canada

    Martin Krzywinski

  5. Department of Statistics, The Pennsylvania State University, State College, PA, USA

    Naomi Altman

Authors
  1. Fadel M. Megahed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ying-Ju Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. L. Allison Jones-Farmer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Steven E. Rigdon
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Martin Krzywinski
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Naomi Altman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Martin Krzywinski.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Megahed, F.M., Chen, YJ., Jones-Farmer, L.A. et al. Comparing classifier performance with baselines. Nat Methods 21, 546–548 (2024). https://doi.org/10.1038/s41592-024-02234-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41592-024-02234-5

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing