Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Correspondence
  • Published:

Disentangling high-order mechanisms and high-order behaviours in complex systems

Nature Physics volume 18, pages 476–477 (2022)Cite this article

Subjects

To the Editor — Battiston et al1. provide a comprehensive overview of how investigations of complex systems should take into account interactions between more than two elements, which can be modelled by hypergraphs and studied via topological data analysis. Following a separate line of enquiry, a broad literature has developed information-theoretic tools to characterize high-order interdependencies from observed data. While these could seem to be competing approaches aiming to address the same question, in this correspondence we clarify that this is not the case, and that a complete account of higher-order phenomena needs to embrace both.

The investigation of high-order behaviour in data has a long history, stemming from foundational work in information theory2 and its early applications in biophysics3,4. These early efforts led to the formalization of high-order behaviour into the framework of partial information decomposition and its subsequent developments5,6,7. This literature has established formal bases for the analysis of high-order interdependencies exhibited by groups of three or more variables, and a description of their (synergistic or redundant) nature. While our primary focus here is on information-theoretic techniques, a number of other frameworks exist for probing the dynamics of complex systems beyond pairwise interactions — for a comprehensive review, see ref. 8.

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Buy this article

  • Purchase on Springer Link
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Contrasting high-order mechanisms and behaviours in complex systems.

References

  1. Battiston, F. et al. Nat. Phys. 17, 1093–1098 (2021).

    Article  Google Scholar 

  2. Watanabe, S. IBM J. Res. Dev. 4, 66–82 (1960).

    Article  Google Scholar 

  3. Gat, I. & Tishby, N. in Adv. Neural Inf. Process. Syst (eds Kearns, M. J. et al.) 111–117 (MIT Press, 1999).

  4. Tononi, G., Sporns, O. & Edelman, G. M. Proc. Natl Acad. Sci. USA 91, 5033–5037 (1994).

    Article  ADS  Google Scholar 

  5. Williams, P. L. & Beer, R. D. Preprint at https://arxiv.org/abs/1004.2515 (2010).

  6. Lizier, J. T., Bertschinger, N., Jost, J. & Wibral, M. Entropy 20, 307 (2018).

    Article  ADS  Google Scholar 

  7. Mediano, P. A. et al. Preprint at https://arxiv.org/abs/2109.13186 (2021).

  8. Battiston, F. et al. Phys. Rep. 874, 1–92 (2020).

    Article  ADS  MathSciNet  Google Scholar 

  9. Peixoto, T. P. Phys. Rev. Lett. 123, 128301 (2019).

    Article  ADS  Google Scholar 

  10. Matsuda, H. Phys. Rev. E 62, 3096 (2000).

    Article  ADS  Google Scholar 

Download references

Acknowledgements

F.R. was supported by the Ad Astra Chandaria Foundation. P.M. was funded by the Wellcome Trust (grant no. 210920/Z/18/Z). A.L. was supported by a Gates Cambridge Scholarship (OPP1144). T.V. is supported by the NSF-NRT grant 1735095, Interdisciplinary Training in Complex Networks and Systems at Indiana University Bloomington. S.S. was supported by the Italian MIUR PRIN 2017 (2017WZFTZP). A.L. and T.V. gratefully acknowledge the support of a Young Researchers’ Bridge Grant from the Complex Systems Society.

Author information

Author notes

  1. These authors contributed equally: Fernando E. Rosas, Pedro A. M. Mediano, Andrea I. Luppi.

Authors and Affiliations

  1. Data Science Institute, Imperial College London, London, UK

    Fernando E. Rosas

  2. Centre for Psychedelic Research, Imperial College London, London, UK

    Fernando E. Rosas

  3. Centre for Complexity Science, Imperial College London, London, UK

    Fernando E. Rosas & Henrik J. Jensen

  4. Department of Informatics, University of Sussex, Brighton, UK

    Fernando E. Rosas

  5. Department of Psychology, University of Cambridge, Cambridge, UK

    Pedro A. M. Mediano

  6. Department of Psychology, Queen Mary University of London, London, UK

    Pedro A. M. Mediano

  7. University Division of Anaesthesia, University of Cambridge, Cambridge, UK

    Andrea I. Luppi

  8. Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK

    Andrea I. Luppi

  9. Leverhulme Centre for the Future of Intelligence, University of Cambridge, Cambridge, UK

    Andrea I. Luppi

  10. The Alan Turing Institute, London, UK

    Andrea I. Luppi

  11. Department of Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA

    Thomas F. Varley

  12. School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, USA

    Thomas F. Varley

  13. Centre for Complex Systems and Faculty of Engineering, The University of Sydney, Sydney, New South Wales, Australia

    Joseph T. Lizier

  14. Dipartimento Interateneo di Fisica, Università degli Studi di Bari Aldo Moro, Bari, Italy

    Sebastiano Stramaglia

  15. INFN, Sezione di Bari, Bari, Italy

    Sebastiano Stramaglia

  16. Department of Mathematics, Imperial College London, London, UK

    Henrik J. Jensen

  17. Institute of Innovative Research, Tokyo Institute of Technology, Tokyo, Japan

    Henrik J. Jensen

  18. Department of Data Analysis, Ghent University, Ghent, Belgium

    Daniele Marinazzo

Authors
  1. Fernando E. Rosas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pedro A. M. Mediano
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andrea I. Luppi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Thomas F. Varley
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Joseph T. Lizier
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sebastiano Stramaglia
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Henrik J. Jensen
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Daniele Marinazzo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Fernando E. Rosas, Pedro A. M. Mediano or Andrea I. Luppi.

Ethics declarations

Competing interests

The authors declare no competing interests.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rosas, F.E., Mediano, P.A.M., Luppi, A.I. et al. Disentangling high-order mechanisms and high-order behaviours in complex systems. Nat. Phys. 18, 476–477 (2022). https://doi.org/10.1038/s41567-022-01548-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41567-022-01548-5

This article is cited by

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing