Skip to main content

Thank you for visiting You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.


Integrating context for superior cancer prognosis

Weakly supervised deep-learning models for the analysis of whole-slide images from tumour biopsies perform better at prognostic tasks if the models incorporate context from the local microenvironment.

This is a preview of subscription content, access via your institution

Access options

Buy article

Get time limited or full article access on ReadCube.


All prices are NET prices.

Fig. 1: Incorporation of context in weakly supervised computational pathology.


  1. Bera, K. et al. Nat. Rev. Clin. Oncol. 16, 703–715 (2019).

    Article  Google Scholar 

  2. Coudray, N. et al. Nat. Med. 24, 1559–1567 (2018).

    CAS  Article  Google Scholar 

  3. Campanella, G. et al. Nat. Med. 25, 1301–1309 (2019).

    CAS  Article  Google Scholar 

  4. Lu, M. Y. et al. Nat. Biomed. Eng. 5, 555–570 (2021).

    Article  Google Scholar 

  5. Chen, R. J. et al. Whole slide images are 2D point clouds: context-aware survival prediction using patch-based graph convolutional networks. In MICCAI 2021: Medical Image Computing and Computer Assisted Intervention (eds de Bruijne, M. et al.) 339–349 (Springer, 2021).

  6. Lee, Y. et al. Nat. Biomed. Eng. (2022).

    Article  PubMed  Google Scholar 

  7. Jaume, G. et al. Quantifying explainers of graph neural networks in computational pathology. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (eds IEEE staff) 8102–8112 (IEEE, 2021).

  8. Dosovitskiy, A. et al. An image is worth 16x16 words: transformers for image recognition at scale. In International Conference on Learning Representations 2021 Paper 1909 (ICLR, 2021).

  9. Shao, Z. C. et al. TransMIL: transformer based correlated multiple instance learning for whole slide image classification. In Advances in Neural Information Processing Systems 34 (eds Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P. S. & Wortman Vaughan, J.) 2136–2147 (NeurIPS, 2021).

  10. Chen, R. J. et al. Scaling vision transformers to gigapixel images via hierarchical self-supervised learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (eds IEEE staff) 16144–16155 (IEEE, 2022).

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Faisal Mahmood.

Ethics declarations

Competing interests

The authors declare no competing interests.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Jaume, G., Song, A.H. & Mahmood, F. Integrating context for superior cancer prognosis. Nat. Biomed. Eng (2022).

Download citation

  • Published:

  • DOI:


Quick links

Nature Briefing: Cancer

Sign up for the Nature Briefing: Cancer newsletter — what matters in cancer research, free to your inbox weekly.

Get what matters in cancer research, free to your inbox weekly. Sign up for Nature Briefing: Cancer