Neuroimaging is a fast-developing research area in which anatomical and functional images of human brains are collected using techniques such as functional magnetic resonance imaging (fMRI), diffusion tensor imaging (DTI), and electroencephalography (EEG). Technical advances and large-scale data sets have allowed for the development of models capable of predicting individual differences in traits and behavior using brain connectivity measures derived from neuroimaging data. Here, we present connectome-based predictive modeling (CPM), a data-driven protocol for developing predictive models of brain–behavior relationships from connectivity data using cross-validation. This protocol includes the following steps: (i) feature selection, (ii) feature summarization, (iii) model building, and (iv) assessment of prediction significance. We also include suggestions for visualizing the most predictive features (i.e., brain connections). The final result should be a generalizable model that takes brain connectivity data as input and generates predictions of behavioral measures in novel subjects, accounting for a considerable amount of the variance in these measures. It has been demonstrated that the CPM protocol performs as well as or better than many of the existing approaches in brain–behavior prediction. As CPM focuses on linear modeling and a purely data-driven approach, neuroscientists with limited or no experience in machine learning or optimization will find it easy to implement these protocols. Depending on the volume of data to be processed, the protocol can take 10–100 min for model building, 1–48 h for permutation testing, and 10–20 min for visualization of results.
Subscribe to Journal
Get full journal access for 1 year
only $21.58 per issue
All prices are NET prices.
VAT will be added later in the checkout.
Rent or Buy article
Get time limited or full article access on ReadCube.
All prices are NET prices.
Kriegeskorte, N., Simmons, W.K., Bellgowan, P.S. & Baker, C.I. Circular analysis in systems neuroscience: the dangers of double dipping. Nat. Neurosci. 12, 535–540 (2009).
Vul, E., Harris, C., Winkielman, P. & Pashler, H. Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspect. Psychol. Sci. 4, 274–290 (2009).
Gabrieli, J.D., Ghosh, S.S. & Whitfield-Gabrieli, S. Prediction as a humanitarian and pragmatic contribution from human cognitive neuroscience. Neuron 85, 11–26 (2015).
Finn, E.S. et al. Functional connectome fingerprinting: identifying individuals using patterns of brain connectivity. Nat. Neurosci. 18, 1664–1671 (2015).
Rosenberg, M.D. et al. A neuromarker of sustained attention from whole-brain functional connectivity. Nat. Neurosci. 19, 165–171 (2016).
Van Essen, D.C. et al. The WU-Minn human connectome project: an overview. Neuroimage 80, 62–79 (2013).
Nooner, K.B. et al. The NKI-Rockland Sample: a model for accelerating the pace of discovery science in psychiatry. Front. Neurosci. 6, 152 (2012).
Milham, M.P., Fair, D., Mennes, M. & Mostofsky, S.H. The ADHD-200 consortium: a model to advance the translational potential of neuroimaging in clinical neuroscience. Front. Syst. Neurosci. 6, 62 (2012).
Satterthwaite, T.D. et al. The Philadelphia Neurodevelopmental Cohort: a publicly available resource for the study of normal and abnormal brain development in youth. Neuroimage 124, 1115–1119 (2016).
Van Essen, D.C., Glasser, M.F., Dierker, D.L., Harwell, J. & Coalson, T. Parcellations and hemispheric asymmetries of human cerebral cortex analyzed on surface-based atlases. Cereb. Cortex 22, 2241–2262 (2012).
Shen, X., Tokoglu, F., Papademetris, X. & Constable, R.T. Groupwise whole-brain parcellation from resting-state fMRI data for network node identification. Neuroimage 82, 403–415 (2013).
Power, J.D. et al. Functional network organization of the human brain. Neuron 72, 665–678 (2011).
Craddock, R.C., James, G.A., Holtzheimer, P.E., Hu, X.P. & Mayberg, H.S. A whole brain fMRI atlas generated via spatially constrained spectral clustering. Hum. Brain Mapp. 33, 1914–1928 (2012).
Whelan, R. & Garavan, H. When optimism hurts: inflated predictions in psychiatric neuroimaging. Biol. Psychiatry 75, 746–748 (2014).
Smith, S. et al. HCP beta-release of the Functional Connectivity MegaTrawl. https://www.humanconnectome.org/documentation/S500/HCP500_MegaTrawl_April2015.pdf (2015).
Smith, S.M. et al. Functional connectomics from resting-state fMRI. Trends Cogn. Sci. 17, 666–682 (2013).
Smola, A. & Vapnik, V. Support vector regression machines. Adv. Neural Inf. Process. Syst. 9, 155–161 (1997).
Dosenbach, N.U. et al. Prediction of individual brain maturity using fMRI. Science 329, 1358–1361 (2010).
Brown, M.R. et al. ADHD-200 global competition: diagnosing ADHD using personal characteristic data can outperform resting state fMRI measurements. Front. Syst. Neurosci. 6, 69 (2012).
Plitt, M., Barnes, K.A. & Martin, A. Functional connectivity classification of autism identifies highly predictive brain features but falls short of biomarker standards. NeuroImage Clin. 7, 359–366 (2015).
Anderson, J.S. et al. Functional connectivity magnetic resonance imaging classification of autism. Brain 134, 3742–3754 (2011).
Arbabshirani, M.R., Kiehl, K.A., Pearlson, G.D. & Calhoun, V.D. Classification of schizophrenia patients based on resting-state functional network connectivity. Front. Neurosci. 7, 133 (2013).
Khazaee, A., Ebrahimzadeh, A. & Babajani-Feremi, A. Identifying patients with Alzheimer's disease using resting-state fMRI and graph theory. Clin. Neurophysiol. 126, 2132–2141 (2015).
Zeng, L.L. et al. Identifying major depression using whole-brain functional connectivity: a multivariate pattern analysis. Brain 135, 1498–1507 (2012).
Haufe, S. et al. On the interpretation of weight vectors of linear models in multivariate neuroimaging. Neuroimage 87, 96–110 (2014).
Van Dijk, K.R., Sabuncu, M.R. & Buckner, R.L. The influence of head motion on intrinsic functional connectivity MRI. Neuroimage 59, 431–438 (2012).
Yendiki, A., Koldewyn, K., Kakunoori, S., Kanwisher, N. & Fischl, B. Spurious group differences due to head motion in a diffusion MRI study. Neuroimage 88C, 79–90 (2013).
Power, J.D., Schlaggar, B.L. & Petersen, S.E. Recent progress and outstanding issues in motion correction in resting state fMRI. Neuroimage 105, 536–551 (2015).
Yan, C.-G. et al. A comprehensive assessment of regional variation in the impact of head micromovements on functional connectomics. Neuroimage 76, 183–201 (2013).
Kohavi, R . A study of cross-validation and bootstrap for accuracy estimation and model selection. in Proceedings of the 14th International Joint Conference on Artificial Intelligence 2, 1137–1143 (1995).
Justice, A.C., Covinsky, K.E. & Berlin, J.A. Assessing the generalizability of prognostic information. Ann. Intern. Med. 130, 515–524 (1999).
Steyerberg, E.W. et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 21, 128–138 (2010).
Gibbons, J.D. & Chakraborti, S. Nonparametric Statistical Inference (Springer, 2011).
Holland, P.W. & Welsch, R.E. Robust regression using iteratively reweighted least-squares. Commun. Stat.-Theory Methods 6, 813–827 (1977).
Street, J.O., Carroll, R.J. & Ruppert, D. A note on computing robust regression estimates via iteratively reweighted least squares. Am. Stat. 42, 152–154 (1988).
Yeo, B.T. et al. The organization of the human cerebral cortex estimated by intrinsic functional connectivity. J. Neurophysiol. 106, 1125–1165 (2011).
Li, N. et al. Resting-state functional connectivity predicts impulsivity in economic decision-making. J. Neurosci. 33, 4886–4895 (2013).
Supekar, K. et al. Neural predictors of individual differences in response to math tutoring in primary-grade school children. Proc. Natl. Acad. Sci. USA 110, 8230–8235 (2013).
Doehrmann, O. et al. Predicting treatment response in social anxiety disorder from functional magnetic resonance imaging. JAMA Psychiatry 70, 87–97 (2013).
Ullman, H., Almeida, R. & Klingberg, T. Structural maturation and brain activity predict future working memory capacity during childhood development. J. Neurosci. 34, 1592–1598 (2014).
M.D.R. and E.S.F. are supported by US National Science Foundation Graduate Research Fellowships. This work was also supported by US National Institutes of Health grant EB009666 to R.T.C.
X.P. is a consultant for Electrical Geodesics Inc.
About this article
Cite this article
Shen, X., Finn, E., Scheinost, D. et al. Using connectome-based predictive modeling to predict individual behavior from brain connectivity. Nat Protoc 12, 506–518 (2017). https://doi.org/10.1038/nprot.2016.178
Functional connectivity during frustration: a preliminary study of predictive modeling of irritability in youth
Cerebral Cortex (2021)
A whole‐brain modeling approach to identify individual and group variations in functional connectivity
Brain and Behavior (2021)
Characterizing Static and Dynamic Fractional Amplitude of Low-Frequency Fluctuation and its Prediction of Clinical Dysfunction in Patients with Diffuse Axonal Injury
Academic Radiology (2021)
Biological Psychiatry: Cognitive Neuroscience and Neuroimaging (2021)