How does the brain represent the numerous types of actions and objects that we can recognize? In this functional MRI study, subjects watched natural movies and linear regression models were applied to each voxel's response to 1,705 categories of actions and objects that appeared in the movies. The analysis revealed a continuous representation of categories that reflects the semantic similarity between categories rather than distinct areas representing specific categories.