## Abstract

We have performed an empirical comparison of two distinct notions of discrete Ricci curvature for graphs or networks, namely, the Forman-Ricci curvature and Ollivier-Ricci curvature. Importantly, these two discretizations of the Ricci curvature were developed based on different properties of the classical smooth notion, and thus, the two notions shed light on different aspects of network structure and behavior. Nevertheless, our extensive computational analysis in a wide range of both model and real-world networks shows that the two discretizations of Ricci curvature are highly correlated in many networks. Moreover, we show that if one considers the augmented Forman-Ricci curvature which also accounts for the two-dimensional simplicial complexes arising in graphs, the observed correlation between the two discretizations is even higher, especially, in real networks. Besides the potential theoretical implications of these observations, the close relationship between the two discretizations has practical implications whereby Forman-Ricci curvature can be employed in place of Ollivier-Ricci curvature for faster computation in larger real-world networks whenever coarse analysis suffices.

## Introduction

One of the central quantities associated to a Riemannian metric is the Ricci tensor. In Einstein’s field equations, the energy-momentum tensor yields the Ricci tensor, and this determines the metric of space-time. In Riemannian geometry, the importance of the Ricci tensor came to the fore in particular through the work of Gromov^{1}. The Ricci flow, introduced by Hamilton^{2}, culminated in the work of Perelman^{3,4} which solved the Poincarè and the more general Geometrization Conjecture for three-dimensional manifolds. On the other hand, there have been important developments extending the notion of Ricci curvature axiomatically to metric spaces more general than Riemannian manifolds^{5,6,7}. More precisely, one identifies metric properties on a Riemannian manifold that can be formulated in terms of local quantities such as growth of volumes of distance balls, transportation distances between balls, divergence of geodesics, and meeting probabilities of coupled random walks. On Riemannian manifolds such local quantities are implied by, or even equivalent to, Ricci curvature inequalities. Moreover when such metric properties are satisfied on some metric space, one says that the space satisfies the corresponding generalized Ricci curvature inequality. This research paradigm has been remarkably successful, and the geometry of metric spaces with such inequalities is currently a very active and fertile field of mathematical research (see for instance^{8}). Of course, on Riemannian manifolds various such properties are equivalent to Ricci curvature inequalities and therefore also to each other. However, when passing to a discrete, metric setting, each approach captures different aspects of the classical Ricci curvature and thus, the various discretizations need no longer be equivalent. One such approach to Ricci curvature inequalities is Ollivier’s^{9,10,11,12} construction on metric spaces.

There is also an older line of research^{13} that searches for the discretization of Ricci curvature on graphs and more general objects with a combinatorial structure. Here, one has exact quantities rather than only inequalities as in the aforementioned research. One elegant approach is by Chow and Luo^{14} based on circle packings which lent itself to many practical applications in graphics, medical imaging and communication networks^{15,16,17}. On the other hand, Ollivier’s^{9,10,11,12} discretization has proven to be suitable for modelling complex networks as well as rendering interesting theoretic results with potential of future applications^{18,19,20,21,22,23,24}. Yet another approach to discretization of Ricci curvature on polyhedral complexes, and more generally, *CW* complexes is due to Forman^{25}. In recent work^{26,27,28,29,30}, we have introduced the Forman’s^{25} discretization to the realm of graphs and have systematically explored the Forman-Ricci curvature in complex networks. A crucial advantage of Forman-Ricci curvature is that, while it also captures important geometric properties of networks, it is far simpler to evaluate on large networks than Ollivier-Ricci curvature^{26,30}. In this contribution, we have performed an extensive empirical comparison of the Forman-Ricci curvature and Ollivier-Ricci curvature in complex networks. In addition, we have also performed an empirical analysis in complex networks of the augmented Forman-Ricci curvature which accounts for two-dimensional simplicial complexes arising in graphs. We find that the Forman-Ricci curvature, especially the augmented version, is highly correlated to Ollivier-Ricci curvature in many model and real networks. This renders Forman-Ricci curvature a preferential tool for the analysis of very large networks with various practical applications.

Although, in this contribution, we show that Forman-Ricci curvature is highly correlated to Ollivier-Ricci curvature in many networks, one should not construe from this observation that we introduce Forman-Ricci curvature as a substitute (and certainly not as a “proxy”^{31}) for Ollivier-Ricci curvature. As mentioned above, and as we shall further explain in the following section, the two discretizations of Ricci curvature capture quite different aspects of network behavior. Indeed the specific definitions of both Ollivier’s and Forman’s discretizations of Ricci curvature prescribe some of their respective essential properties that have important consequences in certain significant applications. Therefore, we shall detail these definitions and not restrict ourselves to the mere technical defining formulas.

Given that networks permeate almost every field of research^{32,33,34,35,36,37,38}, an important challenge has been to unravel the architecture of complex networks. In particular, the development of geometric tools^{10,18,19,20,21,23,24,26,39,40,41}, and mainly curvature, allow us to gain deep insights into the structure, dynamics and evolution of networks. It is in the very nature of discretization of differential geometric properties that each such discrete notion sheds a different light and understanding upon the studied object, for example, a network. In particular, Ollivier’s curvature is related to clustering and network coherence via the distribution of the eigenvalues of the graph Laplacian, giving insights into the global and local structure of networks. In contrast, Forman’s curvature captures the geodesics dispersal property and also gives information on the algebraic topological structure of the network. Furthermore, Forman’s curvature is simple to compute and can easily be extended to analyze both directed networks and hyper-networks^{26,27,28,29}. Given the contrast between the two discretizations of Ricci curvature at hand, the empirically observed correlation in many networks is quite surprising and encouraging. Moreover, both types of curvature admit natural Ricci curvature flows^{16,29} that enable the study of long time evolution and prediction of networks. Moreover, the observed correlation further increases the relevance and importance of future investigation of discrete Ricci flows for the better understanding of the structure and evolution of complex networks.

Note that in Riemannian geometry, the Ricci tensor encodes all the essential properties of a Riemannian metric. Similarly, it is an emerging principle that Ricci curvature, because it evaluates edges instead of vertices, also captures the basic structural aspects of a network. Both Ollivier-Ricci curvature and Forman-Ricci curvature are *edge-based* measures which assign a number to each edge of a (possibly weighted and directed) network that encodes local geometric properties in the vicinity of that edge. We highlight that *edges* are what networks are made of as the *vertices* alone do not yet constitute a network.

## Theory

We briefly present here the geometric meaning of the notion of Ricci curvature, as well as the two discretizations considered herein. For other discretizations of this type of curvature and their applications, see for instance^{16}.

### Ricci curvature

In Riemannian geometry curvature measures the deviation of the manifold from being locally Euclidean. Ricci curvature quantifies that deviation for tangent directions. It controls the average dispersion of geodesics around that direction. It also controls the growth of the volume of distance balls and spheres. In fact, these two properties are related, as can be seen from the following formula^{42}:

Here, *n* is the dimension of the Riemannian manifold in question, and Vol_{
α
}(*ε*) is the (*n* − 1)-volume generated within an *n*-solid angle *dα* by geodesics of length *ε* in the direction of the vector v (i.e., it controls the growth of measured angles). Thus, Ricci curvature controls both divergence of geodesics and volume growth (Fig. 1(a)). In dimension *n* = 2, Ricci curvature reduces to the classical *Gauss curvature*, and can therefore be easily visualized.

As we shall see, the two discretizations of Ricci curvature by Ollivier and Forman considered here for networks capture different properties of the classical (smooth) notion. Forman’s definition expresses dispersal (diffusion), while Ollivier’s definition compares the averaged distance between balls to the distance between their centers. Thus, the two definitions lead to different generalization of classical results regarding Ricci curvature. In this respect, Ollivier’s version seems to be advantageous, since, in addition to certain geometric properties, analytic inequalities also hold, whereas Forman’s version encapsulates mainly the topology of the underlying space.

Nevertheless, in our specific context of complex networks, as we shall show in the sequel, the definitions by Ollivier and Forman are highly correlated in many networks. Therefore, for the empirical analysis of large networks, at least in a first approximation, from the analysis of Forman’s definition, one can also make inferences about the properties encoded by the Ollivier’s definition. For instance, Ollivier’s curvature is, by its very definition, excellently suited to capture diffusion and stochastic properties of a given network. Unfortunately, the computation of Ollivier-Ricci curvature might be prohibitive for many large complex networks. In contrast, due to its simple, combinatorial formula, Forman-Ricci curvature is easy and fast to compute^{26}. Given the basic equivalence, at least on a statistical level, between these two discretizations, one can therefore determine, at least in first approximation, many properties encapsulated by Ollivier’s curvature via simple computations with Forman’s curvature. However, for a finer analysis, each of the two discrete Ricci curvatures should be employed in the context that best befits the geometrical phenomenology it encapsulates.

### Ollivier-Ricci curvature

Ollivier’s approach^{9,10,11,12} interprets eq. 1 as follows: If a small ball *B*_{
x
} of radius *ε* and centered at *x* is mapped, via parallel transport^{43} to a corresponding ball *B*_{
y
} centered at *y*, then the average distance between points on *B*_{
x
} and their corresponding points on *B*_{
y
} is:

where *d*(*x*, *y*) = *δ*, and where *ε*, *δ* → 0. Thus, we can *synthetically* characterize Ollivier-Ricci curvature^{12} by the following phrase: “In positive (negative) curvature, balls are closer (farther) than their centers are”. Balls are given by their volume measures, and in fact, one may define a transportation distance for any two (normalized) measures. In this sense, Ollivier’s notion compares the distance between the centers of their balls with that between their measures (Fig. 1(b–d)). For the distance between the centers one takes (of course) the given metric of the underlying space, i.e., manifold, mesh, network, etc. As for the distance between measures, there is a natural choice, the Wasserstein transportation metric *W*_{1}^{44}. More formally, Ollivier’s curvature is defined as:

where *m*_{
x
}, *m*_{
y
} represent the measures of the balls around *x* and *y*, respectively. Here, given that the measure *m*, associated to the discrete set of vertices of a graph (network) is obviously a discrete measure, the Wasserstein distance *W*_{1}(*m*_{
x
}, *m*_{
y
}), i.e. the transportation distance between the two probability measures *m*_{
x
} and *m*_{
y
}, is given by

with \({\rm{\Pi }}({m}_{x},{m}_{y})\) being the set of probability measures *μ*_{x,y} that satisfy:

Measures satisfying eq. 5 start with the measure *m*_{
x
} and end up with *m*_{
y
}, and represent all the transportation possibilities of the mass (measure) *m*_{
x
} to the measure *m*_{
y
}, by *disassembling* it, transporting it, along all possible paths, and *reassembling* it as *m*_{
y
}. *W*_{1}(*m*_{
x
}, *m*_{
y
}) is the minimal cost (measured in terms of distances) to transport the mass of *m*_{
x
} to that of *m*_{
y
}. Note that the distance *d* in eq. 4 above can be any useful or expressive graph metric. However, in practice, when considering the Wasserstein metric and Ollivier-Ricci curvature for unweighted networks, the *combinatorial* metric is naturally considered.

In the Riemannian setting, Ollivier’s definition reduces to the classical one. More precisely, if *M*^{n} is a Riemannian manifold, with its natural measure *d*Vol, then for *d*(*x*, *y*) small enough and *v* the unit tangent vector at *x* on the geodesic \(\overline{xy}\)

The Wasserstein distance^{44} between two vertices in a network depends on the triangles, quadrangles and pentagons that they are contained in (see for instance^{21,45}). It can also be computed in terms of random walks on a graph, where one has the choice between the *lazy*^{23} and the *non-lazy*^{21} random walk. While the two variants are clearly equivalent from a theoretical viewpoint, the choices may render differences in the implementation. In this work, we have used the lazy random walk option within the open-source implementation of Ollivier-Ricci curvature, originally developed by P. Romon and improved by E. Madsen, within SageMath software (http://www.sagemath.org/) for our computations.

While Ollivier-Ricci curvature is essentially defined on edges, one can define Ollivier-Ricci curvature of a vertex^{24} as the sum of the Ollivier-Ricci curvatures of edges incident on that vertex in the network, and this is analogous to scalar curvature in Riemannian geometry^{43}.

### Forman-Ricci curvature

Forman’s definition is conceptually quite different from Ollivier’s definition. To begin with, Forman’s definition works in the framework of *weighted CW cell complexes*, rather than that of Markov chains and metric measure spaces, as Ollivier’s definition does. The weighted *CW* cell complexes are of fundamental importance in topology and include both polygonal meshes and weighted graphs. In the setting of weighted *CW* cell complexes, Forman’s definition develops an abstract version of a classical formula in differential geometry or geometric analysis, the so called *Bochner-Weitzenböck formula* (see for instance^{43}), that relates curvature to the classical (Riemannian) Laplace operator.

Forman^{25} derived an analogue of the Bochner-Weitzenböck formula that holds in the setting of *CW* complexes. In the 1-dimensional case, i.e. of graphs or networks, it takes the following form^{26}:

where *e* denotes the edge under consideration between two nodes *v*_{1} and *v*_{2}, *w*_{
e
} denotes the weight of the edge *e* under consideration, \({w}_{{v}_{1}}\) and \({w}_{{v}_{2}}\) denote the weights associated with the vertices *v*_{1} and *v*_{2}, respectively, \({e}_{{v}_{1}}\sim e\) and \({e}_{{v}_{2}}\sim e\) denote the set of edges incident on vertices *v*_{1} and *v*_{2}, respectively, after excluding the edge *e* under consideration which connects the two vertices *v*_{1} and *v*_{2} (Fig. 1(e)). Since edges in the discrete setting of networks naturally correspond to vectors or directions in the smooth context, the above formula represents, in view of the classical Bochner-Weitzenböck formula, a discretization of Ricci curvature. For gaining further intuition regarding this discretization of Ricci curvature in its generality, the reader is referred to Forman’s original work^{25}, and to our previous papers^{26,30} for more insight on its adaptation to networks.

In the combinatorial case, i.e. for *w*_{
e
} = *w*_{
v
} = 1, *e* ∈ *E*(*G*), *v* ∈ *V*(*G*), where *E*(*G*) and *V*(*G*) represent the set of edges and vertices, respectively, in graph *G*, the above formula (eq. 7) reduces to the quite simple and intuitive expression:

where *v* ~ *e* denote the vertices anchoring the edge *e*. This simple case captures the role of Ricci curvature as a measure of the flow through an edge and illustrates how Ricci curvature captures the *social behavior* of geodesics dispersal depicted in Fig. 1. While Forman-Ricci curvature is essentially defined on edges, one can easily define Forman-Ricci curvature of a vertex^{28} as the sum of the Forman-Ricci curvatures of edges incident on that vertex in the network.

#### Augmented Forman-Ricci curvature

From a graph, one may construct two-dimensional polyhedral complexes by inserting a two-dimensional simplex into any connected triple of vertices (or cycle of length 3), a tetragon into any cycle of length 4, a pentagon into a cycle of length 5, and so on. This is natural, if, for instance, one wants to represent higher order correlations between vertices in the network. Again, Forman’s scheme assigns a Ricci curvature to such a complex, via the following formula, which also includes possible weights *w* of simplices, edges, and vertices:

where *w*_{
e
} denotes weight of edge *e*, *w*_{
v
} denotes weight of vertex *v*, *w*_{
f
} denotes weight of face *f*, *σ* < *τ* means that *σ* is a face of *τ*, and where || signifies *parallelism*, i.e. the two cells have a common *parent* (higher dimensional face) or a common *child* (lower dimensional face), but not both a common parent and common child. In particular, we have employed eq. 9 to define an *Augmented Forman-Ricci curvature* of an edge which also accounts for two-dimensional simplicial complexes or cycles of length 3 arising in graphs while neglecting cycles of length 4 and greater (Fig. 1(f)).

In unweighted networks, *w*_{
f
} = *w*_{
e
} = *w*_{
v
} = 1, ∀*f* ∈ *F*(*G*), *e* ∈ *E*(*G*), *v* ∈ *V*(*G*), where *F*(*G*), *E*(*G*) and *V*(*G*) represent the set of faces, edges and vertices, respectively, in graph *G*. In such unweighted networks, we remark that there is a simple relationship^{46} between Forman-Ricci curvature F(*e*) of an edge *e* and Augmented Forman-Ricci curvature F^{#}(*e*) of an edge *e*, namely,

where *m* is the number of triangles containing edge *e* under consideration in the network. In this work, we have explored both Forman-Ricci curvature and its augmented version in model and real-world networks.

### Ollivier’s vs. Forman’s Ricci curvature: A first comparison

As we have seen in detail in the previous section, and already explained in the Introduction, the two types of discrete Ricci curvature, Ollivier’s and Forman’s, express different geometric properties of a network, and they can therefore be quite different from each other for specific networks. In this section, let us consider some simple examples.

As the first example, consider a complete graph on *n* vertices. Then any two vertices share *n* − 2 neighbors in the complete graph, and therefore, the corresponding balls largely overlap. The transportation distance between the balls is thus very small in a complete graph, and thus, the Ollivier-Ricci curvature (eq. 3) is almost 1 for large *n*, the largest possible value. On the other hand, the degree of any vertex is *n* − 1 in a complete graph, and therefore, the Forman-Ricci curvature (eq. 8) takes the most negative possible value. Thus, for such complete graphs, the two types of Ricci curvature behave in opposite fashion. The reason is that Ollivier-Ricci curvature is positively affected by triangles whereas Forman-Ricci curvature is not at all. Thus, it is not surprising that locally they can numerically diverge from each other. As the second example, consider a star graph, that is, a graph consisting of a central vertex *v*_{0} that is connected to all other vertices *v*_{1}, …, *v*_{
m
}, while these vertices have no further connections. Consider an edge, for example, *e* = (*v*_{0}, *v*_{1}) in the star graph. The neighborhood of *v*_{1} consists of *v*_{0} only, while that of *v*_{0} contains all the vertices *v*_{1}, …, *v*_{
m
} in the star graph. Since each of these vertices *v*_{1}, …, *v*_{
m
} have distance 1 from *v*_{0} in the star graph, the transportation cost is 1, and hence the Ollivier-Ricci curvature is 0. In this example of a star graph, there are no triangles. In contrast, the Forman-Ricci curvature of the edge in the star graph is 3 − *m*. As the third example, consider a double star graph, that is, take two stars with vertices \({v}_{0},\,{v}_{1},\,...,\,{v}_{m}\) and \({v{\rm{^{\prime} }}}_{0},\,{v{\rm{^{\prime} }}}_{1},\,...,\,{v}_{m{\rm{^{\prime} }}}^{{\rm{^{\prime} }}}\), where the two central vertices \({v}_{0}\) and \({v^{\prime} }_{0}\) of the stars are connected by an edge. In this case of double star graph, almost all vertices in their respective neighborhoods are a distance 3 apart, and so, the Ollivier-Ricci curvature of the edge (\({v}_{0},\,{v{\rm{^{\prime} }}}_{0}\)) is quite negative, and so is the Forman-Ricci curvature, which equals 2 − *m* − *m*′. Thus, the second example of a star graph is an intermediate between the first example of a complete graph and the third example of a double star graph.

While these examples suggest an equivocal picture wherein sometimes the two discretizations of Ricci curvatures are aligned, but in other cases, they may show an opposite behavior, our numerical results in complex networks which are reported in the following sections show that, Ollivier-Ricci and Forman-Ricci curvature in many networks are highly correlated to each other. Thus, in several model and real networks that we have investigated, large degrees of the vertices bounding an edge do not correlate highly with large fractions of triangles or other short loops containing these vertices. Furthermore, if we augment the definition of the Forman-Ricci curvature to account for two-dimensional simplicial complexes (i.e., triads or cycles of length 3) arising in graphs (eqs. 9 and 10), then such an Augmented Forman-Ricci curvature is even better correlated at *small scale* to Ollivier-Ricci curvature, as in the augmented definition the triangles of vertices no longer contribute negatively to Forman-Ricci curvature. In the sequel, we shall also show that the Augmented Forman-Ricci curvature is better correlated to Ollivier-Ricci curvature in both model and real-world networks.

## Benchmark Dataset of Complex Networks

We have considered four models of undirected networks, namely, Erdös-Rényi (ER)^{47}, Watts-Strogatz (WS)^{33}, Barabási-Albert (BA)^{34} and Hyperbolic Graph Generator (HGG)^{48}. The ER model^{47} produces an ensemble of random graphs *G*(*n*, *p*) where *n* is the number of vertices and *p* is the probability that each possible edge exists between any pair of vertices in the network. The WS model^{33} generates small-world networks which exhibit both a high clustering coefficient and a small average path length. In the WS model, an initial regular graph is generated with *n* vertices on a ring lattice with each vertex connected to its *k* nearest neighbours. Subsequently an endpoint of each edge in the regular ring graph is rewired with probability *β* to a new vertex selected from all the vertices in the network with a uniform probability. The BA model^{34} generates scale-free networks which exhibit a power-law degree distribution. In the BA model, an initial graph is generated with *m*_{0} vertices. Thereafter, a new vertex is added to the initial graph at each step of this evolving network model such that the new vertex is connected to *m* ≤ *m*_{0} existing vertices, selected with a probability proportional to their degree. Thus, the BA model implements a preferential attachment scheme whereby high-degree vertices have a higher chance of acquiring new edges than low-degree vertices. The HGG model^{48,49} can produce random hyperbolic graphs with power-law degree distribution and non-vanishing clustering. In the HGG model, the *n* vertices of the network are placed randomly on a hyperbolic disk, and thereafter, pairs of vertices are connected based on some probability which depends on the hyperbolic distance between vertices. In the HGG model, the input parameters^{48,49} are the number of vertices *n*, the target average degree *k*, the target exponent *γ* of the power-law degree distribution and temperature *T*. In this work, we have used HGG model with default input parameters of *γ* = 2 and *T* = 0 to generate hyperbolic random geometric graphs. Note that the input parameters, *γ* and *T*, of the HGG model^{48,49} can be varied to produce other random graph ensembles such as configuration model, random geometric graphs on a circle and ER graphs.

Supplementary Table S1 lists the model networks analyzed in this work along with the number of vertices, number of edges, average degree and edge density of each network. In each model, we have chosen different combinations of input parameters to generate networks with different sizes and average degree (Supplementary Table S1). Moreover, we have sampled 100 networks starting with different random seed for a specific combination of input parameters from each generative model, and the results reported in the next section for model networks in an average over the sample of 100 networks with chosen input parameters (Supplementary Tables S2–S5).

We have also considered seventeen widely-studied real undirected networks. These are six communication or infrastructure networks, the Chicago road network^{50}, the Euro road network^{51}, the US Power Grid network^{52}, the Contiguous US States network^{53}, the autonomous systems network^{52} and an Email communication network^{54}. In the Chicago road network, the 1467 vertices correspond to transportation zones within the Chicago region, and the 1298 edges are roads in the region linking them. In the Euro road network, the 1174 vertices are cities in Europe, and the 1417 edges are roads in the international E-road network linking them. In the US Power Grid network, the 4941 vertices are generators or transformers or substations in the western states of the USA, and the 6594 edges are power supply lines linking them. In the Contiguous US States network, the 48 vertices correspond to the 48 contiguous states of USA (except the two states, Alaska and Hawaii, which are not connected by land with the other 48 states), and the 107 edges represent land border between the states. In the autonomous systems network, the 26475 vertices are autonomous systems of the Internet, and the 53381 edges represent communication between autonomous systems connected to each other from the CAIDA project. In the Email communication network, the 1133 vertices are users in the University Rovira i Virgili in Tarragona in Spain, and the 5451 edges represent direct communication between them. We have considered five social networks, the Zachary karate club^{55}, the Jazz musicians network^{56}, the Hamsterster friendship network, the Dolphin network^{57} and the Zebra network^{58}. In the Zachary karate club, the 34 vertices correspond to members of an university karate club, and the 78 edges represent ties between members of the club. In the Jazz musicians network, the 198 vertices correspond to Jazz musicians, and the 2742 edges represent collaboration between musicians. In the Hamsterster friendship network, the 2426 vertices are users of hamsterster.com, and the 16631 edges represent friendship or family links between them. In the Dolphin network, the 62 vertices correspond to bottlenose Dolphins living off Doubtful Sound in South West New Zealand, and the 159 edges represent frequent associations among Dolphins observed between 1994 and 2001. In the Zebra network, the 27 vertices correspond to Grevy’s Zebras in Kenya, and the 111 edges represent observed interaction between Zebras during the study^{58}. We have also considered a scientific co-authorship network based on papers from the arXiv’s Astrophysics (astro-ph) section^{52} where the 18771 vertices correspond to authors and the 198050 edges represent common publications among authors. We have also considered the PGP network^{59}, an online contact network, where the 10680 vertices are users of the Pretty Good Privacy (PGP) algorithm, and the 24316 edges represent interactions between the users. We have also considered a linguistic network, an adjective-noun adjacency network^{60}, where the 112 vertices are nouns or adjectives, and the 425 edges represent their presence in adjacent positions in the novel David Copperfield by Charles Dickens. We have considered three biological networks, the yeast protein interaction network^{61}, the PDZ domain interaction network^{62} and the human protein interaction network^{63}. In the yeast protein interaction network, the 1870 vertices are proteins in yeast *Saccharomyces cerevisiae*, and the 2277 edges are interactions between them. In the PDZ domain interaction network, the 212 vertices are proteins, and the 244 edges are PDZ-domain mediated interactions between proteins. In the human protein interaction network, the 3133 vertices are proteins, and the 6726 edges are interactions between human proteins as captured in an earlier release of the proteome-scale map of human binary protein interactions. The seventeen empirical networks analyzed here were downloaded from the KONECT^{64} database. Supplementary Table S1 lists the real networks analyzed in this work along with number of vertices, number of edges, average degree and edge density of each network.

We remark that the above-mentioned model and real-world networks considered in this work are unweighted graphs, and thus, the weights of vertices, edges and two-dimensional simplicial complexes are taken to be 1 while computing the Forman-Ricci curvature and its augmented version. Furthermore, the largest connected component of the above-mentioned model and real-world networks is considered while computing the Ollivier-Ricci curvature of edges. In earlier work^{26,28}, we had characterized the Forman-Ricci curvature of edges and vertices in some of the above-mentioned networks. In the present work, we have compared the Forman-Ricci curvature and its augmented version with Ollivier-Ricci curvature in above-mentioned networks.

## Results

### Comparison between Forman-Ricci and Ollivier-Ricci curvature in model and real networks

We have compared the Ollivier-Ricci with Forman-Ricci and Augmented Forman-Ricci curvature of edges in model networks (Table 1 and Supplementary Table S2). In random ER networks, small-world WS networks and scale-free BA networks, we find a high positive correlation between the Ollivier-Ricci and Forman-Ricci curvature of edges or between Ollivier-Ricci and Augmented Forman-Ricci curvature of edges when the model networks are sparse with small average degree, however, the observed correlation vanishes with increase in average degree of model networks (Table 1 and Supplementary Table S2). In hyperbolic random geometric graphs, we also find a high positive correlation between the Ollivier-Ricci and Forman-Ricci curvature of edges or between Ollivier-Ricci and Augmented Forman-Ricci curvature of edges, however, the observed correlation in the hyperbolic graphs seems relatively less dependent on average degree of networks based on our limited exploration of the parameter space (Table 1 and Supplementary Table S2). We remark that hyperbolic random geometric graphs unlike ER, WS and BA networks have explicit geometric structure. Note that the Augmented Forman-Ricci in comparison to Forman-Ricci curvature of edges has typically higher positive correlation with Ollivier-Ricci curvature of edges in ER, WS and BA models (Table 1 and Supplementary Table S2). Moreover, WS networks have higher clustering coefficient (and thus, higher proportion of triads) in comparison to ER or BA networks with same number of vertices and average degree, and thus, it is not surprising to observe that the Augmented Forman-Ricci curvature in comparison to Forman-Ricci curvature of edges has much higher positive correlation with Ollivier-Ricci curvature of edges in WS networks, especially, when networks become denser with increase in average degree (Table 1 and Supplementary Table S2). This last result is expected because the Augmented Forman-Ricci curvature of edges also accounts for two-dimensional simplicial complexes or cycles of length 3 arising in graphs (see discussion in Theory section and Fig. 1(e,f)).

We have also compared the Ollivier-Ricci with Forman-Ricci and Augmented Forman-Ricci curvature of edges in seventeen real-world networks. In several of the analyzed real-world networks, we find a moderate to high positive correlation between Ollivier-Ricci and Forman-Ricci curvature of edges (Table 1 and Supplementary Table S2). We highlight that some of the real-world networks such as Astrophysics co-authorship network, Email communication network, Jazz musicians network and Zebra network have very weak or no correlation between Ollivier-Ricci and Forman-Ricci curvature of edges (Table 1 and Supplementary Table S2). However, in most real-world networks analyzed here, we find a moderate to high positive correlation between Augmented Forman-Ricci and Ollivier-Ricci curvature of edges (Table 1 and Supplementary Table S2). Interestingly, we also find that the Augmented Forman-Ricci curvature has moderate to high correlation with Ollivier-Ricci curvature of edges in Astrophysics co-authorship network, Email communication network, Jazz musicians network and Zebra network where Forman-Ricci curvature has very weak or no correlation with Ollivier-Ricci curvature of edges (Table 1 and Supplementary Table S2). Thus, at the level of edges, we observe a positive correlation between Ollivier-Ricci and Forman-Ricci curvature, especially, the augmented version, in many networks (Table 1 and Supplementary Table S2).

From the definition of the Ollivier-Ricci and Forman-Ricci curvature of edges, it is straightforward to define Ollivier-Ricci and Forman-Ricci curvature of vertices in networks^{24,28} as the sum of the Ricci curvatures of the edges incident on the vertex in the network. Note that the definition of Ollivier-Ricci and Forman-Ricci curvature of vertices in networks^{24,28} is a direct discrete analogue of the scalar curvature in Riemannian geometry^{43}.

We have compared the Ollivier-Ricci with Forman-Ricci and Augmented Forman-Ricci curvature of vertices in model networks (Table 2 and Supplementary Table S3). In random ER networks, small-world WS networks and scale-free BA networks, we find a high positive correlation between the Ollivier-Ricci and Forman-Ricci curvature of vertices or between Ollivier-Ricci and Augmented Forman-Ricci curvature of vertices, and the observed correlation seems to have minor dependence on size or average degree of networks based on our limited exploration of the parameter space (Table 2 and Supplementary Table S3). In most hyperbolic random geometric graphs analyzed here, we also find a moderate positive correlation between the Ollivier-Ricci and Forman-Ricci curvature of vertices or between Ollivier-Ricci and Augmented Forman-Ricci curvature of vertices (Table 2 and Supplementary Table S3). Note that in random ER networks, small-world WS networks and scale-free BA networks, the Spearman correlation is typically higher than Pearson correlation between Ollivier-Ricci and Forman-Ricci curvature of vertices, however, in the hyperbolic random geometric graphs, the Spearman correlation is typically lower than Pearson correlation between Ollivier-Ricci and Forman-Ricci curvature of vertices (Tables 1 and 2 and Supplementary Tables S2 and S3).

We have also compared the Ollivier-Ricci with Forman-Ricci and Augmented Forman-Ricci curvature of vertices in seventeen real-world networks. In several of the analyzed real-world networks, we find a moderate to high positive correlation between Ollivier-Ricci and Forman-Ricci curvature of vertices (Table 2 and Supplementary Table S3). Also, in most real-world networks analyzed here, we find a higher positive correlation between Augmented Forman-Ricci and Ollivier-Ricci curvature of vertices in comparison to Forman-Ricci and Ollivier-Ricci curvature of vertices (Table 2 and Supplementary Table S3). Thus, at the level of vertices, we observe a positive correlation between Ollivier-Ricci and Forman-Ricci curvature, especially, the augmented version, in many networks (Table 2 and Supplementary Table S2).

Importantly, we find that the correlation between Ollivier-Ricci and Forman-Ricci curvature of vertices is higher than Ollivier-Ricci and Forman-Ricci curvature of edges in most networks analyzed here (Tables 1 and 2 and Supplementary Tables S2 and S3). An intuitive explanation consists in the following observation. For the curvature of a vertex *v*_{0} in an unweighted network, we average over all edges (*v*_{0}, *v*) that have that vertex as one of its endpoints. Therefore, the Forman-Ricci curvature of each edge (*v*_{0}, *v*) with vertex *v*_{0} as one of its endpoint in an unweighted network has the form, 4 − *deg v*_{0} − *deg v* (see eq. 8), and the Forman-Ricci curvature of all such edges (*v*_{0}, *v*) share the term *deg v*_{0} which decreases the variance. For example, we even find a high positive correlation between Ollivier-Ricci and Forman-Ricci curvature of vertices in Email communication network where only a weak positive correlation exists between Ollivier-Ricci and Forman-Ricci curvature of edges (Tables 1 and 2 and Supplementary Tables S2 and S3). In a nut shell, although the two discretizations of Ricci curvature, Ollivier-Ricci and Forman-Ricci, capture different geometrical properties, our empirical analysis intriguingly finds a high positive correlation in many networks, especially, real-world networks. Deeper investigations in future are needed to better understand this empirically observed correlation between Ollivier-Ricci and Forman-Ricci curvature in many networks.

### Comparison of Forman-Ricci and Ollivier-Ricci curvature with other edge-based measures

We emphasize that Ollivier-Ricci and Forman-Ricci curvature are edge-based measures of complex networks. We compared Ollivier-Ricci, Forman-Ricci and Augmented Forman-Ricci curvature with three other edge-based measures, edge betweenness centrality^{37,65,66}, embeddedness^{67} and dispersion^{68}, for complex networks. Edge betweenness centrality^{37,65,66} measures the number of shortest paths that pass through an edge in a network. Edge betweenness centrality can be used to identify bottlenecks for flows in network. Embeddedness^{67} of an edge quantifies the number of neighbors that are shared by the two vertices anchoring the edge under consideration in the network. Embeddedness is a measure to quantify the strength of ties in social networks^{67}. Dispersion^{68} quantifies the extent to which the neighbours of the two vertices anchoring an edge are not themselves well connected. Dispersion is a measure to predict romantic relationships in social networks^{68}.

In model networks, we find that Ollivier-Ricci, Forman-Ricci and Augmented Forman-Ricci curvature have significant negative correlation with edge betweenness centrality (Table 3 and Supplementary Table S4). In most real networks considered here, we find that Ollivier-Ricci curvature has moderate to high negative correlation with edge betweenness centrality while Forman-Ricci curvature has a weak to moderate negative correlation with edge betweenness centrality (Table 3 and Supplementary Table S4). Moreover, in most real networks considered here, we observe a higher negative correlation between Ollivier-Ricci curvature and edge betweenness centrality in comparison to Forman-Ricci curvature and edge betweenness centrality (Table 3 and Supplementary Table S4). This may be explained by the fact that Ollivier-Ricci curvature is also affected by cycles of length 3, 4 and 5 containing the two vertices of an edge, and these are relevant for edge betweenness centrality. Interestingly, in real networks considered here, the Augmented Forman-Ricci curvature in comparison to Forman-Ricci curvature has much higher negative correlation with edge betweenness centrality (Table 3 and Supplementary Table S4). Our results suggest that the augmented version of Forman-Ricci curvature which also accounts for two-dimensional simplicial complexes arising in graphs is better suited for analysis of complex networks.

In both model and real networks considered here, we find no consistent relationship between Ollivier-Ricci, Forman-Ricci, or Augmented Forman-Ricci curvature of an edge and embeddedness (Table 3 and Supplementary Table S4). Similarly, in both model and real networks considered here, we find no consistent relationship between Ollivier-Ricci, Forman-Ricci, or Augmented Forman-Ricci curvature of an edge and dispersion (Table 3 and Supplementary Table S4). In summary, the two discrete notions of Ricci curvatures are negatively correlated to edge betweeness centrality but have no consistent relationship with embeddedness or dispersion in analyzed networks.

### Comparison of Forman-Ricci and Ollivier-Ricci curvature with vertex-based measures

We compared Ollivier-Ricci, Forman-Ricci and Augmented Forman-Ricci curvature of vertices with three other vertex-based measures, degree, betweenness centrality^{37,65} and clustering coefficient^{33,69}, in a network. Vertex degree gives the number of edges incident to that vertex in a network. Betweennness centrality^{37,65} of a vertex quantifies the fraction of shortest paths between all pairs of vertices in the network that pass through that vertex. The clustering coefficient^{33,69} of a vertex quantifies the number of edges that are realized between the neighbours of the vertex divided by the number of edges that could possibly exist between the neighbours of the vertex in the network. We remark that the clustering coefficient has been proposed as a measure to quantify the curvature of networks^{39}.

Not surprisingly, we find that Ollivier-Ricci, Forman-Ricci or Augmented Forman-Ricci curvature of vertices have high negative correlation with degree in most model as well as real networks analyzed here (Table 4 and Supplementary Table S5). After all, the vertex degree is intrinsic in the definition of the Ollivier-Ricci or Forman-Ricci curvature of a vertex as it appears implicitly in the sum over adjacent edges in the defining formula. Similarly, in model as well as real networks analyzed here, we find that Ollivier-Ricci, Forman-Ricci or Augmented Forman-Ricci curvature of vertices have high negative correlation with betweenness centrality (Table 4 and Supplementary Table S5). In contrast, we do not find any consistent relationship between Ollivier-Ricci, Forman-Ricci or Augmented Forman-Ricci curvature of vertices and clustering coefficient in model and real networks analyzed here (Table 4 and Supplementary Table S5).

### Relative importance of Forman-Ricci and Ollivier-Ricci curvature for topological robustness of networks

We employ a global network measure, communication efficiency^{70}, to quantify the effect of removing edges or vertices on the large-scale connectivity of networks. Communication efficiency *E* of a graph *G* is given by:

where *d*_{
ij
} denotes the shortest path between the pair of vertices *i* and *j*, *n* is the number of vertices in the graph, and *V*(*G*) denotes the set of vertices in the graph. Note that communication efficiency captures the resilience of a network to failure in the face of perturbations, as it essentially identifies locally with the clustering coefficient and globally with the inverse of the characteristic path length.

We investigated the relative importance of Ollivier-Ricci, Forman-Ricci or Augmented Forman-Ricci curvature of edges for the large-scale connectivity of networks by removing edges based on the following criteria: random order, increasing order of the Forman-Ricci curvature of an edge, increasing order of the Augmented Forman-Ricci curvature of an edge, increasing order of the Ollivier-Ricci curvature of an edge, and decreasing order of edge betweenness centrality. In both model and real networks, we find that removing edges based on increasing order of Ollivier-Ricci curvature or increasing order of Forman-Ricci curvature or increasing order of Augmented Forman-Ricci curvature or decreasing order of edge betweenness centrality leads to faster disintegration in comparison to the random removal of edges (Fig. 2). Furthermore, in most cases, removing edges based on increasing order of Ollivier-Ricci curvature or decreasing order of edge betweenness centrality typically leads to faster disintegration in comparison to removing edges based on increasing order of Forman-Ricci curvature (Fig. 2). We remark that both Ollivier-Ricci curvature of an edge and edge betweenness centrality are global measures while Forman-Ricci curvature of an edge is a local measure dependent on nearest neighbors of an edge.

We also investigated the relative importance of Ollivier-Ricci, Forman-Ricci or Augmented Forman-Ricci curvature of vertices for the large-scale connectivity of networks by removing vertices based on the following criteria: random order, increasing order of the Forman-Ricci curvature of a vertex, increasing order of the Augmented Forman-Ricci curvature of a vertex, increasing order of the Ollivier-Ricci curvature of a vertex, decreasing order of betweenness centrality of a vertex, decreasing order of vertex degree, and decreasing order of clustering coefficient of a vertex. In both model and real networks, we find that removing vertices based on increasing order of Ollivier-Ricci curvature or increasing order of Forman-Ricci curvature or increasing order of Augmented Forman-Ricci curvature or decreasing order of betweenness centrality or decreasing order of degree leads to faster disintegration in comparison to the random removal of vertices (Fig. 3). Furthermore, in most model as well as real networks, removing vertices based on increasing order of Ollivier-Ricci curvature typically leads to faster disintegration in comparison to removing vertices based on increasing order of Forman-Ricci curvature or on increasing order of Augmented Forman-Ricci curvature (Fig. 3). Also, in most model as well as real networks, removing vertices based on increasing order of Ollivier-Ricci curvature typically leads to at least slightly faster disintegration in comparison to removing vertices based on any other measure (Fig. 3). In summary, vertices or edges with highly negative Ollivier-Ricci curvature are found to be more important than vertices or edges with highly negative Forman-Ricci curvature for maintaining the large-scale connectivity of most networks analyzed here.

## Conclusions

We have performed an empirical investigation of two discretizations of Ricci curvature, Ollivier’s Ricci curvature and Forman’s Ricci curvature, in a number of model and real-world networks. The two discretizations of Ricci curvature were derived using different theoretical considerations and methods, and thus, convey insights into quite different geometrical properties and behaviors of complex networks. Specifically, Ollivier-Ricci curvature captures clustering and coherence in networks while Forman-Ricci curvature captures dispersal and topology. Moreover, in the context of weighted networks, Ollivier-Ricci curvature implicitly, by its very definition, relates to edge weights as probabilities, while Forman’s Ricci curvature fundamentally views edge weights as abstractions of lengths, and vertex weights as, for instance, concentrated area measures. This suggests that Ollivier-Ricci curvature is intrinsically better suited to study probabilistic phenomenon on networks while Forman-Ricci curvature is better suited to investigate networks where edge weights correspond to distances. Still, our results obtained in a wide-range of both model and real-world networks, consistently demonstrate that the two types of Ricci curvature in many networks are highly correlated. The immediate benefit of this realization is that one can compute Forman-Ricci curvature in large networks to gain some first insight into the computationally much more demanding Ollivier-Ricci curvature. Furthermore, the state of the art computational implementation of the Ollivier-Ricci curvature can handle only weights on edges rather than vertices in weighted networks. In addition, while computing the Ollivier-Ricci curvature of an edge in a weighted network, a necessary step is the normalization of the neighboring edge weights. In contrast, the mathematical definition of the Forman-Ricci curvature can incorporate any set of positive weights, placed simultaneously at the vertices and the edges. Furthermore, the Augmented Forman-Ricci curvature can also account for higher-dimensional simplicial complexes, thus making it a natural and simple to employ tool for understanding networks with explicit geometric structure, especially, hyper-networks. Therefore, our empirical observations on the correlation between these two different notions of Ricci curvature in networks warrant deeper investigation in the future.

We remark that while the present manuscript was under final stages of submission, a preprint^{71} devoted to comparison problem in biological networks appeared on Arxiv server, independently from our present study.

### Data availability

All data generated or analysed during this study are included in this article or is available upon request from the corresponding author.

## Additional information

**Publisher's note:** Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## References

- 1.
Gromov, M. Structures métriques pour les variétés riemanniennes (CEDIC/Fernand Nathan, Paris, 1981).

- 2.
Hamilton, R. The Ricci Flow on Surfaces.

*A.M.S. Contemp. Math.***71**, 237–261 (1986). - 3.
Perelman, G. The entropy formula for the Ricci flow and its geometric applications. Preprint at https://arxiv.org/abs/math/0211159 (2002).

- 4.
Perelman, G. Ricci flow with surgery on three-manifolds. Preprint at https://arxiv.org/abs/math/0303109 (2003).

- 5.
Bakry, D., Gentil, I. & Ledoux, M.

*Analysis and geometry of Markov diffusion operators*(Springer International Publishing, Switzerland, 2014). - 6.
Lott, J. & Villani, C. Ricci curvature for metric-measure spaces via optimal transport.

*Annals of Mathematics***169**, 903–991 (2009). - 7.
Sturm, K. On the geometry of metric measure spaces.

*Acta mathematica***196**, 65–131 (2006). - 8.
Bauer, F., Hua, B., Jost, J., Liu, S. & Wang, G. The Geometric Meaning of Curvature: Local and Nonlocal Aspects of Ricci Curvature. In Najman, L. & Romon, P. (eds)

*Modern Approaches to Discrete Curvature*, 1–62 (Springer International Publishing, Cham, 2017). - 9.
Ollivier, Y. Ricci curvature of metric spaces.

*Comptes Rendus Mathematique***345**, 643–646 (2007). - 10.
Ollivier, Y. Ricci curvature of Markov chains on metric spaces.

*Journal of Functional Analysis***256**, 810–864 (2009). - 11.
Ollivier, Y. A survey of Ricci curvature for metric spaces and Markov chains. In Kotani, M., Hino, M. & Kumagai, T. (eds)

*Probabilistic approach to geometry*, vol. 57, 343–381 (World Scientific Publishing, 2010). - 12.
Ollivier, Y. A visual introduction to Riemannian curvatures and some discrete generalizations. In Dafni, G., John McCann, R. & Stancu, A. (eds)

*Analysis and Geometry of Metric Measure Spaces: Lecture Notes of the 50th Séminaire de Mathématiques Supérieures (SMS), Montréal, 2011*, vol. 56, 197–219 (American Mathematical Society, 2013). - 13.
Stone, D. A. A combinatorial analogue of a theorem of Myers.

*Illinois Journal of Mathematics***20**, 12–21 (1976). - 14.
Chow, B. & Luo, F. Combinatorial Ricci flows on surfaces.

*Journal of Differential Geometry***63**, 97–129 (2003). - 15.
Jin, M., Kim, J. & Gu, X. D. Discrete surface Ricci flow: Theory and applications. In Martin, R., Sabin, M. & Winkler, J. (eds)

*Mathematics of Surfaces XII*, 209–232 (Springer, Berlin, Heidelberg, 2007). - 16.
Gu, X. D. & Saucan, E. Metric Ricci Curvature for Manifolds.

*Geometry***2013**, 694169 (2013). - 17.
Gao, J., Gu, X. D. & Luo, F. Discrete Ricci Flow for Geometric Routing. In Kao, M.-Y. (ed.)

*Encyclopedia of Algorithms*, 1–8 (Springer, Berlin, Heidelberg, 2014). - 18.
Lin, Y. & Yau, S. Ricci curvature and eigenvalue estimate on locally finite graphs.

*Math. Res. Lett.***17**, 343–356 (2010). - 19.
Lin, Y., Lu, L. & Yau, S. Ricci curvature of graphs.

*Tohoku Mathematical Journal***63**, 605–627 (2011). - 20.
Bauer, F., Jost, J. & Liu, S. Ollivier-Ricci curvature and the spectrum of the normalized graph Laplace operator.

*Math. Res. Lett.***19**, 1185–1205 (2012). - 21.
Jost, J. & Liu, S. Ollivier’s Ricci curvature, local clustering and curvature-dimension inequalities on graphs.

*Discrete & Computational Geometry***51**, 300–322 (2014). - 22.
Loisel, B. & Romon, P. Ricci curvature on polyhedral surfaces via optimal transportation.

*Axioms***3**, 119–139 (2014). - 23.
Ni, C., Lin, Y., Gao, J., Gu, X. D. & Saucan, E. Ricci curvature of the Internet topology. In

*2015 IEEE Conference on Computer Communications (INFOCOM)*, 2758–2766 (IEEE, 2015). - 24.
Sandhu, R.

*et al*. Graph curvature for differentiating cancer networks.*Scientific Reports***5**, 12323 (2015). - 25.
Forman, R. Bochner’s method for cell complexes and combinatorial Ricci curvature.

*Discrete and Computational Geometry***29**, 323–374 (2003). - 26.
Sreejith, R. P., Mohanraj, K., Jost, J., Saucan, E. & Samal, A. Forman curvature for complex networks.

*Journal of Statistical Mechanics: Theory and Experiment*063206 (2016). - 27.
Sreejith, R. P., Jost, J., Saucan, E. & Samal, A. Forman curvature for directed networks. Preprint at https://arxiv.org/abs/1605.04662 (2016).

- 28.
Sreejith, R. P., Jost, J., Saucan, E. & Samal, A. Systematic evaluation of a new combinatorial curvature for complex networks.

*Chaos, Solitons & Fractals***101**, 50–67 (2017). - 29.
Weber, M., Saucan, E. & Jost, J. Characterizing complex networks with Forman-Ricci curvature and associated geometric flows.

*Journal of Complex Networks***5**, 527–550 (2017). - 30.
Saucan, E., Samal, A., Weber, M. & Jost, J. Discrete curvatures and network analysis.

*MATCH Commun. Math. Comput. Chem.***80**, 605–622 (2018). - 31.
Pal, S.

*et al*. Jaccard curvature–an efficient proxy for Ollivier-Ricci curvature in graphs. In Cornelius, S., Coronges, K., Gonçalves, B., Sinatra, R. & Vespignani, A. (eds)*Complex Networks IX*, 51–63 (Springer International Publishing, Cham, 2018). - 32.
Wasserman, S. & Faust, K.

*Social network analysis: Methods and applications*, vol. 8 (Cambridge University Press, 1994). - 33.
Watts, D. J. & Strogatz, S. H. Collective dynamics of small-world networks.

*Nature***393**, 440–442 (1998). - 34.
Barabási, A. L. & Albert, R. Emergence of scaling in random networks.

*Science***286**, 509–512 (1999). - 35.
Albert, R. & Barabási, A. L. Statistical mechanics of complex networks.

*Reviews of Modern Physics***74**, 47–97 (2002). - 36.
Feng, J., Jost, J. & Qian, M.

*Networks: from biology to theory*(Springer–Verlag, London, 2007). - 37.
Newman, M. E. J.

*Networks: An Introduction*(Oxford University Press, 2010). - 38.
Fortunato, S. Community detection in graphs.

*Physics Reports***486**, 75–174 (2010). - 39.
Eckmann, J. & Moses, E. Curvature of co-links uncovers hidden thematic layers in the world wide web.

*Proceedings of the National Academy of Sciences USA***99**, 5825–5829 (2002). - 40.
Wu, Z., Menichetti, G., Rahmede, C. & Bianconi, G. Emergent complex network geometry.

*Scientific Reports***5**, 10073 (2015). - 41.
Bianconi, G. & Rahmede, C. Emergent hyperbolic network geometry.

*Scientific Reports***7**, 41974 (2017). - 42.
Heintze, E. & Karcher, H. A general comparison theorem with applications to volume estimates for submanifolds.

*Ann. Sci. Ecole Norm. Sup.***11**, 451–470 (1978). - 43.
Jost, J.

*Riemannian Geometry and Geometric Analysis*, 7 edn (Springer International Publishing, 2017). - 44.
Vaserstein, L. N. Markov processes over denumerable products of spaces, describing large systems of automata.

*Probl. Peredachi Inf.***5**, 64–72 (1969). - 45.
Bhattacharya, B. B. & Mukherjee, S. Exact and asymptotic results on coarse Ricci curvature of graphs.

*Discrete Mathematics***338**, 23–42 (2015). - 46.
Weber, M., Saucan, E. & Jost, J. Coarse geometry of evolving networks.

*Journal of Complex Networks*https://doi.org/10.1093/comnet/cnx049 (2017). - 47.
Erdös, P. & Rényi, A. On the evolution of random graphs.

*Bull. Inst. Internat. Statist***38**, 343–347 (1961). - 48.
Krioukov, D., Papadopoulos, F., Kitsak, M., Vahdat, A. & Boguná, M. Hyperbolic geometry of complex networks.

*Physical Review E***82**, 036106 (2010). - 49.
Aldecoa, R., Orsini, C. & Krioukov, D. Hyperbolic graph generator.

*Computer Physics Communications***196**, 492–496 (2015). - 50.
Eash, R., Chon, K., Lee, Y. & Boyce, D. Equilibrium traffic assignment on an aggregated highway network for sketch planning.

*Transportation Research***13**, 243–257 (1979). - 51.
Šubelj, L. & Bajec, M. Robust network community detection using balanced propagation.

*European Physical Journal B***81**, 353–362 (2011). - 52.
Leskovec, J., Kleinberg, J. & Faloutsos, C. Graph evolution: Densification and shrinking diameters.

*ACM Transactions on Knowledge Discovery from Data (TKDD)***1**, 2 (2007). - 53.
Knuth, D. E. The Art of Computer Programming, Volume 4, Fascicle 2: Generating All Tuples and Permutations (Addison-Wesley Professional, Boston MA, 2005).

- 54.
Guimera, R., Danon, L., Diaz-Guilera, A., Giralt, F. & Arenas, A. Self-similar community structure in a network of human interactions.

*Physical Review E***68**, 065103 (2003). - 55.
Zachary, W. W. An information flow model for conflict and fission in small groups.

*Journal of Anthropological Research***33**, 452–473 (1977). - 56.
Gleiser, P. M. & Danon, L. Community structure in Jazz.

*Advances in complex systems***6**, 565–573 (2003). - 57.
Lusseau, D.

*et al*. The bottlenose dolphin community of Doubtful Sound features a large proportion of long-lasting associations.*Behavioral Ecology and Sociobiology***54**, 396–405 (2003). - 58.
Sundaresan, S. R., Fischhoff, I. R., Dushoff, J. & Rubenstein, D. I. Network metrics reveal differences in social organization between two fission–fusion species, Grevy’s zebra and onager.

*Oecologia***151**, 140–149 (2007). - 59.
Boguñá, M., Pastor-Satorras, R., Daz-Guilera, A. & Arenas, A. Models of social networks based on social distance attachment.

*Physical Review E***70**, 056122 (2004). - 60.
Newman, M. E. J. Finding community structure in networks using the eigenvectors of matrices.

*Physical Review E***74**, 036104 (2006). - 61.
Jeong, H., Mason, S. P., Barabási, A. L. & Oltvai, Z. N. Lethality and centrality in protein networks.

*Nature***411**, 41–42 (2001). - 62.
Beuming, T., Skrabanek, L., Niv, M. Y., Mukherjee, P. & Weinstein, H. PDZBase: a protein–protein interaction database for PDZ-domains.

*Bioinformatics***21**, 827–828 (2005). - 63.
Rual, J. F.

*et al*. Towards a proteome-scale map of the human protein–protein interaction network.*Nature***437**, 1173–1178 (2005). - 64.
Kunegis, J. Konect: the Koblenz network collection. In

*Proceedings of the 22nd International Conference on World Wide Web companion*, 1343–1350 (ACM, New York, NY, USA, 2013). - 65.
Freeman, L. C. A set of measures of centrality based on betweenness.

*Sociometry***40**, 35–41 (1977). - 66.
Girvan, M. & Newman, M. Community structure in social and biological networks.

*Proceedings of the National Academy of Sciences USA***99**, 7821–7826 (2002). - 67.
Marsden, P. & Campbell, K. Measuring tie strength.

*Social forces***63**, 482–501 (1984). - 68.
Backstrom, L. & Kleinberg, J. Romantic partnerships and the dispersion of social ties: a network analysis of relationship status on Facebook. In

*Proceedings of the 17th ACM conference on Computer supported cooperative work & Social Computing*, CSCW ‘14, 831–841 (ACM, New York, NY, USA, 2014). - 69.
Holland, P. W. & Leinhardt, S. Transitivity in structural models of small groups.

*Comparative Group**Studies***2**, 107–124 (1971). - 70.
Latora, V. & Marchiori, M. Efficient behavior of small-world networks.

*Physical Review Letters***87**, 198701 (2001). - 71.
Pouryahya, M., Mathews, J. & Tannenbaum, A. Comparing Three Notions of Discrete Ricci Curvature on Biological Networks. Preprint at https://arxiv.org/abs/1712.02943 (2017).

## Acknowledgements

We thank the anonymous reviewers for their constructive comments which have helped improve the manuscript. E.S. and A.S. thank the Max Planck Institute for Mathematics in the Sciences, Leipzig, for their warm hospitality. A.S. would like to acknowledge support from Max Planck Society, Germany, through the award of a Max Planck Partner Group in Mathematical Biology.

## Author information

### Author notes

### Affiliations

### Contributions

A.S., E.S. and J.J. designed the study. R.P.S. performed the simulations. A.S., R.P.S. and J.G. contributed software. A.S., R.P.S., J.G., S.L., E.S. and J.J. analyzed results. A.S., S.L., E.S. and J.J. wrote the manuscript. A.S. and R.P.S. contributed equally to this work. All authors reviewed and approved the manuscript.

### Competing Interests

The authors declare no competing interests.

### Corresponding authors

Correspondence to Emil Saucan or Jürgen Jost.

## Electronic supplementary material

## Rights and permissions

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

## About this article

#### Received

#### Accepted

#### Published

#### DOI

## Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.