Abstract
In many social and biological networks, the collective dynamics of the entire system can be shaped by a small set of influential units through a global cascading process, manifested by an abrupt firstorder transition in dynamical behaviors. Despite its importance in applications, efficient identification of multiple influential spreaders in cascading processes still remains a challenging task for largescale networks. Here we address this issue by exploring the collective influence in general threshold models of cascading process. Our analysis reveals that the importance of spreaders is fixed by the subcritical paths along which cascades propagate: the number of subcritical paths attached to each spreader determines its contribution to global cascades. The concept of subcritical path allows us to introduce a scalable algorithm for massively largescale networks. Results in both synthetic random graphs and real networks show that the proposed method can achieve larger collective influence given the same number of seeds compared with other scalable heuristic approaches.
Introduction
Cascading process lies at the heart of an array of complex phenomena in social and biological systems, including failure propagation in infrastructure^{1}, adoption of new behaviors^{2}, diffusion of innovations in social networks^{3} and cascading failures in brain networks^{4}, etc. In these cascading processes, a small number of influential units, or influencers, arise as a consequence of the structural diversity of the underlying interacting networks^{5}. In different fields, it has been accepted that the initial activation of a small set of such “superspreaders”, who usually hold prominent locations in networks, is capable of shaping the collective dynamics of large populations^{6,7,8}. In practice, identification of superspreaders can help to control the entire network’s dynamics with a low cost, e.g., a company can boost product popularity by targeted advertisement on influencers in viral marketing, or we can maintain the robustness of infrastructure systems by protecting structurally pivotal units. Given its great practical values in a wide range of important applications, the problem of locating superspreaders has attracted much attention in various disciplines^{9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28}.
In the simple case of finding single influential spreaders, centralitybased heuristic measures such as degree^{29}, Betweenness^{30}, PageRank^{31} and Kcore^{32} are routinely adopted. Beyond this noninteracting problem of finding single spreaders, it becomes more complicated when trying to select a group of spreaders, due to the collective effects of multiple agents. In fact, searching for the optimal set of influencers in cascading dynamics is an NPhard problem and remains to be a challenging conundrum in network science^{9}. To address the manybody problem, several approaches designed for the influence maximization in different models have been proposed. In the case of percolation model, a framework for optimal percolation based on the stability analysis of zero solution was developed^{15,16}. More recently, message passing algorithms for optimal decycling in statistical physics further pushed the critical point toward its optimal value^{20,21}. For susceptibleinfectedrecovered (SIR) model, the problem of finding influential spreaders is also explored using the percolation theory in recent works^{24,25}. In the above models, cascading processes can be transformed to the percolation model with a continuous phase transition. While optimal percolation theory^{15,16} applies only to systems with second order phase transitions, here we treat the case of cascading models which present first order discontinuous transitions. Such transitions cannot be treated with the stability analysis methods based on the nonbacktracking matrix as done in^{15,16} for models with continuous transitions, so a new approach is needed.
In a large variety of contexts, the cascading process is properly described by the Linear Threshold Model (LTM) in which the states of nodes are determined by a threshold rule^{33,34,35,36,37,38,39,40}. That is, a node will become active only after a certain number of its neighbors have been activated. The choice of threshold m_{i} = k_{i} − 1 in LTM guarantees a continuous phase transition, where k_{i} is the degree of node i. In this case, the cascading dynamics of LTM can be mapped to the classical percolation process^{15}, for which the influence maximization problem can be solved by various algorithms designed for optimal percolation. Nevertheless, for other choices of threshold, LTM exhibits a firstorder (i.e., discontinuous) phase transition. In fact, influence maximization in LTM corresponds to finding nontypical trajectories of cascading processes that deviate from the average ones^{17}. Altarelli et al.^{17} analyzed the statistics of large deviations of LTM dynamics with a belief propagation algorithm, and further developed a MaxSum (MS) algorithm to explicitly find the optimal set of seeds in terms of a predefined energy function^{18}. Guggiola and Semerjian^{19} obtained the theoretical limit of the size of minimal contagious sets for random regular graphs, and used a survey propagation like algorithm to locate the minimal set of seeds. Given these recent progresses in searching for optimal influencers in LTM, it is a challenging task to apply these methods to massively largescale networks with tens of millions nodes encountered in modern bigdata analysis. Therefore, the problem of developing an efficient scalable algorithm of influence maximization in cascading models with discontinuous transitions that is feasible in realworld applications still needs to be further explored.
Here, we examine the collective influence in general LTM, and develop a scalable algorithm for influence maximization. By analyzing the message passing equations of LTM, we formulate the form of interactions between spreaders and provide an analytical expression of their contributions to cascading process. Each seed’s contribution, defined as the collective influence in threshold model (CITM), is determined by the number of subcritical paths emanating from it. Since the subcritical paths are such routes along which cascades can propagate, CITM can be considered as a reliable estimation of seeds’ structural importance in LTM. CITM is the generalization of the CI algorithm of optimal percolation for second order transitions treated in^{15,16} to the present case of first order transitions. To apply our method to largescale networks, we present an efficient adaptive selection procedure to achieve collective influence maximization. Compared with other competing heuristics, our results on both synthetic and realistic largescale networks reveal that the proposed mechanismbased algorithm can produce a larger cascading process given the same number of seeds.
Results
Collective influence in threshold models: CITM
We present a theoretical framework to analyze the collective influence of individuals in general LTM. For a network with N nodes and M links, the topology is represented by the adjacency matrix {A_{ij}}_{N×N}, where A_{ij} = 1 if i and j are connected, and A_{ij} = 0 otherwise. The vector n = (n_{1}, n_{2}, …, n_{N}) records whether a node i is chosen as a seed (n_{i} = 1) or not (n_{i} = 0). The total fraction of seeds is therefore q = ∑_{i}n_{i}/N. During the spreading, the state of each node falls into the category of either active or inactive. The spreading starts from a q fraction of active seeds and evolves following a threshold rule: a node i becomes active when m_{i} neighbors get activated. This process terminates when there are no more newly activated nodes. We introduce ν_{i} as node i’s indicator in active (ν_{i} = 1) or inactive (ν_{i} = 0) state at the final stage, and denote Q(q) as the size of the giant connected component of active population.
For a directed link i → j, we introduce ν_{i→j} as the indicator of i being in an active state assuming node j is disconnected from the network. If n_{i} = 1, then ν_{i→j} = 1. Otherwise, ν_{i→j} = 1 only when there are at least m_{i} active neighbors excluding j. Since there exist many possible choices of these m_{i} neighbors, we define as the set of all combinations of m_{i} nodes selected from ∂i\j, where ∂i\j is the set of nearest neighbors of i excluding j. Clearly, if i has k_{i} connections emanating from it, there are combinations, so the set contains elements, denoted by P_{h}, . Each element P_{h} has the form where are the m_{i} nodes in the hth combination. Figure 1a illustrates all three combinations P_{1}, P_{2} and P_{3} corresponding to ν_{i→j} for node i with a threshold m_{i} = 2. Should at least one combination is fully activated, we have ν_{i→j} = 1.
Generally, for locally treelike networks, we have the following message passing equation:
The final state of i is given by
The above equations Eq. (12) describe the general cases of LTM. For the special choice of threshold m_{i} = k_{i} − 1, there is only one combination in , and the transition becomes continuous and then it can be treated with the stability methods of optimal percolation as done in^{15,16}. We note that, Eq. (12) are only valid under the locally treelike assumption. For synthetic random networks, this assumption holds since short loops appear with a probability of order O(1/N)^{15}. Nevertheless, a considerable number of short loops may exist in realworld networks. For those networks with clustering, many prior works have confirmed that results obtained for treelike networks apply quite well also for loopy graphs. For instance, Melnik et al. found that, for a series of problems, the treelike approximation worked well for clustered networks as long as the mean intervertex distance was sufficiently small^{41}. As most of realworld networks are smallworld, the approximation of Eq. (12) should be reasonable provided the density of loops is not excessively large.
For all the 2M directed links i → j, Eq. (1) is a nonlinear function of :
In Eq. (3), in which n_{i→j} = n_{i} for link i → j, and where G_{i→j} is the nonlinear function of vector ν_{→} for link i → j. Given the initial configuration of seeds n, the final state of ν_{→} is fully determined by the selfconsistent Eq. (3). Unfortunately, it cannot be solved directly due to the exponentially growing number of combinations in . Therefore, for a small number of seeds, we adopt the iterative method to estimate the solution. In this point of view, Eq. (3) can be treated as a discrete dynamical system
with the initial condition .
To simplify the calculation, we approximate the nonlinear function G_{i→j} by linearization. Define . By Eq. (1), we know that for . While in the case of and k ≠ j, we have
Although Eq. (5) has a complex form, in fact it is only determined by a simple quantity , which is interpreted as the number of i’s active neighbors excluding k and j when i is absent from the network. On one hand, if a_{k→i,i→j} ≥ m_{i}, at least one term of equals one, since we are selecting m_{i} elements from a set containing at least m_{i} elements of value 1. Under such condition, . On the other hand, if a_{k→i,i→j} ≤ m_{i} − 2, all the terms are zeros because we are selecting m_{i} − 1 elements from a set containing at most m_{i} − 2 nonzero elements, which also leads to . When a_{k→i,i→j} = m_{i} − 1, all the terms and are zeros, and only the exact combination of these m_{i} − 1 nonzero elements would lead to . Therefore, we have . Based on the above reasoning, we define a quantity for links and i → j as follows:
The definition of is reminiscent of the Hashimoto nonbacktracking (NB) matrix ^{15,42,43}. In the case of m_{i} = k_{i} − 1, our quantity can be transformed to the corresponding element of NB matrix . In fact, is closely related to the concept of subcritical nodes. Recall that a node i is subcritical if it has m_{i} − 1 active neighbors^{38,39,40}. This implies that one more activation of its neighbors will cause i activated. From Eq. (6) we know that only if the links and i → j are connected, nonbacktracking, and additionally, node i is subcritical in the absence of node k and j. In Fig. 1b, node i has an active neighbor k_{1} and two inactive ones k_{2} and k_{3}. By definition, for a threshold m_{i} = 2, we conclude since i has no active neighbor excluding k_{1} and j, while because i has 1 (=m_{i} − 1) active neighbor excluding k_{2} and j.
For a small ν_{→}, a standard linearization around origin 0 gives . However this will cause degeneracy since Eq. (5) constantly gives . Therefore, we approximate G_{i→j}(ν_{→}) by given ν_{→} is close to 0. In Methods, we prove that this linearization has an approximation accuracy of O(ν_{→}^{2}) ( ⋅  is the vector norm), same as the linear Taylor expansion. To account for the increasing network size as N → ∞, we define the vector norm as (2M is the number of directed links), so that ν_{→} is always bounded below 1 for all network sizes. The linear approximation is valid when the number of links attached to initial seeds is small compared with all directed links. As we will see, the fraction of seeds at the discontinuous transition is small for both synthetic and realistic networks. Therefore, the linear approximation before the critical point should be valid. In Methods, we compare ν_{→} calculated by linear approximation with its real value on a scalefree network assuming LTM is initialed by one single seed. The approximation results agree well with their true values. See the detailed discussion in Methods.
Combining all direct links, Eq. (4) can be approximated by a linear equation
where is a 2M × 2M matrix defined on the directed links , i → j with elements
With the notion of , we can write as:
Now we update the state of following Eq. (7). In the following calculation, we simplify and to and respectively for notation convenience. We put the matrix in a higherdimensional space^{15}:
where function is 1 if , and 0 otherwise. The indices run from 1 to N. Starting from , gives
The physical meaning of Eq. (11) can be interpreted as follows. If node i is a seed, . Otherwise, is nonzero if i is subcritical () and at least one of its corresponding neighbors k is a seed (n_{k} = 1). Supposing i is not a seed, the contribution of a neighboring seed k is conveyed by the directed path k → i → j that satisfies n_{k} = 1, n_{i} = 0 and , which is shown in the second panel of Fig. 1c.
For t = 2, we have . Therefore,
The last term in Eq. (12) is actually the contribution of node i’s 2step neighbors s to . The contribution of a seed s is conducted through a directed path s → k → i → j that satisfies n_{s} = 1, n_{k} = 0, n_{i} = 0 and (See Fig. 1c).
Inspired by Eq. (12), we define the concept of subcritical paths. For a directed link i → j, the path is a subcritical path of length L if , , and any two consecutive links are nonbacktracking. If i_{1} = i, we set the path’s length L = 0. The subcritical paths of length L = 0, 1 and 2 are displayed in Fig. 1c. Notice that, the calculation of Llength subcritical paths is in fact implemented by the multiplication of . In fact, the concept of subcritical path has a clear physical meaning. A subcritical path is composed of connected subcritical nodes. So once the node i_{1} at the beginning of the subcritical path is activated, the cascade of activation will propagate along the path and lead to ν_{i→j} = 1 for the link i → j at the tail. Therefore, the longrange interaction between node i_{1} and node i is realized through the subcritical path connecting them. Following this idea, we can generalize Eq. (12) to at a given time T. The exact formula for is
where k_{−1} = j, k_{0} = i and runs from 1 to N for . Notice that the form of is nothing but n_{i} plus the contribution of seeds connected to i through subcritical paths with length L ≤ T when n_{i} = 0.
CITM Algorithm
To quantify the active population in LTM, we define , where 2M is the total number of directed links. Starting from when no seed is selected, increases as more seeds are activated. Therefore, we expect that the collective influence of a given number of seeds can be optimized by maximizing .
Based on the form of each element in ν_{→}, we learn that the contribution of a seed i to is composed of all its collective contributions to every potential element, exerted through the subcritical paths attached to i. Therefore, we employ a seed’s contribution to to define its Collective Influence in Threshold Model (CITM) to find the best influencers. For the trivial case of subcritical paths with length L = 0, we define CI − TM_{0}(i) = k_{i}, where k_{i} is the degree of node i. Thus, at the zeroorder approximation we recover the highdegree heuristic. The first panel of Fig. 1d illustrates CI − TM_{0}(i) = 3 for node i. For L ≥ 1, subcritical paths are involved in the definition of CITM. For L = 1,
As shown in Fig. 1(d), the contribution of node i to through subcritical paths of length L = 1 is 2. Therefore, we have CI − TM_{1}(i) = 5. For L = 2,
In Fig. 1d, the additional 2length subcritical paths also contribute to CI − TM_{2}(i), leading to CI − TM_{2}(i) = 7. Moreover, in Fig. 1d, we can observe that for the tree structure, the activation of node j in the firststep update will not affect in the secondstep update, which means . More generally, is not affected by the activation of k’s any precedent nodes on the subcritical path. Therefore, we will leave out the superscript t in the definition of CITM for locally treelike networks. We can generalize the above CITM calculation to any given L. In summary, the definition of node i’s influence CITM in an area of length L is:
Figure 1e illustrates the calculation of node i’s CITM for L = 2, in which subcritical paths with length are distinguished by colors.
For a given fraction q of seeds, our goal is to maximize . As we have explained, the CITM value of a seed depends on the choice of other seeds. Therefore, it is hard to obtain the optimal configuration {n∑_{i}n_{i}/N = q} without turning to extremely timeconsuming algorithms. To compromise and obtain a scalable algorithm, we propose an adaptive CITM algorithm following a greedy approach. Define C(i, L) as the set of node i plus subcritical vertices belonging to all subcritical paths originating from i with length . Beginning with an empty seed set S, we remove the top CITM nodes as follow. The calculation proceeds following the CITM algorithm.
Algorithm 1 CITM algorithm
1: Initialize S = ∅
2: Calculate CI − TM_{L} for all nodes
3: for l = 1 to qN do
4: Select i with the largest CI − TM_{L}
5: S = S ∪ {i}
6: Remove C(i, L), and decrease the degree and threshold of C(i, L)’s existing neighbors by 1
7: Update CI − TM_{L} for nodes within L + 1 steps from C(i, L)
8: end for
9: Output S
In the above algorithm, we remove C(i, L) once i is added to the seed set. The reason lies in that it is unnecessary to select nodes in C(i, L) as seeds in later calculation, because the activation of i will definitely active C(i, L) (See Fig. 1f). Besides, C(i, L) can be identified during the computation of CI − TM_{L} without additional cost. In traditional centralitybased methods, seeds may have significant overlap in their influenced population. It has been reported that the performance of these methods, such as Kcore, suffers a lot from this phenomenon^{12}. On the contrary, in our algorithm, this problem is alleviated by the removal of subcritical nodes in C(i, L), which successfully reduces the overlap and improves the efficacy of each seed. Although such greedy strategy is not guaranteed to give the exact optimal spreaders, we expect a good performance in comparison with other heuristic methods in largescale networks. For extreme sparse networks with large numbers of fragmented subcritical clusters, a simple modified algorithm can find a smaller set of influencers (See Methods).
More importantly, the CITM algorithm is scalable for large networks with a computational complexity O(NlogN) as N → ∞. On one hand, computing CI − TM_{L} is equivalent to iteratively visiting subcritical neighbors of each node layer by layer within L radius. Because of the finite search radius, computing CI − TM_{L} for each node takes O(1) time. Initially, we have to calculate CI − TM_{L} for all nodes. However, during later adaptive calculation, there is no need to update CI − TM_{L} for all nodes. We only have to recalculate for nodes within L + 1 steps from the removed vertices, which scales as O(1) compared to the network size as N → ∞ as shown in ref. 16. On the other hand, selecting the node with maximal CITM can be realized by making use of the data structure of heap that takes O(logN) time^{16}. Therefore, the overall complexity of ranking N nodes is O(NlogN) even when we remove the top CITM nodes one by one. In addition, considering the relative small number of subcritical neighbors, the cost of searching for subcritical paths is far less than that when scanning all neighbors. This permits the efficient computation of CITM for considerably large L. In our later experiments on finitesize networks, we do not put a limit on L so as to calculate CITM thoroughly. But remember that we can always truncate L to speed up CITM algorithm for extremely largescale networks.
Test of CITM Algorithm
We first simulate LTM dynamics on synthetic random networks, including Rényi (ER) and scalefree (SF) networks. In the models, we adopt a fractional threshold rule , which means that a node will be activated once t fraction of its neighbors are active ( is the ceiling function). Here we choose this special form of threshold setting. But we note that the algorithm can apply to other more general choices of threshold in LTM. In order to verify the efficacy of CITM algorithm, we compare its performance against several widelyused ranking methods, including high degree (HD)^{29}, high degree adaptive (HDA), PageRank (PR)^{31} and Kcore adaptive (KsA)^{32}. As a reference, we also display the result of random selection of seeds, as well as the size of optimal seed set identified by MaxSum algorithm (MS)^{18}. Details about these strategies are explained in Methods.
Figure 2a presents Q(q) versus q on ER networks (t = 0.5, N = 2 × 10^{5}, 〈k〉 = 6). Similar to bootstrap percolation on homogeneous networks, Q(q) first undergoes a continuous transition from Q(q) = 0 to nonzero, and then a firstorder transition at a higher value of q_{c}^{37}. Remarkably, compared with competing heuristics, CITM algorithm achieves a larger active population for a given number of seeds. It not only brings about an earlier continuous transition, but also activates the total population with a smaller seed set. Among all the strategies, random selection represents the average behavior of cascade initiated by randomly chosen seeds, with a critical value . Although the original Kcore ranking has an unsatisfactory performance for multisource spreading^{12}, the adaptive version KsA gives a better result similar to HDA. For different threshold t, the critical values q_{c} for CITM and other heuristic methods are shown in Table 1. We also provide the firstorder critical value q_{c} for CITM and HDA on ER networks with different average degree 〈k〉 in the inset of Fig. 2a. With the growth of 〈k〉, q_{c} increases and so does the difference between CITM and HDA. In some cases, q_{c} can be further improved by a simple modification on CITM (See Methods).
We then examine CITM’s performance on SF networks with powerlaw degree distributions in Fig. 2b. We generate SF networks of size N = 2 × 10^{5} and powerlaw exponent γ = 3 following the configuration model^{44}. It can be seen that the critical value of firstorder transition becomes rather small for SF networks, due to the existence of highly connected hubs. Still, CITM algorithm outperforms other heuristic approaches by producing a larger active component Q(q) for a given fraction of seed q. Since most nodes have a quite small number of connections in SF networks, the cascade triggered by randomly selected seeds is limited to a local scale, even with a relatively large number of seeds, as shown by the grey line at the bottom of Fig. 2b. This implies, compared with homogeneous networks, the deviations of the optimized trajectories from typical ones are much more extreme in heterogeneous networks. Moreover, as SF networks become more heterogeneous with a smaller powerlaw exponent γ of the degree distribution, the minimal number of seeds required for global cascade decreases accordingly, as shown in the inset of Fig. 2b.
In applications, we are frequently faced with largescale networks which exhibit more complicated topological characteristics than random graphs. Thus, it is more necessary and challenging to find a feasible strategy to efficiently approximate the optimal spreaders for those networks. Next, we explore CITM algorithm’s performance for real networks. We examine two representative datasets: Youtube friendship network (N = 3, 223, 589, M = 9, 375, 374, c = 0.00138, l = 5.29)^{45} and Internet autonomous system network (N = 1, 464, 020, M = 10, 863, 640, c = 0.00539, l = 5.04)^{46}. Here N is the network size, M is the number of undirected links, c is the average clustering coefficient, and l is the average shortest path length. Youtube network represents the undirected friend relations between users in the famous video sharing website Youtube. The Internet network records the communications between routers in different autonomous systems. The links between routers are constructed from the Border Gateway Protocol logs in an interval of 785 days. This provides an example of infrastructure network on which malicious attack and failure propagation may occur. Both networks are treated as undirected in the analysis.
Figure 3a displays Q(q) for different numbers of seeds S for Youtube network. CITM is able to trigger the global cascade with a smaller group of seeds, whose size is quite small compared to the entire network due to the heavytailed degree distribution. We also discover that, in the setting of firstorder transitions, some nodes with moderate numbers of connections play a crucial role in the collective influence of LTM. As shown in the inset figure, we present the percentage of influencers predicted by CITM that HDA and HD have identified, with the vertical dash line indicating CITM’s q_{c}. At q_{c}, HDA and HD locate nearly 80% overlapping seeds with CITM algorithm, most of which are tagged as hubs. However, due to the collective nature of LTM, seeding the set of privileged nodes in the noninteracting view does not guarantee the maximization of collective influence. The other proportion of spreaders with lower degree, although may be inefficient as single spreaders, are responsible for bridging the collective influence of hubs. With the help of both hubs and bridging low degree nodes, CITM can expand the collective influence with a smaller number of seeds. The Internet network also exhibits a similar phenomenon in Fig. 3b. In this case, HDA and HD can only find 80% influencers at the firstorder transition of CITM algorithm, missing a substantial amount of nodes with lower degree but indispensable in integrating the collective influence of highdegree seeds.
Although the performance of Kcore can be improved by adaptive calculation in Fig. 2, for largescale real networks, we do not display the result of KsA due to its O(N^{2}) computational complexity and only show the curve of Kcore. One cause for the unsatisfactory result of Kcore is that it is not designed as a multiple spreaders finder since high Kcore nodes tend to form densely connected clusters in the same shell, which prevents the expanding of information cascade.
In Methods, we further compare CITM algorithm with other methods, including Betweenness Centrality (BC)^{30}, Closeness Centrality (CC)^{47} and Greedy Algorithm (GA)^{9}. Results from ER and SF networks suggest that CITM algorithm also outperforms computationally expensive BC, CC and GA.
Analysis of subcritical paths
With the CITM algorithm, we present an analysis of subcritical paths in cascading process. In Fig. 4a, we first display the evolution of the number of subcritical paths during the sequential activation process based on CITM ranking. We run LTM model for t = 0.5 on an ER network with size N = 10^{4} and average degree 〈k〉 = 6. Nodes are activated sequentially according to their ranks in CITM algorithm. At the time of each activation, the number of subcritical paths attached to the node is calculated. After the activation, nodes on the subcritical paths are activated automatically, as we did in the CITM algorithm. In Fig. 4a, the evolution of subcritical path number for CITM (L = 5, 10, 20) is displayed. For all L values, the number of subcritical paths peaks at the critical point, where the firstorder transition occurs. In addition, as L increases, the peak time of CITM is slightly shifted forward, while the peak value increases dramatically. As large numbers of subcritical paths imply a heavy computational burden, the majority of computation is concentrated around the critical point. Therefore, if we want to optimize the influence before the discontinuous transition, which is common in realworld applications, CITM algorithm becomes much more efficient since it avoids counting extremely long subcritical paths near the critical point.
We also examine the distribution of nodes’ activation time in a global cascading. In Fig. 4b, we report the distribution of activation time at the critical point for CITM (L = 5, 10, 20) and random selection of seeds. All the curves first decrease and then develop a second peak. Compared with the distribution of random selection, CITM has a much larger number of nodes getting activated at the second peak. More importantly, the increase of L in CITM algorithm will postpone the arrival of the second peak, which is similar to the previous finding on regular networks^{17}. In CITM algorithm with a larger L, longer subcritical paths are allowed during the calculation, as shown in the inset of Fig. 4b. Considering the size of optimal seeds in Fig. 4a and the distribution of activation time in Fig. 4b, a smaller L in CITM algorithm can expedite the global cascading, but at the expense of a few more seeds.
Discussion
Identification of superspreaders in LTM has great practical implications in a wide range of dynamical processes. However, the complicated interactions among multiple spreaders prevent us from accurately locating the pivotal influencers in LTM. In this work, we propose a framework to analyze the collective influence of individuals in general LTM. By iteratively solving the linearized message passing equations, we decompose into separate components, each of which corresponds to the contribution made by a single seed. Particularly, we find that the contribution of a seed is largely determined by its interplay with other nodes through subcritical paths. In order to maximize the active population, we develop a scalable CITM algorithm that is feasible for largescale networks. Results show that the proposed CITM algorithm outperforms other ranking strategies in synthetic random graphs and realworld networks. Our CITM algorithm can be employed in relevant applications such as viral marketing and information spreading in bigdata analysis.
Methods
Linearization of G_{i→j}
The conventional method to linearize the nonlinear function G_{i→j}(ν_{→}) is Taylor expansion around the fixed point 0: . However, for our specific function G_{i→j}, the gradient is constantly 0 according to Eq. (5). To avoid the degeneracy, other linear approximation method should be applied.
For a differentiable function and x, , the mean value theorem guarantees that there exists a real number c ∈ (0, 1) such that f(y) − f(x) = ∇f((1 − c)x + c y) ⋅ (y − x). Here ∇ is the gradient and ⋅ denotes the dot product. Set f = G_{i→j}, x = 0, and y = ν_{→}, we have . Notice that, if we set c = 0, the above equation becomes the classical linear Taylor expansion: , where the approximation accuracy is O(ν_{→}^{2}) ( ⋅  is the norm of vectors). In a network with N nodes and M undirected links, we define the norm as ν_{→} ≡ ∑_{ij}ν_{i} → _{j}/2M (2M is the number of directed links) so that ν_{→} is bounded below 1 for network size N → ∞.
To deal with the degeneracy of , we approximate G_{i→j}(ν_{→}) by setting c = 1 for small ν_{→}: . The approximation error can be calculated by . Recall that . In a finitesize network, for a small ν_{→} with elements ν_{i→j} ≤ 1, the gradient of each element is bounded according to Eq. (5). For all 2M elements, there exists a uniform upper bound for all the gradients . Applying the mean value theorem to the differentiable function , there should be a constant L such that for all the elements of . Summing up all the elements in , we conclude that . Therefore, the approximation error . This proves that the accuracy of the linear approximation is O(ν_{→}^{2}), which is same as the linear Taylor expansion.
In the CITM algorithm, we only select one seed at each time step. Here we directly examine the accuracy of the linear approximation when LTM is initiated by one single seed. Specifically, we run LTM dynamics with threshold t = 0.5 from each node in a scalefree network (N = 5,000, M = 7753, γ = 3). For each of these realizations, we plot the realistic ν_{→} value and its approximation in Fig. 5. As expected, the approximation is generally lower than the real value since loops are neglected. The correlation between real values and approximations is 0.9118, and a higher correlation 0.9437 is obtained in the logarithmic scale. Therefore, the linear approximation in each step of CITM algorithm is accurate. As more seeds are considered, the approximation accuracy will decrease gradually. The decreasing rate should be related to the number of short loops existing in the network. How the density of short loops affects the approximation accuracy will be further explored in future works.
More comparisons with competing methods
A growing number of methods aimed to rank nodes’ influence in networks have been proposed in previous studies. Here we introduce some of the most widely used competing methods and perform a thorough comparison with CITM algorithm.
High degree (HD)
Degree, defined as the number of connections attached to a node, is the most widelyused measure of influence^{29}. In HD method, we rank nodes according to their degrees in a descending order, and sequentially select them as information sources. For HD method, the selected hubs intend to link with each other due to the assortative mixing property, making their influence areas overlap significantly. In this case, the selected seeds could rarely be optimal. High degree adaptive (HDA) is the adaptive version of HD method. After each removal, the degree of each node is recalculated. Such adaptive procedure can usually mitigate the overlapping and improve the performance of HD.
Kcore (Ks)
Through a kshell decomposition process, Kcore method assigns each node a k_{S} value to distinguish whether it locates in the core region or peripheral area^{32}. In kshell decomposition, nodes are iteratively removed from the network according to their current degrees. During the removal, all the nodes are classified into different kshells. The Kcore method selects nodes within high kshells as the spreaders. In practice, single influential spreaders can be identified effectively by Kcore ranking, which has been confirmed by both simulations and realworld data^{12,13,14}. However, Kcore ranking has the disadvantage of severe overlap of seeds’ influence areas, and therefore performs poorly for multiple node selection. This limitation can be alleviated with an adaptive scheme where we recompute the Kcore after each removal. Since there exists many nodes in the same kshell, we select the node with the largest degree to further distinguish nodes within the highest kshell. Such Kcore adaptive (KsA) method can effectively enhance the performance of Kcore.
PageRank (PR)
PageRank is a popular ranking algorithm of webpages which was developed and used by search engine Google^{31}. Over the years, PageRank has been adopted in many practical ranking problems. Generally speaking, PageRank measures a webpage’s stationary visiting probability by a random walker following the hyperlinks in the network. As a special case of eigenvector centralities, PageRank evaluates the score of a node by taking into account its neighbors’ scores. Even though such scorepropagating mechanism works well for some purposes such as webpage ranking, an unfavorable consequence may be a heavy accumulation of scores near the highdegree nodes, specially for scalefree networks^{43}.
Greedy algorithm (GA)
In GA, starting from an empty set of seeds, nodes with the maximal marginal gain are sequentially added to the seed set. Kempe et al. have proven that for a class of LTM with the attribute of submodularity, GA has a performance guarantee of 1 − 1/e ≈ 63%, which means it could achieve at least 63% of real maximal influence^{9}. This result relies on the submodular property defined by a diminishing returns effect: the marginal gain from adding a node to the seed set S decreases with the size of S. It has been proven that several classes of LTM have submodular property, such as a random choice of thresholds. However, for LTM with a fixed threshold, it is not generally submodular. As a consequence, GA is not guaranteed to provide a such approximation of the optimal spreaders for general LTM. Furthermore, the greedy search of GA requires massive simulations, which makes GA unscalable and thus limits its application in largescale social networks.
Betweenness centrality (BC)
BC quantifies the importance of node i in terms of the number of shortest paths cross through it^{30}. Therefore, nodes with large BC usually occupy the pivotal positions in the shortest pathways connecting large numbers of nodes. In BC method, we select nodes with high BC scores as seeds. Although BC has been widely applied in social network analysis, its relatively high computational complexity makes BC prohibitive for largescale networks. A typical BC algorithm takes O(MN) to calculate for a network with N nodes and M links^{48}, which is still not applicable to modern social networks with millions of users.
Closeness centrality (CC)
Closeness centrality quantifies how close a node to other nodes in the network^{47}. Formally, CC is defined as the reciprocal of the average shortest distance of a node to others in a network. Thus, nodes with high CC values tend to locate at the center of network clusters or communities. In CC method, we pick the seeds according to nodes’ CC scores. Same as BC, CC also requires the heavy task of calculating all possible shortest paths. Thus the high computational cost of CC makes it infeasible for largescale networks.
MaxSum (MS)
F. Altarelli et al. developed a MaxSum algorithm aimed to find the initial configurations that maximized the final number of active nodes in threshold models. Precisely, the trajectory of nodes’ states is parametrized by a configuration t = {t_{i}, 1 ≤ i ≤ N} where is the activation time of node i (t_{i} = ∞ if inactive). By mapping the optimization onto a constraint satisfaction problem, an energyminimizing algorithm based on the cavity method of statistical physics is proposed. In the algorithm, a convolution process is employed to compute the MaxSum updates. The technical details of the derivation and implementation of the MS algorithm can be found in ref. 18. In some cases MS algorithm does not converge, then a reinforcement strategy is implemented^{18}. By imposing an external field slowly increasing over time with a growth rate r, the system is forced to converge to a higher energy, which increases with r. In addition, it requires O(r^{−1}) iterations to reach convergence. For a node of degree k and threshold m_{i}, each update takes operations^{18}. Precomputing the convolution can further save a factor of k − 1. Considering the updates of all N nodes for O(r^{−1}) iterations, the overall complexity of MS is . Therefore, the time complexity of MS depends on both the degree distribution of networks and the choice of threshold.
In Fig. 6, we provide the thorough comparisons of different methods on ER and SF networks (N = 10^{4}), including computationally expensive methods GA, BC and CC. We set T = 40 and a reinforcement parameter r = 1 × 10^{−4} in MS algorithm. For both homogeneous and heterogeneous networks, CITM shows a larger active population for a given fraction of seed q compared with other heuristic ranking strategies. We display the scaling of run time of CITM algorithm for ER networks with 〈k〉 = 6 and threshold t = 0.5 as a function of N in the inset of Fig. 6a. CITM algorithm with L = 3 is feasible for networks with size up to N = O(10^{8}) within run time of O(10^{5}) seconds, which can be applied to the modern largescale online social networks.
Modified CITM algorithm
The CITM algorithm is essentially a greedy approach based on CITM values. The success of CITM algorithm depends on whether the currently selected seed has potentials to create more subcritical nodes that are helpful for the early formation of giant subcritical cluster. In LTM, there exists a special case of subcritical nodes with threshold m = 1, which is defined as vulnerable vertices in previous literature^{36}. Different from general subcritical nodes, vulnerable vertices are naturally subcritical since they have threshold m = 1 and do not rely on the states of others. During the calculation, a node of degree k becomes vulnerable when its m − 1 neighbors are removed, leaving k − m + 1 links in the network. For ER networks with a low average degree, the limited number of remaining links of vulnerable vertices could only form fragmented clusters. In this case, CITM would bias to nodes connected to large numbers of small vulnerable clusters, such as a peripheral hub linked to numerous leaf nodes. Unfortunately, the activation of such small clusters provides little help to the formation of giant subcritical cluster. Because the scattered vulnerable clusters have very few links connected to existing nonsubcritical nodes, their activations are not effective in producing subsequent subcritical nodes. Moreover, once global cascade appears, these fragmented vulnerable clusters will be activated subsequently, without additional seeds. In this case, we heuristically propose a modified CITM (CITMm) algorithm by excluding vulnerable nodes in the calculation of CITM value. The performance of CITMm algorithm is displayed in Fig. 7 for ER networks with an average degree 〈k〉 = 4. The critical value q_{c} for CITMm is advanced compared to CITM algorithm. However, before the firstorder transition, CITMm cannot optimize the spreading and has substantially lower Q(q) than CITM. We should note that, CITMm presents a lower q_{c} only in the situation of fragmented vulnerable clusters. For ER networks with higher average degrees (e.g., 〈k〉 = 6) where relatively large vulnerable clusters emerge, CITM still predicts earlier firstorder transition.
Additional Information
How to cite this article: Pei, S. et al. Efficient collective influence maximization in cascading processes with firstorder transitions. Sci. Rep. 7, 45240; doi: 10.1038/srep45240 (2017).
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
Buldyrev, S. V., Parshani, R., Paul, G., Stanley, H. E. & Havlin, S. Catastrophic cascade of failures in interdependent networks. Nature 464, 1025–1028 (2010).
Watts, D. J. & Dodds, P. S. Influentials, networks, and public opinion formation. J. Consum. Res. 34, 441–458 (2007).
Rogers, E. M. Diffusion of Innovation(Free Press, New York, 1995).
Reis, S. D. et al. Avoiding catastrophic failure in correlated networks of networks. Nature Phys. 10, 762–767 (2014).
Kleinberg, J. Algorithmic Game Theory (Cascading Behavior in Networks: Algorithmic and Economic Issues)chapter 24, 613–632 (Cambridge University Press, Cambridge, 2007).
Domingos, P. & Richardson, M. Mining the network value of customers. In Proc. 7th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining 57–66 (ACM, 2001).
Valente, T. W. & Davis, R. L. Accelerating the diffusion of innovations using opinion leaders. Ann. Am. Acad. Polit. Soc. Sci. 556, 55–67 (1999).
Galeotti, A. & Goyal, S. Influencing the influencers: a theory of strategic diffusion. The RAND J. Econ. 40, 509–532 (2009).
Kempe, D., Kleinberg, J. & Tardos, É. Maximizing the spread of influence through a social network. In Proc. 9th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining. 137–146 (ACM, 2003).
Leskovec, J., Krause, A., Guestrin, C., Faloutsos, C., VanBriesen, J. & Glance, N. Costeffective outbreak detection in networks. In Proc. 13th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining. 420–429 (ACM, 2007).
Chen, W., Wang, Y. & Yang, S. Efficient influence maximization in social networks. In Proc. 15th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining. 199–208 (ACM, 2009).
Kitsak, M. et al. Identification of influential spreaders in complex networks. Nature Phys. 6, 888–893 (2010).
Pei, S. & Makse, H. A. Spreading dynamics in complex networks. J. Stat. Mech. 12, P12002 (2013).
Pei, S., Muchnik, L., Andrade Jr, J. S., Zheng, Z. & Makse, H. A. Searching for superspreaders of information in realworld social media. Sci. Rep. 4, 5547 (2014).
Morone, F. & Makse, H. A. Influence maximization in complex networks through optimal percolation. Nature 524, 65–68 (2015).
Morone, F., Min, B., Bo, L., Mari, R. & Makse, H. A. Collective Influence Algorithm to find influencers via optimal percolation in massively large social media. Sci. Rep. 6, 30062 (2016).
Altarelli, F., Braunstein, A., Dall’Asta, L. & Zecchina, R. Large deviations of cascade processes on graphs. Phys. Rev. E 87, 062115 (2013).
Altarelli, F., Braunstein, A., Dall’Asta, L. & Zecchina, R. Optimizing spread dynamics on graphs by message passing. J. Stat. Mech. 9, P09011 (2013).
Guggiola, A. & Semerjian, G. Minimal contagious sets in random regular graphs. J. Stat. Phys. 158, 300–358 (2015).
Mugisha, S. & Zhou, H. J. Identifying optimal targets of network attack by belief propagation. Phys. Rev. E 94, 012305 (2016).
Braunstein, A., Dall’Asta, L., Semerjian, G. & Zdeborová, L. Network dismantling. Proc. Natl. Acad. Sci. USA 113, 12368–12373 (2016).
Teng, X., Pei, S., Morone, F. & Makse, H. A. Collective influence of multiple spreaders evaluated by tracing real information flow in largescale social networks. Sci. Rep. 6, 36043 (2016).
Pei, S., Muchnik, L., Tang, S., Zheng, Z. & Makse, H. A. Exploring the complex pattern of information spreading in online blog communities. PLoS ONE 10, e0126894 (2015).
Radicchi, F. & Castellano, C. Leveraging percolation theory to single out influential spreaders in networks. Phys. Rev. E 93, 062314 (2016).
Hu, Y., Ji, S., Feng, L. & Jin, Y. Quantify and maximise global viral influence through local network information. arXiv preprint arXiv:1509.03484 (2015).
Lawyer, G. Understanding the influence of all nodes in a network. Sci. Rep. 5, 8665 (2015).
Quax, R., Apolloni, A. & Sloot, P. M. The diminishing role of hubs in dynamical processes on complex networks. J. R. Soc. Interface 10, 20130568 (2013).
Tang, S., Teng, X., Pei, S., Yan, S. & Zheng, Z. Identification of highly susceptible individuals in complex networks. Physica A 432, 363–372 (2015).
Albert, R., Jeong, H. & Barabási, A. L. Error and attack tolerance of complex networks. Nature 406, 378–382 (2000).
Freeman, L. C. Centrality in social networks conceptual clarification. Soc. Netw. 1, 215–239 (1978).
Brin, S. & Page, L. Reprint of: The anatomy of a largescale hypertextual web search engine. Computer networks 56, 3825–3833 (2012).
Seidman, S. B. Network structure and minimum degree. Soc. Netw. 5, 269–287 (1983).
Granovetter, M. Threshold models of collective behavior. Am. J. Sociol. 83, 1420–1443 (1978).
Schelling, T. C. Micromotives and macrobehavior(Norton, New York, 1978).
Valente, T. W. Network Models of the Diffusion of Innovations(Hampton Press, Cresskill, NJ, 1995).
Watts, D. J. A simple model of global cascades on random networks. Proc. Natl. Acad. Sci. USA 99, 5766–5771 (2002).
Baxter, G. J., Dorogovtsev, S. N., Goltsev, A. V. & Mendes, J. F. F. Bootstrap percolation on complex networks. Phys. Rev. E 82, 011103 (2010).
Goltsev, A. V., Dorogovtsev, S. N. & Mendes, J. F. F. kcore (bootstrap) percolation on complex networks: Critical phenomena and nonlocal effects. Phys. Rev. E 73, 056101 (2006).
Dorogovtsev, S. N., Goltsev, A. V. & Mendes, J. F. F. kcore architecture and kcore percolation on complex networks. Physica D 224, 7–19 (2006).
Schwarz, J. M., Liu, A. J. & Chayes, L. Q. The onset of jamming as the sudden emergence of an infinite kcore cluster. Europhys. Lett. 73, 560 (2006).
Melnik, S., Hackett, A., Porter, M. A., Mucha, P. J. & Gleeson, J. P. The unreasonable effectiveness of treebased theory for networks with clustering. Phys. Rev. E 83, 036112 (2011).
Hashimoto, K. Zeta functions of finite graphs and representations of padic groups. Adv. Stud. Pure Math. 15, 211 (1989).
Martin, T., Zhang, X. & Newman, M. E. J. Localization and centrality in networks. Phys. Rev. E 90, 052808 (2014).
Molloy, M. & Reed, B. A critical point for random graphs with a given degree sequence. Random Structures & Algorithms 6, 161–180 (1995).
Mislove, A. Online Social Networks: Measurement, Analysis, and Applications to Distributed Information Systems. PhD thesis, Rice University (2009).
Leskovec, J., Kleinberg, J. & Faloutsos, C. Graphs over time: densification laws, shrinking diameters and possible explanations. In Proc. 11th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining. 177–187 (ACM, 2005).
Bavelas, A. Communication patterns in tasks oriented groups. J. Acoust. Soc. Am. 22, 725–730 (1950).
Brandes, U. A faster algorithm for betweenness centrality. J. Math. Sociol. 25, 163–177 (2001).
Acknowledgements
This work was supported by NIHNIBIB 1R01EB022720, NIHNCI U54CA137788/ U54CA132378, NSFPoLS PHY1305476, NSFIIS 1515022, and ARL Cooperative Agreement Number W911NF0920053, the ARL Network Science CTA (to H.A.M.), as well as US NIH grant GM110748 and the Defense Threat Reduction Agency contract HDTRA115C0018 (to J.S.).
Author information
Authors and Affiliations
Contributions
S.P., X.T, J.S., F.M. and H.A.M. designed research, performed study, analyzed data, and wrote the paper. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Rights and permissions
This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
About this article
Cite this article
Pei, S., Teng, X., Shaman, J. et al. Efficient collective influence maximization in cascading processes with firstorder transitions. Sci Rep 7, 45240 (2017). https://doi.org/10.1038/srep45240
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/srep45240
This article is cited by

Leveraging neighborhood and path information for influential spreaders recognition in complex networks
Journal of Intelligent Information Systems (2023)

Multisource detection based on neighborhood entropy in social networks
Scientific Reports (2022)

Cycletree guided attack of random Kcore: Spin glass model and efficient messagepassing algorithm
Science China Physics, Mechanics & Astronomy (2022)

Social network node influence maximization method combined with degree discount and local node optimization
Social Network Analysis and Mining (2021)

Influence maximization algorithm based on reducing search space in the social networks
SN Applied Sciences (2020)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.