# Influence Maximization for Fixed Heterogeneous Thresholds

## Abstract

Influence Maximization is a NP-hard problem of selecting the optimal set of influencers in a network. Here, we propose two new approaches to influence maximization based on two very different metrics. The first metric, termed Balanced Index (BI), is fast to compute and assigns top values to two kinds of nodes: those with high resistance to adoption, and those with large out-degree. This is done by linearly combining three properties of a node: its degree, susceptibility to new opinions, and the impact its activation will have on its neighborhood. Controlling the weights between those three terms has a huge impact on performance. The second metric, termed Group Performance Index (GPI), measures performance of each node as an initiator when it is a part of randomly selected initiator set. In each such selection, the score assigned to each teammate is inversely proportional to the number of initiators causing the desired spread. These two metrics are applicable to various cascade models; here we test them on the Linear Threshold Model with fixed and known thresholds. Furthermore, we study the impact of network degree assortativity and threshold distribution on the cascade size for metrics including ours. The results demonstrate our two metrics deliver strong performance for influence maximization.

## Introduction

Cascading processes emerge naturally through the interactions of nodes in different states in natural and human-made networks. Microscopic processes can potentially have large macroscopic impact on networks. In the case of human-made networks, their ever-increasing size and interconnectedness exponentially increases the uncanny impact of cascade processes. For instance, in financial or power grid networks, small initial perturbations or failures can result in cascades in the network causing tremendous disasters of global impact1,2,3. In social networks, contact processes, namely social influence (or contagion), enable the spread of new behaviors, opinions and products, driving politics, social movements and norms, and viral marketing.

The key challenge in predicting such cascading processes is the identification of nodes whose change of state can potentially affect large portions of the networks. It is a computationally hard problem, and as such, multiple heuristics, theoretical analyses and algorithms have been introduced to solve it4,5,6. Some are designed to address the specific nature of cascade processes, while others are based on more general algorithmic approaches or network based centrality measures. Such algorithms can be used to minimize disasters by, for example, re-enforcing weak nodes in power-grid nodes7,8,9, or placing sensors to detect the contamination in water pipe network10. Likewise, arresting the spread of infectious disease requires a global awareness of its existence11,12,13,14. Understanding cascades is also important for optimizing viral marketing15,16,17. Yet, it is challenging to find the set of initiators (also called seeds) which, when put into a new state (opinion/idea/product), will maximize the spread of this state18,19,20,21,22,23,24,25,26,27,28.

Here, we study the problem of influence maximization for a classical opinion contagion model, namely the Linear Threshold Model (LTM)29,30. Yet our methods can be used for any percolation-based model. The LTM is designed to capture the peer pressure dynamics that lead an individual to accept a new state being propagated. It is a binary state model, where a node i has either adopted a new product/state/opinion, ni = 1, or not, ni = 0. In the LTM, each node in the network has a fractional threshold, an intrinsic parameter representing the node’s resistance to peer pressure. The spreading rule is that an inactive node (ni = 0), with in-degree $${k}_{i}^{{\rm{in}}}$$ and threshold ϕi, adopts a new opinion only when the fraction of its neighbors j ∂i holding the new opinion is higher than the node’s threshold, that is $${\sum }_{j\in \partial i}\,{n}_{j}\ge {\varphi }_{i}{k}_{i}^{{\rm{in}}}$$. The process is deterministic and once a node adopts a new opinion it cannot return to its previous state. The integer number of active neighbors required for node i to get active is given by its initial resistance $${r}_{i}={\varphi }_{i}{k}_{i}^{{\rm{in}}}$$. Naturally, the maximum resistance of a node is kin. At each step of the spread, the resistance is decreased by the number of the node’s neighbors that adopted a new opinion. A node gets activated through spread when its resistance drops to zero or below, ri ≤ 0. Bootstrap percolation31,32 is an alternative formulation of the LTM where the thresholds are not fractional, but integer (resistance). Interestingly, LTM and bootstrap percolation conceptually share similarities with the integrate-and-fire-neuron model33,34,35,36, with the main differences being that in the later, activation of a node is probabilistic rather than a fixed threshold value, and return to the initial (inactive) state ni = 0 is allowed. The size of cascades in the LTM is governed by the thresholds of the nodes37,38, the size of the initiator set39, the selection of initiators28, and of course, the structure of the underlying network40,41,42,43,44.

Examples of LTM-type spread mechanisms and of the heterogeneity of the thresholds are provided through a number of controlled experiments45,46,47 and by empirical data analysis48,49,50,51,52. Unicomb et al.53 studied the threshold model in weighted networks and found that the time of cascade emergence depends non-monotonically on weight heterogeneities. Watts and Dodds38 showed through simulations of various types of spread mechanisms that the cascade size is governed not by superspreaders, but by a small critical set of nodes with low resistance to influence. Karampourniotis et al. showed that the threshold distribution is important for the overall dynamics37. In particular, with an increasing standard variation σ of thresholds (while holding the average of the thresholds fixed) a smaller initiator fraction is required for global cascades. Furthermore, they showed that in the vicinity of σ ≈ 0 a tipping point appears as the required fraction of randomly selected initiators gradually increases. Yet, with gradually increasing variance σ, eventually the tipping point is replaced by smooth transition. In addition, Watts and Dodds38 showed that a critical fraction of nodes with high susceptibility contributes to social influence much more than initiators with high network centrality.

Hence, the knowledge of thresholds or their distribution is critical for influence maximization algorithms. In the case of zero information about the thresholds or their distribution, a good assumption to make is that the threshold distribution is uniform. This is a very interesting case for which the spread function is submodular, that is, it follows a diminishing returns property18, which can be used for maximizing the influence10,18,19,20,21,24,54,55. In general, submodularity does not hold when the thresholds are known and fixed or for any threshold distribution but the uniform. For the cases of fixed known thresholds, the influence of any seed set can be computed in polynomial time56. Further, in the special case of a unique threshold for all nodes, a first-order transition appears39,57,58. Then a powerful algorithm, namely CI-TM with complexity $${\mathscr{O}}(N\,\mathrm{log}\,N)$$, provides great performance28. In ref.59 the authors express the influence maximization problem as a constraint-satisfaction problem and use believe propagation to solve it. Yet, for the case of identical thresholds it does not perform as well as the CI-TM with which it was compared in28. Other analytical based metrics show the importance of network structure, but only for a small number of initiators60. Furthermore, in61 the authors propose to use of an evolutionary algorithm implemented with general-purpose computing on graphics processing units (GPGPU) to tackle the challenge of combinatorics, at the additional cost of higher time and memory complexity. The authors show that their approach clearly outperforms the greedy algorithm for known thresholds both in cascade size and time, but it is currently limited to graphs of size in the order of N = 103.

Here, we study the efficiency of known selection strategies for fixed (and known) heterogeneous thresholds generated from different threshold distributions, and a range of assortativity values. We introduce two new and very different selection strategies for the LTM with fixed thresholds and compare them in terms of their performance with a number of other strategies, including the CI-TM, and greedy. Since we focus on fixed (and known) thresholds we do not include the performance of various network centrality measures like the Page Rank and k-core39, which do not take into account the provided threshold information and thus are outperformed by the strategies that do.

## Selection Strategies

We use many fast heuristics, which take advantage of the knowledge of thresholds. Since the thresholds are fixed and known, the cascade size caused by an initiator is deterministic. Hence, we sequentially introduce initiators on the inactive subgraph of the original network. First, the node with the highest dynamic fractional threshold (thres) is a reasonable choice. Likewise, a natural selection is the node with the highest dynamic out-degree $${k}_{i}^{{\rm{out}}}$$ (i.e., counting only edges to currently inactive nodes) at each step (deg). Another possible heuristic for the LTM is the selection of the node with the highest resistance (res) at each step. Resistance ri is the current (dynamic) integer threshold of node i, defined as the number of active neighbors required for the node to get activated. Accordingly, when a node is activated by a cascade or by being selected as an initiator, its resistance turns zero, and so a fully activated network has total resistance of zero.

The selection of any inactive node i as an initiator lowers the resistance of all its inactive neighbor nodes by one, for a total decrease of $${k}_{i}^{{\rm{out}}}$$. Moreover, if any neighbor of i had resistance equal to one, it will also get activated, further reducing the resistance of other nodes. In addition, if node i is the initiator, then its resistance is reduced to zero, ri = 0. Therefore, the total reduction of the entire graph resistance is at least $${r}_{i}+{k}_{i}^{{\rm{out}}}$$. To capture the resistance drop at the direct neighbors of node i, termed direct drop (DD), we introduce the heuristic strategy DD, with metric $${{\rm{DD}}}_{i}={r}_{i}+{k}_{i}^{{\rm{out}}}$$. In addition, we introduce the heuristic method indirect drop of resistance (ID), by summing the DD metric and the drop of the resistance of the inactive subgraph caused by the neighbors of the node i which are indirectly activated by the selection of i as seed. That is $${{\rm{ID}}}_{i}={r}_{i}+{k}_{i}^{{\rm{out}}}+{\sum }_{j\in \partial i|{r}_{j}=1}({k}_{j}^{{\rm{out}}}-1)$$. The total drop of the network’s resistance caused by choosing i as an initiator is at least as high as IDi; it is more if the spread expands beyond the direct neighborhood (e.g the second or further neighborhoods). The ID heuristic is equivalent to the CI-TM algorithm28 for a sphere of influence L = 1 with the addition of the resistance, ri, of the selected node i in the metric. For very large L, a node’s i CI-TM score is essentially (assuming a tree-like approximation of the network) equal to the drop of the network’s total resistance if i was the seed, minus node’s i resistance ri. The metric of CI-TM is governed by the out-degree of the nodes surrounding the target node ignoring the challenge of activating nodes with high resistance and/or low in-degree. For comparison to our methods, we apply the CI-TM algorithm itself (for L = 6), and the greedy algorithm for fixed thresholds, where at each step the node which causing the maximum cascade size is selected.

### Balanced Index Strategy

Constructing a selection strategy mainly based on the network structure or just on the resistance of the nodes, is not ideal, since useful information is not being utilized. On one hand, selecting nodes solely based on some network centrality metric, leads to many easily susceptible nodes being selected as initiators, nodes that could potentially be activated through spread. On the other hand, aiming at selecting high resistance nodes, does remove spread obstacles but does not guarantee they will be great influencers. The DD and ID strategies aim to address this weakness by using intuitive heuristics. To quantify the interplay between the importance of low resistance and high centrality nodes, we introduce the Balanced Index (BI) selection strategy. For this strategy, we assign weights (a, b, c) to each term of IDi to capture the importance of each feature, that is

$${{\rm{BI}}}_{i}=a{r}_{i}+b{k}_{i}^{{\rm{out}}}+c\sum _{j\in \partial i|{r}_{j}=1}({k}_{j}^{{\rm{out}}}-1),$$
(1)

where a + b + c = 1 and a, b, c ≥ 0. The optimal weights for influence maximization are determined by scanning within the ranges of weights in the ensemble of graphs and for various threshold distributions. In this case, the out-degree (deg) strategy corresponds to (a, b, c) = (0, 1, 0), res to (a, b, c) = (1, 0, 0), the CI-TM for L = 1 to (a, b, c) = (0, 1/2, 1/2), while the two heuristics we introduced, DDi and IDi, correspond to weights (a, b, c) = (1/2, 1/2, 0) and (a, b, c) = (1/3, 1/3, 1/3) respectively. Interestingly, the weighted metric BIi can be viewed as a measure (units) of resistance, however, in general, it does not correspond to the network’s total resistance drop when i is the seed. As far as the time complexity of each method is concerned $${\mathscr{O}}(\langle k\rangle N+N\,\mathrm{log}\,N)$$ the computation of a seed’s (or set of seeds) induced spread takes $${\mathscr{O}}(\langle k\rangle N)$$ time. Yet, (similar to28) when computing the spreading process for sparse graphs, we can place a stop condition on the algorithm “L levels” away from the seed node, reducing the complexity by $${\mathscr{O}}(N)$$. In addition, using a heap structure, re-ordering the highest BI nodes takes $${\mathscr{O}}(N\,\mathrm{log}\,N)$$. Thus, the time complexity of these methods for sparse graphs reduces to $${\mathscr{O}}(N\,\mathrm{log}\,N)$$.

### Group Performance Index algorithm

All of the above strategies are essentially local in nature, since they aim to maximize the number of activated nodes or to reduce the total resistance of the system caused by one initiator at a time. They lack in their metrics the impact of the combination of initiators on influence maximization, which by default limits their performance. Algorithms that use combinations of nodes in their metrics can lead to high-quality approximate global solutions. However, look-ahead algorithms suffer from the potentially prohibitive computational costs. For instance, to measure the total impact of a subset of g nodes selected from the total of N nodes, a brute force algorithm would require $$(\begin{array}{c}N\\ g\end{array})$$ selections of possible initiator sets. It’s complexity would be $${\mathscr{O}}(\langle k\rangle {N}^{g+1})$$, which would be prohibitively computationally expensive except for very small g.

Instead, a probabilistic look-ahead algorithm would aim to reduce the number of combinations by randomly selecting initiators. That is, at each step t, in order to measure the impact of a node i in the presence of other nodes, i would have to be selected as an initiator. Then, the remaining initiators would be randomly selected. This process would be repeated v times, each time recording the cascade size. We would have essentially measured the impact of node i as an initiator in the presence of randomly selected sets of initiators. We would repeat this process for all other inactive nodes, and finally select the node with the highest impact.

Here, we introduce (Alg. 1) the Group Performance Index algorithm (GPI). With GPI we target the nodes which, when included in any randomly selected initiator set (group), cause the group to have higher than average performance. GPI shares similarities with the probabilistic look-ahead, however it is much more efficient. First, we take advantage of the property that permutations of any set of initiators do not impact the total cascade size returned by that set for the LTM. By not having to scan each node individually when computing its impact in the presence of other initiators, we reduce the number of computations by $${\mathscr{O}}(N)$$. Moreover, for the probabilistic look-ahead algorithm we would be selecting each initiator one-by-one, each time having to update the impact of each node by re-running simulations.

We select $$\lceil sN\rceil$$ initiators (instead of one-by-one, where s (0, 1)) defines granularity of initiator set increases, thus reducing the complexity by another $${\mathscr{O}}(N)$$ factor. Also, when randomly picking nodes as test-initiators for our metric, we do not predefine the order of selecting initiators, but we pick them randomly one by one from the inactive nodes. Finally, we aim to maximize the cascade size for a specific number of initiators, which is essentially our cost budget. However, the impact of even a small fraction of initiators can potentially have a large impact on the cascade size, especially near a tipping point. That means, a nearby tipping point can be missed because of fixed seed budget. To address this, we aim to minimize the size of the initiator set in order for the cascade size to be at least as large as a specific predefined fraction of nodes, Sgoal. However, in general, GPI can also be used when constraining either the seed budget, or computational time.

Let us start with the initial graph G(V, E, r), where V(G) is the set of N nodes, E(G) is the set of edges of the graph, while ri is the resistance of each node iV(G). Our goal is to find the initiator set Y such that the fraction of nodes activated by it satisfies the inequality f(Y)/N ≥ Sgoal, where the function f(X) expresses the number of nodes that got activated from the set X (here, we also include the initiator nodes in f(X)), see Alg. 1. To do so, at each step t we select the set Q of $$\lceil sN\rceil$$ nodes with the highest GPI-ranking (we will define it below) as initiators. Then, we compute the cascade induced by Q on the graph with cascade induced by nodes in Y already included in graph G and we include the Q set of nodes in the initiator set Y by updating Y = YQ. Finally, we update the spread size, and update G(V, E, r) (reducing the resistance, and removing all activated nodes and their edges).

As stated above, at any step t we look for the nodes with the highest GPI value, that is, the nodes which, when present in the initiator set, cause the desired cascade size to be reached (on average) with a small initiator set size. To measure the expected GPI, a large enough number v of simulations is required. Each simulation j is run on a series of graphs with the initial one defined as Gtest = G. The simulation stops when the desired cascade size $$\lceil {S}_{{\rm{goal}}}N\rceil$$ is reached. For each simulation j, we randomly select one-by-one an inactive node, place it on the initially empty set Ytest,j, then we compute the spread, and update Gtest accordingly. Each simulation stops when f(Ytest,j) ≥ SgoalN − f(Y).

Let nj,i be 1 when iYtest,j, and 0 otherwise, informing whether node i belongs to set Ytest,j. At the beginning of each simulation, Ytest,j is empty, hence, nj,i for each node i is initially zero. Then, for each node i that belongs to Ytest,j, GPI metric can be expressed analytically as

$${{\rm{G}}{\rm{P}}{\rm{I}}}_{i}=\frac{\sum _{j=1}^{v}|{Y}_{{\rm{t}}{\rm{e}}{\rm{s}}{\rm{t}},j}|{n}_{j,i}}{\sum _{j=1}^{v}{n}_{j,i}},{\rm{f}}{\rm{o}}{\rm{r}}\,i\,{\rm{s}}{\rm{u}}{\rm{c}}{\rm{h}}\,{\rm{t}}{\rm{h}}{\rm{a}}{\rm{t}}\sum _{j=1}^{v}{n}_{j,i} > 0$$
(2)

The numerator of GPIi is the sum of sizes of the randomly selected initiator sets |Ytest,j| in which node i is present. Since we select inactive nodes uniformly at random, the nodes do not appear in the initiator sets equal number of times. If that was not the case (that is if all nodes were equally frequently chosen just like for the probabilistic look-ahead we mentioned above), the numerator of the fraction of Eq. 2 would be a sufficient metric, where the smaller the sum is the larger the impact of node i is. The presence of the denominator is necessary to normalize the number of times node i is selected as an initiator. In addition, because we only select inactive nodes, the nodes which are more likely to be activated through spread, that is typically nodes with low resistance and high in-degree, are going to be less frequently a part of the initiator set than others. And so, nodes with a large number of appearances are nodes less likely to be activated by diffusion than others.

Since GPI deals with the expected impact of nodes, it is by default slower than the rest of the strategies but can potentially find much better initiator sets than other strategies do. Computing the GPI of each node takes $${\mathscr{O}}(v\langle k\rangle N)$$, since, we randomly select one-by-one test-initiators and compute the spread $${\mathscr{O}}(\langle k\rangle N)$$ (which for sparse graphs becomes $${\mathscr{O}}(N)$$) until the Sgoal is satisfied, and finally we repeat the process v times. Sorting the nodes based on their GPI ranking takes $${\mathscr{O}}(N\,\mathrm{log}\,N)$$ using a heap structure. Finally, for each Q, computing the spread induced from the highest GPI-ranked takes $${\mathscr{O}}(\langle k\rangle N)$$. Thus, the complexity for each batch of seeds Q is $${\mathscr{O}}(v\langle k\rangle N+N\,\mathrm{log}\,N+\langle k\rangle N)$$, so $${\mathscr{O}}(v\langle k\rangle N+N\,\mathrm{log}\,N)$$ for v 1. Since the final size of the seed set |Y| is $${\mathscr{O}}(N)$$, we require $$\lceil |Y|/\lceil sN\rceil \rceil$$ steps which is $${\mathscr{O}}(\mathrm{1/}s)$$, hence the final complexity is $$1/s\ast {\mathscr{O}}(v\langle k\rangle N+N\,\mathrm{log}\,N)$$. From our experience, for a good estimation of the expected GPI value of each node the number of randomizations v should be of the order of the system size N, $${\mathscr{O}}(N)$$. Thus, the worst case time complexity becomes $$1/s\ast {\mathscr{O}}(\langle k\rangle {N}^{2}+N\,\mathrm{log}\,N)$$. In addition, it’s possible to control the size of the computation of the spread any initiator would induce on a sphere of influence L (see28). Then, under the assumption of sparse graphs the spread computation is an $${\mathscr{O}}(1)$$ process, hence the total complexity becomes $$1/s\ast {\mathscr{O}}(\langle k\rangle N+N\,\mathrm{log}\,N)$$; which, for sparse graphs with average degree independent of the system size N, it becomes $$\mathrm{1/}s\ast {\mathscr{O}}(N\,\mathrm{log}\,N)$$. Hence, GPI becomes competitive in terms of complexity with the best-known solutions. Furthermore, for the case of an identical threshold for all nodes, since there is a sharp phase transition point (and small spread otherwise), the computation of spread size is even faster.

For the reminder of the paper, unless otherwise specified, we set the control parameters of GPI as s = 10−3, v = 105, and Sgoal = 0.5, and will compute the full spread size induced by any initiator node. Those value were chosen based on performance of alternatives. Indeed, v/s defines the computational budget for finding a solution, so for fair comparison of different values of v and s, we need to keep v/s constant. Hence, a smaller value of s means that v needs to be kept low resulting in poor selection of seeds due to unreliable estimate of GPI. In contrast, large s means that we have large v which results in good selection of seeds, but also large Q, so these seeds are likely to become obsolete before they are replaced because graph may change much after less than |Q| seeds are added. Finally, when s > 1/N, then there is a non-zero probability that a (small fraction) of selected initiators will be activated from a previously selected initiator. For those cases, we excluded the activated initiators from the final initiator set.

## Results

We are comparing the performance (cascade size Seq) of the strategies for the entire parameter space of network assortativity ρ, and threshold distribution with fixed average threshold $$\bar{\varphi }=0.5$$ and varying standard deviation σ. In Fig. 1 we present our main results for the ensemble of ER graphs for the extreme cases of high positive (ρ = 0.9) and high negative (ρ = −0.9), and neutral (ρ = 0) assortativity, measured with Spearman’s rank correlation coefficient ρ62. Furthermore, we examine the cases of a identical thresholds (σ = 0), a uniform threshold distribution (σ = 0.287), and a truncated normal distribution in between (σ = 0.2). For the GPI strategy we present the critical initiator fraction for which the Sgoal is satisfied. First, focusing especially on ER graphs (ρ = 0) we notice that as we move from a threshold distribution with standard deviation σ = 0 to larger σ, there is a change from a first-order phase transition to a smooth crossover also seen for randomly selected initiators in37. Interestingly, in the case of the uniform threshold distribution (σ = 0.287) at the ensemble level, we observe that all the direct methods appear to have diminishing returns with increasing cascade size, that is, the contribution to the cascade size of any additional initiator in an initiator set is diminishing as the initiator set is becoming larger.

As far as the performance of the strategies is concerned, the degree (deg) strategy’s relative performance is decreasing for larger σ’s, while the resistance strategy’s performance is increasing. In addition, CI-TM which incorporates a network structure decomposition using the neighboring nodes with the information about resistance v = 1 in it as metric, is out-performing the degree strategy for the case of σ = 0 and ρ = 0 but it is not performing as well in the rest of cases. On the other hand, the ID approach is outperforming the degree, the resistance and the CI-TM strategy for all cases of ρ and σ. Naturally, the introduced weighted strategy is outperforming in all cases the strategies that incorporates their ranking metrics (deg, res, CI-TM, DD, ID), especially for Seq = 0.5 which is what we optimized it for here.

The GPI strategy largely outperforms the rest of the strategies in all cases except for the case of very high assortativity ρ with identical thresholds (σ = 0). Yet, for a desired cascade size of Seq = 0.5 with even lower s and higher v the performance of GPI improves. The strong performance of GPI in the case of ER graphs (ρ = 0) with a identical threshold σ = 0 reveals the importance of the combination of initiators for Influence Maximization. We have used a s = 10−3 fraction of initiator and v = 105, even though the best resolution we could achieve for a graph with size N would be s = 1/N, because then the initiators are inserted one-by-one. Additionally, we demostrate the performance of our strategies against ER graphs with varying average degree, as well empirical networks (see Figs 1 and 2 of the Supplementary Information).

To further study the direct methods, we evaluate their performance in the assortativity space ρ (Fig. 2) and the threshold distribution space σ (Fig. 3) for Seq = 0.5. Evaluating through ρ for σ = 0, we observe a highly non-monotonic behavior for all the strategies. Between the range of approximately −0.8 ≤ ρ ≤ 0.4, CI-TM is outperforming the degree strategy, which is approximately in the same regime, in which ID is outperforming all other direct strategies. Yet, for ρ ≥ 0.5 DD is the best strategy. With increased deviation of the thresholds σ = 0.20 (Fig. 2b), the performance of the strategies which depend more on the network structure like the degree and CI-TM is getting worse, while strategies which give higher importance to the resistance of the node, like res, DD and ID are performing better. Finally, for a uniform threshold distribution σ = 0.2887 (Fig. 2c), we observe that strategies show a convex response to ρ, with ID being the best strategy (for a desired cascade size Sgoal = 0.5). On the other hand, the threshold (thres) strategy appears to be independent of ρ for thresholds generated randomly with σ = 0.2887. Finally, from Fig. 3 we observe that ID has the best performance compared to all the direct strategies over nearly all of the entire range of σ, making it the best overall strategy (excluding the BI and GPI strategies).

In order to better study the performance of each strategy, we additionally examined the probability of any strategy being the best one (Fig. 4) for the same initiator fraction p. In particular, we tested the performance of all strategies at a fixed randomly generated ER network, for 200 different threshold generations. The actual cascade size Seq vs. initiator fraction p can be seen in the Supplementary Information Fig. 3a (average) and Fig. 3b (50 runs). GPI remains superior even for a very small number of initiators.

First, we notice that the greedy algorithm is in all cases outperforming all other strategies for a small initiator fraction, while for a very large initiator fraction all strategies have the same performance, because all of the network is activated. For an ER graph (ρ = 0) with σ = 0 the spread is minimal until the phase transition point has been reached, and CI-TM leads until the tipping point for ID has been reached. Since the metric of CI-TM takes into account the out-degree of the nodes, and does not consider the effort required to activate nodes with high resistance and low in-degree, it is outperforming other methods for smaller initiator sizes, but eventually gets surpassed, when the nodes with high resistance with a structural importance have not been activated. However, for very low (ρ = −0.9) and high (ρ = 0.9) degree assortativity, there are multiple initiator fractions for which a large spread occurs, which vary for the strategies, allowing for a sudden change of ‘lead’ between the four network depend strategies (CI-TM, ID, deg, and DD), with DD and ID performing the best. For larger σ the importance of resistance increases while the importance of the network structure declines, making the strategies more depended on resistance to take the ‘lead’, while also reducing the number of sharp ‘lead’ changes.

Next, we focus on the BI and GPI strategies and their performance for their different parameters. For the BI strategy, we scan the parameters space a × b and record the average minimum pc at which the cascade size is Sgoal = 0.5 (Fig. 5). The second and third feature of this weighted method defined by Eq. 1 correspond to the first two terms of the CI-TM metric. The three features are interdependent, e.g. before the cascade begins with σ = 0, a node’s i resistance ri is nearly linearly proportional to its degree ki, which is why we observe those linear contours on the plots a, d, e. Moreover, it is clear that any strategy that would exclude the resistance (a = 0) from its metric, such as the CI-TM, will have inferior performance. The contours indicate that the importance of the resistance and degree of a node relative to the third feature, which in addition is computationally most costly to obtain. Furthermore, we have recorded the impact of the standard deviation σ on the optimal weights (Fig. 6). As σ increases, the optimal c coefficient decreases. Interestingly, the most important feature is the resistance (a ≈ 0.53), then the degree (b ≈ 0.32), and the smallest importance is left for c ≈ 0.15. This result is especially important since other strategies do not fully utilize the resistance information combined with other network centrality measures. We further record the performance the optimal weights for BI against the degree assortativity of the networks (see Fig. 4 of the Supplementary Information).

For the GPI strategy, Figs 7 and 8 we show its performance of GPI in relationship to the number of randomizations v and step sizes s, respectively. On average, with increasing v and decreasing s we always minimize pc for obtaining a cascade desired size (here we aim at the size N/2). On average, we expect and observe an asymptotic return with increasing v. For computational efficiency, we fix the s and v when the additional performance is minimal. Further investigation is required in order to find the interplay between the two control parameters in order to optimize the performance of the algorithm for the smallest computational time possible. Interestingly, for σ = 0.2878 in contrast to the direct methods, there is a large transition on cascade size as we reach Sgoal.

## Discussion

The challenge of Influence Maximization for the LTM or other diffusion processes is finding low complexity, yet well performing algorithms for the discovery of superspreaders. We tackle this challenge by introducing two different approaches. On our first approach we take advantage of the combination of different node features: the resistance to influence, the out- degree, and the impact of its activation to its second neighborhood. Those features essentially capture the resistance drop of the network. By placing weights between them and constructing the BI metric, we are able to study the importance of each of those features for a variety of network structures (degree assortativity) and threshold distributions. We discovered that resistance is often the most impactful of the features. E.g., for bidirectional graphs, the cascade size is governed not by initiators with high network centrality measures but by high resistance nodes when selected as an initiator. Moreover, a past research further demonstrates that the cascade size is governed not by superspreaders but by a critical mass of low resistance nodes being connected to each other38. These results emphasize the importance of resistance to adoption in dynamic processes.

In addition, we optimized those weights for influence maximization. Among the strategies with similar or lower complexity, BI always outperforms them for any degree assortativity or threshold distribution. Even in the case of non-optimized weights, like considering equal weights between the three features (ID strategy) or just the resistance and out-degree (DD), our method is out-performing all other strategies with similar or lower complexity ($${\mathscr{O}}(\langle k\rangle N+N\,\mathrm{log}\,N)$$, which reduces to $${\mathscr{O}}(N\,\mathrm{log}\,N)$$ for sparse graphs when using a sphere of influence to approximately compute the spread).

Yet, most strategies (including ours above), are based on heuristic/analytical metrics that do not take into consideration the combination of nodes, leading to local solutions of reduced size of initiators’ set. Our second approach (GPI) focuses on the random combination of nodes for influence maximization, thus targeting a global optimum. It allows us to control a number of parameters which in return control the performance and computational time. The time complexity of GPI is $$\mathrm{1/}s\ast {\mathscr{O}}(\langle k\rangle {N}^{2}+N\,\mathrm{log}\,N)$$, which reduces to $$\mathrm{1/}s\ast {\mathscr{O}}(N\,\mathrm{log}\,N)$$ for sparse graphs when using a sphere of influence to approximately compute the spread. Our results show that the GPI metric performs better than any strategy against we compared it for almost any initiator size, threshold distribution, and network assortativity. To say the least, GPI serves as a benchmark for (synthetic) graphs and sets a minimum bound for the optimal initiator set. Finally, in terms of applicability, both our approaches can be used for directed and weighted graphs as well, although a few adjustments would have to be made for the weighted strategy in case of weighted graphs.

Our two approaches, combining node features, and combining nodes, show there are more possible improvements to be made on both the performance and time-complexity for Influence Maximization. New methods could simultaneously take into account the network and model specific node properties as well as the combination of nodes. Other methods could possibly focus on learning to discover important node features for instance. As far as GPI is concerned, a number of improvements can be made for controlling the number of repetitions v while keeping the algorithm performance approximately the same.

## Methods

For the generation of Erdős-Rényi (ER) graphs63 we used the G(N, pER) model with N being the system size and pER the probability that a random node will be connected to any node in the graph. The probability pER is given by pER = 〈k〉/(N − 1), where 〈k〉 is the nominal average degree in the network. The probability of the existence of a disconnected component is 4.5 × 10−5 for 〈k〉 = 10 and N = 104.

The degree assortativity was first introduced by Newman64 to describe the connectivity between neighboring nodes with different degrees. To measure it we use Spearman’s ρ62. ER graphs have ρ = 0 degree assortativity. To control the degree assortativity, we use the method applied in65.

As far as the thresholds are concerned, they are bound between 0 and 1. The threshold distributions are truncated to generate numbers between the above two bounds37. The standard deviation for a uniform threshold distribution for these bounds is $$\sigma =1/\sqrt{12}\approx 0.2887$$. The truncated threshold distribution P(ϕ, σ) is given by $$P(\varphi ,\sigma )=N(\mu ,\tau )/(1-{\int }_{-\infty }^{0}N(\mu ,\tau )d\mu -{\int }_{1}^{\infty }N(\mu ,\tau )d\mu )$$ for 0 ≤ ϕ ≤ 1, and P(ϕ, σ) = 0 anywhere else, similar to37. In the above, N(μ, τ) is the normal distribution with mean μ and standard deviation τ, which take values 0 ≤ μ ≤ 1 and 0 ≤ σ ≤ ∞ respectively.

## References

1. 1.

Crucitti, P., Latora, V. & Marchiori, M. A topological analysis of the Italian electric power grid. Physica A 338(1-2), 92–97 (2004).

2. 2.

Kinney, R., Crucitti, P., Albert, R. & Latora, V. Modeling cascading failures in the North American power grid. Eur. Phys. J. B 46, 101–107 (2005).

3. 3.

Hines, P., Balasubramaniam, K. & Sanchez, E. C. Cascading failures in power grids. IEEE Potentials 28(5), 101–107 (2009).

4. 4.

Mugisha, S. & Zhou, H. J. Identifying optimal targets of network attack by belief propagation. Phys. Rev. E 94, 012305 (2016).

5. 5.

Zhou, H. J. Structural resilience of directed networks. arXiv preprint, arXiv:1701.03404 (2016).

6. 6.

Braunstein, A., Dall’Asta, L., Semerjian, G. & Zdeborová, L. Network dismantling. Proc. Natl. Acad. Sc. USA 113, 12368–12373 (2016).

7. 7.

Motter, A. & Lai, Y.-C. Cascade-based attacks on complex networks. Phys. Rev. E 66, 065102 (2002).

8. 8.

Wang, J.-W. & Rong, L.-L. Cascade-based attack vulnerability on the US power grid. Saf Sci 47(10), 1332–1336 (2009).

9. 9.

Asztalos, A., Sreenivasan, S., Szymanski, B. K. & Korniss, G. Cascading failures in spatially-embedded random networks. PLOS ONE 9(1), e84563 (2013).

10. 10.

Leskovec J. et al. Cost-effective Outbreak Detection in Networks. 13th ACM SIGKDD, 420–429 (2007).

11. 11.

Kitsak, M. et al. Identification of influential spreaders in complex networks. Nat. Phys. 6, 888–893 (2010).

12. 12.

Pastor-Satorras, R., Castellano, C., Mieghem, P. V. & Vespignani, A. Epidemic processes in complex networks. Rev. Mod. Phys. 87, 925 (2015).

13. 13.

Altarelli, F., Braunstein, A., Dall’Asta, L., Wakeling, J. R. & Zecchina, R. Containing epidemic outbreaks by message-passing techniques. Phys. Rev. X 4, 021024 (2014).

14. 14.

Malliaros, F. D., Rossi, M.-E. G. & Vazirgiannis, M. Locating influential nodes in complex networks. Sci. Rep 87, 925 (2016).

15. 15.

Domingos, P. & Richardson, M. Mining the network value of customers. 7th ACM SIGKDD, 57–66 (2001).

16. 16.

Richardson, M. & Domingos, P. Mining knowledge-sharing sites for viral marketing. 8th ACM SIGKDD, 61–70 (2002).

17. 17.

Barbieri, N. & Bonchi F. Influence maximization with viral product design. SIAM ICDM, 55–63 (2014).

18. 18.

Kempe, D., Kleinberg, J. & Tardos, É. Maximizing the spread of influence through a social network. 9th ACM SIGKDD, 137–146 (2003).

19. 19.

Chen, W., Yuan, Y. & Zhang, L. Scalable Influence Maximization in Social Networks under the Linear Threshold Model. IEEE ICDM, 88–97 (2010).

20. 20.

Goyal, A., Lu, W. & Lakshamanan, L. V. S. CELF++: Optimizing the Greedy Algorithm for Influence Maximization in Social Networks. ACM WWW, (Companion Volume) (2011).

21. 21.

Goyal, A., Lu, W. & Lakshamanan, L. V. S. SIMPATH: An Efficient Algorithm for Influence Maximization under the Linear Threshold Model. 11th IEEE ICDM, 211–220 (2011).

22. 22.

Wang, C., Chen, W. & Wang, Y. Scalable influence maximization for independent cascade model in large-scale social networks. Data Min. Knowl. Disc. 25(3), 545–576 (2012).

23. 23.

Jankowski, J. et al. Sequential Seeding in Complex Networks: Trading Speed for Coverage. Sci. Rep. 7, 891 (2017).

24. 24.

Jiang, Q. et al. Simulated Annealing Based Influence Maximization in Social Networks. 25th AAAI, 127–132 (2011).

25. 25.

Lü, L. et al. Vital nodes identification in complex networks. Physics Reports 650, 1–63 (2016).

26. 26.

Shakarian, P., Eyre, S. & Paulo, D. A scalable heuristic for viral marketing under the tipping model. Soc. Netw. Anal. Min. 3, 1225–1248 (2013).

27. 27.

Morone, F. & Makse, H. A. Influence maximization in complex networks through optimal percolation. Nature 524, 65–68 (2015).

28. 28.

Pei, S., Teng, X., Shaman, J., Morone, F. & Makse, H. Efficient collective influence maximization in threshold models of behavior cascading with first-order transitions. Sci. Rep. 7, 45240 (2017).

29. 29.

Granovetter, M. Threshold Models of Collective Behavior. Am. J. Sociol. 83, 1420–1443 (1978).

30. 30.

Schelling, T. C. Hockey helmets, concealed weapons, and daylight saving: A study of binary choices with externalities. J. Confl. Resolut. 17, 381–428 (1973).

31. 31.

Baxter, G. J., Dorogovtsev, S. N., Goltsev, A. V. & Mendes, J. F. F. Bootstrap percolation on complex networks. Phys. Rev. E 82, 011103 (2010).

32. 32.

Baxter, G. J., Dorogovtsev, S. N., Goltsev, A. V. & Mendes, J. F. F. Heterogeneous k-core versus bootstrap percolation on complex networks. Phys. Rev. E 83, 051134 (2011).

33. 33.

Amini, H. Bootstrap percolation in living neural networks. J Stat Phys 141, 459–475 (2010).

34. 34.

Eckmanna, J.-P. et al. The physics of living neural networks. Physics Reports 449(1–3), 54–76 (2007).

35. 35.

Kozma, R., Puljic, M., Balister, P., Bela Bollobás, B. & Freeman, W. J. Phase transitions in the neuropercolation model of neural populations with mixed local and non-local interactions. Biol. Cybern. 92, 367–379 (2005).

36. 36.

Lymperopoulos, I. N. & Ioannou, G. D. Online social contagion modeling through the dynamics of Integrate-and-Fire neurons. Inf Sc 320, 26–61 (2015).

37. 37.

Karampourniotis, P. D., Sreenivasan, S., Szymanski, B. K. & Korniss, G. The Impact of Heterogeneous Thresholds on Social Contagion with Multiple Initiators. PLoS One 10(11), e0143020 (2015).

38. 38.

Watts, D. J. & Dodds, P. S. Influential, networks, and public opinion formation. J. Cons. Res. 34, 441–458 (2007).

39. 39.

Singh, P., Sreenivasan, S., Szymanski, B. K. & Korniss, G. Threshold-limited spreading in social networks with multiple initiators. Sci. Rep. 3, 2330 (2013).

40. 40.

Gleeson, J. P. Cascades on correlated and modular random networks. Phys. Rev. E 77, 046117 (2008).

41. 41.

Ikeda, Y., Hasegawa, T. & Nemoto, K. Cascade dynamics on clustered network. J. Phys.: Conf. Ser. 221, 012005 (2010).

42. 42.

Lee, K.-M., Brummitt, C. D. & Goh, K.-I. Threshold cascades with response heterogeneity in multiplex networks. Phys. Rev. E. 90, 062816 (2014).

43. 43.

Nematzadeh, A., Ferrara, E., Flammini, A. & Ahn, Y.-Y. Optimal network modularity for information diffusion. Phys Rev. Lett. 113, 088701 (2014).

44. 44.

Curato G. & Lillo, F. Optimal information diffusion in stochastic block models. Phys. Rev. E 94(3) (2016).

45. 45.

Latané, B. & L’Herrou, T. Spatial Clustering in the Conformity Game: Dynamic Social Impact in Electronic Groups. J. Pers. Soc. Psychol. 70, 1218–1230 (1996).

46. 46.

Centola, D. The Spread of Behavior in an Online Social Network Experiment. Science 329, 5996 (2010).

47. 47.

Monsted, B., Sapiezynski, P., Ferrara E. & Lehmann S. Evidence of Complex Contagion of Information in Social Media: An Experiment Using Twitter Bots arXiv preprint, arXiv:1703.06027 (2017).

48. 48.

Romero, D. M., Meeder, B. & Kleinberg J. Differences in the mechanics of information diffusion across topics: Idioms, political hashtags, and complex contagion on twitter. In Srinivasan, S. et al. (eds) ACM WWW 20, 695–704 (2011).

49. 49.

Karsai, M., Iñiguez, G., Kikas, R., Kaski, K. & Kertész, J. Local cascades induced global contagion: How heterogeneous thresholds, exogenous effects, and unconcerned behaviour govern online adoption spreading. Sci. Rep. 6, 27178 (2016).

50. 50.

Fink, C., Schmidt, A., Barash, V., Cameron. C. & Macy, M. Complex contagions and the diffusion of popular Twitter hashtags in Nigeria. Soc. Netw. Anal. Min. 6(1) (2016)

51. 51.

Fink C. et al. Investigating the Observability of Complex Contagion in Empirical Social Networks. 10th AAAI, 121–130 (2016)

52. 52.

State, D. & Adamic, L. The Diffusion of Support in an Online Social Movement: Evidence from the Adoption of Equal-Sign Profile Pictures, Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, pp. 1741–1750 (ACM, New York, NY, 2015).

53. 53.

Unicomb, S., Iñiguez, G. & Karsai, M. Threshold driven contagion on weighted networks. Sci Rep 8, 3094 (2018).

54. 54.

Tang, Y., Xiao, X. & Shi, Y. Influence Maximization: Near-Optimal Time Complexity Meets Practical Efficiency. ACM SIGMOD15, 75–86 (2014).

55. 55.

Liu, X. et al. IMGPU: GPU-Accelerated Influence Maximization in Large-Scale Social Networks. IEEE Trans. Parallel. Distrib. Syst. 25(1), 136–145 (2014).

56. 56.

Lu, Z., Zhang, W., Wu, W., Kim, J. & Fu, B. The complexity of influence maximization problem in the deterministic linear threshold model. J. Comb. Optim. 24, 374–378 (2012).

57. 57.

Watts, D. J. A simple model of global cascades on random networks. Proc. Natl. Acad. Sci. USA 99, 5766–5771 (2002).

58. 58.

Gleeson, J. P. & Cahalane, D. J. Seed size strongly affects cascades on random networks. Phys. Rev. E 75, 056103 (2007).

59. 59.

Altarelli, F., Braunstein, A., Dall’Asta, L. & Zecchina, R. Optimizing spread dynamics on graphs by message passing. J. Stat. Mech. 9, P09011 (2013).

60. 60.

Lim, Y., Ozdaglary, A. & Teytelboymz, A. A Simple Model of Cascades in Networks (2015).

61. 61.

Weskida, M. & Michalski, R. Evolutionary Algorithm for Seed Selection in Social Influence Process. IEEE/ACM ASONAM 17, 1189–1196 (2016).

62. 62.

Hovstad, R. & Litvak, N. Degree-Degree Dependencies in Random Graphs with Heavy-Tailed Degrees. Internet Math 10, 287–334 (2014).

63. 63.

Erdős, P. & Rényi, A. On random graphs. Publ. Math. Debrecen 6, 290–297 (1959).

64. 64.

Newman, M. E. J. Assortative mixing in networks. Phys. Rev. Lett. 89, 208701 (2002).

65. 65.

Molnár, F. Jr. et al. Dominating Scale-Free Networks Using Generalized Probabilistic Methods. Sci. Rep. 4, 6308 (2014).

## Acknowledgements

The authors thank Prof. Radoslaw Michalski for his comments on this work. This work was supported in part by the Army Research Office grant W911NF-12-1-0546, by the Army Research Laboratory under Cooperative Agreement Number W911NF-09-2-0053, by the Office of Naval Research Grant No. N00014-09-1-0607 and N00014-15-1-2640. B.K.S. and G.K. were also supported by the Defense Advanced Research Projects Agency (DARPA) and the Army Research Office (ARO) under Contract No. W911NF-17-C-0099, and B.K. was also supported by the National Science Centre, Poland, project no. 2016/21/B/ST6/01463. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies either expressed or implied of the Army Research Laboratory or the U.S. Government.

## Author information

Authors

### Contributions

P.D.K., B.K.S. and G.K. designed the research; P.D.K. implemented and performed numerical experiments and simulations; P.D.K., B.K.S. and G.K. analyzed data and discussed results; P.D.K., B.K.S. and G.K. wrote, reviewed, and revised the manuscript.

### Corresponding author

Correspondence to P. D. Karampourniotis.

## Ethics declarations

### Competing Interests

The authors declare no competing interests.

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

Reprints and Permissions

Karampourniotis, P.D., Szymanski, B.K. & Korniss, G. Influence Maximization for Fixed Heterogeneous Thresholds. Sci Rep 9, 5573 (2019). https://doi.org/10.1038/s41598-019-41822-w

• Accepted:

• Published:

• ### Identifying influential spreaders in reversible process

• Junyi Qu
• , Ming Tang
• , Ying Liu
•  & Shuguang Guan

Chaos, Solitons & Fractals (2020)