Abstract
The evolution processes of complex systems carry key information in the systems’ functional properties. Applying machine learning algorithms, we demonstrate that the historical formation process of various networked complex systems can be extracted, including protein-protein interaction, ecology, and social network systems. The recovered evolution process has demonstrations of immense scientific values, such as interpreting the evolution of protein-protein interaction network, facilitating structure prediction, and particularly revealing the key co-evolution features of network structures such as preferential attachment, community structure, local clustering, degree-degree correlation that could not be explained collectively by previous theories. Intriguingly, we discover that for large networks, if the performance of the machine learning model is slightly better than a random guess on the pairwise order of links, reliable restoration of the overall network formation process can be achieved. This suggests that evolution history restoration is generally highly feasible on empirical networks.
Similar content being viewed by others
Introduction
As generic representations of vastly different complex systems, complex networks1,2,3 are widely used in different areas across biology4,5,6,7, ecology8,9, social science10,11, etc. Networks represent the internal interactions between the various components within the systems. For these networked complex systems, evolution is their most striking feature. However, what distinct underlying mechanisms do they follow when evolving from simple structures to the current complex forms? How do patterns and functionalities emerge during the evolutionary process of the networks? What are the future directions of evolution? These are key scientific questions about complex systems that have challenged the academic community for a long time.
The structures of most complex networks from biology, ecology, and human society are very complicated. Characteristics such as hierarchical community structure2, (dis)assortativity12, local clustering13, motifs14, etc., are ubiquitous in complex networks. These make it challenging to comprehensively capture the evolution mechanisms that generated such complex structures with concise rules, as existing researches on the evolution of complex networks typically only focus on certain specific features of real-world networks. For instance, the well-known preferential attachment (PA) mechanism15 can only explain the scale-free property of a network’s degree distribution but not other features, and sometimes even lead to contradictions with other features (e.g., networks generated by PA have zero local clustering coefficient16 and no communities17).
In this work, by employing graph neural network (GNN) models, we demonstrate that the evolution process of a network can be reconstructed with high precision. Validated computationally, our developed theory indicates that such reconstruction can be done reliably even with slightly better than a random guess on the pairwise temporal order of links. The recovered evolution trajectories enable us to discover concise rules in the complex evolution process of networks, and capture the emerging process of key characteristics of a network that previous theories were unable to capture collectively with concise rules (e.g., community structure, local clustering, (dis)assortativity, etc.). In addition, we show that such high-resolution evolution trajectories have important practical applications in facilitating network structure prediction, interpreting the evolution of protein-protein interaction networks, as well as revealing the co-evolution mechanisms of preferential attachment and community structure.
Results
Methodological framework
The main purpose of this study is to restore the growing edge sequence for an evolving network based on its final structure (see Fig. 1a). We achieve this goal in two steps using machine learning techniques (illustrated in Fig. 1b, c). First, for networks where a small fraction of the edge generation sequence is available, we build a supervised machine learning model leveraging the network topology and known history to infer the formation process of the entire network. Second, for networks where only the final structure is available, we adopt a transfer learning approach18 in which a machine learning model trained on a similar network as described in the first step is applied to the target network.
In the first step, the edges in the final structure of a network with partial evolution history (Network A) are embedded into a low-dimensional space19,20,21,22,23. Then the edges are paired and used to train the machine learning model for predicting the relative generation order of any two edges in the network. Note that the training set includes only edge pairs with known generation order which can be directly obtained from the evolution history. The concrete model proposed here is an ensemble model consisting of six comparative paradigm neural network (CPNN) models24 and a classical edge feature (see Supplementary Fig. S1). Once the predicted generation order of any two edges is obtained, a ranking algorithm, the Borda’s method25, is applied to find an ordered sequence of all edges so that the formation process of the full network can be recovered accordingly. More details of our approach with regard to embedding the edges, building the ensemble model, and implementing the ranking algorithm are provided in the Methods section and the Supplementary Sections 1 and 2. In cases where the purpose is to restore high temporal resolution of a network’s historical evolution process from very low temporal resolution data like the case in some of the biological/ecological networks, this first step is enough for the purpose. In certain applications where even the low resolution of a network’s evolution history is unknown, we then proceed to the next step. In the second step, the edges in a network of the same domain without any historical information (Network B) are embedded into a low-dimensional space and aligned with that of Network A through a linear transformation, which is the key to successful transfer learning (details in Methods section). Lastly, the ensemble model trained on Network A as well as the same ranking algorithm in the first step can be used to infer the formation history of Network B.
Restoration of network evolution trajectory
To demonstrate the effectiveness of the proposed method, we apply it to 17 real-world networks with multiple snapshots of their evolving processes. The 17 networks include five protein-protein interaction (PPI) networks26,27,28, a world trade web29,30, six collaboration networks31,32, two animal interaction networks33,34, and three transportation networks35 (full listing is given in Supplementary Section 3). The generation time of an edge is assigned as the timestamp of the snapshot in which it appears for the first time. In this way, the relative generation order of edges from different snapshots can be obtained. Depending on the granularity of the snapshots, different networks have varying amounts of edge pairs with distinguishable generation orders.
The performance of the proposed approach in restoring the network formation process with partial history is quite satisfactory (the comparison between restored, random, and real evolution trajectories for some networks can be seen in Supplementary Section 4 and the Supplementary Movie 1–3). First of all, it is surprising that we only need a small percentage of edge pairs to train the ensemble model to obtain high accuracy. We define x to be the number of edge pairs with correctly predicted generation order divided by the total number of edge pairs in the test set. As Fig. 2a shows, the pairwise accuracy x of the ensemble model in predicting the relative generation order of any two edges increases rapidly to over 75% as more edge pairs are used to train the model and saturates when the percentage reaches just 5% (more results can be found in Supplementary Section 5 and Supplementary Fig. S8). While x represents the accuracy of the intermediate results of our approach, we are also interested in quantifying the error of the final output, i.e., the restored temporal sequence of edges. Let \({{{{{{{\mathcal{E}}}}}}}}\) denote the overall error of the restored edge sequence, we would like to further explore how is \({{{{{{{\mathcal{E}}}}}}}}\) related to x. Denote αi as the position of edge i in the true edge sequence (e.g., αi = i, larger αi means that edge i joined the network later) and \({\widehat{\alpha }}_{i}\) as its corresponding position in the output sequence of our approach. Then α = (α1, α2, …, αE) and \(\widehat{{{{{{{{\boldsymbol{\alpha }}}}}}}}}=({\widehat{\alpha }}_{1},{\widehat{\alpha }}_{2},\ldots,{\widehat{\alpha }}_{E})\) are the ground-truth sequence and the restored sequence, respectively. Thus, \({D}_{i}={\alpha }_{i}-{\widehat{\alpha }}_{i}\) measures the error of edge i so that the overall error \({{{{{{{\mathcal{E}}}}}}}}\) of the entire sequence can be defined as the root-mean-squared error (RMSE) normalized by E, i.e.,
This definition of the overall error is theoretically equivalent with other measures for assessing the correlation between two ordered sequences, including the Kendall’s τ36 and Spearman’s ρ37 (please refer to the Supplementary Section 6 for more details). We choose the \({{{{{{{\mathcal{E}}}}}}}}\) in Eq. (1) as the measure of performance because its physical meaning is more intuitive compared to the other measures. After mathematical derivation (see details in the Methods section and Supplementary Section 6), the theoretical relationship between \({{{{{{{\mathcal{E}}}}}}}}\) and x is
where \(x \, \gg \, 0.5+\frac{1}{4\sqrt{E}}\).
Equation (2) shows that the overall error of the restored edge sequence is inversely proportional to the square root of the number of edges, suggesting that our approach has a huge advantage for networks with a rich number of edges. In other words, when the number of edges is large enough, we only need a machine learning model with accuracy slightly better than a random guess for predicting the relative generation order of any two edges to make the overall error small. This is a really nice property and consistent with the results shown in Fig. 2b.
Investigating further on this point, the distributions of Di/E (see Fig. 2c) are bell-shaped and symmetric about zero with the spread of the distribution determined by E and x, i.e., the spread decreases with E and x. While these results are based on simulations with fine-grained ground-truth sequence, the one we have in practice is typically coarse-grained. Therefore, we also draw the distributions of Di/E with coarse-grained ground-truth sequence for real-world networks (see Fig. 2d, e). The results demonstrate that the distributions of Di/E based on real data are in accordance with those obtained by simulations which reflect the theoretical results. For details on drawing Fig. 2c–e, please refer to the diagram shown in Fig. 2f and the pseudo code in the Methods section. However, it is worth noting that for real-world networks that lack fine-grained ground truth, it is a challenging problem to verify the credibility of the restored network evolution trajectory. This is a generic problem for many machine learning techniques. A preliminary discussion on this topic is provided in the Supplementary Section 7.
Transfer learning
Finally, the performance of our transfer learning approach in restoring the network formation process for networks without any historical information is explored. We compare the performance of transfer learning (i.e., aligning the vector representations of Network B with that of Network A, see details in the Methods section and the Supplementary Section 8) with that of direct validation (the vector representations of Network B are fed directly into the ensemble model trained on Network A). The results on different synthetic network models15,38,39 are summarized in Table 1. We can see that the accuracy of transfer learning is much higher than that of direct validation, indicating that our approach is able to restore network formation processes well with only the final structure.
Interpretation of the evolution of PPI network
Having been able to reliably reconstruct the evolution history of networked systems, we can carry out rich scientific investigations based on the reconstructed edge sequence, ranging from understanding the evolution or emergence of functional properties, extracting fundamental evolution mechanisms, to even facilitating practical problems like structural predictions for future evolution of complex networks. Here we show that our restored edge sequence can help understand the evolutionary process of living systems. The evolution trajectory of PPI networks is critical for understanding the fundamental mechanisms of cellular processes and the emergence of complexity of life forms. This enables researchers to gain insights into the function of protein organization40, the development of new biological functions41, and the selection mechanisms driving network evolution42. However, to the best of our knowledge, there is no complete data on the evolution trajectory of PPI so far due to the lack of paleontological data. This is where our network restoration method comes into play.
By applying our method to PPI networks, we find that proteins with specific functions appear in an order reflecting the evolutionary patterns of life. Take the PPI network for fungi as an example, Fig. 3a shows the restored network snapshot corresponding to the immemorial times which exhibits some distinct cluster structures. Interestingly, we find that nearly every cluster is composed of proteins with consistent functionality. According to the order of the edges, we count the absolute number of proteins by function over time and calculate the proportion of proteins with different functions added (see Fig. 3b, c). These results suggest that the evolution of the PPI network focused early on basic functions at the molecular level like protein synthesis and gene expression regulation (e.g., [J] translation, ribosomal structure, and biogenesis), then shifted to the maintenance of genetic information, and eventually towards advanced functions at the cellular level like cell division and inheritance of genetic material (e.g., [D] cell cycle control, cell division, chromosome partitioning). Note that we arrive at it based solely on the limited historical information of the PPI network without referring to much biological knowledge. We believe that our work provides biologists with a novel way to explore more principles underlying the evolution of complex life.
Revealing the evolution mechanisms
We then show that our restored edge generation sequence not only enables us to reproduce the growth mechanisms with the same preferential strength as the original network, but also to observe richer mechanisms related to community structures in the network other than preferential attachment (PA). PA is a commonly-known mechanism in the growth of real-world networks, producing networks with power-law degree distributions15,43,44. To date, researches on the growth mechanisms of networks with power-law degree distributions have been largely confined to PA or its variants while deeper, especially those about sub-network functions, remain an under-explored area.
From Fig. 4a–c, it is observed that the restored growth process of many real-world networks shows the PA phenomenon with the same strength as the original network, demonstrating that our method can well capture the growth mechanism of the networks and the results are highly reliable (the detailed information can be found in Supplementary Section 9). Then taking the PPI network for fungi as an example, we investigate the meso-level evolution process of real-world PPI networks on the basis of our restored results. Concretely, a meso-level protein network is constructed with each node being a protein functional community, i.e., a collection of proteins with the same function. Edges between proteins with the same function in the original PPI network are reflected as self-connected edges in the new network. The upper row of Fig. 4d displays the evolution process represented by the adjacency matrices of the meso-level protein network based on our restored edge sequence while the lower row provides those obtained when new edges are added purely according to the PA rule. By comparison, we find that the growth process of our restored network is significantly different from that under the pure PA mechanism. Specifically, the restored results show that newly added edges tend to connect proteins within the same community, allowing the PPI network to maintain a strengthened community structure during growth. On the contrary, newly added edges tend to connect proteins between communities under the pure PA mechanism, weakening the existing community structure in the evolution process. The adjacency matrix and protein function network based on the real network is displayed in Fig. 4h, i, showing that our restored network highly agrees with the real network. Figure 4g further demonstrates that our restoring method captures the strong community structure in the real network while the pure PA rule fails to achieve. The restored co-evolution of community structure and preferential attachment provides commendable data support for understanding the relationship between the structure and function of networks.
Moreover, we also study how likely that nodes with similar degree tend to be connected (i.e., degree-degree correlations12) and how clustered the connections are (i.e., local clustering13). Figure 5 displays the results for selected real-world networks and the full results can be found in Supplementary Section 9. The big gap among the results based on our restored edge sequences, the random edge sequences, and the edge sequences assuming pure PA rule along with the high concordance between the restored and the real edge sequences demonstrate that rich characteristics of a network can be recovered based on the restored evolution process.
Facilitating structure prediction
Structure or link prediction is a task that aims to predict new edges based on existing ones in a network, which is widely used in drug development45,46,47, protein interaction prediction4,6 and recommendation systems48,49. Here we show that the edge generation order produced by our method can be used in link prediction and improve the prediction accuracy significantly. Specifically, we regard the network whose edge generation sequence has been restored by our approach as a tensor, denoted by Z with elements \({{{{{{{\bf{Z}}}}}}}}({i}_{1},{i}_{2},{\widehat{\alpha }}_{i})\) which takes value 1 if edge i is generated at position \({\widehat{\alpha }}_{i}\) and 0 otherwise (i1, i2 are the two nodes of edge i), and employ the collapsed weighted tensor method50 to define a weighted adjacency matrix X with entries \({{{{{{{\bf{X}}}}}}}}({i}_{1},{i}_{2})={{{{{{{\bf{Z}}}}}}}}({i}_{1},{i}_{2},{\widehat{\alpha }}_{i})\times {\theta }^{\max (\widehat{\alpha })-{\widehat{\alpha }}_{i}}\) (θ ∈ (0, 1)). Then by applying the truncated singular value decomposition algorithm (TSVD)50 on X, the predicted scores for all candidate edges to be added in the future can be obtained. The candidates with larger predicted scores are more likely to be added in the future. Figure 6 clearly demonstrates that the restored edge generation order can significantly improve the link prediction performance up to several times for some networks. Significant improvements can also be found by implementing other classical link prediction algorithms besides TSVD51,52 on our restored edge sequence (see more results in Supplementary Section 10). It is noteworthy that after a decade of development, the design of link prediction algorithms has hit a roadblock and it is not easy to achieve such a significant performance boost.
Discussion
The problem of restoring the system structure is of great importance in many fields. In this article, we address the fundamental problem of restoring the structure evolution trajectory of networked complex systems, and demonstrate that the problem can be resolved with high accuracy based on graph neural network techniques, especially for networks with a large number of edges. With the restored edge formation history, the performance of link prediction algorithms can be greatly improved and the network evolution mechanisms can be revealed.
Note that there are some limitations in this work: 1) We assume that the edges in a network will always exist after they are generated. However, in many real-world systems, many nodes and edges diverge or even disappear. 2) For many real-world networks, there may be only a small number of edge pairs with time information (i.e., edge pairs with distinguishable generation order) and the generation time of these edge pairs may be biased. For example, for the five PPI networks used in this work, there are only a few snapshots and edges with time information are mostly from the last snapshot. In this case, how to measure the credibility of the restoration results is also a problem worthy of in-depth study. 3) Our current transfer learning technique can only be successfully implemented on artificially synthesized networks with similar generation mechanisms. The application of transfer learning to real-world networks requires further exploration. Our work is just the beginning, not the end, of the researches in this field. Nevertheless, we believe that our research provides a novel path and approach for understanding the structure formation of networked complex systems, the relationship between structure and functionality, as well as the practical application of complex networks in a broad range of research fields including life science, brain science, ecology, information science, etc.
Methods
The embedding methods
In our approach to restore the temporal sequence of edges for an evolving network, we first obtain the low-dimensional vector representation for each edge. Two types of representation methods are implemented in this work. One is network embedding, which learns low-dimensional representations of nodes in a network based on its topology. After getting the vectors of all nodes, the vector representation of an edge is computed as the Hadamard product of the corresponding two node vectors. Specifically, five popular node embedding methods are applied, namely Node2Vec19, DeepWalk20, SDNE23, LINE21, and Struct2Vec22. The other one is a vector consisting of eleven classical edge features (see Supplementary Section 1 for details). With five vectors obtained by the five network embedding methods and one vector of edge features, we have six vector representations \({{{{{{{{\bf{e}}}}}}}}}_{i}^{1},{{{{{{{{\bf{e}}}}}}}}}_{i}^{2},\ldots,{{{{{{{{\bf{e}}}}}}}}}_{i}^{6}\) for edge i.
The ensemble model
An important step of our approach is to predict the relative generation order of any two edges with a machine learning model. In our work, an ensemble model consisting of six CPNN models is proposed, each taking the vector representations of two edges \({{{{{{{{\bf{e}}}}}}}}}_{i}^{l}\) and \({{{{{{{{\bf{e}}}}}}}}}_{j}^{l}\) (l = 1, 2, …, 6) as input. Each CPNN model outputs a probability that edge i is added to the network later than edge j, generating six probabilities \({o}_{i}^{1},{o}_{i}^{2},\ldots,{o}_{i}^{6}\). Moreover, we select the feature that has the highest prediction accuracy in the training set among the eleven edge features as the “best feature” and obtain an additional output \({o}_{i}^{7}\) based on it (e.g., \({o}_{i}^{7}=1\) if edge i has a larger value on the best feature than edge j and \({o}_{i}^{7}=0\) otherwise). The final output of the ensemble model is a weighted average of all seven outputs:
where the weights w1, w2, …, w7 satisfy \(\mathop{\sum }\nolimits_{l=1}^{7}{w}_{l}=1\) and are determined by grid search during training.
The ranking algorithm
In our approach, the Borda’s method, a voting-based ranking algorithm, is used to find an ordered sequence of all edges based on the predicted generation order of any two edges. Specifically in our setting, the relative generation order of any two edges is considered a ranking result so that the Borda count for edge i is
where uij = 1 if edge i is newer than edge j and uij = 0 otherwise. Then the temporal sequence of all edges from old to new is determined by ranking the edges by their Borda count in ascending order.
The theoretical relationship between \({{{{{{{\mathcal{E}}}}}}}}\) and x
A brief mathematical derivation of the theoretical result about the relationship between the overall error \({{{{{{{\mathcal{E}}}}}}}}\) of the restored sequence and the accuracy x of the ensemble model is provided here. Without loss of generality, assume that the ground truth sequence is \({{{{{{{\boldsymbol{\alpha }}}}}}}}=({\alpha }_{1},{\alpha }_{2},\ldots,{\alpha }_{E})=(\frac{1}{E},\frac{2}{E},\ldots,1)\) (normalized by the number of edges E). For the uij in Eq. (4), its expectation and variance are (in subsequent derivation, the counts are normalized by E for convenience)
Then for the Borda count ui, its expectation is
The approximation is obtained since (E + 1)/E ≈ 1 for large E. Treating E and x as constants, E(ui) is a linear function of i with two boundaries E(u1) = 1 − x and E(uE) = x. In other words, the normalized Borda counts of the E edges are evenly distributed over the interval [1 − x, x]. According to the mean field theory, the position \({\widehat{\alpha }}_{i}\) of edge i in the restored sequence \(\widehat{{{{{{{{\boldsymbol{\alpha }}}}}}}}}\) should be the length from 1 − x to ui divided by the total length of the interval 2x − 1, i.e.,
Then the expectation and variance of \({\widehat{\alpha }}_{i}\) are (plugging in Eqs. (5) and (6))
Therefore, \({\widehat{\alpha }}_{i}\) is an unbiased estimate of αi so that the mean-squared error is just the variance and the root-mean-squared error is the standard deviation, as stated by Eq. (2).
Pseudo code for the simulations in Fig. 2
To better explain the simulations involved in Fig. 2, we provide the pseudo code to implement the simulations. The essential idea is that in the simulations, we only need to specify the pairwise accuracy x to obtain the restored sequence for a fine-grained ground-truth sequence of edges, i.e., no need to actually pass through an ensemble model to obtain the generation order of each edge pair.
Algorithm 1
Pseudo code to compute Di/E to plot Fig. 2b, c
Inputs: number of edges E, pairwise accuracy x, number of repetitions R.
Assuming that the ground-truth sequence of edges {e1, …, eE} is α = (1, 2, …, E), form the set of all edge pairs \({\mathbb{S}}=\{({e}_{i},\, {e}_{j}):i,\, j=1,\ldots,\, E,\, i \, < \, j\}\), then \(| {\mathbb{S}}|=E(E-1)/2\). Let \(M=\lfloor | {\mathbb{S}}| \, * \, x\rfloor\).
for rep = 1 to R do
Step 1: Randomly select M pairs from S and assign the correct generation order to them; the remaining \(| {\mathbb{S}}| -M\) pairs are assigned the wrong order.
Step 2: Apply the ranking algorithm (i.e., Borda count) on the pairwise orders from Step 2 to get the restored sequence \(\widehat{{{{{{{{\boldsymbol{\alpha }}}}}}}}}=({\widehat{\alpha }}_{1},\, {\widehat{\alpha }}_{2},\ldots,\, {\widehat{\alpha }}_{E})\).
Step 3: Compute Di as \({D}_{i}=i-{\widehat{\alpha }}_{i}\) for i = 1, 2, …, E.
end for
Algorithm 2
Pseudo code to compute Di/E corresponding to “Real Data” in Fig. 2d, e
Inputs: a coarse-grained ground-truth sequence α, an ensemble model, number of repetitions R.
Let n be the number of snapshots in α and lk be the number of edges in the kth snapshot, then α = (1, …, 1, 2, …, 2, …, n, …, n) and \(\mathop{\sum }\nolimits_{k=1}^{n}{l}_{k}=E\), where E is the length of α.
Step 1: Obtain the restored sequence \(\widehat{{{{{{{{\boldsymbol{\alpha }}}}}}}}}=({\widehat{\alpha }}_{1},\, {\widehat{\alpha }}_{2},\ldots,\, {\widehat{\alpha }}_{E})\) by passing through our ensemble mod- el and ranking algorithm. Then \({\widehat{\alpha }}_{1} \, \ne \, {\widehat{\alpha }}_{2}\ne \cdots \ne \, {\widehat{\alpha }}_{E}\) and \({\widehat{\alpha }}_{i}\in \{1,\, 2,\ldots,\, E\}\).
for rep = 1 to R do
Step 2: Randomly assign fine-grained order to edges within the same snapshot to generate an intermediate sequence \({{{{{{{{\boldsymbol{\alpha }}}}}}}}}^{*}=({\alpha }_{1}^{*},\, {\alpha }_{2}^{*},\ldots,\, {\alpha }_{E}^{*})\), i.e., \({\alpha }_{1}^{*} \, \ne \, {\alpha }_{2}^{*} \, \ne \cdots \ne \, {\alpha }_{E}^{*}\), \({\alpha }_{i}^{*}\in \{1,\ldots,\, {l}_{1}\}\) for i = 1, …, l1, \({\alpha }_{i}^{*}\in \{{l}_{1}+1,\ldots,{l}_{1}+{l}_{2}\}\) for i = l1 + 1, …, l1 + l2, ⋯ , and \({\alpha }_{i}^{*}\in \{{l}_{1}+\cdots+{l}_{n-1}+1,\ldots,\, E\}\) for i = l1 + ⋯ + ln−1 + 1, …, E.
Step 3: Compute Di as \({D}_{i}={\alpha }_{i}^{*}-{\widehat{\alpha }}_{i}\) for i = 1, 2, …, E.
end for
Algorithm 3
Pseudo code to compute Di/E corresponding to “Simulation” in Fig. 2d, e
Inputs: a coarse-grained ground-truth sequence α, pairwise accuracy x, number of repetitions R.
for rep = 1 to R do
Step 1: Randomly assign fine-grained order to edges within the same snapshot to generate an intermediate sequence α* as Step 2 in Algorithm 2.
Step 2: Obtain the restored sequence \(\widehat{{{{{{{{\boldsymbol{\alpha }}}}}}}}}\) as Step 1–2 in Algorithm 1.
Step 3: Compute Di as \({D}_{i}={\alpha }_{i}^{*}-{\widehat{\alpha }}_{i}\) for i = 1, 2, …, E.
end for
The linear transformation in transfer learning
The key to a successful transfer is to find a projection between Network A and B such that the low-dimensional vector representations of the corresponding nodes in the two networks are as similar as possible. There are different ways to establish a corresponding relationship between the nodes of Network A and B, here we consider the quantiles of the degrees of the nodes as an illustrating example. Thus, we first sort the nodes in both networks by their degrees in descending order and obtain the matrices consisting of vectors of the ordered nodes for both networks, denoted by HA and HB. Then our goal is to find a linear transformation L such that ∣∣HBL − HA∣∣ is minimized. By the least squares method, we obtain
Reporting summary
Further information on research design is available in the Nature Portfolio Reporting Summary linked to this article.
Data availability
The network data used in this study are available at https://github.com/yijiaozhang/evolution_restore55. The source data generated in this study are provided in the Source Data file. Source data are provided with this paper.
Code availability
The code for this study are available at https://github.com/yijiaozhang/evolution_restore55.
References
Boccaletti, S., Latora, V., Moreno, Y., Chavez, M. & Hwang, D.-U. Complex networks: Structure and dynamics. Phys. Rep. 424, 175–308 (2006).
Newman, M. E. J. The structure and function of complex networks. SIAM Rev. 45, 167–256 (2003).
Barrat, A., Barthelemy, M. & Vespignani, A. Dynamical processes on complex networks (Cambridge University Press, 2008).
Yu, H., Braun, P., Yıldırım, M. A. & Lemmens, I. et al. High-quality binary protein interaction map of the yeast interactome network. Science 322, 104–110 (2008).
Szklarczyk, D., Franceschini, A., Wyder, S. & Forslund, K. et al. String v10: protein–protein interaction networks, integrated over the tree of life. Nucleic Acids Res. 43, D447–D452 (2015).
Stumpf, M. P. H. et al. Estimating the size of the human interactome. Proc. Natl Acad. Sci. 105, 6959–6964 (2008).
Barzel, B. & Barabási, A.-L. Network link prediction by global silencing of indirect correlations. Nat. Biotechnol. 31, 720–725 (2013).
Montoya, J. M., Pimm, S. L. & Solé, R. V. Ecological networks and their fragility. Nature 442, 259–264 (2006).
Bascompte, J. Structure and dynamics of ecological networks. Science 329, 765–766 (2010).
Kitsak, M. et al. Identification of influential spreaders in complex networks. Nat. Phys. 6, 888–893 (2010).
Ahn, Y.-Y., Han, S., Kwak, H., Moon, S. & Jeong, H. Analysis of topological characteristics of huge online social networking services. In Proceedings of the 16th International Conference on World Wide Web, WWW ’07, 835–844 (ACM, 2007). https://doi.org/10.1145/1242572.1242685.
Newman, M. E. J. Assortative mixing in networks. Phys. Rev. Lett. 89, 208701 (2002).
Watts, D. J. & Strogatz, S. H. Collective dynamics of ‘small-world’ networks. Nature 393, 440–442 (1998).
Milo, R. et al. Network motifs: Simple building blocks of complex networks. Science 298, 824–827 (2002).
Barabási, A.-L. & Albert, R. Emergence of scaling in random networks. Science 286, 509–512 (1999).
Bollobás, B. & Riordan, O. M. Mathematical results on scale-free random graphs. In Handbook of Graphs and Networks, chap. 1, 1–34 (John Wiley & Sons, Ltd, 2002).
Fortunato, S. Community detection in graphs. Phys. Rep. 486, 75–174 (2010).
Weiss, K., Khoshgoftaar, T. M. & Wang, D. A survey of transfer learning. J. Big Data 3, 9 (2016).
Grover, A. & Leskovec, J. Node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’16, 855–864 (ACM, 2016). https://doi.org/10.1145/2939672.2939754.
Perozzi, B., Al-Rfou, R. & Skiena, S. Deepwalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’14, 701–710 (ACM, 2014). https://doi.org/10.1145/2623330.2623732.
Tang, J. et al. Line: Large-scale information network embedding. In Proceedings of the 24th International Conference on World Wide Web, WWW ’15, 1067–1077 (ACM, 2015). https://doi.org/10.1145/2736277.2741093.
Ribeiro, L. F., Saverese, P. H. & Figueiredo, D. R. Struc2vec: Learning node representations from structural identity. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’17, 385–394 (ACM, 2017). https://doi.org/10.1145/3097983.3098061.
Wang, D., Cui, P. & Zhu, W. Structural deep network embedding. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’16, 1225–1234 (ACM, 2016). https://doi.org/10.1145/2939672.2939753.
Tesauro, G. Connectionist learning of expert preferences by comparison training. In Proceedings of the 1st International Conference on Neural Information Processing Systems, NIPS’88, 99–106 (NIPS, 1988).
Emerson, P. The original borda count and partial voting. Soc. Choice Welf. 40, 353–358 (2013).
Jin, Y., Turaev, D., Weinmaier, T., Rattei, T. & Makse, H. A. The evolutionary dynamics of protein-protein interaction networks inferred from the reconstruction of ancient networks. Plos One 8, 1–15 (2013).
Lemos, B., Meiklejohn, C. D. & Hartl, D. L. Regulatory evolution across the protein interaction network. Nat. Genet. 36, 1059–1060 (2004).
Qin, H., Lu, H. H., Wu, W. B. & Li, W.-H. Evolution of the yeast protein interaction network. Proc. Natl Acad. Sci. 100, 12820–12824 (2003).
Zheng, M., García-Pérez, G., Boguñá, M. & Serrano, M. Á. Scaling up real networks by geometric branching growth. Proc. Natl Acad. Sci. 118, e2018994118 (2021).
García-Pérez, G., Boguñá, M., Allard, A. & Serrano, M. Á. The hidden hyperbolic geometry of international trade: World trade atlas 1870–2013. Sci. Rep. 6, 1–10 (2016).
Hu, Y., Havlin, S. & Makse, H. A. Conditions for viral influence spreading through multiplex correlated social networks. Phys. Rev. X 4, 021031 (2014).
Xie, J. et al. Detecting and modelling real percolation and phase transitions of information on social media. Nat. Hum. Behav. 5, 1161–1168 (2021).
Mersch, D. P., Crespi, A. & Keller, L. Tracking individuals shows spatial fidelity is a key regulator of ant social organization. Science 340, 1090–1093 (2013).
van Dijk, R. E. et al. Cooperative investment in public goods is kin directed in communal nests of social birds. Ecol. Lett. 17, 1141–1148 (2014).
Gallotti, R. & Barthelemy, M. The multilayer temporal network of public transport in Great Britain. Sci. Data 2, 1–8 (2015).
Kendall, M. G. A new measure of rank correlation. Biometrika 30, 81–93 (1938).
Spearman, C. The proof and measurement of association between two things. Am. J. Psychol. 15, 72–101 (1961).
Papadopoulos, F., Kitsak, M., Serrano, M. Á., Boguná, M. & Krioukov, D. Popularity versus similarity in growing networks. Nature 489, 537–540 (2012).
Bianconi, G. & Barabási, A.-L. Competition and multiscaling in evolving networks. Europhys. Lett. 54, 436–442 (2001).
Barabási, A.-L. & Oltvai, Z. N. Network biology: understanding the cell’s functional organization. Nat. Rev. Genet. 5, 101–113 (2004).
Panchenko, A. R., Kondrashov, F. & Bryant, S. Prediction of functional sites by analysis of sequence and structure conservation. Protein Sci. 13, 884–892 (2004).
Wagner, A. The Yeast Protein Interaction Network Evolves Rapidly and Contains Few Redundant Duplicate Genes. Mol. Biol. Evol. 18, 1283–1292 (2001).
Barabási, A.-L. et al. Evolution of the social network of scientific collaborations. Phys. A Stat. Mech. Appl. 311, 590–614 (2002).
Jeong, H., Néda, Z. & Barabási, A.-L. Measuring preferential attachment in evolving networks. Europhys. Lett. 61, 567–572 (2003).
Yıldırım, M. A., Goh, K.-I., Cusick, M. E., Barabási, A.-L. & Vidal, M. Drug-target network. Nat. Biotechnol. 25, 1119–1126 (2007).
Hopkins, A. L. Network pharmacology: the next paradigm in drug discovery. Nat. Chem. Biol. 4, 682–690 (2008).
Gysi, D. M. et al. Network medicine framework for identifying drug-repurposing opportunities for covid-19. Proc. Natl Acad. Sci. 118, e2025581118 (2021).
Schafer, J. B., Konstan, J. A. & Riedl, J. E-commerce recommendation applications. Data Min. Knowl. Discov. 5, 115–153 (2001).
Fouss, F., Pirotte, A., Renders, J.-M. & Saerens, M. Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE Trans. Knowl. Data Eng. 19, 355–369 (2007).
Dunlavy, D. M., Kolda, T. G. & Acar, E. Temporal link prediction using matrix and tensor factorizations. ACM Trans. Knowl. Discov. Data 5, 1–27 (2011).
Liben-Nowell, D. & Kleinberg, J. The link-prediction problem for social networks. J. Am. Soc. Inf. Sci. Technol. 58, 1019–1031 (2007).
Adamic, L. A. & Adar, E. Friends and neighbors on the web. Soc. Netw. 25, 211–230 (2003).
Papadopoulos, F., Psomas, C. & Krioukov, D. Network mapping by replaying hyperbolic growth. IEEE/ACM Trans. Netw. 23, 198–211 (2015).
Newman, M. E. J. Modularity and community structure in networks. Proc. Natl Acad. Sci. 103, 8577–8582 (2006).
Wang, J. et al. Reconstructing the evolution history of networked complex systems. arxiv https://arxiv.org/abs/2403.14983 (2024).
Acknowledgements
The authors would like to thank Bing-Yi Jing, Ziwei Dai, Meizhen Zheng, Hongxin Wei, and Guanhua Chen for many helpful discussions. This work is supported by the National Natural Science Foundation of China under Grants No. T2350710802, 12101294, 12275118 and 11931019. This research is supported in part by NUS AcRF Grant A-0004550-00-00 and the National Research Foundation, Prime Minister’s Office, Singapore, and the Ministry of Communications and Information, under its Online Trust and Safety (OTS) Research Programme (MCI-OTS-001). Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not reflect the views of National Research Foundation, Prime Minister’s Office, Singapore, or the Ministry of Communications and Information.
Author information
Authors and Affiliations
Contributions
Y.H. conceived the project. Y.-J.Z., C.X., J.S., J.X., L.F., T.Z.,and Y.H. designed the project. J.W. and J.L. performed experiments and numerical modeling. Y.-J.Z., C.X., L.F. and Y.H. wrote the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Nature Communications thanks the anonymous reviewers for their contribution to the peer review of this work. A peer review file is available.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Source data
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Wang, J., Zhang, YJ., Xu, C. et al. Reconstructing the evolution history of networked complex systems. Nat Commun 15, 2849 (2024). https://doi.org/10.1038/s41467-024-47248-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467-024-47248-x
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.