Abstract
This study investigates the suitability of the annealed approximation in high-dimensional systems characterized by dense networks with quenched link disorder, employing models of coupled oscillators. We demonstrate that dynamic equations governing dense-network systems converge to those of the complete-graph version in the thermodynamic limit, where link disorder fluctuations vanish entirely. Consequently, the annealed-network systems, where fluctuations are attenuated, also exhibit the same dynamic behavior in the thermodynamic limit. However, a significant discrepancy arises in the incoherent (disordered) phase wherein the finite-size behavior becomes critical in determining the steady-state pattern. To explicitly elucidate this discrepancy, we focus on identical oscillators subject to competitive attractive and repulsive couplings. In the incoherent phase of dense networks, we observe the manifestation of random irregular states. In contrast, the annealed approximation yields a symmetric (regular) incoherent state where two oppositely coherent clusters of oscillators coexist, accompanied by the vanishing order parameter. Our findings imply that the annealed approximation should be employed with caution even in dense-network systems, particularly in the disordered phase.
Similar content being viewed by others
Introduction
Recently, there has been notable attention given to dynamics of complex systems. One popular strategy for understanding their connection geometry is through the use of networks composed of nodes and links1,2. Network structure often exhibits quenched link disorder, thereby rendering the system analytically intractable. In addition to numerical analyses, mean-field approximations have been employed to study the collective properties of complex-network systems. The “annealed” approximation (AA), a frequently employed mean-field method1,2,3,4,5,6,7,8,9,10,11,12,13,14, characterizes a quenched link as an annealed one with an appropriate linking probability. This approximation is commonly referred to the heterogeneous mean-field approximation1,2,3 in complex-network studies, where the linking probability depends solely on the numbers of links (degrees) of the two connecting nodes.
In sparse networks characterized by a finite mean degree, it is well-established that the AA manifests various limitations11,12,13,14,15, as it only captures a portion of network disorder. For instance, in investigations of Kuramoto-type models of coupled oscillators16,17,18,19, previous studies have observed that systems subject to the AA not only shift the transition point but also occasionally alter the nature of the transition14. On the contrary, in the context of dense networks with a diverging mean degree20, there exists a widely held belief that such networks closely approximate a complete graph (all-to-all connections) in the thermodynamic limit. Consequently, it is reasonable to anticipate that the AA may correctly characterize the collective properties of dense-network systems in general, as the AA mitigates disorder fluctuations in such systems21. It is reminiscent of the adiabatic elimination method commonly employed in quantum optics22: According to the adiabatic elimination, the dense-network fluctuations can be regarded as fast modes, resulting in corrections to the slow-mode dynamics corresponding to the fully connected case. Nevertheless, in the incoherent (disordered) phase where the order parameter vanishes, finite-size effects may exert significant influence on stabilizing steady states, suggesting a breakdown of the adiabatic elimination because of a lack of slow-modes. Thus, one might imagine a potential disparity in the incoherent steady-state patterns for systems on the complete graph (CG), dense network (DN), and annealed network (AN), attributed to the finite-size effects contingent upon the network structure.
In this study, we explore the extent of similarity between a DN system and its CG counterpart, and assess the validity of the AA. To achieve this, we employ systems of the Kuramoto-type oscillators known for exhibiting collective properties sensitive to connectivity (link) disorder, which has led to a critical failure of the AA in sparse-network systems14. Firstly, we demonstrate that connectivity fluctuations in DNs vanish in the thermodynamic limit, resulting in the order parameter behavior identical to that of the CG version. In the case of identical oscillators without frequency disorder, often referred as the Watanabe-Strogatz (WS) model23,24, we observe that finite-size effects stemming from connectivity disorder are strong enough to destroy all infinitely many, initial-condition dependent, “regular” (symmetric) steady-state patterns found in the incoherent phase of its CG version23,24. In DNs, random steady-state patterns emerge in the end, suggesting that quenched disorder can readily eliminate regularity in incoherent patterns. Under the influence of the AA, similar incoherent regular patterns appear with more complex symmetries, distinct from both the random patterns observed in DNs and the regular patterns in the CG version. We note that all these regular patterns are vulnerable to frequency disorder, resulting in random incoherent patterns. Consequently, the incoherent patterns are all identical in the CG, DN, and AN with heterogeneous oscillators featuring random natural frequencies.
Secondly, we introduce coupling disorder (competition of attractive and repulsive couplings) to the WS model on the CG and examine its collective behavior both numerically and by applying the AA. This model can be also viewed as the WS model on a combined version of two DNs based on two competing couplings. Intriguingly, we discover a single initial-condition independent symmetric steady-state pattern in the incoherent phase for the system subject to the AA. In this symmetric pattern, oscillators are sharply divided into two coherent clusters with a phase difference of \(\pi\). The sizes of these two clusters become identical in the thermodynamic limit, resulting in the vanishing order parameter. Our numerical analysis without the AA reveals that this incoherent symmetric pattern is replaced by the incoherent random pattern. This sharp and simple disparity in incoherent states leads us to conclude that the AA may not accurately represent the incoherent steady-state pattern even in (generalized) DNs for a wide range of various many-body dynamics.
Finally, we note that temporal networks where connection links undergo temporal changes bear resemblance to the annealed network systems when the time scale for link connection is sufficiently short. Thus, in these networks which are prevalent in various biological and social systems, the regular/symmetric incoherent patterns can be empirically observed.
Kuramoto model on dense networks
We start with a system of N Kuramoto-type oscillators16 on a complex network. The dynamics of each oscillator is governed by the equation of motion as
where \(\phi _i\) and \(\omega _i\) represent the phase angle and natural random frequency of oscillator i, respectively. The element \(a_{ij}\) of the adjacency matrix denotes the connectivity between oscillators i and j, with \(a_{ij}=1\) indicating a connection and \(a_{ij}=0\) otherwise. The parameter J represents the strength of coupling. For simplicity, the summation is normalized by the mean degree \(\langle k \rangle = (1/N) \sum _{i} k_{i}\), where \(k_i\)(\(=\sum _j a_{ij}\)) denotes the degree (the number of neighbors) of oscillator i.
Defining the “local” field \(h_i\) by
with phase factor \(z_j=e^{ \text{i} \phi _j }\), Eq. (1) is now rewritten as
where \({\text{Im}}(X)\) denotes the imaginary part of X and \(z_i^*\) the complex conjugate of \(z_i\). We also define the order parameters from averaged \(z_i\) and \(h_i\), respectively:
Note that \(\langle z \rangle\) is the so-called Kuramoto phase order parameter defined in Ref.16.
It is convenient to recast the local field in the form as
where \(\delta \tilde{k}_i\) and \(\xi _i\) represent the degree fluctuation and the average phase factor (\(z_i\)) fluctuation over neighbors, respectively, with
and a “noise” term \(\xi _i\) reads
In the case of the CG where \(a_{ij}=1\) for all pairs, the local field and two order parameters become identical, i.e., \(h_i = \langle h \rangle =\langle z \rangle\) with the complete absence of fluctuations (\(\delta \tilde{k}_i=0\) and \(\xi _i=0\)). In contrast, for a sparse network characterized by a finite \(\langle k \rangle\) such as the Erdös-Rényi (ER) network with an extremely low connection probability25,26 or scale-free networks27 , the fluctuations can be of the order \(\mathscr {O}(1)\). Consequently, these fluctuations may influence the dynamics significantly, leading to steady states distinct from those of the CG version.
Here, we focus our attention on a dense network (DN) characterized by the following conditions:
with \(0 <\alpha \le 1\) and \(\beta <\alpha\). The above power-law scaling of \(\langle k \rangle\) can be found in the ER network with a finite connection probability26 and scale-free-like DNs27. It is then straightforward to estimate the order of local fluctuations as
where we estimate \(\xi _i\sim \mathscr {O}(\sqrt{k_i}/\langle k\rangle )\) under the reasonable assumption that the phase factor fluctuation (\(z_j-\langle z\rangle\)) is almost Gaussian random with zero mean. In DNs, both local fluctuations vanish as \(N\rightarrow \infty\), and then the local field \(h_i\) in Eq. (5) converges to the global order parameter \(\langle z\rangle\) in the ordered phase with \(\langle z\rangle \sim \mathscr {O}(1)\). Consequently, the dynamic equation of motion, Eq. (3), becomes identical to that for the CG as \(N\rightarrow \infty\) and thus the order parameter values for DNs become identical to those for the CG. It is noteworthy that in the incoherent (disordered) phase, where \(\langle z\rangle\) also approaches to zero as \(N\rightarrow \infty\), \(\langle z\rangle\) competes with the local fluctuation \(\xi _i\) in Eq. (5). This suggests that different types of finite-size effects in the CG, DN, and AN may yield distinct incoherent patterns, while still adhering to the condition of the vanishing order parameter.
Annealed approximation on networks
The analytical treatment of models on a network with quenched link disorder is typically challenging. Instead, the AA is frequently employed due to its analytical tractability, while still yielding results analogous to the original system.
In the AA, networks are substituted with annealed ones using the heterogeneous mean field approximation1,2,3, where the linking probability depends solely on the degrees of the two connecting nodes. Within this framework, the adjacency matrix \(a_{ij}\) is replaced by \(a^\text{A}_{ij}\) as
which represents the mean linking probability between nodes i and j3,6. Then, the annealed version of the local field \(h^\text{A}_i\) is given by
with phase factor \(z^\text{A}_j = e^{\text{i} \phi _j^\text{A}}\) satisfying the AA-applied dynamic equation. The average phase factor fluctuation \(\xi ^\text{A}_i\) in the AA is rather simplified as
Note that the local property of \(\xi ^\text{A}_i\) is limited to \(k_i\) (no explicit connection information), leading to the simple expression for \(h^\text{A}_i\) as
whose local property is also solely given by \(k_i\), allowing the analysis of the dynamic Eq. (3) simpler. The order of \(\xi ^\text{A}_i\) is estimated similarly as
which also vanishes as \(N\rightarrow \infty\) for DNs, as expected. Nonetheless, the finite-size effects are different for the annealed and quenched networks, which may exert a crucial influence on the determination of incoherent steady states.
Validity of the annealed approximation for the WS model
For the WS model with identical oscillators (\(\omega _i=\Omega\))23,24, the dynamic equation is given by \(\dot{\phi }_i = \Omega + J~\mathrm{{Im}}\left( h_i z_i^* \right)\). We can set \(\Omega =0\) without loss of generality via simple mapping of \(\phi _i \rightarrow \phi _i+\Omega t\). On the CG, the local field loses its locality completely as \(h_i=\langle z\rangle\), thus we get
In the long time limit, there exist two types of stable fixed points \(\{\phi _i\}\), satisfying (a) \(\langle z\rangle =0\) for \(J<0\) (see "Methods") or (b) \(\phi _i=\Phi\) for \(J>0\) with the global angle \(\Phi\) defined by \(\langle z\rangle =|\langle z\rangle |e^\mathrm{{i}\Phi }\). Consequently, we obtain \(|\langle z \rangle | =1\) for \(J>0\) and \(\langle z\rangle =0\) for \(J<0\) with \(\{\phi _i \}\) satisfying discrete rotational symmetries (\(\sum _{j=1}^N z_j=0\))23,24. An initial condition selects one of these many incoherent “regular” symmetric steady states for \(J<0\), exact for any finite N.
In DNs, these incoherent regular fixed points are not stable any longer, due to strong fluctuations in the local field \(h_i\). Instead, \(\phi _j\) becomes random with the uniform distribution over \([0,2\pi ]\) to make \(\langle z\rangle\) vanish in the \(N\rightarrow \infty\) limit for \(J<0\). This is confirmed by numerical simulations [not shown here]. In the AA of DNs, the local field fluctuations become weaker with a degree dependence only as in Eq. (13), leading to
Similar to the CG case, there are two types of stable fixed points, satisfying (a) \(\langle h^\text{A}\rangle =0\) for \(J<0\) (see "Methods") and (b) \(\phi _i^{\text{A}}=\Psi ^\text{A}\) for \(J>0\) with another global angle \(\Psi ^\text{A}\) defined by \(\langle h^\text{A}\rangle =|\langle h^\text{A}\rangle |e^\mathrm{{i}\Psi ^\text{A}}\). Consequently, we obtain \(|\langle z^\text{A} \rangle | =1\) for \(J>0\) and \(\langle z^\text{A}\rangle \rightarrow 0\) as \(N\rightarrow \infty\) for \(J<0\) with \(\{\phi _i^{\text{A}} \}\) satisfying more complex discrete symmetries (\(\sum _{j=1}^N k_jz_j^{\text{A}}=0\)). Again, the incoherent steady state depends on the initial condition.
The incoherent steady state patterns are all different for the WS model on the CG, DN, and AN. It implies that the AA fails to predict the stable steady-state solutions of Eq. (1) for DN systems, in particular when the oscillators are identical. Certainly, this failure is not common in general DN systems. An illustrative example is evident in the Kuramoto model with frequency disorder in \(\omega _i\). In its incoherent phase in DNs, oscillators undergo rotational motion with their respective natural frequencies, i.e. \(\dot{\phi }_i = \omega _i\) in the long time limit. The order parameter \(\langle z \rangle\) as well as the local field \(h_i\) vanish as \(N \rightarrow \infty\), identical to the behavior observed in the CG. The AA-applied systems are expected to yield the same rotating behavior, thereby resulting in identical incoherent states on the CG, DN, and AN. This is not much surprising, as the additional frequency disorder is of the order \(\mathscr {O}(1)\), dominant over local fluctuations that diminish in the \(N\rightarrow \infty\) limit for DN systems. Temporal fluctuations such as a thermal noise also destroy the intricate structure of incoherent regular steady states in the AA (and also in the CG), and then the incoherent steady state pattern becomes fully random, akin to the incoherent phase in DN systems.
An intriguing question arises as to the nature of additional disorder that maintains a distinction in incoherent steady-state patterns between the AA-applied and original system. Subsequently, we investigate the inclusion of a quenched coupling disorder residing in the links of DNs, where the associated fluctuations are expected to be of a similar order to those of the quenched link disorder.
Oscillators with competing interactions
We consider a generalized Kuramoto model with coupling disorder, governed by the dynamic equation as
where \(J_{ij}\) is a random coupling strength between oscillators i and j. For simplicity, we consider the CG case (\(a_{ij}=1\), thus \(\langle k\rangle =N\)). This model has been introduced and studied in the context of “oscillator glass” by Daido28,29.
In the case of identical oscillators (\(\omega _i=0\)), this model describes the zero-temperature Sherrington-Kirkpatrick model for XY spin glass30,31,32. Recently, Hong and Martens33 also considered this model with a probability distribution P[J] for \(J_{ij}\) that has two \(\delta\)-peaks such as
with \(J_+>0\) (attractive) and \(J_-<0\) (repulsive). These competitive interactions induce frustration between oscillators and the first-order phase transition occurs between the fully ordered and disordered phases when the mean value of coupling strengths (\(pJ_+ + (1-p) J_-\)) changes its sign, i.e. at \(p=p_c=(-J_-)/(J_+-J_-)\)33.
It is now worth noting that the random interaction \(J_{ij}\) in the so-called “two-peak” model with identical oscillators can be expressed using the adjacency matrix \(b_{ij}\) of a random network, as follows:
where \(b_{ij}=1\) represents a positive (attractive) link with \(J_+\), while \(b_{ij}=0\) represents a negative (repulsive) link with \(J_-\). As the positive and negative links are randomly distributed, the positive degree \(k_i\) (the number of positive links stemming from node i) satisfies the binomial distribution with mean \(\langle k \rangle =Np\) and variance \(\langle k^2 \rangle - \langle k \rangle ^2=Np(1-p)\) for large systems. Thus, the \(\{b_{ij}\}\) network is dense with the exponents \(\alpha =1\) and \(\beta =1/2\) defined in Eq. (8). This model can be also regarded as a competition between the CG model with the negative coupling constant \(J_-\) \((<0)\) and the DN model (\(b_{ij}\)) with the positive one \(p(J_+-J_-)\) \((>0)\). For more general case with the underlying DN (\(a_{ij}\)) and multi-peak distributions of P[J] in Eq. (17), we expect the coupled systems on multiple DNs like a hypernetwork 34, which are left for future study.
Eq. (19) is rewritten in a more illustrative form as
where the corresponding local field \(q_i\) reads
with \(\Delta \equiv (-J_-)/\left( J_+ - J_-\right) =p_c\) \((0<\Delta <1)\). Using Eq. (5), we get
with \(\xi _i =\sum _{j} b_{ij} \left( z_j - \langle z \rangle \right) /{\langle k \rangle }\).
As discussed previously, both local fluctuations, \(\delta \tilde{k}_i\) and \(\xi _i\), in the DN diminish as \(N\rightarrow \infty\), thus the local field \(q_i\) approaches \(\langle z\rangle (p-\Delta )\). Consequently, the dynamic equation becomes identical to Eq. (15) with substitution of J by \((J_+-J_-)(p-\Delta )=pJ_++(1-p)J_-\) (mean coupling strength). Therefore, we expect the first-order phase transition at \(p=\Delta\) from the disordered to the fully ordered phase. As the \(\{b_{ij}\}\) network is dense (not CG for \(p< 1\)), there are finite-size fluctuations which make the incoherent steady state uniformly random for \(p\le \Delta\) (numerically confirmed later, shown in Fig. 1).
The application of the AA as in Eq. (10) yields
with the annealed local field \(q_i^\text{A}\) given by
where Eq. (13) is used. Similar to the previous cases without coupling disorder shown in Eqs. (15) and (16), there exist incoherent regular fixed points satisfying both \(\langle h^\text{A}\rangle =\langle z^\text{A}\rangle =0\) simultaneously. However, these regular fixed points are proven to be always unstable with a distribution of \(k_i\) (see Methods).
Instead, one of two “ordered” fixed points becomes stable in the long-time limit, depending on the magnitude of degree \(k_i\);
with \(\langle z^\text{A}\rangle =|\langle z^\text{A}\rangle |e^\mathrm{{i}\Phi ^\text{A}}\). The stability condition for the fixed points requires the identical global phase angles, denoted as \(\Phi ^\text{A}=\Psi ^\text{A}\) where \(\langle h^\text{A}\rangle =|\langle h^\text{A}\rangle |e^\mathrm{{i}\Psi ^\text{A}}\). Thus, the threshold value \(k^*\) is determined by the equation \({k^*}|\langle h^\text{A}\rangle |/N -\Delta |\langle z^\text{A}\rangle | =0\) (see Eq. (24)), which can be solved in a self-consistent manner. Detailed derivations are given later.
The coexistence of two coherent (ordered) clusters with a phase difference of \(\pi\) is observed across the entire parameter range of \((p,\Delta )\). In the disordered phase (\(p<\Delta\)), the threshold value \(k^* \simeq \langle k\rangle\), leading to identical cluster sizes in the \(N\rightarrow \infty\) limit. Thus, the order parameters approach zero; \(\langle z^\text{A}\rangle \simeq 0\) and \(\langle h^\text{A}\rangle \simeq 0\). Conversely, in the ordered phase (\(p>\Delta\)), one cluster fully dominates over the other in the \(N\rightarrow \infty\) limit with \(k^*\simeq (\Delta /p)\langle k\rangle\). This results in \(\langle z^\text{A}\rangle \simeq 1\) and \(\langle h^\text{A}\rangle \simeq 1\).
It is evident that the incoherent steady state for the AA-applied system differs from the random incoherent one in the original system. This incoherent steady-state pattern exhibits the simple \(Z_2\) symmetry (the same number of oscillators with \(z_i^\text{A} e^{-\text{i}\Phi ^\text{A}}= 1\) or \(-1\)), resembling a regular symmetric pattern found in the WS model on the CG in Eq. (15). However, the origin of this symmetry is obviously different. Furthermore, this symmetry is exact only in the \(N\rightarrow \infty\) limit and is also independent of initial conditions, while the regular symmetric patterns in the previous models are exact for any finite N and are dependent on initial conditions.
Numerical results
We numerically solve the equation of motion, Eq. (19), employing the Heun’s method with various network sizes and fixed \(p=\langle k \rangle /N\)=0.2. Initial phase angles are randomly chosen within \([-0.005 \pi , 0.005 \pi ]\). Solid symbols in Fig. 1a denote the values of \(|\langle z \rangle |\), averaged over a period of \(t=5\times 10^4 \sim 10^5\), after discarding an initial transient period of the same duration and also averaged over \(10 \sim 100\) network realizations and initial conditions. We also display the analytic solutions \(|\langle z^\text{A} \rangle |\) in Fig. 1a, obtained from a self-consistency equation Eq. (35) for the annealed networks. We find that both \(|\langle z \rangle |\) and \(|\langle z^\text{A} \rangle |\) seem to show a discontinuous transition from the fully ordered to the disordered phase at \(\Delta = p\), as \(|\langle z \rangle |\) tends to approach 1 (0) asymptotically for \(\Delta <p\) (\(\Delta >p\)) for increasing N. At \(\Delta =p\), however, \(|\langle z^\text{A} \rangle |\) remains finite as \(N \rightarrow \infty\), as demonstrated by the crossing of solid curves, while \(|\langle z \rangle |\) approaches zero. This observation may suggest distinct underlying mechanisms of the transitions between the annealed and quenched systems.
In b–e in Fig. 1, phase angle snapshots are plotted as a function of degree for the quenched and annealed cases, denoted by \(\phi\) and \(\phi ^\text{A}\), respectively. Data are obtained numerically from Eq. (19) in a single network realization for \(p=0.2\) and \(N=3200\). Starting from an initial condition described above, the data points are obtained at \(t=10^5\) near the steady state. For \(\Delta <p\), we observe in Fig. 1b and c that in the original quenched system a single coherent cluster with \(\phi \simeq 0\) is formed by oscillators with higher degrees (stronger interactions effectively) and scattered phase angles for those with lower degrees seem to be due to finite-size effects. The annealed case shows two coherent clusters with phase difference of \(\pi\), but one cluster dominates over the other. The finite-size effects are much weaker in the annealed systems, as their fluctuations should be much weaker than those for the quenched systems.
For \(\Delta >p\) in Fig. 1e, the phase angles seem randomly distributed as expected in the quenched system. Remarkable distinction is found in the annealed system, where a binary mixture of two coherent clusters with comparable sizes emerges. The contributions of the two clusters to the order parameter \(\langle z^\text{A}\rangle\) seem to cancel out exactly in the \(N\rightarrow \infty\) limit. At the transition (\(\Delta =p\)), the balance of two cluster sizes are slightly broken, yielding a nontrivial value of \(|\langle z^\text{A} \rangle | \simeq 0.61946\), which is consistent with the analytic result derived in the following.
Back to the scattered plots in Fig. 1, we note that the outcomes from the original quenched model (orange dots) present notable disparities in comparison to those of the annealed model (blue dots), particularly in the vicinity of the threshold value \(k^*\). This phenomenon can be understood by considering the following. In the quenched system, the magnitude of noise fluctuations \(\xi _i\) is of the order \(\mathscr {O} (N^{-1/2})\). This suggests that the local field \(q_i\) is predominantly influenced by these fluctuations, especially near \(k\simeq k^*\), where the value of the annealed local field almost vanishes as \(q_i^\text{A}\simeq 0\). In contrast, in the region where \(|k_i-k^*|/N \gtrsim \mathscr {O}(N^{-1/2})\), the annealed local field \(q_i^\text{A}\) becomes comparable to \(\xi _i\), resulting in a reduced disparity between the quenched and annealed results. This trend is also observable in the scattered plots.
Analytic solutions of the annealed two-peak model
We rewrite the dynamic equation (23) in a convenient form as
where
yielding the stable steady-state fixed points as
Utilizing the definition of the global phase angle \(\Phi ^\text{A}\), we obtain the expression as \(|\langle z^\text{A}\rangle |=z^\text{A} e^{-\text{i}\Phi ^\text{A}}= \langle e^\mathrm{{i}\tilde{\phi }^\text{A}}\rangle\), implying \(\langle \sin \tilde{\phi }^\text{A} \rangle =0\) and \(\langle \cos \tilde{\phi }^\text{A} \rangle \ge 0\). In addition, from Eqs. (27) and (28), we observe that the signs of the steady-state solution for \(\sin \tilde{\phi }_i^\text{A}\) should coincide with the sign of \(\sin (\Psi ^\text{A}-\Phi ^\text{A})\), independent of i. Then, the constraint of \(\langle \sin \tilde{\phi }^\text{A}\rangle =0\) demands \(\sin \tilde{\phi }_i^\text{A}=0\) for all i’s, thereby \(A_i=0\) and \(\sin (\Psi ^\text{A}-\Phi ^\text{A})=0\). Subsequently, it follows that \(\cos \tilde{\phi }_i^\text{A}=\pm 1\) and \(\cos (\Psi ^\text{A}-\Phi ^\text{A})=\pm 1\) in the steady state. With the selection of \(\cos (\Psi ^\text{A}-\Phi ^\text{A})=-1\), \(B_i\) is always negative, thus Eq. (28) yields \(\cos \tilde{\phi }_i^\text{A}=- 1\) for any i. However, this contradicts the condition \(\langle \cos \tilde{\phi }^\text{A} \rangle \ge 0\), thereby \(\cos (\Psi ^\text{A}-\Phi ^\text{A})=+1\) (implying \(\Psi ^\text{A}=\Phi ^\text{A}\)) must be selected for stable fixed points. In this case, the sign of \(B_i\) changes as \(k_i\) varies. Consequently, \(\cos \tilde{\phi }_i^\text{A}=+1\) with \(B_i>0\) for large \(k_i\) and \(\cos \tilde{\phi }_i^\text{A}=-1\) with \(B_i<0\) for small \(k_i\), leading to
where \(k^*\) is defined as
To determine the threshold value \(k^*\), we need to solve Eq. (30) in a self-consistent manner. Using \(|\langle z^\text{A} \rangle | = \langle \cos \tilde{\phi }^\text{A}\rangle\) and \(|\langle h^\text{A} \rangle | = \langle k \cos \tilde{\phi }^\text{A}\rangle /\langle k \rangle\), the order parameters in the steady state are given as
where the degree distribution B(k, p) is the binomial distribution of degree k for a given p. For large N, it is well known that B(k, p) can be approximated by the Gaussian distribution of a continuous variable \(k\in [-\infty , \infty ]\) with mean \(\langle k\rangle =Np\) and variance \(Np(1-p)\). In this continuum limit, Eq. (31) can be expressed in a simple form as
where the error function is defined as \(\text{erf}[x] = \left( 2/\sqrt{\pi } \right) \int _0^x dt\, \exp \left[ -t^2 \right]\). From the constraint \(|\langle z^\text{A} \rangle | \ge 0\), we note that \(k^*\) cannot exceed \(\langle k \rangle =Np\).
For convenience, we rewrite Eq. (32) as
with
By substituting Eq. (33) into Eq. (30), we obtain
The solution for X in Eq. (35) provides the threshold value \(k^*\) and also determine the order parameter values in Eq. (33) in the steady state. These results are in very good agreement with the numerical outcomes obtained directly from the annealed Eq. (23) (not shown here). For small \(\varepsilon\) (large N), the explicit expression for X can be derived from Eq. (35) as
with \(X_c \approx -0.62006\), determined by solving the equation of \(\text{erf}[X_c] e^{X_c^2} X_c= {1}/\sqrt{\pi }\) which is given by Eq. (35) with \(\Delta =p\) for small \(\varepsilon\).
In the \(N\rightarrow \infty\) (\(\varepsilon \rightarrow 0\)) limit, the order parameters are calculated from Eq. (33): \(|\langle z^\text{A} \rangle |=1\) (\(X\rightarrow -\infty\)), \(|\langle z^\text{A} \rangle |= -\text{erf}[X_c] \approx 0.61946\), and \(|\langle z^\text{A} \rangle |=0\) (\(X\rightarrow 0\)) for \(\Delta <p\), \(\Delta =p\), and \(\Delta >p\), respectively, as seen in Fig. 1a. We also find \(|\langle z^\text{A} \rangle |\approx |\langle h^\text{A} \rangle |\). Eq. (36) is expressed in terms of \(k^*\) as
yielding numerical values of \(k^*\) as 576, 608, 620, and 624 for parameter values given in Fig. 1b–e, respectively, that are in excellent accordance with simulation data.
The phase distribution \(\rho (\phi ^\text{A})\) in the steady state is given by the combination of two \(\delta\) peaks from Eq. (29) as
where \(a=\sum _{k>k^*} B(k,p)\approx \frac{1}{2} (1-\text{erf}[X])\) and \(b=1-a\). From Eqs. (36) and (37), we find \(a=1\) (\(b=0\)) for \(\Delta <p\) (single peak and fully synchronized) and \(a=b=1/2\) for \(\Delta >p\) (two symmetric peaks). At \(\Delta =p\), \(a=\frac{1}{2} (1-\text{erf}[X_c])\approx 0.80973\) (\(b\approx 0.19027\)) (two asymmetric peaks). This is illustrated in Fig. 2.
In large quenched systems, the numerical results suggest \(\rho \left( \phi \right) =\delta \left( \phi - \Phi \right)\) for \(\Delta <p\). In contrast, for \(\Delta \ge p\), it is observed that the phase angles are uniformly distributed, implying that \(\rho (\phi )=1/({2\pi })\). We can also consider the generalized order parameters defined as \(z_m \equiv |\langle z^m \rangle |\) and \(z^\text{A}_m \equiv |\langle \left( z^\text{A} \right) ^m \rangle |\) with an arbitrary integer m. We note that \(z^\text{A}_m\) for even m does not distinguish the ordered and disordered phase (\(z^\text{A}_m=1\)) in the annealed systems, as two coherent clusters are synchronized with phase difference of \(\pi\).
Summary
In summary, we showed that the dynamic equations governing DN systems with quenched link disorder converge to those of the CG version in the thermodynamic limit, where the local fluctuations vanish entirely. Consequently, the AA-applied systems where fluctuations are attenuated, exhibit the same dynamic behavior in the thermodynamic limit. However, a notable discrepancy may arise in the incoherent (disordered) phase, where finite-size effects can become critical in determining the steady-state pattern.
We illustrate our findings through two prototypical models of coupled oscillators; the WS model for synchronization and the zero-temperature XY-like model with competing couplings. In both cases, we analytically derive the incoherent patterns in the annealed systems, revealing stark differences from those in the original quenched systems. These patterns in the annealed systems are regular and symmetric, in contrast to the random patterns in the quenched case. This suggests that caution should be given when applying the AA even to the DN systems, particularly when examining incoherent steady-state patterns. We emphasize that our analysis based on the network topology and findings are not restricted to the oscillator or XY-spin systems. One may expect a similar discrepancy for the two-peak model with Ising spins because phase angles of oscillators with the AA-applied two competing interactions align along two branches, reminiscent of the Ising spins. Furthermore, we point out the possibility of observing these intriguing regular and symmetric incoherent patterns in temporal networks with sufficiently fast time scales, which may underlie various biological and social systems.
Methods
Stability analysis of incoherent regular solutions
First, we perform a linear stability analysis of the incoherent regular fixed points for the WS model. For the CG version with the dynamics governed by Eq. (15), a small perturbation \(\delta {{\phi }}_i\) around the fixed points \({{\phi }}_i^\text{s}\) satisfying \(\langle z\rangle =0\) evolves as
with the stability matrix element \(S_{ij}\) given by
This stability matrix can be expressed as the sum of two rank-1 matrices as \(S_{ij} =S_{ij}^{(1)} + S_{ij}^{(2)}\) with \(S_{ij}^{(1)}=(J/N) \cos (\phi _j^\text{s})\cos (\phi _i^\text{s})\) and \(S_{ij}^{(2)}=(J/N) \sin (\phi _j^\text{s})\sin (\phi _i^\text{s})\). It is trivial to show that any rank-1 matrix has zero eigenvalues except for one eigenvalue given by its trace. For \(J>0\), both rank-1 matrices are positive semi-definite with the non-zero eigenvalues of \((J/N)\sum _j \cos ^2 (\phi _j^\text{s})\) and \((J/N)\sum _j \sin ^2 (\phi _j^\text{s})\), respectively. As the sum of two positive semi-definite matrices should be also positive semi-definite, it follows that the eigenvalues of the stability matrix are non-negative, leading to the conclusion that all regular fixed points should be unstable for \(J>0\). Consequently, the stabilization of the regular fixed points is only feasible for \(J<0\).
This stability analysis can be also applied to the AN version with the dynamics governed by Eq. (16), leading to the stability matrix \(S_{ij}^\text{A}\) as
It is clear that this stability matrix can be also decomposed into two rank-1 matrices, thus the same conclusion as above can be drawn, as the link degree \(k_i\) is always non-negative.
For the AA-applied model with coupling disorder, the dynamic equation is given by Eq. (23), yielding the stability matrix as
It should be noted that this matrix can be decomposed into two positive semi-definite rank-1 matrices and two negative semi-definite rank-1 matrices. It is straightforward but rather lengthy to prove that the signs of the non-zero eigenvalues of the stability matrix align with those of the decomposed rank-1 matrices, if none of these rank-1 matrices is not a multiple of another (a proof not included here). Given a distribution of \(k_i\), it is evident that none of our four rank-1 matrices is proportional to any other. Consequently, the stability matrix invariably possesses two positive eigenvalues, thereby rendering all incoherent regular solutions unstable. This conclusion is further substantiated by numerical results.
Data availability
The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.
References
Dorogovtsev, S. N., Goltsev, A. V. & Mendes, J. F. F. Critical phenomena in complex networks. Rev. Mod. Phys. 80, 1275 (2008).
Pastor-Satorras, R., Castellano, C., Van Mieghem, P. & Vespignani, A. Epidemic processes in complex networks. Rev. Mod. Phys. 87, 925 (2015).
Pastor-Satorras, R., Castellano, C. P. & Vespignani, A. Epidemic spreading in scale-free networks. Phys. Rev. Lett. 86, 3200 (2001).
Ichinomiya, T. Frequency synchronization in a random oscillator network. Phys. Rev. E 70, 026116 (2004).
Lee, D.-S. Synchronization transition in scale-free networks: Clusters of synchrony. Phys. Rev. E 72, 026208 (2005).
Hong, H., Park, H. & Tang, L.-H. Finite-size scaling of synchronized oscillation on complex networks. Phys. Rev. E 76, 066104 (2007).
Oh, E., Lee, D.-S., Kahng, B. & Kim, D. Synchronization transition of heterogeneously coupled oscillators on scale-free networks. Phys. Rev. E 75, 011104 (2007).
Castellano, C. & Pastor-Satorras, R. Routes to thermodynamic limit on scale-free networks. Phys. Rev. Lett. 100, 148701 (2008).
Boguñá, M., Castellano, C. & Pastor-Satorras, R. Langevin approach for the dynamics of the contact process on annealed scale-free networks. Phys. Rev. E 79, 036110 (2009).
Yi, S., Um, J. & Kahng, B. Extended mean-field approach for chimera states in random complex networks. Chaos 32, 033108 (2022).
Noh, J. D. & Park, H. Critical behavior of the contact process in annealed scale-free networks. Phys. Rev. E 79, 056115 (2009).
Lee, S. H., Ha, M., Jeong, H., Noh, J. D. & Park, H. Critical behavior of the Ising model in annealed scale-free networks. Phys. Rev. E 80, 051127 (2009).
Hong, H., Um, J. & Park, H. Link-disorder fluctuation effects on synchronization in random networks. Phys. Rev. E 87, 042105 (2013).
Um, J., Hong, H. & Park, H. Nature of synchronization transitions in random networks of coupled oscillators. Phys. Rev. E 89, 012810 (2014).
Castellano, C. & Pastor-Satorras, R. Non-mean-field behavior of the contact process on scale-free networks. Phys. Rev. Lett. 96, 038701 (2006).
Kuramoto, Y. International Symposium on Mathematical Problems in Theoretical Physics 30, 420 (Springer, New York, 1975); Chemical Oscillations, Waves, and Turbulence (Springer, 1984).
Acebrón, J. A., Bonilla, L. L., Vicente, C. J. P., Ritort, F. & Spigler, R. The Kuramoto model: A simple paradigm for synchronization phenomena. Rev. Mod. Phys. 77, 137 (2005).
Pazó, D. Thermodynamic limit of the first-order phase transition in the Kuramoto model. Phys. Rev. E 72, 046211 (2005).
Martens, E. A. et al. Exact results for the Kuramoto model with a bimodal frequency distribution. Phys. Rev. E 79, 026204 (2009).
Newman, M. Networks (Oxford University Press, 2018).
Li, C., van de Bovenkamp, R. & Van Mieghem, P. Susceptible-infected-susceptible model: A comparison of N-intertwined and heterogeneous mean-field approximations. Phys. Rev. E 86, 026116 (2012).
Walls, D. & Milburn, G. Quantum Optics (Springer-Verlag, 2008).
Watanabe, S. & Strogatz, S. Integrability of a globally coupled oscillator array. Phys. Rev. Lett. 19, 2391 (1992).
Watanabe, S. & Strogatz, S. Constants of motion for superconducting Josephson arrays. Physica D 74, 197 (1994).
Erdös, P. P. & Rényi, A. On random graphs I. Publ. Math. 6, 290 (1959).
Newman, M., Strogatz, S. & Watts, D. Random graphs with arbitrary degree distributions and their applications. Phys. Rev. E 64, 026118 (2001).
Ma, F., Wang, X., Wang, P. & Luo, X. Dense networks with scale-free feature. Phys. Rev. E 101, 052317 (2020).
Daido, H. Population dynamics of randomly interacting self-oscillators. I: Tractable models without frustration. Prog. Theor. Phys. 77, 622 (1987).
Daido, H. Quasientrainment and slow relaxation in a population of oscillators with random and frustrated interactions. Phys. Rev. Lett. 68, 1073 (1992).
Sherrington, D. & Kirkpatrick, S. Solvable model of a spin-glass. Phys. Rev. Lett. 35, 1792 (1975).
Kirkpatrick, S. & Sherrington, D. Infinite-ranged models of spin-glasses. Phys. Rev. B 17, 4384 (1978).
Billoire, A. Some aspects of infinite-range models of spin glasses: Theory and numerical simulations. In Rugged Free Energy Landscapes (ed. Janke, W.) 11–46 (Springer, 2008).
Hong, H. & Martens, E. A. First-order like phase transition induced by quenched coupling disorder. Chaos 32, 063125 (2022).
Sorrentino, F. Synchronization of hypernetworks of coupled dynamical systems. New J. Phys. 14, 033035 (2012).
Acknowledgements
We thank Su-Chan Park for valuable discussions. This research was supported by the NRF Grant No. 2022R1I1A1A01063166 (JU), No. 2021R1A2B5B01001951 (HH), and No. 2017R1D1A1B06035497 (HP), and by the KIAS individual Grant No. PG013604 (HP).
Author information
Authors and Affiliations
Contributions
All authors contributed to conducting this study and wrote the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Um, J., Hong, H. & Park, H. Validity of annealed approximation in a high-dimensional system. Sci Rep 14, 6816 (2024). https://doi.org/10.1038/s41598-024-57323-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-024-57323-4