Article | Open | Published:

Extracting the multi-timescale activity patterns of online financial markets

Scientific Reportsvolume 8, Article number: 11184 (2018) | Download Citation

Abstract

Online financial markets can be represented as complex systems where trading dynamics can be captured and characterized at different resolutions and time scales. In this work, we develop a methodology based on non-negative tensor factorization (NTF) aimed at extracting and revealing the multi-timescale trading dynamics governing online financial systems. We demonstrate the advantage of our strategy first using synthetic data, and then on real-world data capturing all interbank transactions (over a million) occurred in an Italian online financial market (e-MID) between 2001 and 2015. Our results demonstrate how NTF can uncover hidden activity patterns that characterize groups of banks exhibiting different trading strategies (normal vs. early vs. flash trading, etc.). We further illustrate how our methodology can reveal “crisis modalities” in trading triggered by endogenous and exogenous system shocks: as an example, we reveal and characterize trading anomalies in the midst of the 2008 financial crisis.

Introduction

Social activity of individuals follows certain rhythms at different time scales. Many of the individual activities, such as sending e-mails and making phone calls, are likely to be done in particular time intervals within a day (i.e., diurnal or circadian cycles), and the total daily activity could heavily depend on the day of the week (i.e., weekly cycles)1,2,3,4,5,6. In general, these social activity rhythms emerging at different time scales may be correlated with each other; for instance, it has been shown that face-to-face contacts between classmates in a primary school follow a common diurnal cycle driven by the daily class schedule7,8, yet at the same time they would also share activity rhythms at longer scales such as weekly and monthly, reflecting the annual school schedule.

As social communications between humans form temporal social networks, financial transactions between banks also shape time-varying networks9,10,11,12,13. In the interbank market, for instance, overnight bilateral lending and borrowing between banks organize temporal networks whose structure changes on a daily basis, because the overnight financial contracts last for only one day11,12. Thus, financial markets, similarly to social networks, can be interpreted as complex systems where each agent’s activity should be captured and characterized at appropriate time scales11,12. In fact, many commonalities have recently been found between social communication patterns of humans and financial interaction patters of banks at particular temporal resolutions12,14,15.

In recent years, non-negative tensor factorization (NTF) has been frequently used to extract temporal activity patterns in various social contexts, such as face-to-face contacts8,16, Twitter posts17 and players’ matches in online games18. Among these studies, Gauvin et al8. showed that NTF is highly effective in detecting diurnal rhythms of students’ activity in a primary school7,19. Characterizing diurnal rhythms lead the authors to uncover the multi-timescale community structure formed by classmates: students’ temporal activity cycles, rather than the aggregated history of contacts, allows to reveal meaningful patterns that explain the complexity of children contact networks and communities.

Given the similarity between social and financial temporal dynamics, justified by underlying human factors, and the fact that multiple activity cycles are present at different frequencies in human social activities, our question is whether similar rhythms exist also in financial systems. In this work, we uncover hidden multi-timescale patterns of banks’ activities in the Italian online interbank market, e-MID20. In previous studies, it has been recognized that there exist activity patterns in banks’ financial transactions at a particular time scale, such as inter-day12 and intra-day scales21,22,23. However, it is still unknown whether these patterns coexisting at different time scales are dependent on each other, in which case banks exhibiting a given interday activity pattern are likely to follow a particular intraday pattern.

We employ NTF as a tool to detect multi-timescale patterns, in which banks’ activities are captured by a tensor having three dimensions: the list of banks, time of the day, and date. We will show that the PARAFAC decomposition of the 3-way tensor24,25 indicates that banks’ trading activities can be classified into several patterns over the data period of 2001–2015. In particular, the NTF allows us to identify an anomalous pattern around the Lehman Brothers’ collapse in September 2008. Our multi-timescale NTF approach reveals not only how banks facing the financial crisis changed their diurnal trading rhythms, but also on what dates such anomalies emerged.

Over the last couple of years, many proposals for measuring and controlling systemic risk have been presented, yet most of them focus on the static nature of financial networks26,27,28. However, as we show in this study of the Italian e-MID interbank market, various patterns and anomalies systematically emerge at different time scales, which should be taken into account in the design of financial regulations. Importantly, even in a situation in which bank activity has certain patterns at intra- and inter-day scales, it remains of paramount importance to understand whether the intra-day patterns are independent of the inter-day patterns (i.e., mono-timescale patterns) or they are correlated with each other (i.e., multi-timescale patterns). Our framework to extract multi-timescale patterns advances the understanding of when and how banks react to systemic shocks, and in the future it could contribute to controlling the spread of financial systemic risk9,10,29,30,31.

Data

We use the time-stamped data on bilateral interbank transactions occurred between January 2001 and December 2015 in the Italian online interbank market (e-MID). e-MID is an online platform for financial institutions provided by the Italian company e-MID SIM S.p.A. based in Milan, Italy (henceforth, we call financial institutions as “banks” for brevity). Banks in need of lending or borrowing funds may find a counterpart by posting an order on the online platform, which makes e-MID a marketplace in which lenders and borrowers are matched. Each transaction record in this data represents when a loan contract agreement has been reached between two banks and how much funds have been lent (in million Euros). In addition, the data contains information about the type of each loan agreement, i.e., a lender-proposed transaction or a borrower-proposed transaction. We define a lender-proposed (resp., borrower-proposed) transaction to be a transaction proposed by a bank that lends to (resp., borrows from) its counterpart.

As in the other interbank markets, the vast majority of transactions (>86%) in the e-MID market are overnight lending and borrowing (i.e., a loan contract lasts just for one day), while there are other types of transactions having longer maturity lengths such as two weeks, three month, etc. To eliminate the influence of differences in maturity length, we focus on overnight transactions of unsecured Euro deposits labeled as “ON” (i.e., overnight) or “ONL” (i.e., overnight large, namely overnight transactions greater than 100 million Euros). Table 1 summarizes the basic statistics of this dataset.

Table 1 Summary statistics of the Italian interbank market, e-MID.

There are 3,839 business days over the data period between Jan 2, 2001 and Dec 31, 2015, on each of which transactions are made between 8:00 and 18:00. There are 289 banks that conducted at least one transaction over this period: 194 of them are Italian banks while the rest are foreign banks. Regardless of the nationality of banks, we examine the transactions conducted between 8:00–18:00 in Italian standard time. We do not consider a time difference between countries where the headquarters of the banks are located. The total number of transactions (ON and ONL) that we use in the analysis amounts to 1,148,699. It should be noted that the 289 banks are not always active over the data period (cf., Fig. 1a). In fact, the daily average of the number of participating banks is around 95, and the average number of daily transactions is approximately 300 (cf., Fig. 1b). Although the time-series behaviors of the numbers of active banks and transactions are non-stationary, there is a stable scaling relationship between them (cf., Fig. 1c)12. The dataset is commercially available from e-MID SIM S.p.A (http://www.e-mid.it/).

Figure 1
Figure 1

Daily activities in the e-MID market. 20-day moving average is shown for (a) number of active banks having at least one transaction on a day and (b) number of trades. (c) Scaling relationship between the numbers of active banks and trades. Each dot represents a day.

Method

As noted in the previous section, banks are not always active in the interbank market. At the daily scale, some banks have transactions only on a certain fraction of business days while having no transactions on the other days12,21. If we look at intraday time scales, on the other hand, the frequency of a bank having at least one transaction is not uniformly distributed over the time intervals21,22. These heterogeneities in temporal bank activity are illustrated in Fig. S1.

Since the maturity of loan contracts is overnight, it is important to identify what are the days in which banks are more likely to be active. Conversely, since the participation of banks in the trading activity can change over the course of a day, it is also crucial to understand intraday activity changes. Due to the multi-scale nature of bank trading activity, directly studying the volume of transactions of each bank over time would not allow us to detect inter- and intra-day dynamics. Thus, we need to disentangle each bank’s activity across the two dimensions (i.e., time scales): interday and intraday. To this aim, we represent our data in a three-dimensional array (i.e., tensor), whose entries represent the amount of trades each bank performs at a given time of a given day. Given this multi-dimensional representation, our main goal is to extract some meaningful correlated multi-timescale activity patterns related to groups of banks sharing a similar amount of transactions at the same time (respectively, intraday and interday). This can be achieved by means of non-negative tensor factorization (NTF), as described in the following.

Non-negative tensor factorization (NTF) at different time scales

Let us consider a three-dimensional tensor \({\chi }\in {{\boldsymbol{{\mathbb{R}}}}}^{I\times J\times K}\), where I = N is the number of banks, J = T is the number of time intervals of bank activity in a day (here between 8:00 and 18:00), and K = D is the number of days. The entry \({x}_{ijk}\in {{\mathbb{Z}}}_{+}\) of the tensor \({\chi }\) denotes the total amounts of trades (in million Euros) conducted by the i-th bank during j-th time interval of the k-th day. To extract the intra- and inter-day trading patterns characterizing banks with similar amount of transactions over time, we rely on the NTF, which decomposes the tensor \({\chi }\) into the sum of several rank-one tensors, namely components (cf., Fig. 2).

Figure 2
Figure 2

Schematic of the implementation of Non-negative Tensor Factorization (NTF) framework.

Here, we implement the NTF by applying the well-established method called PARAFAC (parallel factor analysis) or CANDECOMP (canonical decomposition) with non-negativity constraints24,25,32. The decomposition can be written as

$${\chi }\approx \sum _{r\mathrm{=1}}^{R}{{\bf{a}}}_{r}\,\circ \,{{\bf{b}}}_{r}\,\circ \,{{\bf{c}}}_{r},$$
(1)
$${x}_{ijk}\approx \sum _{r\mathrm{=1}}^{R}{a}_{ir}{b}_{jr}{c}_{kr},$$
(2)

where \(R\in {\mathbb{N}}\) denotes the number of components (i.e., the rank of the tensor), and the operator ° represents outer product. Eq. (1) is the so-called canonical polyadic decomposition (CP) of a tensor \({\chi }\), where \({{\bf{a}}}_{r}\in {{\mathbb{R}}}_{+}^{N}\), \({{\bf{b}}}_{r}\in {{\mathbb{R}}}_{+}^{T}\) and \({{\bf{c}}}_{r}\in {{\mathbb{R}}}_{+}^{D}\) represent r-th component factors that respectively encode the membership of a bank to the component, the intervals in a day and the days in which the component is active (i.e. br and cr are the intra- and inter-day activity patterns of the groups of banks in ar).

Let \({\bf{A}}\in {{\mathbb{R}}}_{+}^{N\times R}\), \({\bf{B}}\in {{\mathbb{R}}}_{+}^{T\times R}\) and \({\bf{C}}\in {{\mathbb{R}}}_{+}^{D\times R}\) denote the factor matrices, whose r-th columns are the vectors ar, br and cr, respectively. The factor matrices A, B and C are calculated by solving the following minimization problem with non-negativity constraints:

$$\mathop{min}\limits_{{\bf{A}}\ge 0,{\bf{B}}\ge 0,{\bf{C}}\ge 0}\parallel \chi -[\hspace{-2pt}[{\bf{A}},{\bf{B}},{\bf{C}}]\hspace{-2pt}]{\parallel }_{{\rm{F}}}^{2},$$
(3)

where \([\kern-2pt[ {\bf{A}},{\bf{B}},{\bf{C}}]\kern-2pt] \) represents the Kruscal form of the tensor decomposition (i.e., the RHS of Eq. (1)), and \(\parallel \cdot {\parallel }_{{\rm{F}}}\) denotes the Frobenius norm.

This minimization problem can be rewritten to perform the minimization with respect to one factor matrix at a time. Let X(n) denote a matrix created by the mode-n matricization (or flattening) of tensor \({\chi }\), where each row of X(n) consists of a vector corresponding to a given index of mode-n. That is, X(1), X(2) and X(3) are N × TD, T × ND and D × NT matrices, respectively. They can be expressed in terms of factor matrices as follows:

$${{\bf{X}}}_{(1)}={\bf{A}}{({\bf{C}}\odot {\bf{B}})}^{{\rm{\top }}},$$
(4)
$${{\bf{X}}}_{{\boldsymbol{(}}2{\boldsymbol{)}}}={\bf{B}}{({\bf{C}}\odot {\bf{A}})}^{{\rm{\top }}},$$
(5)
$${{\bf{X}}}_{{\boldsymbol{(}}3{\boldsymbol{)}}}={\bf{C}}{({\bf{B}}\odot {\bf{A}})}^{{\rm{\top }}},$$
(6)

where \(\odot \) denotes the Khatri–Rao product, which is the “matching columnwise” Kronecker product defined as \({\bf{A}}\odot {\bf{B}}=[{{\bf{a}}}_{1}\otimes {{\bf{b}}}_{1},\ldots ,{{\bf{a}}}_{R}\otimes {{\bf{b}}}_{R}]\). The minimization problem for PARAFAC decomposition Eq. (3) can be now reformulated as

$$\{\mathop{min}\limits_{{\bf{A}}\ge 0}\parallel {{\bf{X}}}_{(1)}-{\bf{A}}{({\bf{C}}\odot {\bf{B}})}^{{\rm{\top }}}{\parallel }_{{\rm{F}}}^{2},\,\mathop{min}\limits_{{\bf{B}}\ge 0}\parallel {{\bf{X}}}_{(2)}-{\bf{B}}{({\bf{C}}\odot {\bf{A}})}^{{\rm{\top }}}{\parallel }_{{\rm{F}}}^{2},\,\mathop{min}\limits_{{\bf{C}}\ge 0}\parallel {{\bf{X}}}_{(3)}-{\bf{C}}{({\bf{B}}\odot {\bf{A}})}^{{\rm{\top }}}{\parallel }_{{\rm{F}}}^{2}\}.$$
(7)

The minimizers of A, B and C of this problem are computed using the non-negative alternate least squares method (ANLS) combined with the Block Principal Pivoting method (BPP) developed by33. Our implementation is based on the Tensor Toolbox34,35 and the MATLAB codes available from36.

Rank size

To determine the number of components R (i.e., rank size) used in the NTF model, we rely on the Core Consistency Diagnostic24. Given the tensor element xijk, we can rewrite Eq. (2) as

$${x}_{ijk}=\sum _{n=1}^{R}\sum _{m=1}^{R}\sum _{p=1}^{R}{\lambda }_{nmp}{a}_{in}{b}_{jm}{c}_{kp},$$
(8)

where λnmp denotes the (n, m, p) element of the superdiagonal binary tensor \( {\mathcal L} \) (i.e., λnmp = δnmδmpδnp). Now let gijk denote the (i, j, k) element of the core tensor \({\mathscr{G}}\), which is obtained by fitting the data to the Tucker3 model24. In the Tucker3 model, the minimization problem reads

$$\mathop{min}\limits_{{\bf{G}}}\parallel {\bf{X}}-{\bf{A}}{\bf{G}}{({\bf{C}}\otimes {\bf{B}})}^{{\rm{\top }}}{\parallel }_{{\rm{F}}}^{2},$$
(9)

where X is a N × TD matrix converted from tensor \({\chi }\), and G is also a matricized version (Rn × RmRp) of the core tensor \({\mathscr{G}}\). With the Tucker3 decomposition, the tensor is written as

$${x}_{ijk}=\sum _{n}^{{R}_{n}}\sum _{m}^{{R}_{m}}\sum _{p}^{{R}_{p}}{g}_{nmp}{a}_{in}{b}_{jm}{c}_{kp}\mathrm{.}$$
(10)

From the lemma of Bro and Kiers24, the core tensor \({\mathscr{G}}\) will be identical to the superdiagonal tensor \( {\mathcal L} \) if the Tucker3 model is perfectly fitted and the factors have full column rank. If \({\mathscr{G}}\) is significantly different from the superdiagonal tensor \( {\mathcal L} \), by contrast, it means that there are non-negligible interactions between factors and the PARAFAC model is not appropriate. Thus, we could assess whether the data should be fitted to the PARAFAC model or the Tucker3 model by measuring the distance between \({\mathscr{G}}\) and \( {\mathcal L} \).

We employ the Core Consistency (CC) value proposed by Bro and Kier24 as a measure of the distance between \({\mathscr{G}}\) and \( {\mathcal L} \):

$${\rm{C}}{\rm{C}}=100\times (1-\frac{\sum _{n=1}^{R}\sum _{m=1}^{R}\sum _{p=1}^{R}{({g}_{nmp}-{\lambda }_{nmp})}^{2}}{R}),$$
(11)

where we imposed the constraint Rn = Rm = Rp = R in implementing the Tucker3 decomposition. CC takes 100 if the PARAFAC model perfectly fits the data and less than 100 (possibly a negative value) if the model does not fit perfectly. Note that a rise in R will reduce fitting errors while increasing the possibility of over-fitting. In general, as R increases, there arises more interactions between components, which makes the core tensor \({\mathscr{G}}\) far from superdiagonal, resulting in a low value of CC. Therefore, it is reasonable to stop increasing R before the symptom of over-fitting emerges. Our determination of R is given as

$$R=\,max\,{R}^{{\rm{^{\prime} }}}\in \{{R}^{{\rm{^{\prime} }}}\,:\,{\rm{C}}{\rm{C}}({R}^{{\rm{^{\prime} }}}) > {L}_{{\rm{c}}c},\,{R}^{{\rm{^{\prime} }}}\in {\mathbb{N}}\},$$
(12)

where CC() denotes the core consistency as a function of the number of components, and Lcc is a threshold parameter. In line with16, we set Lcc = 85, and to minimize randomness created by a PARAFAC decomposition, we implement PARAFAC decomposition 20 times for a given rank size and use their mean as the value for CC(R′). Our implementation uses the MATLAB code available form37 which is based on the alternating nonnegativity-constrained least squares with block principal pivoting38.

It should be noted that if one implements a low-dimensional clustering method, such as non-negative matrix factorization, separately at different time scales, then in general one would obtain different numbers of mono-timescale patterns at different scales. In that case, however, it would not be possible to know whether or not there exist multi-timescale patterns such that banks exhibiting a common intraday pattern also show a common interday pattern.

Results

Synthetic temporal financial markets

To validate the accuracy of our multi-timescale decomposition, we first implement NTF on a synthetic financial market whose properties are fully known ex ante. Suppose that there are three groups of banks, each of which having particular intra- and inter-day trading patterns. First, we introduce intraday trading patterns by considering the “fitness” of banks. In the fitness model, the probability that banks i and j trade at time t is given by

$${p}_{ij,t}={a}_{i,t}{a}_{j,t},$$
(13)

where ai,t [0, 1] denotes the fitness of bank i within the time interval [t − Δ, t]12,39. Δ is the length of a time interval (in a day) expressed in minutes. Differences in the intraday trading patterns across groups are then represented by different values of fitness. Let us assume that the fitness evolves as illustrated in Fig. 3a. Banks belonging to group 1 are most active in the early morning (blue solid), and banks in group 2 exhibit the highest trading activity around noon (red solid), and banks in group 3 are most active at the end of the day (black dotted). More specifically, the fitness value of a bank belonging to group s at time interval t is given as

$${a}_{i,t}^{s}=f(t;{\mu }_{s},\sigma ),\,t=\mathrm{1,}\ldots ,T,$$
(14)

where f(t; μs, σ) is the p.d.f. of normal distribution with mean μs and standard deviation σ. We set (μ1, μ2, μ3) = (0, T/2, T) and σ = T/4.

Figure 3
Figure 3

Predefined intra- and interday trading patterns for the synthetic financial market. (a) Predefined intraday activity patterns, represented by the fluctuation of fitness. (b) Predefined interday activity patterns, given by the participation probability.

Second, the interday trading patterns are captured by variations in a bank’s participation probability, which is the probability that a bank participates in the market on a given day, apart from whether or not the bank is able to find a trading partner ex post. For day d = 1, …, D, the participation probability of bank i, denoted by qi,d, is given as (Fig. 3b)

$${q}_{i,d}=\{\begin{array}{cc}0.5 & {\rm{i}}{\rm{f}}\,i\in {\rm{g}}{\rm{r}}{\rm{o}}{\rm{u}}{\rm{p}}\,1,\\ \frac{2}{D}(d-1) & {\rm{i}}{\rm{f}}\,i\in {\rm{g}}{\rm{r}}{\rm{o}}{\rm{u}}{\rm{p}}\,2\,\,{\rm{a}}{\rm{n}}{\rm{d}}\,\,d\le D/2,\\ \frac{-2}{D}(d-D) & {\rm{i}}{\rm{f}}\,i\in {\rm{g}}{\rm{r}}{\rm{o}}{\rm{u}}{\rm{p}}\,2\,\,{\rm{a}}{\rm{n}}{\rm{d}}\,\,d > D/2,\\ \frac{1}{D}(d-1) & {\rm{i}}{\rm{f}}\,i\in {\rm{g}}{\rm{r}}{\rm{o}}{\rm{u}}{\rm{p}}\,3.\end{array}$$
(15)

For simplicity, we assume that trade volumes are identical for all trades so that the (i, j, k) element of the 3-dimensional tensor is equal to the total number of trades that bank i has during time interval j on day k. We will introduce a volume heterogeneity when analyzing the empirical data in the next section. We set N = 120, T = 20 (i.e., resolution Δ = 30 for hours between 8:00 and 18:00 in each day) and D = 1000.

Using the above synthetic tensor, we can now implement our multi-timescale tensor factorization. The factorization of tensor \({\chi }\) allows us to measure the activity of each individual element: a bank, an intra-day time interval, and a day. The activity of intra-day time interval j of component r is given by bjr, and analogously the activity of day k of component r is represented by ckr. Figure 4 illustrates that PARAFAC decomposition well extracts the true multi-timescale patterns. The core-consistency value strongly suggests R = 3 since CC(4) takes a large negative value (Fig. 5).

Figure 4
Figure 4

PARAFAC decomposition for the synthetic financial markets. (a) Intra-day activity for each component. Activity in time interval j of component r is given by bjr. (b) Inter-day activity for each component. Activity of day k of component r is given by ckr.

Figure 5
Figure 5

Core-Consistency for the synthetic markets. Dashed line denotes Lcc = 85.

Empirical data

Now we analyze empirical data. Given the accuracy of our method in the synthetic model, we expect the NTF method to extract latent multi-timescale patterns in the real-world financial market, e-MID. Here, we implement the N × T × D tensor factorization described in Method, where we set intraday time resolution (in minutes) Δ = {3, 5, 10, 15, 30, 45, 50}, and D is set at the total number of business days between January 2001 and December 2015 (i.e., D = 3, 839). The number of active banks N, which traded at least once during the period, is 289. The Core-Consistency will reveal the number of components R, if any, which is equivalent to the the variety of existent activity patterns.

Core-Consistency

The CC value for a given rank size is illustrated in Fig. 6a for Δ = 15. The CC value becomes lower than 85 for R ≥ 4, suggesting that R = 3 should be selected. In general, imposing different intraday resolutions may lead us to choose different values of R (Fig. 6b). There is a tendency that a higher resolution requires a larger number of components for the PARAFAC decomposition to be appropriate. In the following, we employ Δ = 15 and thereby R = 3 as the benchmark case, the rationale of which will be discussed in the next subsection.

Figure 6
Figure 6

Determination of rank size. (a) Core-Consistency values for Δ = 15. Error bar denotes the 95% confidence interval of the mean Core-Consistency value, calculated by 20 runs of PARAFAC decomposition. (b) Selected value of R for a given time resolution Δ  {3, 5, 10, 15, 30, 45, 60}.

Intra-day and inter-day activity

Figure 7a shows intra- and inter-day activities for Δ = 15, in which case there are three different patterns. The intra-day activity of Component 1 is characterized by its bimodal pattern (Since the assignment of component index is originally arbitrary in the NTF implementation, we re-assign index in the ascending order of cumulative intra-day activity between 8:00 and 10:00). It has two peaks around 10:00 and 17:00. On the other hand, both Components 2 and 3 have a single distinct peak in the early morning, after which their activities are very low. However, the distribution of intraday activity of Component 3 is more skewed than that of Component 2, which makes Components 1 and 3 two polar cases and Component 2 in between them. We would call the trading patterns of Components 1, 2 and 3 as normal trading, early trading, and flash trading, respectively.

Figure 7
Figure 7

Intra- and inter-day activities. Peak of the US house price (July 2006) and Lehman collapse (September 2008) are indicated by blue dotted and red dashed, respectively. The data for the US house price is taken from FRED (S&P/Case-Shiller U.S. National Home Price Index)42 (a) Intra-day activity. (b) Inter-day activity. (c) Share of a component in the daily activity. In panels (b) and (c), 20-day moving average is shown.

The activity patterns for different temporal resolutions are also presented in Fig. S2. For the case of a finer intra-day resolution (e.g., Δ = 5, Fig. S2a), there are more than three components, and the activity of an additional component (i.e., Component 4) turns out to be very similar to the flash-trading pattern we saw in Fig. 7a. On the other hand, when the temporal resolution is low (e.g., Δ = 45, Fig. S2c), there are only two components and the flash-trading pattern is no longer detected. Given these observations, it is natural to set Δ = 15 as a benchmark case, where apparently independent intra-day patterns can be captured. It should be noted that the following results are not sensitive to the temporal resolution level as long as R = 3 is to be selected (e.g., Δ = 30, Fig. S2b).

Figure 7b illustrates the inter-day activity of each component. For Components 1 and 2, the activity decreased radically during the global financial crisis of 2007–2009, which was initiated by a significant decline of the US house prices (the peak date is indicated by blue dotted). In contrast, the activity of Component 3 spiked around the collapse of Lehman Brothers in September 2008 (indicated by red dashed). Figure 7c shows how the share of a given component evolved over time.

These observations suggests that Component 3 captures the “crisis mode” of bank trading while Components 1 and 2 represent more normal trading patterns. The crisis-mode interpretation is reinforced by the intra-day trading pattern of Component 3, in which banks trade only in the very early morning. In fact, we will show that, although we did not use information about the directionality of trades, this anomaly comes from the fact that banks in need of liquidity tried to obtain loans, rather than to extend credit, in the midst of the financial crisis.

Banks’ affiliation to components

Each element of vector ar represents the extent to which a bank’s trading pattern is captured by Component r. Thus, we can extract a subgroup of banks whose trading patterns are characterized by Component r at least to some extent. Here, the set of banks belonging to component r is given by Ir = {i′} for which \({a}_{i^{\prime} r}\) is within the 90th percentile of \({\{{a}_{ir}\}}_{i\mathrm{=1}}^{N}\) (Fig. 8a). It should be noted that a bank may belong to multiple components if its trading pattern has multiple features (Fig. 8b).

Figure 8
Figure 8

Affiliation of banks to components. The set of banks belonging to component r is given by Ir = {i′} for which \({a}_{{i}^{\text{'}}r}\) is within the 90th percentile of \({\{{a}_{ir}\}}_{i\mathrm{=1}}^{N}\). (a) Number of banks that belong to a component. (b) Jaccard index for the overlap of banks belonging to multiple components. (c) Average membership level on a given day. Membership level for a bank is given by a row of \({{\bf{a}}}_{r}{{\bf{c}}}_{r}^{{\rm{\top }}}\).

The bank activity patterns emerging at the daily scale, captured by the row average of \({{\bf{a}}}_{r}{{\bf{c}}}_{r}^{{\rm{\top }}}\), exhibit explicit differences across components (Fig. 8c). While all types of banks have not been active since 2009, the normal-trading feature of banks belonging to Component 1 represents their behavior until 2008, and the trading pattern of banks belonging to Component 2 are dominated by the early-trading pattern up to 2006. On the other hand, the banks belonging to Component 3 exhibit daily patterns similar to the other types of banks prior to 2008, but suddenly their activity level spiked around the collapse of Lehman Brothers.

Characterization of components

Aside from the intra- and inter-day trading patters, it would be of interest to see whether we may characterize each component by inherent attributes of the belonging banks. In the e-MID data set, a trading bank is classified into either of the following four types: aggressor lender, quoter lender, aggressor borrower and quoter borrower. In the e-MID online platform, a bank posts a request for loans or a proposal for lending, and a loan contract is made if another bank accepts the posted request. A bank is called “aggressor lender” when the bank accepts a request for loan posted on the e-MID platform, and the bank posted the request and borrowed fund is called “quoter borrower”. “quoter lender” and “aggressor borrower” can also be understood analogously. In addition, we can also ask to what extent the nationality of banks can explain the differences in trading patterns.

In fact, the majority of transactions in the e-MID market were done between aggressor lenders and quoter borrowers, which is a common property to all the component types (Fig. 9a). However, more than half of the banks belonging to Component 3 are quoter borrowers and the share of aggressor lenders is significantly lower than that. As for the nationality, the share of Italian banks among all the banks belonging to Component 1 is significantly low while the corresponding fraction is significantly large for the banks in Component 2 (Fig. 9b) at 90% statistical significance, respectively. This suggests that foreign banks (i.e., banks from countries outside Italy) are likely to exhibit the normal-trading pattern, and Italian banks are more likely to employ the early-trading pattern than foreign banks do.

Figure 9
Figure 9

Role of bank attributes in the characterization of components. (a) Average frequency of a bank being an aggressor lender, a quoter borrower, an aggressor borrower and a quoter lender. Error bar denotes 95% confidence interval. (b) Share of Italian banks in each group. “Random” denotes the average share of Italian banks under random chance, and error bar denotes the 90% interval calculated from a binomial distribution with parameter (Nr, p), where Nr is the number of banks belonging to component r and p ≡ #Italian banks/N.

These observations give us important implications about the multi-timescale trading patterns in the financial market. First, flash trading, which represents the intra-day trading pattern of Component 3, can be attributed mostly to quoter borrowers. Recall that flash trading was observed mostly in the period around the Lehman collapse in September 2008, but we do not know ex ante whether such a trading pattern was driven either by demand or supply. The fact that Component 3 is largely attributed to quoter borrowers suggests that the flash-trading pattern during the financial crisis was conducted by banks that attempted to obtain liquidity as early as possible by posting quotes for loans. This may be regarded as evidence that some banks in fact faced a serious liquidity shortage at the time of the Lehman collapse40,41. Our multi-timescale NTF approach reveals not only how banks reacted to the fear of liquidity shortage (i.e., intra-day pattern), but also specific dates on which the fear was most evident (i.e., inter-day pattern).

Second, differences in the nationality of banks can lead to the variety of trading patterns. It turns out that foreign banks (Italian banks) are more likely to employ normal trading (early trading) than early trading (normal trading). On the other hand, the source of the crisis modality cannot be explained by the nationality of banks (Fig. 9b), suggesting that banks had similar chance of being in a crisis mode regardless of their nationalities.

Discussion

In this work, we presented an analytic framework based on non-negative tensor factorization (NTF) to extract temporal activity patterns of financial systems. Despite previous studies on online financial markets recognized the existence of trading activity patterns at specific time scales (e.g., inter-day12, or intra-day21,22,23), we demonstrated–to the best of our knowledge for the first time–that activity patterns coexist at different time scales and depend upon each other. Our methodology allowed us to uncover the hidden multi-timescale patterns of trading activities in an online interbank market (e-MID20).

Within our framework, banks’ activities were represented by means of a tensor of three dimensions, namely the list of banks, time of the day, and date. Leveraging the power of NTF (based on the PARAFAC decomposition of the 3-way tensor24,25), we uncovered the multi-timescale nature of financial trading dynamics in e-MID, suggesting that banks’ trading patterns could be classified into subgroups exhibiting significantly different multi-timescale patterns. Our framework also allowed us to attribute roles to banking institutions (aggressor lender/borrower, or quoter lender/borrower) based on their trading patterns, yielding interpretable analytic insights.

By modeling the multi-timescale dynamics occurred over the period covered by our data (2001–2015), the proposed NTF-based framework allowed us to identify trading anomalies in the midst of the financial crisis. For example, around the time of Lehman Brothers’ collapse in September 2008, our approach showed how banks changed their trading rhythms, and on what dates such anomalies emerged.

Understanding trading patterns in financial systems is of fundamental importance for many reasons: first, a rigorous characterization of such systems’ trading dynamics could help central banks to effectively intervene in the interbank market. In turn, this would contribute to reducing systemic risk in the financial system as a whole. Financial linkages created by bilateral transactions between banks can lead to a global network of interconnected risk, in which a failure of one bank can immediately spread over the entire system9,29,30. Extracting multi-timescale patterns of financial markets allows for a better understanding of when and how banks react to systemic shocks.

Of course, the current approach has certain limitations. First, the tensor representation of interbank transactions does not capture information about the network aspect of the interbank market. While the current NTF takes bank ID, time and day as inputs, the interconnectivity between banks is still ignored. Given that many previous studies revealed that interbank networks contain rich information regarding systemic risk9,29,30, including structural information in the framework could improve the results.

Second, while we focused on two different time resolutions, namely intra- and inter-day, there could also be other timescales, such as weekly or monthly periodicity, that could contain meaningful information for characterizing the trading behavior of banks. However, the introduction of additional time scales would add more dimensions to the tensor, which would make it more challenging to find explicit patterns using the PARAFAC decomposition.

Third, the current analysis did not fully explore the role of multi-scale activity patterns in propagating systemic risk. It would be interesting to examine to what extent each of the three activity patterns could promote or prevent financial contagion of bank defaults. To the best of our knowledge, the multi-timescale aspect of the source of financial systemic risk has not been investigated so far. This appears as a promising future direction of this line of research.

Finally, while the current work focused on the Italian e-MID market, this is just a small part of the entire financial system. There are many other interbank markets in different countries, and there are also other types of interbank transactions such as trading of government bonds and credit default swaps. An important question to ask would therefore be: are the multi-timescale patterns found in our analysis ubiquitous or they are specific of markets that obey trading dynamics typical of the e-MID market?

This work lays out the foundations for other researchers to study how patterns and anomalies emerge in financial systems at different temporal resolutions: in the future, such a framework could contribute to controlling the spread of financial systemic risk9,10,29,30,31. It would be interesting to investigate whether our method could be used both in predictive and prescriptive ways to help determine what could happen under certain risk conditions, as well as to provide possible intervention strategies prior to shocks or cascading collapses in financial systems.

Additional information

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. 1.

    Malmgren, R. D., Stouffer, D. B., Motter, A. E. & Amaral, L. A. N. A Poissonian explanation for heavy tails in e-mail communication. Proc. Natl. Acad. Sci. USA 105, 18153–18158 (2008).

  2. 2.

    Malmgren, R. D., Stouffer, D. B., Campanharo, A. S. L. O. & Amaral, L. A. N. On universality in human correspondence activity. Science 325, 1696–1700 (2009).

  3. 3.

    Jo, H. H., Pan, R. K. & Kaski, K. Emergence of bursts and communities in evolving weighted networks. PLOS ONE 6, e22687 (2011).

  4. 4.

    Jo, H. H., Karsai, M., Kertész, J. & Kaski, K. Circadian pattern and burstiness in mobile phone communication. New J. Phys. 14, 013055 (2012).

  5. 5.

    Aledavood, T., Lehmann, S. & Saramäki, J. Digital daily cycles of individuals. Front. Phys. 3, 73 (2015).

  6. 6.

    Aledavood, T. et al. Daily rhythms in mobile telephone communication. PLOS ONE 10, e0138098 (2015).

  7. 7.

    Stehlé, J. et al. High-resolution measurements of face-to-face contact patterns in a primary school. PLOS ONE 6, e23176 (2011).

  8. 8.

    Gauvin, L., Panisson, A. & Cattuto, C. Detecting the community structure and activity patterns of temporal networks: a non-negative tensor factorization approach. PLOS ONE 9, e86028 (2014).

  9. 9.

    May, R. M., Levin, S. A. & Sugihara, G. Complex systems: Ecology for bankers. Nature 451, 893–895 (2008).

  10. 10.

    Haldane, A. G. & May, R. M. Systemic risk in banking ecosystems. Nature 469, 351–355 (2011).

  11. 11.

    Barucca, P. & Lillo, F. Disentangling bipartite and core-periphery structure in financial networks. Chaos Solitons Fractals 88, 244–253 (2016).

  12. 12.

    Kobayashi, T. & Takaguchi, T. Social dynamics of financial networks. EPJ Data Science 7(15), (2018).

  13. 13.

    Caccioli, F., Barucca, P. & Kobayashi, T. Network models of financial systemic risk: a review. J. Comput. Soc. Sci. 1, 81–114 (2018).

  14. 14.

    Starnini, M., Baronchelli, A. & Pastor-Satorras, R. Modeling human dynamics of face-to-face interaction networks. Phys. Rev. Lett. 110, 168701 (2013).

  15. 15.

    Starnini, M., Baronchelli, A. & Pastor-Satorras, R. Model reproduces individual, group and collective dynamics of human contact networks. Soc. Netw. 47, 130–137 (2016).

  16. 16.

    Sapienza, A., Barrat, A., Cattuto, C. & Gauvin, L. Estimating the outcome of spreading processes on networks with incomplete information: a mesoscale approach. arXiv:1709.01806 (2017).

  17. 17.

    Panisson, A., Gauvin, L., Quaggiotto, M. & Cattuto, C. Mining concurrent topical activity in microblog streams. In Proceedings of the 4th workshop on ‘Making Sense of Microposts’, World Wide Web Conference 2014 (2014).

  18. 18.

    Sapienza, A., Bessi, A. & Ferrara, E. Non-negative tensor factorization for human behavioral pattern mining in online games. Information 9, 66.

  19. 19.

    Cattuto, C. et al. Dynamics of person-to-person interactions from distributed RFID sensor networks. PLOS ONE 5, 1–9 (2010).

  20. 20.

    e-MID SIM S.p.A website, http://www.e-mid.it/.

  21. 21.

    Iori, G., De Masi, G., Precup, O. V., Gabbi, G. & Caldarelli, G. A network analysis of the Italian overnight money market. J. Econ. Dyn. Control 32, 259–278 (2008).

  22. 22.

    Beaupain, R. & Durré, A. The interday and intraday patterns of the overnight market: Evidence from an electronic platform. ECB Working Paper 988 (2008).

  23. 23.

    Kobayashi, T. & Takaguchi, T. Identifying relationship lending in the interbank market: A network approach. arXiv:1708.08594 (2017).

  24. 24.

    Bro, R. & Kiers, H. A. A new efficient method for determining the number of components in PARAFAC models. J. Chemom. 17, 274–286 (2003).

  25. 25.

    Kolda, T. G. & Bader, B. W. Tensor decompositions and applications. SIAM Rev. 51, 455–500 (2009).

  26. 26.

    Beale, N. et al. Individual versus systemic risk and the regulator’s dilemm. a. Proc. Natl. Acad. Sci. USA 108, 12647–12652 (2011).

  27. 27.

    Gai, P., Haldane, A. & Kapadia, S. Complexity, concentration and contagion. J. Monet. Econ. 58, 453–470 (2011).

  28. 28.

    Kobayashi, T. & Hasui, K. Efficient immunization strategies to prevent financial contagion. Sci. Rep. 4, 3834 (2014).

  29. 29.

    Gai, P. & Kapadia, S. Contagion in financial networks. Proc. R. Soc. Lond. A Math. Phys. Sci. 466, 2401–2423 (2010).

  30. 30.

    Brummitt, C. D. & Kobayashi, T. Cascades in multiplex financial networks with debts of different seniority. Phys. Rev. E 91, 062813 (2015).

  31. 31.

    Battiston, S., Caldarelli, G., May, R. M., Roukny, T. & Stiglitz, J. E. The price of complexity in financial networks. Proc. Natl. Acad. Sci. USA 113, 10031–10036 (2016).

  32. 32.

    Lim, L.-H. & Comon, P. Nonnegative approximations of nonnegative tensors. J. Chemom. 23, 432–441 (2009).

  33. 33.

    Kim, J. & Park, H. Fast nonnegative tensor factorization with an active-set-like method. In High-Performance Scientific Computing, 311–326 (Springer, 2012).

  34. 34.

    Bader, B. W. et al. Matlab Tensor Toolbox version 2.6. http://www.sandia.gov/tgkolda/TensorToolbox/ (2015).

  35. 35.

    Bader, B. W. & Kolda, T. G. Efficient MATLAB computations with sparse and factored tensors. SIAM J. Sci. Comput. 30, 205–231 (2007).

  36. 36.

    Kim, J. Nonnegative Matrix and Tensor Factorizations, https://sites.google.com/site/jingukim/, accessed December 10, 2017.

  37. 37.

    Papalexakis, V. Fast and Efficient Core Consistency Diagnostic for Big Sparse Tensors, http://www.cs.ucr.edu/epapalex/code.html, accessed December 10, 2017.

  38. 38.

    Papalexakis, E. E. & Faloutsos, C. Fast efficient and scalable Core Consistency diagnostic for the PARAFAC decomposition for big sparse tensors. In Acoustics, Speech and Signal Processing (ICASSP ), 2015 IEEE International Conference on, 5441–5445 (IEEE, 2015).

  39. 39.

    De Masi, G., Iori, G. & Caldarelli, G. Fitness model for the Italian interbank money market. Phys. Rev. E 74, 066112 (2006).

  40. 40.

    Brunnermeier, M. K. Deciphering the liquidity and credit crunch 2007–2008. J. Econ. Perspect. 23, 77–100 (2009).

  41. 41.

    Allen, F. & Carletti, E. An overview of the crisis: Causes, consequences, and solutions. Intl. Rev. Finance 10, 1–26 (2010).

  42. 42.

    Federal Reserve Bank of St. Louis, FRED, S&P/Case-Shiller U.S. National Home Price Index, https://fred.stlouisfed.org/series/CSUSHPINSA, accessed Feb 19, 2018.

Download references

Acknowledgements

TK acknowledges financial support from the Japan Society for the Promotion of Science Grants no. 15H05729 and 16K03551. EF is grateful to DARPA for support (grant #D16AP00115). This project does not necessarily reflect the position/policy of the Government; no official endorsement should be inferred. Approved for public release; unlimited distribution.

Author information

Affiliations

  1. Graduate School of Economics, Center for Computational Social Science, Kobe University, Kobe, Japan

    • Teruyoshi Kobayashi
  2. Information Sciences Institute, University of Southern California, Los Angeles, CA, USA

    • Anna Sapienza
    •  & Emilio Ferrara

Authors

  1. Search for Teruyoshi Kobayashi in:

  2. Search for Anna Sapienza in:

  3. Search for Emilio Ferrara in:

Contributions

T.K. and E.F. conceived the research and wrote the manuscript. T.K. performed the analysis. T.K., A.S. and E.F. discussed the results and reviewed the manuscript.

Competing Interests

The authors declare no competing interests.

Corresponding author

Correspondence to Emilio Ferrara.

Electronic supplementary material

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/s41598-018-29537-w

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.