Abstract
Earthquake signal detection is at the core of observational seismology. A good detection algorithm should be sensitive to small and weak events with a variety of waveform shapes, robust to background noise and nonearthquake signals, and efficient for processing large data volumes. Here, we introduce the CnnRnn Earthquake Detector (CRED), a detector based on deep neural networks. CRED uses a combination of convolutional layers and bidirectional longshortterm memory units in a residual structure. It learns the timefrequency characteristics of the dominant phases in an earthquake signal from three component data recorded on individual stations. We train the network using 500,000 seismograms (250k associated with tectonic earthquakes and 250k identified as noise) recorded in Northern California. The robustness of the trained model with respect to the noise level and nonearthquake signals is shown by applying it to a set of semisynthetic signals. We also apply the model to one month of continuous data recorded at Central Arkansas to demonstrate its efficiency, generalization, and sensitivity. Our model is able to detect more than 800 microearthquakes as small as −1.3 ML induced during hydraulic fracturing far away than the training region. We compare the performance of the model with the STA/LTA, template matching, and FAST algorithms. Our results indicate an efficient and reliable performance of CRED. This framework holds great promise for lowering the detection threshold while minimizing false positive detection rates.
Introduction
During the past 10 years, there has been an enormous increase in the volume of data being generated by the seismological community. Each year, more than 50 terabytes of seismic data are archived at the Incorporated Research Institutions for Seismology (IRIS) alone. The massive amount of data highlights the need for more efficient and powerful tools for data processing and analyses. The main challenge is the efficient extraction of as much useful information as possible from these large datasets. This is where rapidly evolving machine learning (ML) approaches have the potential to ply a key role^{1,2,3,4}. One of the first stages that observational seismologists need to meet this challenge is in the processing of continuous data to detect earthquake signals. Among a large variety of detection methods developed in past few decdes, STA/LTA^{5} and template matching^{6,7} are the most commonly used algorithms. While STA/LTA is generalized and efficient, its sensitivity to timevarying background noise and lack of sensitivity to small events, false positives, and events recorded shortly after each other make it less than optimal for robust and sensitive detection. Although the high sensitivity of crosscorrelation improves the detection threshold of template matching, the requirement of prior knowledge of templates and multiple crosscorrelation procedures make it less general and inefficient for realtime processing of large seismic data volumes. Although more advanced algorithms such as Fingerprint And Similarity Thresholding (FAST)^{8} using LocalitySensetive Hashing^{9} can improve the efficiency of the similarity search, the outputs are in that case limited to repeated signals.
Shallow fully connected Neural Networks (NN) were among the first ML methods used for the earthquake signal detection^{10,11}. NN receive a feature vector, x (a sparse representation of seismic data), as input and transform it through a series of hidden layers to predict the desired outputs, y, in the output layer. Each hidden layer is made up of a set of neurons, where each neuron is fully connected to all neurons in the adjacent layers, and where neurons in a single layer function completely independently and do not share any connections. Nonlinear activation functions inside neurons make learning complex xy relations possible through an optimization process. To learn these relations more deeply and to build a more complex model requires exponentially more units in each layer or alternatively many layers with few units in each layer (a deep neural net). Fully connected layers, as in standard neural networks, don’t scale well to large input vectors and require careful initiation, feature engineering, optimization, and regularization to prevent vanishing/exploding gradients^{12} and overfitting.
During the recent renewed interest in ML applications among seismologists, some studies have revisited the detection problem^{13,14,15}. These studies presented successful and promising performances of deep convolutionalneuralnetworks (CNN) for robust and efficient detection of parts of earthquake signals. In addition to fully connected layers, CNN’s include convolutional layers and pooling layers. A convolutional layer consists of a set of learnable filters (or kernels). Every filter has a small receptive field (connected to a small region of the layer before it). It applies a convolution operation to the input and produces an activation map that gives the responses of that filter at every spatial position. Hence, as the input volume is passing through the convolutional layers the network automatically learns the low/mid/highlevel features in data. This eliminates the need for heavy preprocessing and hand engineering of features. Moreover, it reduces the number of free parameters, allowing the network to be deeper with fewer parameters. Pooling layers combine the outputs of multiple neurons at one layer into a single neuron in the next layer, hence it can reduce the dimension of learned features as data is fed forward.
In this paper, we formulate the detection problem as a sequencetosequence learning^{16} where a time series of inputs are mapped to a time series of probability outputs and separate predictions are made for each individual sample. Recurrent neural networks (RNN) were designed for processing sequential data like seismograms. They have internal state (memory) and can share features learned across the different positions within a time series^{17}. Hence, they can learn the dynamic temporal relations within a time sequence. In this study, we use bidirectional longshortterm memory (LSTM) as our RNN units and employ a residuallearning framework to make deeper learning feasible. In the residual learning framework, the network will learn the residual functions instead of original mapping functions. This makes their optimization easier, keeps the training error in the deeper layer the same as for the shallower ones, and by doing so makes it possible to train a deeper network. Deeper networks allow learning higherlevel features and building more complex models. We demonstrate the performance of the network using both semisynthetic and real data.
Results
The network architecture
The architecture of our proposed network is presented in Fig. 1. We use three types of layers: convolutional, recurrent, and fully connected, in a residual structure.
Inputs into the network are spectrograms of three component seismograms. Our previous studies^{18,19} showed that timefrequency transforms can improve event detection by better characterizing seismic signals. The first few blocks (blue layers) consist of mainly convolutional layers. Convolutional layers in the residual block are preceded by a batch normalization (BN) and an activation layer. BN layers normalize the activation of a convolution layer during the training, which accelerates the training and has some regularization characteristics that help prevent overfitting. These layers will automatically learn and extract features from the input spectrograms so there is no need for feature engineering or complicated preprocessing. As the network gets deeper, these layers extract higherlevel (i.e., finer scale) features.
To maximize the feature extraction we increased the number of 2D convolutional layers by arranging them into residual blocks based on the improved structure presented by He et al.^{20}. This is done by providing shortcuts that make it possible to train a deeper network without degradation. Every two residual blocks are preceded by an individual layer with a stride of 2 that halves the feature map size. This decreases the feature map size with depth and downsamples the feature volume to a more sparse representation. The number of filters in every three layers is doubled to preserve the time complexity per layer. The downsampling speeds the training of recurrent layers in the following section.
After 2D convolutional layers, the feature volume is redistributed into a sequence and passes into two residual blocks of bidirectional LSTMs. These layers learn and model the sequential pattern of data. Since in real time seismic acquisition, samples of an earthquake signal are recorded/represented with time increasing from lefttoright, we add one additional unidirectional LSTM layer to the end of the recurrent section. Finally, the last two layers of the network are fully connected layers that perform the highlevel reasoning and map the learned sequence model from the last step to the desired output classes. We used a sigmoid binary activation function in the last layer of the network, and the output is a vector of predicted probabilities for each sample to contain an earthquake signal.
Overall the network consists of 12 layers and has 256,000 trainable parameters. It takes advantage of three different types of layers within an efficient structure. Design of the network with shortcuts in a residual learning structure makes it possible to train the network with an acceptably low error rate. This is an endtoend learning framework that can characterize the seismic data with high precision. It is designed to be extensible and has the potential to fulfill many applications in automating seismic data processing.
Data
We use 550,000 30second 3component seismograms recorded by 889 broadband and shortperiod stations in North California for the training of the network and its validation. 50% of these seismograms are associated with earthquakes occurring from January 1987 to December 2017. The metadata used for labeling the Pwave and Swave arrival times are manual picks provided by the Northern California Earthquake Data Center. Another half of the data set consists of seismic noise recorded by the same network stations. The noise samples contain a variety of ambient and nonambient noises Fig. 2. We randomly sampled 30second noise seismograms obtained from time spans between the cataloged events. We then performed a simple quality check of the ratio of maximum over the median amplitude in each window to eliminate those noise traces that might contain uncatalogued events. To further ensure no contamination of the noise samples by small events below the background noise level, we used a designaling algorithm^{21} on the remaining traces. This algorithm removes the anomalous spectral features associated with earthquake signals.
We detrended all the traces by removing the mean, bandpass filtered between 1 and 45 Hz, resampled at 100 HZ, and normalized. We used the Short Time Fourier Transform to construct spectrograms. For ground truth, we generated one binary label vector with the same length as spectrograms. In the label vector, we set the value of corresponding samples from the P arrival to P + 3(S − P) to 1 and the rest to 0 representing the probabilities of existence of earthquake signal Fig. 2. This range captures the dominant spectral energy of P and shear waves, which characterize the earthquake signals in the timefrequency domain.
Training and testing of the model
We randomly split the dataset into training (80%), evaluation (10%), and test (10%) sets. We trained the network on one Tesla V100PCIE GPU. We used binary crossentropy as the loss function and the ADAM algorithm^{22} for optimization. We completed the training in 62 epochs, and found that the validation accuracy did not improve in the last 20 epochs. The final training and validation accuracies are 99.33% and 99.24% respectively while the losses are 0.02 and 0.03. The mean absolute errors are 0.01 and 0.009 for the training set and validation set respectively. These values are measured from a pointbypoint comparison of the model predictions with the ground truth.
To evaluate the performance of the model for detection, we used 50,000 test samples. After selecting a decision threshold value (tr) for output probabilities, we can calculate several parameters for evaluating the performance of the model. We use precision, recall, and Fscore as evaluation metrics. Precision is defined as the fraction of predictions that are accurate, Recall is defined as the fraction of instances that are accurately predicted, and the Fscore (the harmonic mean of precision and recall) combines these two parameters to eliminate effects of unbalanced sample size for different classes:
where, TP denotes true positives, FP denotes false positives, and FN are false negatives. In a perfect classifier TP = 1, and FP = 0. The precision and recall are calculated using different threshold values to check the effect of different threshold selection on the detection results Fig. 3. As can be seen from Fig. 4, regardless of the threshold choice, the model test results in a precision higher than 96% and a recall above 99%. Threshold values between 0.1 and 0.3, however, lead to the maximum Fscore of 99.95. In Table 1 we report the confusion matrix for the threshold value of 0.11.
From Fig. 4 we see that the network was able to generalize its learning and predict the entire duration of earthquake signals (including S coda) with high precision no matter if the event is large Fig. 4a or small Fig. 4b, local Fig. 4b or teleseismic Fig. 4d, recorded on an instrument with a malfunctioning channel Fig. 4c, recorded on old stations Fig. 4e, contaminated with high background noise level Fig. 4f, or not earthquake signals Fig. 4g. Since the predictions are performed for each sample individually, the network does not require the full length of a signal to detect an earthquake. This is important for realtime processing. In Fig. 4i we see that it was able to detect an event that was missing from the catalog we used for the labeling, or to correct the mislabeled P arrival and estimated end of coda in Fig. 4j, and by doing so, in these instances it improved upon “ground truth”.
Sensitivity to the noise level
To explore the performance sensitivity of the CRED to the background noise level and compare it with the other popular algorithms, we performed a test using semisynthetic data. We selected 500 events with highSNR from the test set. We visually checked each seismogram prior to the test. We also generated 500 Ricker wavelets with random width and scaled amplitudes to represent impulsive nonearthquake signals. Earthquake and nonearthquake signals were then randomly assembled to generate 8.4 hours of continuous data. Next, we added 23 different levels of Gaussian noise to the continuous waveforms in a way that result in 23 realizations of data with SNRs ranging from −2 dB to 20 dB. SNR is measured as
where S_{A} and N_{A} are peak amplitudes of signal and noise respectively. A portion of the generated synthetic data is presented in Fig. 5.
We applied the CRED, STA/LTA, and template matching on the synthetic data. For the template matching two templates were used. The detection threshold for each of these algorithms was tuned carefully to maximize the precision. The results are presented in Fig. 6.
As can be seen from the Fig. 6, CRED had superior performance compared to the two other methods. It detects 100% events with SNR >= 12 db with 0 false positives for all SNRs. At SNR of 7 db, CRED detected 80% of events while the detection rates for STA/LTA and template matching at this level were 27% and 3% respectively. In general CRED can detect far more events at low SNRs with a very low false positive rate. Template matching also resulted in no false positives but it had the lowest detection rate (81.8% at 20 db) due to the fact that most of the events were not located nearby or recorded on the same station. On the other hand STA/LTA resulted in the highest false positive rate (72.6% at 20 db). This is due to the sensitivity of its characteristic function to the abrupt amplitude changes, which causes a low precision for the STA/LTA at high SNRs Fig. 6c. The superior performance of CRED in noisy condition could be due to its reliance on spectral contents of the signal rather than the waveform. Although our results indicate lower sensitivity of CRED to the background noise level compared to other traditional methods, noise still affects the detection performance. Hence, applying a seismic denoising algorithms^{23,24,25,26,27,28} prior to the detection can improve the results.
Application to central U.S
A good model that does not overfit the data set used for the training, should generalize well to other data sets. To test this characteristic of our detector and the model obtained using the North California data set, we apply CRED to continuous data recorded in GuyGreenbrier, Arkansas, during the 2010–2011 sequence^{29,30}. Several earthquake catalogs exist for this sequence based on different detection methods: ANSS^{29} and Ogwari et al.^{31} based on STA/LTA, Huang and Beroza^{32} based on template matching, and Yoon et al.^{33} based on FAST. August 2010 is the overlapping time period in these catalogs, hence we made a unified catalog for this period combining information of all the above catalogs containing 3788 events. Most of these events are microearthquakes with local magnitudes ranging from −1.3 to 0.5 associated with hydraulic fracturing or wastewater injection. Events are located within a 2 km area at 2 to 4 km depths. Template matching^{32} has the highest detection rate (3732), FAST^{33} detected 3266 of the events, and studies based on STA/LTA^{29,31} detected 23 and 24 events respectively.
We process one month of continuous data recorded at station WHAR during August, 2010. This is the common station used in these studies. Detecting induced microearthquakes in different regions and at the local scale in the presence of high noise levels is a challenging task for a detection algorithm. We applied the CRED algorithm using a moving window of 30 seconds. The total processing time including transferring threechannel data into STFT and applying the model was 1 hour and 9 minutes on a laptop with a 2.7 GHz Intel Core i7 processor and 16 GB of memory. Our model detected 1102 events. Of these, 680 events were already in the catalog. We visually checked the remaining detections and verified 77 of them as new events and 345 of them as false positives. This leads to a detection precision of 69%. Detected events by CRED range from magnitude −1.2 to 2.6 Fig. 7. Lowering the detection threshold can lead to detection of more cataloged events; however, it would also result in more false positives.
A few examples of events detected by CRED are presented in Fig. 8 Almost all of the events larger than M_{L} 1.0 have been detected. The detection extends to lower magnitudes and includes a variety of SNRs and waveforms. Magnitude calculation of newly detected events is beyond the scope of this paper; however, by comparing the amplitudes and durations of these events with the waveforms of some of the cataloged events we estimate 0.1 < M_{L} < 0.4 for these events.
Discussion
Reliable earthquake signal detection is at the core of observational earthquake seismology. While improving the sensitivity and robustness of current algorithms is still an active field of research, improving the efficiency has received increased attention in the recent years due to a significant increase in data volumes. In this paper we explored the application of a deep residual network of convolutional and recurrent units for earthquake signal detection. Convolutional layers are powerful tools for automatic extraction of sparse features from seismograms. Recurrent units can learn sequential characteristics of seismic data and provide robust models. Here we used LSTM, a powerful type of recurrent network to search for earthquake signals in the timefrequency domain.
We designed the network with a residual structure to prevent degradation and reach a higher accuracy with a deeper learning. The residuallearning structure of the network makes a verydeep endtoend learning of seismic data feasible. The proposed network, can learn the dynamic timefrequency characteristics of earthquake signals and build a generalized model using a modestsized training set. Using timefrequency representation of seismic data and the sparsity of learned features by the CNN layers make the model robust to the noise. Sensitivity tests revealed the superior performance of CRED in the presence of high noise levels compared with both STA/LTA and template matching.
To compare the performance of our proposed network architecture with other common neural networks, we performed a separate experiment training six different networks  our proposed residual CNN + RNN + NN (CRED) network, a network containing both convolutional and fully connected layers (CNN + NN), a network similar to the CRED with bidirectional GRU units instead of LSTM (GRU), a traditional fully connected neural network (NN), a network containing both convolutional and fully connected layers in residual structure (ResCNN + NN), and a network similar to the CRED with unidirectional LSTM (UniLSTM). We trained all these networks using 1000 samples and measured their relative performance in terms of classification accuracy and the mean absolute error Fig. 9. The fully connected network (NN) tends to have the lowest accuracy and the highest error. Using a combination of convolutional and fully connected layers (CNN + NN) results in higher accuracy and lower error. Recasting the CNN + NN network in a residual learning structure improves the performance, however it is still lower than the CRED (residual CNN + RNN + NN). Using unidirectional LSTM instead of bidirectional LSTM slightly decreases the performance in earlier epochs (<40) however the overall results are very close and using bidirectional LSTM does not have a significant effect. We have also tested replacing the bidirectional LSTM units in CRED with bidirectional GRU units. GRU or gated recurrent units^{34} are a type of simplified LSTM known to perform better on some problems; however, we did not find any significant improvement in our application. Both networks (LSTM and GRU) resulted in very similar accuracy and error.
The learned model generalizes well to seismic data recorded in other regions. We trained the network using local and regional waveforms recorded in Northern California. The events mainly have tectonic origins, range in magnitude from M = 0–5, with most events around M 2 Fig. 10, and epicentral distances of mostly around 50 km. The model was tested on detecting microseismic events in Central Arkansas, with substantially different crustal structure, much lower magnitude range (mainly −1.0 to 0.5 M), shorter epicentral distance (within 3 km), and generally shallower depths. This represents an exceptionally challenging test of the method, but our model performed acceptably by detecting 3 orders of magnitude more events compared with STA/LTA. Although CRED’s detection rate was 30% of template matching and FAST, unlike template matching, no templates were used in its training. Moreover, it ran more than 100 times faster than FAST (nonparallel version) and resulted in lower false positive rates (31%) compared to FAST (55%). CRED resulted in 69% detection precision while the precision of detection was 45% for FAST^{33}. Detection of new events missed by all previous studies indicates an inherent limitation of similaritysearch based methods in addition to their high computational costs.
Here we used only 250 k waveforms of earthquakes with limited parameter distribution for training. Retraining the network with a much larger data set with a higher variability of earthquake signals with different hypocentral parameters and magnitude ranges should improve the performance. Moreover, a recursive approach can be adapted by the inclusion of events detected in the first round of applying the model into retraining and updating the initial model. Including more reliable labels through a secondary crossvalidation step or incorporating different types of nonearthquake signals recorded on seismic stations are other steps that could be implemented to improve the method further.
A potential application of CRED is in realtime monitoring of seismic activity for hazard mitigation in tectonically active regions or areas of induced seismicity. Microseismic monitoring and earthquake early warning are other areas where CRED could be used. This framework can provide fast and reliable event detection and is easily scalable to large N (many sensor) or large T (long duration) data. Reprocessing large volumes of archived data can potentially lead to new insights into a wide variety of earthquake phenomena.
In this paper we present a CnnRnn Earthquake Detector (CRED), which is a network that combines convolutional and recurrent units for deep residual learning of the timefrequency characteristics of earthquake signals. This framework is capable of detecting seismic events with high efficiency and precision. The learned model has low sensitivity to the background noise level, can generalize well to other regions with different seismicity characteristics, and outperforms STA/LTA in terms of sensitivity and template matching in terms of efficiency. Application of our method is fast and once the network is trained it can be applied to a stream of seismic data in real time. The architecture is flexible and can be easily scaled. False positive rates are minimal due to the highresolution modeling of earthquake signals based on their spectral structure.
Methods
Sequential learning
The RNN performs sequential learning by retaining relations among inputs while training itself Fig. 11.
A nonlinear function of the weighted sum of input at time t, x^{(t)}, and the previous state (or learned activation in the previous time step), a^{(t−1)}, is used to compute the current state, a^{(t)}, and predict the output at time t, y^{(t)}.
where the W’s and b’s are associated weights and bias terms, and gt and gs are Tanh and Sigmoid activation functions:
This basic RNN unit Fig. 12a, however, is not effective for learning long sequences due to the vanishing/exploding gradient problem. Some specific types of RNN such as longshortterm memory (LSTM) are commonly used to reduce the vanishing/exploding gradient problem and make application of deeper networks feasible.
An LSTM^{35} unit has an internal memory cell, c, which is simply added to the processed input. This greatly reduces the multiplicative effect of small gradients. The time dependence and effects of previous inputs are controlled by a forget gate, which determines what states are remembered or forgotten. Two other gates, the update gate, and an output gate are also featured in LSTM cells Fig. 12b.
where \({\tilde{c}}^{\{t\}}\) is a candidate value for replacing the memory, \({u}^{\{t\}}\) is an update gate, \({f}^{\{t\}}\) is a forget gate and \({o}^{\{t\}}\) is the output gate. The value of the memory cell at each time step will be set using the candidate value at current step, \({\tilde{c}}^{\{t\}}\), and previous value, \({c}^{\{t1\}}\), based on update and forget gates:
where * is elementwise multiplication. The final state at time t, \({a}^{\{t\}}\), is obtained based on output gate and the value of memory cell:
These LSTM units can be connected to each other in a row to form one hidden layer of the RNN Fig. 13. To learn the temporal pattern both from left to right and right to left, we can simply concatenate two of these layers with opposite directionality to form a bidirectional^{36} RNN layer Fig. 13. This structure allows the networks to have both backward and forward information about the sequence at every time step.
Residual learning
In an endtoend deep network, the “levels” of learned features can be enriched by the number of stacked layers (depth). For that reason, the number of layers (depth of a network) plays a crucial role in allowing the network to learn more highlevel features and build more complex models. There are, however, two main problems that occur in the training of very deep networks (where “deep” is usually taken to mean more than 15 layers): (1) vanishing/exploding gradients and (2) degradation (saturation and degradation of accuracy). The vanishing/exploding gradients problem occurs when the network cannot learn because the gradients of the network’s output with respect to the parameters in the early layers become extremely small or large^{12}, and can be largely addressed by normalized initialization. An effective solution for the latter was proposed by He et al.^{20} by introducing the residual learning framework.
In a standard deep network, every few stacked layers basically learn a nonlinear underlying function, H, that maps the input to the first of these layers, x, to the output of the final layer, H(x). In the residual learning framework, the original mapping is recast into F(x) + x. Each few stacked layers (a residual block) rather than directly learning H(x), learns the residual functions, F(x): = H(x) − x. Since optimization of the residual mapping is easier than for the original unreferenced mapping, this can help to keep the training error in the deeper layer the same as for the shallower ones, and by doing so make it possible to train a deeper network. Residual learning blocks can be realized by feedforward neural networks with “shortcut connections” Fig. 14 that skip one or more layers. The shortcut connections simply perform identity mapping, and their outputs are added to the outputs of the stacked layers Fig. 14. These identity shortcut connections add neither extra parameters nor computational complexity to the problem.
In residual learning a building block is defined as:
Here x and y are the input and output vectors of the layers considered. The function \(F(x,\{{W}_{i}\})\), represents the residual mapping to be learned. For the example in Fig. 1 that has two layers, \(F={W}_{2\sigma }({W}_{1x})\), in which \(\sigma \) denotes the activation function and the biases are omitted t simplifying notations. The operation F + x is performed by a shortcut connection and elementwise addition. As noted above, the shortcut connections introduce neither extra parameters nor computation complexity.
References
Zhu, W. & Beroza, G. C. PhaseNet: a deepneuralnetworkbased seismic arrivaltime picking method. Geophysical Journal International 216, 261–273 (2018).
Ross, Z. E., Meier, M.A. & Hauksson, E. P wave arrival picking and firstmotion polarity determination with deep learning. Journal of Geophysical Research: Solid Earth 123, 5120–5129 (2018).
Chen, Y. Automatic microseismic event picking via unsupervised machine learning. Geophysical Journal International 212, 88–102 (2017).
Chen, Y. Fast waveform detection for microseismic imaging using unsupervised machine learning. Geophysical Journal International 215, 1185–1199 (2018).
Allen, R. V. Automatic earthquake recognition and timing from single traces. Bulletin of the Seismological Society of America 68, 1521–1532 (1978).
Gibbons, S. J. & Ringdal, F. The detection of low magnitude seismic events using arraybased waveform correlation. Geophysical Journal International 165, 149–166 (2006).
Shelly, D. R., Beroza, G. C. & Ide, S. Nonvolcanic tremor and lowfrequency earthquake swarms. Nature 446, 305 (2007).
Yoon, C. E., O’Reilly, O., Bergen, K. J. & Beroza, G. C. Earthquake detection through computationally efficient similarity search. Science advances 1, e1501057 (2015).
Rong, K. et al. Localitysensitive hashing for earthquake detection: a case study of scaling datadriven science. Proceedings of the VLDB Endowment 11, 1674–1687 (2018).
Wang, J. & Teng, T.L. Artificial neural networkbased seismic detector. Bulletin of the Seismological Society of America 85, 308–319 (1995).
Madureira, G. & Ruano, A. E. A neural network seismic detector. IFAC Proceedings Volumes 42, 304–309 (2009).
Hochreiter, S. The vanishing gradient problem during learning recurrent neural nets and problem solutions. International Journal of Uncertainty, Fuzziness and KnowledgeBased Systems 6, 107–116 (1998).
Perol, T., Gharbi, M. & Denolle, M. Convolutional neural network for earthquake detection and location. Science Advances 4, 1700578 (2018).
Wu, Y. et al. DeepDetect: A cascaded regionbased densely connected network for seismic event detection. IEEE Transactions on Geoscience and Remote Sensing 99, 1–14 (2018).
Generalized Seismic Phase Detection with Deep Learning. Bulletin of the Seismological Society of America, https://doi.org/10.1785/0120180080 (2018).
Sequence to Sequence Learning with Neural Networks. vol. 27, 5346–2014 (2014).
Evolving Memory Cell Structures for Sequence Learning, vol. 5769 (Springer, Berlin, Heidelberg, 2009).
Mousavi, S. M., Horton, S. P., Langston, C. A. & Samei, B. Seismic Features and Automatic Discrimination of Deep and Shallow InducedMicroearthquakes Using Neural Network and Logistic Regression. Geophysical Journal International 207, 29–46 (2016).
Mousavi, S. M. & Langston, C. A. Fast and novel microseismic detection using timefrequency analysis. SEG Technical Program Expanded Abstracts 2016, 2632–2636 (2016).
He, K., Zhang, X. R. S. & Sun, J. Deep Residual Learning for Image Recognition (NV, 2016).
Mousavi, S. M. & Langston, C. A. Automatic NoiseRemoval/SignalRemoval Based on the GeneralCrossValidation Thresholding in Synchrosqueezed domains, and its application on earthquake data. Geophysics 82 (2017).
Kingma, D. P. & Ba, J. Adam: A Method for Stochastic Optimization arXiv: 1412.6980 [cs (2014).
Zhu, W., Mousavi, S. M. & Beroza, G. C. Seismic Signal Denoising and Decomposition Using Deep (2018).
Chen, Y. Nonstationary leastsquares complex decomposition for microseismic noise attenuation. Geophysical Journal International 213, 1572–1585 (2018).
Chen, Y. et al. Empirical lowrank approximation for seismic noise attenuation. IEEE Transactions on Geoscience and Remote Sensing 55, 4696–4711 (2017).
Mousavi, S. M., Langston, C. A. & Horton, S. P. Automatic Microseismic Denoising and Onset Detection Using the SynchrosqueezedContinuous Wavelet Transform. Geophysics 81, 341–355 (2016).
Mousavi, S. M. & Langston, C. A. Adaptive noise estimation and suppression for improving microseismic event detection. Journal of Applied Geophysics 132, 116–124 (2016).
Mousavi, S. M. & Langston, C. A. Hybrid seismic denoising using higherorder statistics and improved wavelet block thresholding. Bulletin of the Seismological Society of America 106, 1380–1393 (2016).
Horton, S. Disposal of hydrofracking waste fluid by injection into subsurface aquifers triggers earthquake swarm in central Arkansas with potential for damaging earthquake. Seismological Research Letters 83, 250–260 (2012).
Mousavi, S. M., Horton, S. O., Langston, P. & Spatiotemporal, C. A. Evolution of FrequencyMagnitude Distribution during Initiation of Induced Seismicity at GuyGreenbrier, Arkansas. Physics of the Earth and Planetary Interiors 267, 53–66 (2017).
Ogwari, P. O., Horton, S. P. & Ausbrooks, S. Characteristics of induced/triggered earthquakes during the startup phase of the guygreenbrier earthquake sequence in NorthCentral Arkansas. Seismological Research Letters 87, 620–630 (2016).
Huang, Y. & Beroza, G. C. Temporal variation in the magnitudefrequency distribution during the guygreenbrier earthquake sequence. Geophysical Research Letters 42, 6639–6646, https://doi.org/10.1002/2015GL065170 (2015).
Yoon, C. E., Huang, Y., Ellsworth, W. L. & Beroza, G. C. Seismicity During the Initial Stages of the GuyGreenbrier, Arkansas, Earthquake Sequence. Journal of Geophysical Research – Solid Earth 122, 9253–9274 (2015).
Chung, J., Gulcehre, C., Cho, K. & Bengio, Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014).
Hochreiter, S. & Schmidhuber, J. Long ShortTerm Memory. Neural Computation 9, 1735–1780 (1997).
Thireou, T. & Reczko, M. Bidirectional Long ShortTerm Memory Networks for Predicting the Subcellular Localization of Eukaryotic Proteins. IEEE/ACM Transactions on Computational Biology and Bioinformatics 4, 441–446 (2007).
Acknowledgements
We would like to thank Stephane Zuzlewski for this help in accessing the waveform data and metadata archived in NCEDC. Clara Yoon and Paul Ogwari helped us in preparing the catalogs for the GuyGreenbrier sequence. We also thank the reviewers for insightful comments. This study was supported by the Stanford Center for Induced and Triggered Seismicity. Waveform data and metadata for the training and validation was obtained from the Northern California Data Center. The continuous data for Arkansas was downloaded from Incorporated Research Institutions for Seismology (IRIS) Data Services (http://ds.iris.edu/ds/nodes/dmc/, last accessed Feb 2018). The facilities of IRIS Data Services (DS), and specifically the IRIS DataManagement Center, were used for access to waveform, metadata, or products required in this study. The IRIS DS is funded through the National Science Foundation and specifically the GEO Directorate through the Instrumentation and Facilities Program of the National Science Foundation. All figures in this paper were generated using Python version 3.6.
Author information
Authors and Affiliations
Contributions
S.M.M. designed the network, performed the preprocessing and training, prepared Figures, and wrote the manuscript, W.Z. prepared the earthquake training set and helped in parallelizing the waveform processing, Y.S. downloaded and preprocessed the noise training set. G.B. lead the project, and reviewed the manuscript. All authors discussed extensively the results.
Corresponding author
Ethics declarations
Competing Interests
The authors declare no competing interests.
Additional information
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Mousavi, S.M., Zhu, W., Sheng, Y. et al. CRED: A Deep Residual Network of Convolutional and Recurrent Units for Earthquake Signal Detection. Sci Rep 9, 10267 (2019). https://doi.org/10.1038/s41598019457481
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598019457481
This article is cited by

Discriminating seismic events using 1D and 2D CNNs: applications to volcanic and tectonic datasets
Earth, Planets and Space (2022)

Deep learning approaches and interventions for futuristic engineering in agriculture
Neural Computing and Applications (2022)

A deep learning network for estimation of seismic local slopes
Petroleum Science (2021)

Detecting earthquakes: a novel deep learningbased approach for effective disaster response
Applied Intelligence (2021)

Earthquake transformer—an attentive deeplearning model for simultaneous earthquake detection and phase picking
Nature Communications (2020)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.