Abstract
This study describes the release of electricity consumption data of some manufacturing factories located in South Korea that participate in the demand response (DR) market. The data (in kilowatt) comprise individual factories’ total power usage details that were acquired using advanced metering infrastructures. They further contain details on the manufacture types, DR participation dates, mandatory reduction capacities, and response capacities of the factories. For data acquisition, 10 manufacturing companies are representatively selected according to the process regularity and company size standard of this study. Entire datasets are newly collected and available at one-minute intervals for seven months from 1 March to 30 September 2019. These datasets can be used in a variety of ways to contribute to the functioning of power systems and markets, including the conduction of industrial load characteristic analysis for load flexibility, estimation of demand-side considerations for virtual power plant design, and determination of energy markets and incentives to achieve carbon neutrality targets at the national level.
Measurement(s) | electricity consumption |
Technology Type(s) | advanced metering infrastructure |
Similar content being viewed by others
Background & Summary
Today, global energy and environmental conditions necessitate the widespread use of renewable energy sources for countries to achieve their carbon neutrality targets and, thereby, address climate change problems1. However, installing renewable energy resources without accounting for the power system reliability limitation causes system stress resulting from a supply-demand imbalance, such as from oversupply or excessive security2. This forces more ancillary generators in the system to stand by or promotes inefficient investment in power grid reinforcement3. To solve this problem, power system operators must understand the concept of load flexibility (LF). LF refers to the resources used to ensure the stable operation of the power system by facilitating dynamic changes, including increments and decrements, in demand. This includes implementing demand-side management (DSM), which changes power use patterns according to the time-series energy production characteristics of wind turbines or solar power sources to increase the application rate of renewable energy4,5.
The demand resources for LF are classified into industrial, commercial, and residential loads6. To apply the LF resources in DSM, load data at one-minute or one-hour resolution are collected for analysis, as shown in Table 17,8,9,10,11,12,13,14,15,16,17,18. Further, up-to-date public data on power usage are collected to perform non-intrusive load monitoring research. They mainly include information on active power, reactive power, voltage, current, aggregated energy consumption, and appliance-level power consumption1,5,6,7,8,9,10,13.
However, although most of the DSM capacity for LF is met by industrial loads, there are quite a few obstacles to the acquisition of industrial demand data. In a competitive industrial environment, the data disclosure of industrial loads is prohibited since such data are considered a trade secret because a manufacturing plant’s electricity consumption data can be used to infer the company’s sales. To the best of the authors’ knowledge, investigations on manufacturing factories’ load data remain limited; only two studies require special mention in this respect: an investigation on the machine-level load data of a paper manufacturing factory in Brazil17 and an examination of the normalized electricity consumption data of food and paper industries18.
In this study, the authors acquire data from volunteered industrial factories and analyze their characteristics to evaluate demand response (DR) availability of Korean industrial demands for securing power system and market flexibility. Furthermore, a market system is being designed to encourage factories to participate as LF resources.
The authors collect electricity consumption data from manufacturing factories in South Korea by using communication systems, including the advanced metering infrastructure (AMI). These factories participate in the DR market through DSM. Accordingly, the resulting dataset is unique and potentially a valuable consideration in several analyses, including.
-
Expected locational DR capacity estimation by statistically estimating customer baseline load (CBL) and participation amount of each industrial sector.
-
Estimation of hourly LF by analyzing industrial demand consumption patterns.
-
Consideration of demand-side utilization in virtual power plants.
-
Design of the LF market and incentive price.
Methods
The load aggregators performing brokerage transactions in the DR market are authorized to collect electricity usage information from the system operator through the AMI for DSM. In this study, the authors first introduce international and Korean demand response programs in detail. Subsequently, they describe a novel communication system in which a load aggregator collects relevant data through the AMI and finally classify the industrial demand data collected from the factories participating in DR programs by manufacture type.
Demand response programs
DR is defined as a tariff or a program established to motivate changes in electric use by end-use customers in response to changes in the price of electricity over time or to give incentive payments designed to induce lower electricity use at times of high market prices or when grid reliability is jeopardized19. It is classified into price-based DR for economic operational purposes and intensive-based DR for system security purposes. Figure 1 illustrates DR programs included in the planning and operation of power system in detail. In DR programs, the participation performance of resources is evaluated based on CBL estimation19. In general, the average demand usage of past days without participating in DR is used in calculating CBL. Table 2 describes DR services of independent system operators (ISOs) in the US, which are internationally benchemarked20,21,22,23,24,25.
Korean DR market consists of six programs depending on the purpose as shown in Table 326. In recent years, along with traditional DR programs, they expanded to mitigate environmental issues, including fine dust problems and supply/demand balance due to rapid renewable energy penetration. Participants are restricted from entering the market depending on the type and capacity of resources they have. Table 4 describes Korean ISO’s DR services in detail26.
Monitoring set-up
In the proposed communication system, watthour pulse (WP) and end-of-interval (EOI) signals are received in one-minute units through the AMI’s photocoupler, which is installed to charge electricity bills to the manufacturing company. The WP-based wattage data are synchronized with the EOI signal and delivered to the server in real-time. Further, the system involves storing the process of monitoring data for a short period to improve data acquisition quality. When data delivery fails, the communication system performs a resending the stored data to the server. After a certain number of retries fail, the data is extinguished by storage period expiration. The well-collected data are backed-up every 30 days. To upload the data to the server, one can select the interface from among Ethernet, RS-232, and RS-482 ports according to the communication environment. Figure 2 illustrates the overall hardware communication network design.
Industrial demand data classification
In Korea, the manufacturing industry is classified into 40 industries. Among them, 10 industries, namely petrochemical, fine chemical, cement, steel, forging, food, paper, metal, electricity/electronics, and textile, mainly participate in the DR market and function as ancillary service resources. The number of their companies account for 44.92% of all industries. The authors selected five representative types which account for 48.36% of the aforementioned 10 manufacturing factories: cement, forge, metal, paper, and steel. Only 11.59% of the companies included in the types are actually participating in the DR program. Therefore, it is expected that they still have high potential that can be utilized as LF resources27.
Data from 20 volunteer factories with data disclosure agreements were obtained. Finally, 10 factories with regular manufacturing processes and their company sizes (e.g., number of employees, sales, and manufacturing scales) were selected in this study. Figures 3–7 illustrate the five representative manufacturing processes. To maintain information security, the company name and factory location are not disclosed in this paper, and net power consumptions without normalization are mentioned to preserve data originality. This study presents the data measured for seven months from 1 March 2019 to 30 September 2019. During the measurement period, a DR was issued twice; Table 5 depicts the date and time of DR participation, mandatory reduction capacity, and response capacity of each factory for the load aggregator’s transaction.
Data Records
The entire dataset comprises 10 comma-separated value (CSV) files28, summarised in Table 6. As mentioned earlier, the total electricity consumption (kW) of each factory was measured in this study. The CSV files of each factory have 308160 rows, including N/A spaces and outliers, which indicate one-minute-interval data (1440 data points/day) for 214 days during the 7-month data collection period in 2019. Since the method of preprocessing data is selected and applied according to various research purposes, the authors provided raw data for reuse without preprocessing. Each file has two columns: one indicates time information (in the YYYY-MM-DD hh:mm format), while the other indicates the factory’s real-time electricity consumption. For better reuse, the Korean system load data file of the same period is provided together28. The dataset has been made publicly available under the creative commons license CC BY 4.0 hosted on the figshare repository.
Technical Validation
This section discusses the visualization of data to clarify the quality of the dataset, which includes missing data, outliers, and weekly pattern plots. The missing data plot and outlier information indicate the availability of minute details on the electricity consumption of each factory, whereas the weekly pattern plots provide the characteristic insights into power consumption according to the manufacturing type and working/non-working date conditions. The summary of manufacturing factories’ dataset statistics is described as shown in Table 7.
Missing data
Figure 8 illustrates the missing electricity consumption data of 10 factories. The missing data plot for the entire data collection period (where the missing data are indicated using black lines) is shown on the left side of the figure. Further, the horizontal bars on the right visually represent the percentage of missing data over the study period. The manufacturing factories have an average data availability of 98.7%. An exception is the Metal 2 factory, whose missing data rate is more than 10% due to data collection errors in April 2019. Data with a 20% or less missing rate guarantees quality through missing data imputation29. The approach for time-series missing data imputation provided in this study is classified mainly into five categories: deletion, neighbor-based, regression-based, multi-layer-perceptron-based, and deep-learning-based approaches. The description and practical methods of each approach were reviewed in detail as shown in Table 830,31,32,33,34,35,36,37,38,39,40.
Outliers
Figure 9 illustrates the 10 factories’ daily electricity consumption profiles during data collection periods. As an index for outlier detection, the interquartile range (IQR) of the box plot was considered. As a result of extracting data located outside the range of 3 sigma of the normal distribution from each demand data, 4, 38, and 1 outlier were detected in Cement 1, Cement 2, and Paper, respectively. The approach for time-series outlier data detection provided in this study is classified into four categories: statistical, unsupervised discriminative, unsupervised parametric, and supervised approaches. The description and practical methods of each approach were reviewed in detail as shown in Table 941,42,43,44,45,46,47,48,49,50. Accordingly, the authors propose to scale and utilize the raw data according to the research purpose.
Weekly patterns
Figure 10 shows the 10 factories’ weekly electricity consumption patterns, obtained by averaging the electricity consumption during the data collection period by day of the week. Each factory reveals approximate periodicity according to its own manufacturing process. The factories that implemented automated processes (Steel 2, Cement 1, and Cement 2) recorded a steady electricity use even on non-working days. The factories’ electricity consumption varied according to their size; for example, employees, sales, and production scale. In particular, factories with high electricity usage (Metal 2, Steel 2, and Cement 1) tended to avoid operating on time intervals with high electricity rates. Despite the limitation of the 7-month acquisition period, the characteristics of weekly demand usage were strongly confirmed.
Figure 11 provides the factories’ electricity consumption profiles at the DR participation day (13 June 2019), which confirm the factories’ responded capacities. The capacity is calculated as the difference between the CBL (denoted using cyan lines in Fig. 11) and the actual load (denoted using red lines). The CBL is a general standard used for settlement in national DR markets. In this study, the factories’ average power consumption in the same time for four out of the past five days, excluding holidays, is considered the CBL. As additional information, Fig. 12 indicates the power system demand profile at the DR participation days (15 May and 13 June 2019) in South Korea.
Code availability
The code implementation was done in R 4.0.5 using R studio. The scripts to perform data visualization are available in28.
References
International Renewable Energy Agency. Power system flexibility for the energy transition part 1: Overview for policy maker https://www.irena.org/publications/2018/Nov/Power-system-flexibility-for-the-energy-transition (2018).
Olson, A., Jones, R. & Hart, E. Renewable curtailment as a power system flexibility resource. Electr. J. 27, 49–61 (2014).
International Renewable Energy Agency. Renewable energy integration in power grids https://irena.org/publications/2015/Apr/Renewable-energy-integration-in-power-grids (2015).
Alahäivälä, A., Ekström, J., Jokisalo, J. & Lehtonen, M. A framework for the assessment of electric heating load flexibility contribution to mitigate severe wind power ramp effects. Electr. Power Syst. Res. 142, 268–278 (2017).
Kocaman, A. S., Ozyoruk, E., Taneja, S. & Modi, V. A stochastic framework to evaluate the impact of agricultural load flexibility on the sizing of renewable energy systems. Renew. Energy 152, 1067–1078 (2020).
Dranka, G. G. & Ferreira, P. Load flexibility potential across residential, commercial and industrial sectors in Brazil. Energy 201, 117483 (2020).
UCI Machine Learning Repository, Individual household electric power consumption Data Set https://archive.ics.uci.edu/ml/datasets/individual+household+electric+power+consumption# (2012).
Makonin, S., Ellert, B., Bajić, I. V. & Popowich, F. Electricity, water, and natural gas consumption of a residential house in Canada from 2012 to 2014. Sci. Data 3, 1–12 (2016).
National Renewable Energy Laboratory, Multifamily programmable thermostat data https://data.openei.org/submissions/500 (2015).
Kleiminger, W., Beckel, C. & Santini, S. ECO data set (electricity consumption & occupancy) https://www.vs.inf.ethz.ch/res/show.html?what=eco-data (2016).
Nambi, A. S. DRED: Dutch Residential Energy Dataset (DRED) http://www.st.ewi.tudelf.nl/akshay/dred (2015).
Kolter, J. Z. & Johnson, M. J. REDD: A public data set for energy disaggregation research. Workshop on Data Mining Applications in Sustainability (SIGKDD), San Diego, CA, 25, 59-62 (2011).
Kelly, J. & Knottenbelt, W. The UK-DALE dataset, domestic appliance-level electricity demand and whole-house demand from five UK homes. Sci. Data 2, 1–14 (2015).
Shin, C. et al. The ENERTALK dataset, 15 Hz electricity consumption data from 22 houses in Korea. Sci. Data 6, 1–13 (2019).
Miller, C. ENERNOC commercial building dataset http://cargocollective.com/buildingdata/100-EnerNOC-Commercial-Buildings (2012).
Pipattanasomporn, M. et al. CU-BEMS, smart building electricity consumption and indoor environmental sensor datasets. Sci. Data 7, 1–14 (2020).
Martins, P. D. M., Nascimento, V. B., Freitas, A. R., Silva, P. B. & Pinto, R. G. D. Industrial machines dataset for electrical load disaggregation. IEEE Dataport https://doi.org/10.21227/cg5v-dk02 (2018).
Valdes, J. & Camargo, L. R. Synthetic hourly electricity load data for the paper and food industries. Data Brief. 35 (2021).
Depart of Energy, Benefits of demand response in electricity markets and recommendations for achieving them https://www.energy.gov/oe/downloads/benefits-demand-response-electricity-markets-and-recommendations-achieving-them-report (2006).
MISO, Business practices manuals https://www.misoenergy.org/legal/business-practice-manuals/ (2021).
NYISO, Manual 05: NYISO day-ahead demand response program manual https://www.nyiso.com/manuals-tech-bulletins-user-guides (2020).
NYISO, Manual 07: Emergency demand response program manual https://www.nyiso.com/manuals-tech-bulletins-user-guides (2022).
PJM, PJM Manual 11: Energy and ancillary service market operations https://www.pjm.com/library/manuals.aspx (2021).
KEMA, PJM empirical analysis of demand response baseline methods https://www.pjm.com/-/media/markets-ops/demand-response/pjm-analysis-of-dr-baseline-methods-full-report.ashx (2011).
ERCOT, Demand response baseline methodologies https://www.ercot.com/services/programs/load (2019).
Korea power exchange, Electricity market operation rules https://new.kpx.or.kr/board.es?mid=a10205010000&bid=0030&act=view&list_no=65906 (2022).
Industrial statistics analysis system, the number of factories (manufacture type) https://istans.or.kr/su/newSuTab.do?scode=S53 (2019).
Kim, J. et al. Datasets on South Korean manufacturing factories’ electricity consumption and demand response participation. Figshare https://doi.org/10.6084/m9.figshare.14822256.v9 (2021).
Ponoćko, J. & Milanović, J. V. Forecasting demand flexibility of aggregated residential load using smart meter data. IEEE Trans. Power Syst. 33, 5446–5455 (2018).
McKnight, P. E., McKnight, K. M., Figueredo, A. J. & Sidani, S. Missing data: a gentle introduction (Guilford Press, 2007).
Wothke, W. Longitudinal and multigroup modeling with missing data (2000).
Batista, G. E. & Monard, M. C. A study of K-nearest neighbour as an imputation method. His 87, 251–260 (2002).
Amiri, M. & Jensen, R. Missing data imputation using fuzzy-rough methods. Neurocomputing 205, 152–164 (2016).
Box, G. E., Jenkins, G. M., Reinsel, G. C. & Ljung, G. M. Time series analysis: forecasting and control (John Wiley & Sons, 2015).
Zhang, G. P. Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50, 159–175 (2003).
Nordbotten, S. Neural network imputation applied to the Norwegian 1990 population census data. JOURNAL OF OFFICIAL STATISTICS-STOCKHOLM 12, 385–402 (1996).
Sharpe, P. K. & Solly, R. J. Dealing with missing values in neural network-based diagnostic systems. Neural Computing & Applications 3, 73–77 (1995).
Che, Z., Purushotham, S., Cho, K., Sontag, D. & Liu, Y. Recurrent neural networks for multivariate time series with missing values. Scientific reports 8, 1–12 (2018).
Luo, Y., Cai, X., Zhang, Y. & Xu, J. Multivariate time series imputation with generative adversarial networks. Advances in neural information processing systems 31, 1603–1614 (2018).
Luo, Y., Zhang, Y., Cai, X. & Yuan, X. E2gan: End-to-end generative adversarial network for multivariate time series imputation Proceedings of the 28th international joint conference on artificial intelligence 3094-3100 (2019).
Barnett, V. and Lewis, T. Outliers in Statistical Data (Wiley, 1978).
Hawkins, D. M. Identification of outliers Vol. 11 (Springer, 1980).
Rousseeuw, P. J. & Leroy, A. M. Robust regression and outlier detection (John wiley & sons, 2005).
Rebbapragada, U., Protopapas, P., Brodley, C. E. & Alcock, C. Finding anomalous periodic time series. Machine learning 74, 281–313 (2009).
Yan, X. Multivariate outlier detection based on self-organizing map and adaptive nonlinear map and its application. Chemometrics and Intelligent Laboratory Systems 107, 251–257 (2011).
Florez-Larrahondo, G., Bridges, S. M. & Vaughn, R. Efficient modeling of discrete events for anomaly detection using hidden markov models International Conference on Information Security 506-514 (2005).
Gao, B., Ma, H. Y. & Yang, Y. H. Hmms (hidden markov models) based on anomaly intrusion detection method. International Conference on Machine Learning and Cybernetics 1, 381–385 (2002).
Qiao, Y., Xin, X. W., Bin, Y. & Ge, S. Anomaly intrusion detection method based on HMM. Electronics letters 38, 663–664 (2002).
Tian, S., Mu, S. & Yin, C. Sequence-similarity kernels for SVMs to detect anomalies in system calls. Neurocomputing 70, 859–866 (2007).
Wang, M., Zhang, C. & Yu, J. Native API based windows anomaly intrusion detection method using SVM. International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC'06) 1, 6 (2006).
Acknowledgements
The authors thank Dr. Keeyoung Nam from GridWiz, Inc., for supporting their work. Further, this research was funded by the Korea Institute of Energy Technology Evaluation and Planning and Ministry of Trade, Industry & Energy of the Republic of Korea (Grant Numbers: 20191210301930 and 20204010600340).
Author information
Authors and Affiliations
Contributions
E. Lee and K. Baek contributed equally to this work. J. Kim managed and supervised this work.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Lee, E., Baek, K. & Kim, J. Datasets on South Korean manufacturing factories’ electricity consumption and demand response participation. Sci Data 9, 227 (2022). https://doi.org/10.1038/s41597-022-01357-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41597-022-01357-8
This article is cited by
-
EWELD: A Large-Scale Industrial and Commercial Load Dataset in Extreme Weather Events
Scientific Data (2023)