Background & Summary

Today, global energy and environmental conditions necessitate the widespread use of renewable energy sources for countries to achieve their carbon neutrality targets and, thereby, address climate change problems1. However, installing renewable energy resources without accounting for the power system reliability limitation causes system stress resulting from a supply-demand imbalance, such as from oversupply or excessive security2. This forces more ancillary generators in the system to stand by or promotes inefficient investment in power grid reinforcement3. To solve this problem, power system operators must understand the concept of load flexibility (LF). LF refers to the resources used to ensure the stable operation of the power system by facilitating dynamic changes, including increments and decrements, in demand. This includes implementing demand-side management (DSM), which changes power use patterns according to the time-series energy production characteristics of wind turbines or solar power sources to increase the application rate of renewable energy4,5.

The demand resources for LF are classified into industrial, commercial, and residential loads6. To apply the LF resources in DSM, load data at one-minute or one-hour resolution are collected for analysis, as shown in Table 17,8,9,10,11,12,13,14,15,16,17,18. Further, up-to-date public data on power usage are collected to perform non-intrusive load monitoring research. They mainly include information on active power, reactive power, voltage, current, aggregated energy consumption, and appliance-level power consumption1,5,6,7,8,9,10,13.

Table 1 Summary of the details in public datasets.

However, although most of the DSM capacity for LF is met by industrial loads, there are quite a few obstacles to the acquisition of industrial demand data. In a competitive industrial environment, the data disclosure of industrial loads is prohibited since such data are considered a trade secret because a manufacturing plant’s electricity consumption data can be used to infer the company’s sales. To the best of the authors’ knowledge, investigations on manufacturing factories’ load data remain limited; only two studies require special mention in this respect: an investigation on the machine-level load data of a paper manufacturing factory in Brazil17 and an examination of the normalized electricity consumption data of food and paper industries18.

In this study, the authors acquire data from volunteered industrial factories and analyze their characteristics to evaluate demand response (DR) availability of Korean industrial demands for securing power system and market flexibility. Furthermore, a market system is being designed to encourage factories to participate as LF resources.

The authors collect electricity consumption data from manufacturing factories in South Korea by using communication systems, including the advanced metering infrastructure (AMI). These factories participate in the DR market through DSM. Accordingly, the resulting dataset is unique and potentially a valuable consideration in several analyses, including.

  • Expected locational DR capacity estimation by statistically estimating customer baseline load (CBL) and participation amount of each industrial sector.

  • Estimation of hourly LF by analyzing industrial demand consumption patterns.

  • Consideration of demand-side utilization in virtual power plants.

  • Design of the LF market and incentive price.

Methods

The load aggregators performing brokerage transactions in the DR market are authorized to collect electricity usage information from the system operator through the AMI for DSM. In this study, the authors first introduce international and Korean demand response programs in detail. Subsequently, they describe a novel communication system in which a load aggregator collects relevant data through the AMI and finally classify the industrial demand data collected from the factories participating in DR programs by manufacture type.

Demand response programs

DR is defined as a tariff or a program established to motivate changes in electric use by end-use customers in response to changes in the price of electricity over time or to give incentive payments designed to induce lower electricity use at times of high market prices or when grid reliability is jeopardized19. It is classified into price-based DR for economic operational purposes and intensive-based DR for system security purposes. Figure 1 illustrates DR programs included in the planning and operation of power system in detail. In DR programs, the participation performance of resources is evaluated based on CBL estimation19. In general, the average demand usage of past days without participating in DR is used in calculating CBL. Table 2 describes DR services of independent system operators (ISOs) in the US, which are internationally benchemarked20,21,22,23,24,25.

Fig. 1
figure 1

Role of DR in electricity system planning and operation.

Table 2 Summary of the details of CBL evaluation methods for ISO in the US.

Korean DR market consists of six programs depending on the purpose as shown in Table 326. In recent years, along with traditional DR programs, they expanded to mitigate environmental issues, including fine dust problems and supply/demand balance due to rapid renewable energy penetration. Participants are restricted from entering the market depending on the type and capacity of resources they have. Table 4 describes Korean ISO’s DR services in detail26.

Table 3 Summary of the details of the DR program in South Korea.
Table 4 Summary of the details of CBL evaluation methods in South Korea.

Monitoring set-up

In the proposed communication system, watthour pulse (WP) and end-of-interval (EOI) signals are received in one-minute units through the AMI’s photocoupler, which is installed to charge electricity bills to the manufacturing company. The WP-based wattage data are synchronized with the EOI signal and delivered to the server in real-time. Further, the system involves storing the process of monitoring data for a short period to improve data acquisition quality. When data delivery fails, the communication system performs a resending the stored data to the server. After a certain number of retries fail, the data is extinguished by storage period expiration. The well-collected data are backed-up every 30 days. To upload the data to the server, one can select the interface from among Ethernet, RS-232, and RS-482 ports according to the communication environment. Figure 2 illustrates the overall hardware communication network design.

Fig. 2
figure 2

Overall hardware communication network used in the study. EOI, end of interval; IP, Internet Protocol; TCP, Transmission Control Protocol; WP, watthour pulse.

Industrial demand data classification

In Korea, the manufacturing industry is classified into 40 industries. Among them, 10 industries, namely petrochemical, fine chemical, cement, steel, forging, food, paper, metal, electricity/electronics, and textile, mainly participate in the DR market and function as ancillary service resources. The number of their companies account for 44.92% of all industries. The authors selected five representative types which account for 48.36% of the aforementioned 10 manufacturing factories: cement, forge, metal, paper, and steel. Only 11.59% of the companies included in the types are actually participating in the DR program. Therefore, it is expected that they still have high potential that can be utilized as LF resources27.

Data from 20 volunteer factories with data disclosure agreements were obtained. Finally, 10 factories with regular manufacturing processes and their company sizes (e.g., number of employees, sales, and manufacturing scales) were selected in this study. Figures 37 illustrate the five representative manufacturing processes. To maintain information security, the company name and factory location are not disclosed in this paper, and net power consumptions without normalization are mentioned to preserve data originality. This study presents the data measured for seven months from 1 March 2019 to 30 September 2019. During the measurement period, a DR was issued twice; Table 5 depicts the date and time of DR participation, mandatory reduction capacity, and response capacity of each factory for the load aggregator’s transaction.

Fig. 3
figure 3

Cement manufacturing process.

Fig. 4
figure 4

Forging process.

Fig. 5
figure 5

Metal casting process.

Fig. 6
figure 6

Paper manufacturing process.

Fig. 7
figure 7

Steel manufacturing process.

Table 5 DR market participation records of manufacturing factories.

Data Records

The entire dataset comprises 10 comma-separated value (CSV) files28, summarised in Table 6. As mentioned earlier, the total electricity consumption (kW) of each factory was measured in this study. The CSV files of each factory have 308160 rows, including N/A spaces and outliers, which indicate one-minute-interval data (1440 data points/day) for 214 days during the 7-month data collection period in 2019. Since the method of preprocessing data is selected and applied according to various research purposes, the authors provided raw data for reuse without preprocessing. Each file has two columns: one indicates time information (in the YYYY-MM-DD hh:mm format), while the other indicates the factory’s real-time electricity consumption. For better reuse, the Korean system load data file of the same period is provided together28. The dataset has been made publicly available under the creative commons license CC BY 4.0 hosted on the figshare repository.

Table 6 Summary of manufacturing factories’ dataset file names.

Technical Validation

This section discusses the visualization of data to clarify the quality of the dataset, which includes missing data, outliers, and weekly pattern plots. The missing data plot and outlier information indicate the availability of minute details on the electricity consumption of each factory, whereas the weekly pattern plots provide the characteristic insights into power consumption according to the manufacturing type and working/non-working date conditions. The summary of manufacturing factories’ dataset statistics is described as shown in Table 7.

Table 7 Summary of manufacturing factories’ dataset statistics.

Missing data

Figure 8 illustrates the missing electricity consumption data of 10 factories. The missing data plot for the entire data collection period (where the missing data are indicated using black lines) is shown on the left side of the figure. Further, the horizontal bars on the right visually represent the percentage of missing data over the study period. The manufacturing factories have an average data availability of 98.7%. An exception is the Metal 2 factory, whose missing data rate is more than 10% due to data collection errors in April 2019. Data with a 20% or less missing rate guarantees quality through missing data imputation29. The approach for time-series missing data imputation provided in this study is classified mainly into five categories: deletion, neighbor-based, regression-based, multi-layer-perceptron-based, and deep-learning-based approaches. The description and practical methods of each approach were reviewed in detail as shown in Table 830,31,32,33,34,35,36,37,38,39,40.

Fig. 8
figure 8

Missing electricity consumption data of 10 manufacturing factories; the missing data are indicated using black lines.

Table 8 Summary of missing data imputation methods for time series data.

Outliers

Figure 9 illustrates the 10 factories’ daily electricity consumption profiles during data collection periods. As an index for outlier detection, the interquartile range (IQR) of the box plot was considered. As a result of extracting data located outside the range of 3 sigma of the normal distribution from each demand data, 4, 38, and 1 outlier were detected in Cement 1, Cement 2, and Paper, respectively. The approach for time-series outlier data detection provided in this study is classified into four categories: statistical, unsupervised discriminative, unsupervised parametric, and supervised approaches. The description and practical methods of each approach were reviewed in detail as shown in Table 941,42,43,44,45,46,47,48,49,50. Accordingly, the authors propose to scale and utilize the raw data according to the research purpose.

Fig. 9
figure 9

Electricity consumption daily profiles of 10 manufacturing factories during data collection periods.

Table 9 Summary of outlier detection methods for time series data.

Weekly patterns

Figure 10 shows the 10 factories’ weekly electricity consumption patterns, obtained by averaging the electricity consumption during the data collection period by day of the week. Each factory reveals approximate periodicity according to its own manufacturing process. The factories that implemented automated processes (Steel 2, Cement 1, and Cement 2) recorded a steady electricity use even on non-working days. The factories’ electricity consumption varied according to their size; for example, employees, sales, and production scale. In particular, factories with high electricity usage (Metal 2, Steel 2, and Cement 1) tended to avoid operating on time intervals with high electricity rates. Despite the limitation of the 7-month acquisition period, the characteristics of weekly demand usage were strongly confirmed.

Fig. 10
figure 10

Weekly electricity consumption patterns of 10 manufacturing factories.

Figure 11 provides the factories’ electricity consumption profiles at the DR participation day (13 June 2019), which confirm the factories’ responded capacities. The capacity is calculated as the difference between the CBL (denoted using cyan lines in Fig. 11) and the actual load (denoted using red lines). The CBL is a general standard used for settlement in national DR markets. In this study, the factories’ average power consumption in the same time for four out of the past five days, excluding holidays, is considered the CBL. As additional information, Fig. 12 indicates the power system demand profile at the DR participation days (15 May and 13 June 2019) in South Korea.

Fig. 11
figure 11

Manufacturing factories’ electricity consumption profiles at the demand response participation day (13 June 2019); cyan lines indicate customer baseline load (CBL), and red lines indicate the actual load.

Fig. 12
figure 12

Power system demand profiles; cyan lines indicate average demand for the month, including the demand response participation days (15 May and 13 June 2019), and red lines indicate demand at the participation days.