Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Coupled online sequential extreme learning machine model with ant colony optimization algorithm for wheat yield prediction

Abstract

Inadequate agricultural planning compounded by inaccurate predictions results in an inflated local market rate and prompts higher importation of wheat. To tackle this problem, this research has designed two-phase universal machine learning (ML) model to predict wheat yield (Wpred), utilizing 27 agricultural counties’ data within the Agro-ecological zone. The universal model, online sequential extreme learning machines coupled with ant colony optimization (ACO-OSELM) is developed, by incorporating the significant annual yield data lagged at (t − 1) as the model’s predictor to generate future yield at 6 test stations. In the first phase, ACO is adopted to search for suitable, statistically relevant data stations for model training, and the corresponding test station by virtue of a feature selection strategy. An annual wheat yield time-series input dataset is constructed utilizing data from each selected training station (1981–2013) and applied against 6 test stations (with each case modelled with 26 station data as the input) to evaluate the hybrid ACO-OSELM model. The partial autocorrelation function is implemented to deduce statistically significant lagged data, and OSELM is applied to generate Wpred. The two-phase hybrid ACO-OSELM model is tested within the 6 agricultural districts (represented as stations) of Punjab province, Pakistan and the results are benchmarked with extreme learning machine (ELM) and random forest (RF) integrated with ACO (i.e., hybrid ACO-ELM and hybrid ACO-RF models, respectively). The performance of the ACO-OSELM model was proven to be good in comparison to ACO-ELM and ACO-RF models. The hybrid ACO-OSELM model revealed its potential to be implemented as a decision-making system for crop yield prediction in areas where a significant association with the historical agricultural crop is well-established.

Introduction

Adoption of new knowledge about the best approaches to farming and strategic crop management systems, whilst learning the best practices from neighbourhood cropping zones, are considered as useful tools1,2,3. Agronomists use this technique to formulate precise and suitable evidence on future crop yield and bring benefits to the farmers4,5,6. In Pakistan, wheat is one of the most commonly grown crops7. Wheat contributes to up to 2.6% of Pakistan’s gross domestic product (GDP) while considering agronomy division its contribution is 12.5% of the GDP8. According to the United Nations, Pakistan was ranked in the top eight global wheat producers between 2016 and 20199,10. Wheat is produced during the winter period, largely in the province of Punjab11.

The current wheat yield prediction and forecasting methods adopted by the Pakistan Government have been reported to be highly inaccurate12. In 2005, poor wheat yield predictions of Pakistan where the actual production was relatively small equated to the estimated yield, resulted in an inflated local market rate and prompted higher importation of wheat13,14. Similarly, in 2012–2013, Pakistan experienced severe challenges in wheat supply, which happened due to the lower production of wheat yield in Punjab15. A plausible reason for this deficit was attributed to poor agricultural planning and inaccurate predictions to satisfy the national grain needs. Sajjad reported about the looming wheat scarcities for an agriculturally rich country, Pakistan16. Due to these concerns that have a direct detrimental impact on income and food security for the already staggering economy of developing Pakistan, the government representatives work towards enhancing the forecast to account for the surplus and shortfalls in advance.

The modelling of wheat yield utilizing ancient procedures and irrelevant information from past yields is bound to deter the outcomes drastically17,18. To calculate the future productions, establishing novel systems for improving current and future agricultural productions, and supporting future food security issues in both developing and first-world nations are necessary. This validates the essential role of wheat yield modelling via novel artificial intelligence (AI) modelling or data-intelligent approaches that encapsulate relevant historical patterns. Data-intelligent techniques have enormous flexibility in crop management due to their ease of employment, viable accuracy, and feature detection capabilities19,20,21,22. These models are also bound to empower officials in attaining efficient ways to predict future crop productions23. There are several examples of data intelligent algorithms in agronomy. Dempewolf et al. implemented vegetation index to predict wheat yield in Punjab24, whereas Hamid examined the wheat frugality and future forecasts25. On the other hand, Muhammad investigated the historic context of the wheat improvements for Balochistan26. Furthermore, Iqbal et al. designed an auto-regressive integrated moving average model (ARIMA) to predict future wheat and yields up to the year 2022 in Pakistan27. Sher and Ahmad integrated the Cobb–Douglas function with ARIMA to predict wheat yield28. However, the works have constructed simplistic regression models (e.g., ARIMA) that are often discredited due to their assumptions of linearity in the data29.

Based on previous approaches for wheat yield prediction, Rahman et al. developed a data-driven approach to predict rice yield for Bangladesh30, whereas monitoring of rice crop was implemented via a neural network model31. Similarly, an artificial neural network (ANN) was developed for soybean and corn predictions in Malaysia32. In addition, all the forgoing works were on a provincial level, or a country-wide, which lacks the significance to a small locality such as the district level forecasting used in this study for better accuracy and applicability. Yield prediction is a challenging job as various interconnected climatic drivers affect the yield5. Thus, agronomic experts can possibly use the preceding yields to predict future production. Despite this, none of the previous work has utilized wheat yield of several locations for training purposes to predict the yield of other stations.

Information from several other locations for training purposes to predict the yield at the main region is essentially beneficial in decision support systems since it can allow the modellers to accept analogous features prevailing to be analysed to evaluate the main region data33. This framework can be adopted in agricultural practices by associating station-specific crop production and creating suitable deductions relevant to the existence of favourable (or unfavourable) eco-friendly or soil fertility circumstances to produce maximum yield34. Considering the need for accurate future wheat yield prediction, the modelling of crop yield using several stations yield data for model development can offer a reasonable system to determine the most cost-effective and useful agricultural monitoring practices.

The proposed two-phase AI system called (i.e., ACO-OSELM) model was adopted in the current research to predict wheat yield. Two benchmark models including random forest (RF) and extreme learning machine (ELM) and their hybrid versions were designed for verification of the ACO-OSELM model. ELM and RF models were selected as a benchmark due to their remarkable predictive potentials as appear in the literature35,36,37,38,39. The selection of the OSELM was owing to the main merit of the ELM model40. ELM model is a single layer feed-forward neural network (SLFN) where the input weights are randomly assigned while the output weights are analytically determined41. Unlike conventional neural network models, the ELM is able to avoid issues such as tuning of learning rates, learning epochs, stopping criteria and local optima making it computationally efficient42. In addition, ELM efficiently handles large-scale data with a better generalization capability and is more suited to large-scale wheat yield predictions43,44. On the other hand, the RF models are ensemble regression tree models that use the bootstrap aggregation (i.e., bagging) approach to generate forecasts45,46,47. The RF model ameliorates the overfitting issue, which is a key drawback of conventional solitary regression tree-based models48. Consequently, these models have been applied in this study. The two-phase hybrid ACO-OSELM is validated for wheat yield prediction in agronomic regions: Rahimyar Khan, Dera Ghazi Khan (denoted as D. G. Khan), Kasur, Sialkot, Rawalpindi, and Jhang located in Punjab province, Pakistan where 26 stations from 26 districts were used to develop the model. The selected study stations are spread throughout the Punjab province and are the major wheat producers. These stations are chosen randomly from the agriculturally rich Punjab province. To verify the applicability of the proposed ACO-OSELM model, this study aims to fulfill three objectives: (i) To develop a bio-inspired ACO algorithm to select the best possible neighbouring stations located in Punjab province, Pakistan for training purposes using feature selection strategy; (ii) To incorporate the statistically important one step antecedent data (i.e., t − 1 where t represents the current data) of the selected training stations in the OSELM model to develop a two-phase hybrid ACO-OSELM model to predict the current and future wheat yield; and (iii) To assess the predictive accuracy of the two-phase ACO-OSELM model for wheat yield prediction universally in the whole province of Punjab in Pakistan.

Theoretical overview

The architecture involved in the establishing of a two-phase hybrid ACO-OSELM model for wheat yield prediction is discussed here.

Ant colony optimization (ACO) algorithm

Dorigo and Di Caro49 presented the ACO feature selection procedure, which has been widely used in different applications50,51,52,53. This study utilized the ACO technique to determine the least possible distance between wheat yield (W) of the training stations, and the testing stations, a strategy that can be adopted to choose the respective training stations for yield prediction at the testing station. A parameter named pheromone in the ACO process is allotted to predictor stations, which categorizes these predictors alongside the target/test stations at the start. The trial pheromone value is used to compute the probability of the chosen station to train against the test station while the magnitude pheromone alters by navigating the training stations, and subsequently, the probability is improved for the next coming ants to pick the optimum station. Readers can survey the following literature for more details on the ACO procedure experiment54,55.

Extreme learning machine (ELM)

Huang et al.42 designed a fast machine learning model consisting of Single Layer Feedforward Neural Network (SLFN) called the ELM that is computationally far more efficient56. In mathematical terms, the ELM can be expressed as:

$$\sum _{i=1}^{N}{\rho }_{i}{f}_{i}\left(x\right)={W}_{for}\left(x\right)$$
(1)

where \(\rho = {\left[{\rho }_{1}, {\rho }_{2},\dots ,{\rho }_{M}\right] }^{T}\) is the output weight vector between the hidden layer of M nodes to the m ≥ 1 output nodes, and \(f\left(x\right)= {\left[{f}_{1}\left(x\right), {f}_{2}\left(x\right),\dots ,{f}_{N}\left(x\right)\right] }^{T}\) is ELM nonlinear feature mapping and \({W}_{for}\left(x\right)\) is the final output/prediction. The function \({W}_{for}\left(x\right)\) denotes the predicted wheat yield (W) at the \(i{\text{th}}\) hidden node. Various output functions may be applied in different hidden neurons. For instance:

$${f}_{i}\left(x\right)=G\left({a}_{i},{b}_{i},x\right),\,\, {a}_{i}\in {R}^{d},\,\, {b}_{i}\in R$$
(2)

The term \(G\left(a,b,x\right)\) is representing a nonlinear piecewise continuous function satisfying ELM universal approximation capability theorems57, (a, b) are the hidden node parameters and \(R\) is the set of real numbers whereas \({R}^{d}\) is the d-dimensional set of real numbers and \(x\) is the input data. The activation functions are Sigmoid, Hyperbolic tangent, Gaussian, Hard limit, Cosine and Fourier basis functions.

Initially, ELM randomly modifies the hidden layer to project the inputs into a feature space using some piecewise continuous nonlinear functions58. The parameters (a, b) are generated randomly that are not dependent on the training set. In the second phase of ELM learning, then, the weights \((\rho )\) linking the hidden and the output layer are solved by minimizing the prediction error in the squared error sense: i.e.

$$\begin{array}{c}min\\ {\rho \in R}^{N\times n}\end{array}{\Vert M\rho -T\Vert }^{2}$$
(3)

where \(M\) is denoting the hidden layer output matrix and \(T\) is the training data matrix which can be simplified as follows57. The · indicates the Frobenius norm.

$$M=\left[\begin{array}{c}m\left({x}_{1}\right)\\ \vdots \\ m\left({x}_{N}\right)\end{array}\right]={\left[\begin{array}{ccc}{m}_{1}\left({x}_{1}\right)& \cdots & {m}_{N}\left({x}_{1}\right)\\ \vdots & \cdots & \vdots \\ {m}_{1}\left({x}_{N}\right)& \cdots & {m}_{N}\left({x}_{N}\right)\end{array}\right]}$$
(4)
$$T=\left[\begin{array}{c}{{t}_{1}}^{T}\\ \vdots \\ {{t}_{N}}^{T}\end{array}\right]={\left[\begin{array}{ccc}{t}_{11}& \cdots & {t}_{1n}\\ \vdots & \cdots & \vdots \\ {t}_{N1}& \cdots & {t}_{Nn}\end{array}\right]}$$
(5)

The ideal solution to (3) is provided by:

$${\rho }^{*}={M}^{+}T$$
(6)

In Eq. (6) \({M}^{+}\) is indicates the Moore–Penrose generalized inverse of M. The SLFNs with randomly chosen input weights successfully learn various training patterns with the least error. In this way, SLFNs can be considered as a linear system. The output weights which attach the hidden layer to the output layer in the linear system can now be analytically solved by generalized inverse operation of the hidden layer output matrices. Thus, the ELM model is faster than the conventional feedforward learning algorithms59,60.

Online-sequential extreme learning machine (OSELM)

In OSELM the data is channelled in a chunk-by-chunk manner for better understanding and accuracy, whereas in ELM a total of N training data points are used for training purposes, which becomes computationally time exhaustive further affecting the learning procedure61. Therefore, the OSELM, which is an advanced form of ELM, operates in two learning stages utilizing the chunk-by-chunk approach i.e., initialization followed by the sequential learning stage. In the initialization phase, the H matrix is packed like ELM, for later usage. The randomized weights together with the biases are allocated to respective chunks of primary wheat yield (W) data to determine the output matrix of the OSELM hidden layers. Then the sequential learning stage is launched either in a one-by-one manner or a lump-by-lump fashion where the one-time data utilization is not permissible. More specific information on OSELM can be found in the following (e.g.,62,63,64). For a given training set \({\beth }_{k-1}\) in the initialization phase:

$${\beth }_{k-1}=\left\{\left({x}_{j},{t}_{j}\right):j=1,2,\dots k-1\right\}$$
(7)

The term \({\beth }_{k-1}\) indicates the training dataset whereas \({x}_{j}\) is the input data and \({t}_{j}\) is the jth parameter. The first output weight is provided by the following equation:

$${\rho }_{k-1}={\varnothing }_{k-1}{M}_{k-1}^{t}{T}_{k-1}$$
(8)

The term \({\rho }_{k-1}\) is showing the initial output weight, \({\varnothing }_{k-1}={\left({M}_{k-1}^{t}{M}_{k-1}\right)}^{-1}\) is indicating the Moore–Penrose generalized inverse of the matrix, \({{M}_{k-1}=\left[{m}_{1}^{t}, \dots ,{m}_{k-1}^{t}\right]}^{t}\) is denoting the hidden layer output matrix, and \({{t}_{k-1}=\left[{t}_{1}, \dots ,{t}_{k-1}\right]}^{t}\) is the training data matrix. The biases and random weights are allocated in a small chunk in the initialization stage to calculate the hidden layer output matrix in the initial wheat yield (W) training data.

The sequential learning phase is then commenced where RLS algorithm is utilized to modify the output weights in a recursive way61. The output weights in OSELM are recursively updated based on the intermediate results in the last iteration and the newly arrived data, which is deleted immediately once the features have been learnt, and therefore, the calculation overhead and the memory requirement of the algorithm are significantly decreased.

Random forest (RF)

The RF model is a regression tree-based learning approach whereby the bootstrapping and bagging are the underpinning modeling techniques on which the RF ensemble modeling approach is constructed upon65,66. Using a random bagging technique, the RF model develops ensembles in which each node is linked randomly by choosing the relevant inputs for better efficiency while avoiding overfitting67. The subsequent stages provide a brief account of the RF model designing:

  1. i.

    Perform bootstrapping on the input predictors to create n-bootstrapped based trees (i.e., ntrees).

  2. ii.

    Determine the largest no. of split variables (mtry) by means of random sampling with a non-prune regression tree.

  3. iii.

    Aggregate the simulated ntrees to predict wheat yield (W).

The RF algorithm has been used in many applications including water quality46, soil moisture68, ecological69, hydrological70 and solar radiation71,72 forecasting applications.

Case study description and data

Study region and wheat yield data

Pakistan’s Federal Bureau of Statistics and the Agriculture Marketing Information Services, Directorate of Agriculture provided the wheat yield data (Economics & Marketing)73,74. The study stations included are of high agricultural significance for the Punjab province, Pakistan. In this paper, each district is represented as a station. Agricultural sectors in Punjab province play an important part with economic contributions of 56.1–61.5%75. Further, a widespread irrigation network enables this province's rich agricultural zone. Considering Punjab as a key agronomic belt, the adoption of AI techniques to predict wheat yield is an interesting research endeavour. To establish the time series wheat yield dataset, the district-level wheat production was assimilated. To construct this dataset, the areal (district level) productions of wheat were acquired through the provincial Crop Reporting Services which had been compiled by the Economic Wing of the devolved Ministry of Food and Agriculture, and later by the Pakistan Federal Bureau of Statistics. The acquired data had some missing wheat yield values for 2009. To overcome this issue, the average of all other data for the period 1981–2013 is used to recover the missing data of the predictor and the corresponding target stations.

Figure 1a,b show the provinces in Pakistan and the map of all districts in Punjab province (current study region). The figure illustrates the study stations (i.e., the major districts) of wheat farming. Figure 2a–f present the total of 6 maps which represents the testing stations (yellow colour), training stations (red colour), and the stations where wheat yield data is not available (green colour) and the stations that are not selected by ACO algorithm (blue colour). Figures 1 and 2 were generated using the GIS software76. A total of 27 stations were considered with data from 1981 to 2013. To obtain the wheat yield time series, out of 27 stations, 26 stations were used for the selection of the best stations for training to develop the model in relation to the remaining (1) testing station. Each time, 26 stations were used to select the best stations for training subsets against the 6 test stations. Table 1 presents basic statistics (i.e., latitude, longitude, and elevations), maximum, minimum, standard deviation, skewness, and kurtosis) of the present study stations.

Figure 1
figure 1

Map of the study region. (a) Provinces of Pakistan. (b) Districts of Punjab where the present study was undertaken.

Figure 2
figure 2

The selected training stations in red and the corresponding test stations in yellow are (a), (b), (c), (d), (e), and (f) respectively. Note that the stations shown in green have ‘no available wheat yield data’ and those in blue were not selected by the ant colony optimisation algorithm.

Table 1 Geographic properties and wheat yield statistics of the study stations for Punjab, Pakistan.

Design of two-phase hybrid ACO-OSELM model

The two-phase hybrid ACO-OSELM model was developed on MATLAB R2016b platform, (The Math Works Inc. USA) with Pentium 4 dual-core Central Processing Unit (CPU). To develop the proposed two-phase universal ACO-OSELM model, historical wheat yield data series were used. In this paper, W represents the wheat yield, Wobs denotes the rvobserved wheat yield while Wpred represents the predicted wheat yield. The original wheat yield data that had statistically significant lagged values at (t 1) were employed as the input predictors in the first phase of the developmental stages. The development of the two-phase hybrid ACO-OSELM model involved the following phases:

Phase 1

In the foremost phase, the selected stations for model training were determined using the robust ACO feature selection strategy. Then, the user-defined parameters were defined with the ant numbers as 10 having 20 iterations and the initial pheromone factor was 1. For every station, the number of predictor stations (features) was defined prior to running the model. For Rahimyar Khan, the number of selected feature stations was 22, D. G. Khan (20), Kasur (19), Sialkot (17), Rawalpindi (12) and Jhang (14). The selected training stations with their correlation r against testing stations are described in Table 2.

Table 2 Selected training stations using ant colony optimization (ACO) algorithm with the correlation coefficient (r) for each training station against the testing station.

The proposed two-phase hybrid ACO-OSELM model was trained and tested on a longer time series as well as at a shorter time series to assess the accuracy and universal performance of the model. This is to ensure that the model could be applied to other locations in Pakistan. In addition, a different number of surrounding predictor stations (features) were defined for every other testing station. Essentially, the Rahimyar Khan testing station had the largest number of surrounding training stations (i.e., 22) having the longest time series with 726 data points in the time series. On the other hand, Rawalpindi testing station has 12 training stations being selected with 396 data points being the shortest time-series used in the study. Table 3 shows the training data lengths for respective stations. In addition, the pheromone exponential weights and heuristic exponential weights were kept as 1. Figure 3 plots the RMSE errors that occurred in optimizing the cost and objective function of the ACO algorithm for identifying the best feature stations.

Table 3 Training data points (in terms of selected training stations) and testing data points for each testing station using the ACO algorithm.
Figure 3
figure 3

Bar graphs of the root mean squared error (RMSE) encountered by the ant colony optimisation algorithm in the selection of training study stations for each testing study station: Station 1: Rahimyar Khan, Station 2: D. G. Khan, Station 3: Kasur, Station 4: Sialkot, Station 5: Rawalpindi, and Station 6: Jhang.

Since the data consisted of annual values from 1981 to 2013, which resulted in a total of 33 data records. ML models sometimes perform poorly on shorter time series. To handle this issue, we adopted the approach of selection of stations by ACO algorithm for training purposes and test the proposed model on the whole time-series data for respective testing stations. This technique of utilizing yield data from surrounding study stations to predict the yield of test stations are practically useful since it can enable the modellers to extract similar features and patterns prevalent at a predictor station to be analysed to estimate the yield at a testing station. This modelling approach does not required the splitting of the data in the traditional manner.

After carefully selecting the training stations for respective testing stations using the ACO algorithm, their correlation r (of selected training stations) against testing stations were calculated to confirm the linear relationship among them. For the study station Rahimyar Khan, the training station Khanewal registered the highest value of r ≈ 0.855, followed by Bahawal Nagar (r ≈ 0.854). Similarly, Muzaffar Garh (r ≈ 0.881) and Rajanpur (r ≈ 0.861) have the largest values of correlation with station D. G. Khan. For the study station, Kasur, Gujranwala, and Shekhupura attained the highest values of (r ≈ 0.950, 0.947). Table 2 summarizes all the correlation coefficients for respective stations. On the other hand, Station Kasur has the smallest cost to objective function RMSE followed by Jhang station (Fig. 3). Table 3 presents the number of datum points for training and testing purposes in each station with a ratio of selected stations against testing stations, with training and testing data distribution parameters. To prevent the differences in skewness in training and testing affecting the outcomes, data normalization was carried out using the following equation:

$${W}_{norm}=\frac{\left(W-{W}_{min}\right)}{\left({Wmin}_{max}\right)}$$
(9)

In Eq. (9) \(W\) indicates input/output of the wheat yield data, \({W}_{min}\) is the smallest value, \({W}_{max}\) is the largest value of wheat yield in the dataset, and \({W}_{norm}\) is the desired normalized value. The normalization process overcomes data fluctuations caused by inherent data features/patterns77. It essentially is invertible and in no way affects the results77. Figure 4 presents the time series of the tested study stations constructed from the selected features using the ACO algorithm.

Figure 4
figure 4

Time series of the annual wheat yield data for the training stations selected by the ant colony optimisation algorithm for each testing study station: Station 1: Rahimyar Khan, Station 2: D. G. Khan, Station 3: Kasur, Station 4: Sialkot, Station 5: Rawalpindi, and Station 6: Jhang.

Phase 2

The partial autocorrelation function (PACF) was employed to calculate and determine the statistically significant lags of historical wheat yield data series as in Fig. 5. Moreover, the cross-validation or any data randomized approach cannot be adopted as time-series data by definition occur in a temporal order/sequence and this order or sequence must be preserved in order to keep the structure of the series intact78.

Figure 5
figure 5

Partial autocorrelation function correlation coefficient (PACF) of the historical annual wheat yield time series for each testing study station: Station 1: Rahimyar Khan, Station 2: D. G. Khan, Station 3: Kasur, Station 4: Sialkot, Station 5: Rawalpindi, and Station 6: Jhang.

These significant lagged inputs at (t 1) were incorporated as the input predictor in the OSELM model to forecast the yield W. Different activation functions (sigmoid, sine, hardlim, radial basis) were tested to determine the best activation function and the radial basis (rbf) and sigmoid (sig) functions were found to be the optimal ones. Consequently, different combinations of hidden neuron ranging from 7 to 35 were trialed with block size being fixed at 100. The second significant lag (t − 2) was also utilized in the proposed two-phase hybrid ACO-OSELM model to check whether model performance increases or not. But upon utilizing the lag (t − 2), the accuracy of the proposed two-phase hybrid ACO-OSELM model decreased, so it was not considered in this paper. Similarly, the benchmark models ELM and RF models were developed resulting in ACO-ELM and ACO-RF models respectively. Figure 6 displays the model schematics. Then model training performances of the proposed hybrid two-phase ACO-OSELM were assessed via correlation coefficient (r) and root-mean-squared-error (RMSE) as shown in Table 4.

Figure 6
figure 6

Flow chart of the proposed hybrid two-phase Ant Colony Optimization algorithm integrated with the Online Sequential Extreme Learning Machine (OSELM) model.

Table 4 Training performance of two-phase hybrid ant colony optimization algorithm coupled online sequential extreme learning machines (ACO-OSELM) versus ACO-ELM and ACO-RF models with correlation coefficient (r) and root mean squared error (RMSE, kg ha−1).

The r and RMSE values attained during the training period by the two-phase hybrid ACO-OSELM models for wheat yield prediction at Rahimyar Khan and D. G. Khan were seen to be: (r = 0.812, 0.790, RMSE = 374.82, 381.57 kg ha−1). Equivalent metrics for Kasur and Sialkot were found to be: (r = 0.804, 0.798, RMSE = 370.49, 386.18 kg ha−1) and finally for Rawalpindi and Jhang were: (r = 0.832, 0.799, RMSE = 356.80, 353.55 kg ha−1). In addition, the training performances of comparative ACO-ELM and ACO-RF models were also studied (Table 4). The performance of the proposed two-phase hybrid ACO-OSELM model was relatively high during the training phase, and it is conjectured that the ACO-OSELM model accuracy in the testing phase for wheat yield prediction at these tested stations would be higher as well.

Setting and tuning parameter optimization

To attain optimum precision, one of the most crucial tasks in designing the prediction model is to adjust the tuning and pruning of parameters associated with the models. Various approaches are adopted to fine-tune the parameters to acquire the desired optimum model. The trial and error strategy was utilized to get the optimum parameters during the constructing phase of the ACO-OSELM, ACO-ELM, and ACO-RF model to predict the wheat yield79. Table 5 presents the details of parameter settings during the prediction of annual wheat yield (W). The parameters utilized to design the ACO-OSELM model are the no. of hidden neurons, activation functions, and no. of blocks. The ACO-ELM model utilizes no. of hidden neurons and activation functions only, while ACO-RF requires two parameters: no. of trees and no. of split predictors. The details on fine-tuning of these parameters are provided in Table 5 for optimally performing ACO-OSELM, ACO-ELM, and ACO-RF model for all selected study stations.

Table 5 Tuning parameters of the ACO-OSELM, ACO-ELM and ACO-RF models to predict wheat yield.

Model performance evaluation

Performance evaluations of the proposed hybrid two-phase ACO-OSELM versus ACO-ELM and the ACO-RF models applied for yield, W, forecasting was carried out via statistical standardized metrics and diagnostic plots80. These assessment metrics are formulated below as per81,82,83,84,85,86:

  1. i.

    Correlation coefficient (r):

    $$r=\left(\frac{{\sum }_{i=1}^{N}\left({W}_{obs,i}-{\stackrel{\_}{W}}_{obs,i}\right)\left({W}_{pred,i}-{\stackrel{\_}{W}}_{pred,i}\right)}{\sqrt{{\sum }_{i=1}^{N}{\left({W}_{obs,i}-{\stackrel{\_}{W}}_{obs,i}\right)}^{2}}\sqrt{{\sum }_{i=1}^{N}{\left({W}_{pred,i}-{\stackrel{\_}{W}}_{pred,i}\right)}^{2}}}\right)$$
    (10)
  2. ii.

    Willmott’s index (WI):

    $$WI=1-\left[\frac{{\sum }_{i=1}^{N}{\left({W}_{pred,i}-{W}_{obs,i}\right)}^{2}}{{\sum }_{i=1}^{N}{\left(\left|{W}_{pred,i}-{\stackrel{\_}{W}}_{obs,i}\right|+\left|{W}_{obs,i}-{\stackrel{\_}{W}}_{obs,i}\right|\right)}^{2}}\right],\quad 0\le WI\le 1$$
    (11)
  3. iii.

    Nash–Sutcliffe coefficient (NSE):

    $$N{S}_{E}=1-\left[\frac{{\sum }_{i=1}^{N}{\left({W}_{obs,i}-{W}_{pred,i}\right)}^{2}}{{\sum }_{i=1}^{N}{\left({W}_{obs,i}-{\overline{W}}_{pred,i}\right)}^{2}}\right],\quad 0\le N{S}_{E}\le 1$$
    (12)
  4. iv.

    Root mean square error (RMSE, kg ha−1):

    $$RMSE=\sqrt{\frac{1}{N}\sum _{i=1}^{N}{\left({W}_{pred,i}-{W}_{obs,i}\right)}^{2}}$$
    (13)
  5. v.

    Mean absolute error (MAE, kg ha−1):

    $$MAE=\frac{1}{N}\sum _{i=1}^{N}\left|\left({W}_{pred,i}-{W}_{obs,i}\right)\right|$$
    (14)
  6. vi.

    Legates–McCabe’s (LM) index:

    $$LM=1-\left[\frac{{\sum }_{i=1}^{N}\left|{W}_{pred,i}-{W}_{obs,i}\right|}{{\sum }_{i=1}^{N}\left|{W}_{obs,i}-{\stackrel{\_}{W}}_{obs,i}\right|}\right],0\le LM\le 1$$
    (15)
  7. vii.

    Relative root mean square error (RRMSE, %):

    $$RRMSE=\frac{\sqrt{\frac{1}{N}{\sum }_{i=1}^{N}{\left({W}_{pred,i}-{W}_{obs,i}\right)}^{2}}}{\frac{1}{N}{\sum }_{i=1}^{N}\left({W}_{obs,i}\right)}\times 100$$
    (16)
  8. viii.

    Relative mean absolute percentage error (RMAE; %):

    $$RMAE=\frac{1}{N}\sum_{i=1}^{N}\left|\frac{\left({W}_{pred,i}-{W}_{obs,i}\right)}{{W}_{obs,i}}\right|\times 100$$
    (17)

where \({W}_{obs,i}\) and \({W}_{pred,i}\) are ith observed and predicted values of the wheat yield W; \({\stackrel{\_}{W}}_{obs,i}\) and \({\stackrel{\_}{W}}_{pred,i}\) represents respective observed and predicted averages of W while N is the number of data points in the testing phase. The value of correlation coefficient (r) can be in the range of − 1 and + 1, which demonstrates the associations in terms of the proportion of variance in between the observed and predicted W from the machine learning models82. A value of + 1 shows that the observed and forecasted values are highly correlated with the least variances. The second metric Willmott’s Index (WI) ranges between 0 and 1. The WI overcomes the insensitivity issues as the differences between the observed and forecasted values are not squared and the ratio of the mean squared error in place of the differences are considered in computations87,88. The next metric, i.e., Nash–Sutcliffe Efficiency (NSE) has the ideal value of 1 and spans till negative infinity that essentially compares the variance of predicted with the observed values89. In addition, the computation of error measures RMSE and MAE are based on the aggregation of residuals of observed and predicted W values90. The higher W values are largely captured by the RMSE whereas the MAE equally assesses all variations regardless of the sign, yet both range from 0 (ideal value) to positive infinity. On the other hand, the Legates–McCabe’s (LM) index is a more robust tool developed to address the limitations of both the W and NSE and the value is bound between 0 and 1 (the ideal value)91.

However, these metrics should not essentially be used to compare model performance at geographically diverse stations92, as these metrics are in their absolute terms. As such the relative values of root mean square error (RRMSE) and mean absolute error (RMAE) were utilized for this purpose93. The relative values are in percentages and for a model to be rated as outstanding, the (RRMSE, RMAPE) < 10%. For models rated as good the range is 10% < (RRMSE, RMAE) < 20%, while the model is fair if 20% < (RRMSE, RMAE) < 30% and if the (RRMSE, RMAE) > 30% the model is considered to have poor prediction performance94,95.

Modelling results and analysis

The proposed two-phase hybrid ACO-OSELM is evaluated with ACO-ELM and ACO-RF models, based on evaluation metrics (“Setting and tuning parameter optimization” section), diagnostic plots together with error distributions. Figure 7 displays a scatterplot with the respective coefficients of determination (r2) depicting the level of associations between the predicted and observed wheat yield (W) overlayed with the goodness-of-fit line and the linear equation. Essentially, the closer the linear equation is to the y = mx representation and the closer the r2 is to unity, the better the model performance is. The proposed two-phase hybrid ACO-OSELM model has better predictive potential than ACO-ELM and ACO-RF models in terms of r2 (ACO-OSELM ≈ 0.995, ACO-ELM ≈ 0.996, ACO-RF ≈ 0.862) for Kasur. Again, the proposed two-phase hybrid ACO-OSELM model is more accurate for Sialkot, r2 (ACO-OSELM ≈ 0.974, ACO-ELM ≈ 0.936, ACO-RF ≈ 0.892), and Rawalpindi stations in terms of the achieved r2 (ACO-OSELM ≈ 0.945, ACO-ELM ≈ 0.924, ACO-RF ≈ 0.814). The proposed two-phase hybrid ACO-OSELM model for other stations Rahimyar Khan, D. G. Khan, and Jhang is reasonably good compared to ACO-ELM and ACO-RF models (Fig. 7). The better accuracy of the proposed two-phase hybrid ACO-OSELM model against the comparison models for all the study regions is confirmed by the linear regression equation and the goodness-of-fit in addition to attaining larger r2 values.

Figure 7
figure 7

Scatterplots of the predicted (Wpred) and observed wheat yield (Wobs) (kg ha−1) in the testing phase of the ACO-OSELM versus ACO-ELM and ACO-RF models including the coefficient of determination (r2) and a linear fit inserted in each panel for the tested study zones. Note: Each point represents each year’s data in the testing period.

Moreover, comparative boxplots of the proposed two-phase hybrid ACO-OSELM model with ACO-ELM and ACO-RF models for each station were established. Figure 8 displays these boxplots of absolute values of prediction error |PE| during the testing data together with respective upper quartiles, medians, and lower quartiles. The ‘+’ on the figure denotes the extreme values of the |PE| distributions. Subsequently, much smaller quartile values registered by the proposed two-phase hybrid ACO-OSELM model for Rahimyar Khan and D. G. Khan followed by the ACO-ELM and ACO-RF models confirmed better predictive performances. The proposed two-phase hybrid ACO-OSELM model achieved improved accuracies for Rawalpindi and Jhang stations in relation to the benchmark models. Similarly, the proposed two-phase hybrid ACO-OSELM model performed well for Sialkot and Kasur stations in predicting wheat yield followed by the ACO-ELM and ACO-RF models. The boxplot in Fig. 8 clearly shows that the proposed two-phase hybrid ACO-OSELM model at all six stations outperformed the comparative models.

Figure 8
figure 8

Boxplots of the prediction error |PE| (kg ha−1) of ACO-OSELM versus ACO-ELM and ACO-RF models between the predicted and observed wheat yield for Station 1: Rahimyar Khan, Station 2: D. G. Khan, Station 3: Kasur, Station 4: Sialkot, Station 5: Rawalpindi, and Station 6: Jhang.

The preciseness of the proposed two-phase hybrid ACO-OSELM is further evaluated with comparative ACO-ELM and ACO-RF models based on r, RMSE, and MAE (Table 6). The proposed two-phase hybrid ACO-OSELM model at Kasur station registered the largest r with least RMSE and MAE (r ≈ 0.999, RMSE ≈ 85.42 kg ha−1, MAE ≈ 66.54 kg ha−1). In comparison, the ACO-ELM attained the following values (r ≈ 0.987, RMSE ≈ 111.59 kg ha−1, MAE ≈ 78.15 kg ha−1) while the ACO-RF model recorded; r ≈ 0.926, RMSE ≈ 154.36 kg ha−1, MAE ≈ 135.24 kg ha−1. Similarly, for Sialkot station, these metrics were ACO-OSELM (r ≈ 0.984, RMSE ≈ 155.86 kg ha−1, MAE ≈ 76.95 kg ha−1), followed ACO-ELM (r ≈ 0.967, RMSE ≈ 197.10 kg ha−1, MAE ≈ 83.21 kg ha−1) and ACO-RF (r ≈ 0.942, RMSE ≈ 209.89 kg ha−1, MAE ≈ 155.35 kg ha−1). Likewise, the performance of the proposed two-phase hybrid ACO-OSELM model was better for Rawalpindi, Jhang, Rahimyar Khan, and D. G. Khan in terms of registering the largest values of r and smallest RMSE and MAE values. This gives a clear indication of better performance of the proposed two-phase hybrid ACO-OSELM model, which can be considered a better data-intelligent tool for wheat yield prediction in contrast to the ACO-ELM and ACO-RF models.

Table 6 Testing performance of ACO-OSELM versus ACO-ELM and ACO-RF models measured by root mean square error (RMSE), mean absolute error (MAE), coefficient of determination (r).

A vector field evaluation (VFE) diagram (Fig. 9) presents a more concise statistical summary of the associations of predicted and observed wheat yield matched based upon the respective WI values. A VFE diagram is a generalization of the Taylor diagram that provides an evaluation of model performances in terms of vector fields96. For Rahimyar Khan, the WI of the proposed two-phase hybrid ACO-OSELM model with observations was ~ 0.98, followed by ACO-ELM  0.97 and ACO-RF  0.87. The WI ~ 0.99 of the ACO-OSELM model was closest to the observed wheat yield as compared to ACO-ELM and ACO-RF for D. G. Khan stations. Similarly, the proposed two-phase hybrid ACO-OSELM models were found to be the best performing models for Kasur station (WI ≈ 0.98) that were within close proximity of the observed wheat yield followed by ACO-ELM (≈ 0.97) and ACO-RF (≈ 0.92) models. For other stations Sialkot and Jhang, the proposed two-phase hybrid ACO-OSELM model is closer to the observed W as compared to the ACO-ELM and ACO-RF models. For the Rawalpindi station, the ACO-RF model was marginally better than ACO-OSELM and ACO-ELM models. Overall, the WI of the proposed two-phase ACO-OSELM model was closely distributed to the observed baseline compared to the other models.

Figure 9
figure 9

Vector field evaluation (VFE) diagram showing Willmott’s agreement between the observed and predicted wheat yield and standard deviation (SD) of ACO-OSELM versus ACO-ELM and ACO-RF models for all tested stations.

After that, the ACO-ELM and ACO-RF models were evaluated in terms of WI, NSE, and LM for all candidate stations. The preciseness of the proposed two-phase hybrid ACO-OSELM model is presented in Table 7. The largest magnitudes of WI ≈ 0.980, NSE ≈ 0.966, and LM ≈ 0.865 were recorded by the proposed two-phase hybrid ACO-OSELM model at Rahimyar Khan station followed by ACO-ELM (WI ≈ 0.978, NSE ≈ 0.963 and LM ≈ 0.848) and the ACO-RF (WI ≈ 0.876, NSE ≈ 0.830 and LM ≈ 0.579) models. For D. G. Khan and Kasur stations, again the proposed two-phase hybrid ACO-OSELM appeared to be the best model (WI ≈ 0.989, 0.977, NSE ≈ 0.978, 0.955, and LM ≈ 0.884, 0.805), followed by ACO-ELM (WI ≈ 0.988, 0.962, NSE ≈ 0.977, 0.923 and LM ≈ 0.879, 0.766) and ACO-RF models (WI ≈ 0.903, 0.920, NSE ≈ 0.823, 0.852 and LM ≈ 0.612, 0.595). For other stations Sialkot, Rawalpindi, and Jhang, the proposed two-phase hybrid ACO-OSELM model appeared to be the best (Table 7) in comparison to the counterpart models revealing the better performances of the proposed two-phase hybrid ACO-OSELM models.

Table 7 The performance of ACO-OSELM versus ACO-ELM and ACO-RF models using Willmott’s index (WI), Nash–Sutcliffe (NSE) and Legates–McCabe’s (LM) agreement, for Station 1: Rahimyar Khan, Station 2: D. G. Khan, Station 3: Kasur, Station 4: Sialkot, Station 5: Rawalpindi and Station 6: Jhang.

Furthermore, the empirical cumulative distribution function (ECDF, Fig. 10) at all stations depicts that the proposed two-phase hybrid ACO-OSELM method was reasonably better and superior to both the ACO-ELM and ACO-RF models. Based on the error (0 to ± 400 kg ha−1) for the Rahimyar Khan, D. G. Khan, and Kasur station, (0 to ± 600 kg ha−1) for Rawalpindi and Jhang station while (0 to ± 1000 kg ha−1) for Sialkot station, Fig. 10 clearly proves that the proposed two-phase hybrid ACO-OSELM method was the most precise model in predicting wheat yield.

Figure 10
figure 10

Empirical cumulative distribution function (ECDF) of the prediction error, |PE| (kg ha−1) for the testing stations using ACO-OSELM versus ACO-ELM and ACO-RF models.

The magnitudes of relative root mean squared error (RRMSE) and relative mean absolute error (RMAE) for the different locations (Rahimyar Khan, D. G. Khan, Kasur, Sialkot, Rawalpindi, and Jhang) are presented in Table 8. It demonstrated that D. G. Khan is the station where the ACO-OSELM wheat yield predicting model performed the best with RRMSE ≈ 3.00 and RMAE ≈ 2.25%. The ACO-OSELM model was found to generate the least relative percentage error values (i.e., RRMSE, RMAE) at all tested stations except for the Rawalpindi station. However, the predicted errors generated by the proposed two-phase hybrid ACO-OSELM model were low in terms of their relative error values, and more importantly, the error values were within the recommended range of 10% threshold for an excellent model classification, except for Rawalpindi station97.

Table 8 Geographic comparison of the accuracy of the ACO-OSELM versus ACO-ELM and ACO-RF models in terms of relative root mean squared error (RRMSE, %) and the relative mean absolute error (RMAE, %) computed within the test stations.

Figure 11 presents the absolute prediction error |PE| in each year from 1981–2013 of the proposed two-phase hybrid ACO-OSELM versus ACO-ELM and ACO-RF models at the testing stations in the form of polar plots. For all stations, the prediction errors generated by the proposed two-phase hybrid ACO-OSELM were very low compared to the ACO-ELM and ACO-RF models. This was justified by the minimum values of relative prediction errors. The |PE| errors were significantly smaller in each year for the proposed two-phase hybrid ACO-OSELM model as compared to ACO-ELM and ACO-RF models in Rahimyar Khan, D. G. Khan, Kasur, Sialkot, Rawalpindi and Jhang stations. Overall, the proposed two-phase hybrid ACO-OSELM model generated better significant accuracy with smaller error statistics and higher WI.

Figure 11
figure 11

Polar plots showing the prediction error |PE| in each year generated from the ACO-OSELM versus ACO-ELM and ACO-RF models in predicting wheat yield for all stations.

Discussions

Developing strategies for accurate crop yield prediction that can address food scarcity issues, decision-making on national imports and exports, and setting the prices in agriculture markets, can play an important role in policymaking, particularly in agriculture-based nations such as Pakistan. This study was aimed at designing a novel two-phase hybrid ACO-OSELM model using significant lag at (t 1) to predict future wheat yield. This is a practically useful approach for crop yield management in terms of using the wheat yield data from several nearby stations in developing better agricultural practices and efficient precision agricultural technologies. For example, the methodology can be used in remote areas where meteorological data is not available due to limited resources. The research framework in this study can be applied to any other study station where yield data (whether it is wheat or any other crop) are available from surrounding stations to provide an accurate prediction.

The proposed two-phase hybrid ACO-OSELM model with its counterpart models (ACO-ELM and ACO-RF) was suitably evaluated, which revealed smaller relative percentage errors in terms of RRMSE and RMAE being generated. Respectively, reasonably large statistical correlation metric values of Legates–McCabe’s between predicted and observed yielded for D. G. Khan and other tested stations (Tables 7, 8). The model performances were high since the percentage errors achieved were less than 10%. Thus, the proposed two-phase hybrid ACO-OSELM model can suitably be used to predict the wheat yield where the prediction of a crop commodity is likely to become more important due to ever-increasing demand.

The proposed two-phase hybrid OSELM model can assist the government’s national policymakers and agricultural engineers in minimizing uncertainties in crop estimates reducing price hikes as well as unwarranted wastages98. Since the proposed two-phase hybrid ACO-OSELM model offers better forecasting potential together with being fast and robust, it can possibly be explored in predicting other crop yields including Rice, Maize, Cotton, Sugarcane, and Oilseeds to generate similar optimal predictions in follow-up studies.

The utilization of historical wheat yield data as inputs to predict the future yield carries some limitations. Certainly, weather conditions are a big driver for any agricultural yield. Hence, to enhance the scope of future studies, predictor inputs consisting of meteorological data (i.e., precipitation, air temperatures, soil moisture, wind speed, solar radiation, etc.) need to be used to predict future crop yield as crop production amounts are largely contingent upon these parameters. Satellite-based remotely sensed data and/or data from atmospheric simulation models (e.g.,31,99,100) as predictor variables are also likely to add great value to the crop yield modeling in remote agricultural areas with limited datasets. Incorporation of remotely sensed photosynthetically active radiation (PAR) that reveals crop health could also be focussed on, in an independent study. In addition, fertilizer/manure usage data accompanied by relevant soil characteristics (e.g., texture, pedality, hydraulics, porosity, bulk density, thickness, and soil organic carbon content) could also be explored in the proposed two-phase hybrid ACO-OSELM model. Fields that use irrigation for production need to utilize irrigation statistics to improve crop yield predictions. Further, as process-based modeling is resource-demanding which emerging agricultural nations like Pakistan unable to afford, the proposed two-phase hybrid ACO-OSELM model could be used as a feasible option.

An ensemble modeling approach could further improve the two-phase hybrid ACO-OSELM modeling with the possibility of achieving better results. Ensemble modeling would provide better confidence in predictions making the model more reliable in strategic decision-making, as uncertainties between several forecasted data would be captured and displayed in the outputs. Quantum-Behaved PSO and the Firefly Algorithms could also be used to identify training stations that have been tested to hybridize with the OSELM (e.g.,101,102). Future works could apply, empirical wavelet transform-EWT103, empirical mode decomposition-EMD104, and singular value decomposition-SVD105, as data pre-processing tools in modeling and predicting crop yields.

Conclusions

The current study was adopted to develop a robust two-phase hybrid ACO-OSELM model to predict wheat yield. Lagged wheat yields from several neighbouring stations were used for training purposes as model predictors for the candidate station. Wheat yield data for the period of 1981–2013 from 26 stations were pooled and the best training stations were selected by the ACO algorithm on the basis of feature selection corresponding to the 27th test station. The selected feature stations were used to construct a time series where the significant lags at (t − 1) were used to develop the proposed two-phase hybrid ACO-OSELM model to achieve better accuracy. Several evaluation criteria including diagnostic plots were adopted to judge the accuracy of the proposed two-phase hybrid ACO-OSELM model. The proposed hybrid ACO-OSELM outperformed the counterpart models for wheat yield prediction. The prediction errors metrics for the best station D. G. Khan registered by ACO-OSELM model were RMSE ≈ 67.12 kg ha−1 and MAE ≈ 42.37 kg/ha. The normalized performance metrics for the D. G. Khan station (r ≈ 0.997, WI ≈ 0.989 and NSE ≈ 0.978. The performance assessment of the ACO-OSELM model in relation to ACO-ELM and the ACO-RF models via Legates–McCabe’s indices were in agreement. The LM values between the predicted and observed wheat yield for the D. G. Khan study station were LM ≈ 0.884 (ACO-OSELM), 0.879 (ACO-ELM) and 0.612 (ACO-RF), respectively and the relative errors, RRMSE and RMAE were very small: 3.00%, 2.25% (ACO-OSELM) compared with 3.09%, 2.39% (ACO-ELM) and 8.48%, 7.33% (ACO-RF). Since the relative percentage errors, RRMSE and RMAE showed that at D. G. Khan station the proposed two-phase hybrid ACO-OSELM model performed the best as compared to other stations, evidently geographic variability does influence the outcomes to a certain degree. This essentially is a baseline study whereby wheat yield data from several stations are being utilized to predict wheat yield more accurately that can potentially be extended to forecasting using other climatological parameters in future studies. Similarly, other agricultural crop yield predictions could be explored with the proposed two-phase hybrid ACO-OSELM model that will assist policymakers and decision-makers in the better management of crop yield and price predictions. More importantly, accurate wheat and other crop yield predictions can be used to alert impacted stakeholders and the government to avert food security issues.

References

  1. Martin, G., Martin-Clouaire, R. & Duru, M. Farming system design to feed the changing world. A review. Agron. Sustain. Dev. 33, 131–149 (2013).

    Google Scholar 

  2. McElwee, G. & Bosworth, G. Exploring the strategic skills of farmers across a typology of farm diversification approaches. J. Farm Manag. 13, 819–838 (2010).

    Google Scholar 

  3. Maghrebi, M. et al. Iran’s agriculture in the anthropocene. Earth’s Future. https://doi.org/10.1029/2020EF001547 (2020).

    Article  Google Scholar 

  4. Raorane, A. A. & Kulkarni, R. V. Data mining: An effective tool for yield estimation in the agricultural sector. Int. J. Emerg. Trends Technol. Comput. Sci. 1, 1–4 (2012).

    Google Scholar 

  5. Gonzalez-Sanchez, A., Frausto-Solis, J. & Ojeda-Bustamante, W. Attribute selection impact on linear and nonlinear regression models for crop yield prediction. Sci. World J. 2014, 509429 (2014).

    Google Scholar 

  6. Salman, S. A. et al. Changes in climatic water availability and crop water demand for Iraq region. Sustainability 12, 3437 (2020).

    Google Scholar 

  7. Mahmood, N., Arshad, M., Kächele, H., Ullah, A. & Müller, K. Economic efficiency of rainfed wheat farmers under changing climate: Evidence from Pakistan. Environ. Sci. Pollut. Res. 27, 34453–34467 (2020).

    Google Scholar 

  8. Pracha, A. S. & Volk, T. A. An edible energy return on investment (EEROI) analysis of wheat and rice in Pakistan. Sustainability 3, 2358–2391 (2011).

    Google Scholar 

  9. Canadell, J. et al. Abberton, M., Conant, R., & Batello, C. (Eds.). (2010). Grassland carbon sequestration: Management, policy and economics. Food and Agriculture Organization of the United Nations, Integrated Crop Management, Vol. 11–2010. Ahlstrom, A., Raupach, M., Schurgers. Sensit. A Semi-Arid Grassl. To Extrem. Precip. Events 127, 6 (2021).

    Google Scholar 

  10. Canton, H. Food and Agriculture Organization of the United Nations—FAO. In The Europa Directory of International Organizations 2021 (ed. Canton, H.) 297–305 (Routledge, 2021).

    Google Scholar 

  11. Abdullah, A. et al. Potential for sustainable utilisation of agricultural residues for bioenergy production in Pakistan: An overview. J. Clean. Prod. 287, 125047 (2020).

    Google Scholar 

  12. Mughal, I. et al. Protein quantification and enzyme activity estimation of Pakistani wheat landraces. PLoS ONE 15, e0239375 (2020).

    CAS  PubMed  PubMed Central  Google Scholar 

  13. Dorosh, P. & Salam, A. Wheat markets and price stabilisation in Pakistan: An analysis of policy options. Pak. Dev. Rev. 47, 71–87 (2008).

    Google Scholar 

  14. Fowke, V. The National Policy and the Wheat Economy (University of Toronto Press, 2019).

    Google Scholar 

  15. Hussain, S. et al. Study the effects of COVID-19 in Punjab, Pakistan using space-time scan statistic for policy measures in regional agriculture and food supply chain. Environ. Sci. Pollut. Res. Int. 20, 1–14 (2021).

    Google Scholar 

  16. Sajjad, S. A. Story of Pakistan’s Elite Wheat (The Express Tribune, 2017).

    Google Scholar 

  17. Durgun, Y. Ö., Gobin, A., Duveiller, G. & Tychon, B. A study on trade-offs between spatial resolution and temporal sampling density for wheat yield estimation using both thermal and calendar time. Int. J. Appl. Earth Obs. Geoinf. 86, 101988 (2020).

    Google Scholar 

  18. Vannoppen, A. et al. Wheat yield estimation from NDVI and regional climate models in Latvia. Remote Sens. 12, 2206 (2020).

    ADS  Google Scholar 

  19. Irmak, A. et al. Artificial neural network model as a data analysis tool in precision farming. Trans. ASABE 49, 2027–2037 (2006).

    Google Scholar 

  20. Bannerjee, G., Sarkar, U., Das, S. & Ghosh, I. Artificial intelligence in agriculture: A literature survey. Int. J. Sci. Res. Comput. Sci. Appl. Manag. Stud. 7, 1–6 (2018).

    Google Scholar 

  21. Patrício, D. I. & Rieder, R. Computer vision and artificial intelligence in precision agriculture for grain crops: A systematic review. Comput. Electron. Agric. 153, 69–81 (2018).

    Google Scholar 

  22. Yaseen, Z. M. et al. Prediction of evaporation in arid and semi-arid regions: A comparative study using different machine learning models. Eng. Appl. Comput. Fluid Mech. 14, 70–89 (2019).

    Google Scholar 

  23. Bauer, M. E. The role of remote sensing in determining the distribution and yield of crops. In Advances in Agronomy (ed. Sparks, D. L.) 271–304 (Elsevier, 1975). https://doi.org/10.1016/s0065-2113(08)70012-9.

    Chapter  Google Scholar 

  24. Dempewolf, J. et al. Wheat yield forecasting for Punjab Province from vegetation index time series and historic crop statistics. Remote Sens. 6, 9653–9675 (2014).

    ADS  Google Scholar 

  25. Hamid, N., Pinckney, T. C., Gnaegy, S. & Valdes, A. The Wheat Economy of Pakistan: Setting and Prospects (IFPRI, 2015).

    Google Scholar 

  26. Muhammad, K. Description of the Historical Background of Wheat Improvement in Baluchistan, Pakistan (Agriculture Research Institute (Sariab, Quetta, Baluchistan, Pakistan), 1989).

    Google Scholar 

  27. Iqbal, N., Bakhsh, K., Maqbool, A. & Abid Shohab, A. Use of the ARIMA model for forecasting wheat area and production in Pakistan. J. Agric. Soc. Sci. 1, 120–122 (2005).

    Google Scholar 

  28. Sher, F. & Ahmad, E. Forecasting wheat production in Pakistan. LAHORE J. Econ. 13, 57–85 (2008).

    Google Scholar 

  29. Khan, N. et al. Determination of cotton and wheat yield using the standard precipitation evaporation index in Pakistan. Arab. J. Geosci. 14, 1–16 (2021).

    Google Scholar 

  30. Rahman, M. M., Haq, N. & Rahman, R. M. Machine learning facilitated rice prediction in Bangladesh. In 2014 Annual Global Online Conference on Information and Computer Technology. https://doi.org/10.1109/gocict.2014.9 (2014).

  31. Chen, C. & Mcnairn, H. A neural network integrated approach for rice crop monitoring. Int. J. Remote Sens. 27, 1367–1393 (2006).

    Google Scholar 

  32. Kaul, M., Hill, R. L. & Walthall, C. Artificial neural networks for corn and soybean yield prediction. Agric. Syst. 85, 1–18 (2005).

    Google Scholar 

  33. Deo, R. C., Samui, P., Kisi, O. & Yaseen, Z. M. Intelligent Data Analytics for Decision-Support Systems in Hazard Mitigation: Theory and Practice of Hazard Mitigation (Springer Nature, 2020).

    Google Scholar 

  34. Sanikhani, H. et al. Survey of different data-intelligent modeling strategies for forecasting air temperature using geographic information as model predictors. Comput. Electron. Agric. 152, 242–260 (2018).

    Google Scholar 

  35. Hai, T. et al. Global solar radiation estimation and climatic variability analysis using extreme learning machine based predictive model. IEEE Access 8, 12026–12042 (2020).

    Google Scholar 

  36. Ramos, A. P. M. et al. A random forest ranking approach to predict yield in maize with UAV-based vegetation spectral indices. Comput. Electron. Agric. 178, 105791 (2020).

    Google Scholar 

  37. Suchithra, M. S. & Pai, M. L. Improving the prediction accuracy of soil nutrient classification by optimizing extreme learning machine parameters. Inf. Process. Agric. 7, 72–82 (2020).

    Google Scholar 

  38. Feng, Z., Huang, G. & Chi, D. Classification of the complex agricultural planting structure with a semi-supervised extreme learning machine framework. Remote Sens. 12, 3708 (2020).

    ADS  Google Scholar 

  39. Tur, R. & Yontem, S. A comparison of soft computing methods for the prediction of wave height parameters. Knowl. Based Eng. Sci. 2, 31–46 (2021).

    Google Scholar 

  40. Yaseen, Z. M., Ali, M., Sharafati, A., Al-Ansari, N. & Shahid, S. Forecasting standardized precipitation index using data intelligence models: Regional investigation of Bangladesh. Sci. Rep. 11, 1–25 (2021).

    Google Scholar 

  41. Sharafati, A., Asadollah, S. B. H. S. & Neshat, A. A new artificial intelligence strategy for predicting the groundwater level over the Rafsanjan aquifer in Iran. J. Hydrol. https://doi.org/10.1016/j.jhydrol.2020.125468 (2020).

    Article  Google Scholar 

  42. Huang, G.-B., Zhu, Q.-Y. & Siew, C.-K. Extreme learning machine: Theory and applications. Neurocomputing 70, 489–501 (2006).

    Google Scholar 

  43. Adnan, R. M. et al. Improving streamflow prediction using a new hybrid ELM model combined with hybrid particle swarm optimization and grey wolf optimization. Knowl. Based Syst. 230, 107379 (2021).

    Google Scholar 

  44. Yaseen, Z. M. et al. Stream-flow forecasting using extreme learning machines: A case study in a semi-arid region in Iraq. J. Hydrol. 542, 603–614 (2016).

    ADS  Google Scholar 

  45. Prasad, R., Deo, R. C., Li, Y. & Maraseni, T. Ensemble committee-based data intelligent approach for generating soil moisture forecasts with multivariate hydro-meteorological predictors. Soil Tillage Res. https://doi.org/10.1016/j.still.2018.03.021 (2018).

    Article  Google Scholar 

  46. Tiyasha, T. et al. Functionalization of remote sensing and on-site data for simulating surface water dissolved oxygen: Development of hybrid tree-based artificial intelligence models. Mar. Pollut. Bull. 170, 112639 (2021).

    CAS  PubMed  Google Scholar 

  47. Ali, M. et al. Variational mode decomposition based random forest model for solar radiation forecasting: New emerging machine learning technology. Energy Rep. 7, 6700–6717 (2021).

    Google Scholar 

  48. Khozani, Z. S. et al. Determination of compound channel apparent shear stress: Application of novel data mining models. J. Hydroinform. 21, 798–811 (2019).

    MathSciNet  Google Scholar 

  49. Dorigo, M. & Di Caro, G. Ant colony optimization: A new meta-heuristic. In Proceedings of the 1999 Congress on Evolutionary Computation, CEC 1999. https://doi.org/10.1109/CEC.1999.782657 (1999).

  50. Mullen, R. J., Monekosso, D., Barman, S. & Remagnino, P. A review of ant algorithms. Expert Syst. Appl. https://doi.org/10.1016/j.eswa.2009.01.020 (2009).

    Article  Google Scholar 

  51. Sweetlin, J. D., Nehemiah, H. K. & Kannan, A. Feature selection using ant colony optimization with tandem-run recruitment to diagnose bronchitis from CT scan images. Comput. Methods Prog. Biomed. https://doi.org/10.1016/j.cmpb.2017.04.009 (2017).

    Article  Google Scholar 

  52. Cordon, O., Herrera, F. & Stützle, T. A review on the ant colony optimization metaheuristic: Basis, models and new trends. Mathw. Comput. 9, 2–3 (2002).

    MathSciNet  MATH  Google Scholar 

  53. Singh, G., Kumar, N. & Kumar Verma, A. Ant colony algorithms in MANETs: A review. J. Netw. Comput. Appl. https://doi.org/10.1016/j.jnca.2012.07.018 (2012).

    Article  Google Scholar 

  54. Kumar, S., Solanki, V. K., Choudhary, S. K., Selamat, A. & González Crespo, R. Comparative study on ant colony optimization (ACO) and K-means clustering approaches for jobs scheduling and energy optimization model in internet of things (IoT). Int. J. Interact. Multimed. Artif. Intell. 6, 107 (2020).

    Google Scholar 

  55. Paniri, M., Dowlatshahi, M. B. & Nezamabadi-pour, H. MLACO: A multi-label feature selection algorithm based on ant colony optimization. Knowl. Based Syst. 192, 105285 (2020).

    Google Scholar 

  56. Yaseen, Z. M., Sulaiman, S. O., Deo, R. C. & Chau, K.-W. An enhanced extreme learning machine model for river flow forecasting: State-of-the-art, practical applications in water resource engineering area and future research direction. J. Hydrol. 569, 387–408 (2019).

    ADS  Google Scholar 

  57. Manju Parkavi, R., Shanthi, M. & Bhuvaneshwari, M. C. Recent trends in ELM and MLELM: A review. Adv. Sci. Technol. Eng. Syst. https://doi.org/10.25046/aj020108 (2017).

    Article  Google Scholar 

  58. Araba, A. M., Memon, Z. A., Alhawat, M., Ali, M. & Milad, A. Estimation at completion in Civil engineering projects: Review of regression and soft computing models. Knowl. Based Eng. Sci. 2, 1–12 (2021).

    Google Scholar 

  59. Tamura, S. & Tateishi, M. Capabilities of a four-layered feedforward neural network: Four layers versus three. IEEE Trans. Neural Netw. 8, 251–255 (1997).

    CAS  PubMed  Google Scholar 

  60. Huang, G.-B. Learning capability and storage capacity of two-hidden-layer feedforward networks. IEEE Trans. Neural Netw. 14, 274–281 (2003).

    PubMed  Google Scholar 

  61. Ali, M., Deo, R. C., Downs, N. J. & Maraseni, T. Multi-stage hybridized online sequential extreme learning machine integrated with Markov Chain Monte Carlo copula-Bat algorithm for rainfall forecasting. Atmos. Res. 213, 450–464 (2018).

    Google Scholar 

  62. Liang, N.-Y., Huang, G.-B., Saratchandran, P. & Sundararajan, N. A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans. Neural Netw. 17, 1411–1423 (2006).

    PubMed  Google Scholar 

  63. Lan, Y., Soh, Y. C. & Huang, G.-B. Ensemble of online sequential extreme learning machine. Neurocomputing 72, 3391–3395 (2009).

    Google Scholar 

  64. Yadav, B., Ch, S., Mathur, S. & Adamowski, J. Discharge forecasting using an online sequential extreme learning machine (OS-ELM) model: A case study in Neckar River, Germany. Measurement 92, 433–445 (2016).

    ADS  Google Scholar 

  65. Breiman, L. Bagging predictors. Mach. Learn. 24, 123–140 (1996).

    MATH  Google Scholar 

  66. Breiman, L. Random forests. Mach. Learn. 45, 5–32 (2001).

    MATH  Google Scholar 

  67. Al-Sulttani, A. O. et al. Proposition of new ensemble data-intelligence models for surface water quality prediction. IEEE Access 9, 108527–108541 (2021).

    Google Scholar 

  68. Carranza, C., Nolet, C., Pezij, M. & Van Der Ploeg, M. Root zone soil moisture estimation with random forest. J. Hydrol. 593, 125840 (2021).

    Google Scholar 

  69. Evans, J. S., Murphy, M. A., Holden, Z. A. & Cushman, S. A. Modeling species distribution and change using random forest. In Predictive Species and Habitat Modeling in Landscape Ecology (eds Ashton Drew, C. et al.) 139–159 (Springer, 2011).

    Google Scholar 

  70. Rahmati, O., Pourghasemi, H. R. & Melesse, A. M. Application of GIS-based data driven random forest and maximum entropy models for groundwater potential mapping: A case study at Mehran Region, Iran. CATENA 137, 360–372 (2016).

    Google Scholar 

  71. Prasad, R., Ali, M., Kwan, P. & Khan, H. Designing a multi-stage multivariate empirical mode decomposition coupled with ant colony optimization and random forest model to forecast monthly solar radiation. Appl. Energy 236, 778–792 (2019).

    Google Scholar 

  72. Sharafati, A. et al. The potential of novel data mining models for global solar radiation prediction. Int. J. Environ. Sci. Technol. https://doi.org/10.1007/s13762-019-02344-0 (2019).

    Article  Google Scholar 

  73. Service, A. M. I. District-Wise Area of Wheat Crop. Available at: http://www.amis.pk/Agristatistics/DistrictWise/2010-2012/Wheat.html (2012).

  74. Service, A. M. I. District-Wise Area of Wheat Crop. Available at: http://www.amis.pk/Agristatistics/DistrictWise/2012-2014/Wheat.html (2014).

  75. Punjab, P. Population. Available at: https://en.wikipedia.org/wiki/Punjab_Pakistan (2015).

  76. Steiniger, S. & Hunter, A. J. S. The 2012 free and open source GIS software map—A guide to facilitate research, development, and adoption. Comput. Environ. Urban Syst. 39, 136–150 (2013).

    Google Scholar 

  77. Hsu, C.-W. et al. A practical guide to support vector classification. BJU Int. https://doi.org/10.1177/02632760022050997 (2008).

    Article  PubMed  Google Scholar 

  78. Bergmeir, C. & Benítez, J. M. On the use of cross-validation for time series predictor evaluation. Inf. Sci. (NY) 191, 192–213 (2012).

    Google Scholar 

  79. Xia, Y., Liu, C., Li, Y. Y. & Liu, N. A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring. Expert Syst. Appl. https://doi.org/10.1016/j.eswa.2017.02.017 (2017).

    Article  Google Scholar 

  80. Yen, B. C., ASCE Task Committee on Definition of Criteria for Evaluation of Watershed Models of the Watershed Management Committee Irrigation and Drainage Division. Discussion and closure: Criteria for evaluation of watershed models. J. Irrig. Drain. Eng. 121, 130–132 (1995).

    Google Scholar 

  81. Yaseen, Z. M. An insight into machine learning models era in simulating soil, water bodies and adsorption heavy metals: Review, challenges and solutions. Chemosphere 277, 130126 (2021).

    ADS  CAS  PubMed  Google Scholar 

  82. Dawson, C. W., Abrahart, R. J. & See, L. M. HydroTest: A web-based toolbox of evaluation metrics for the standardised assessment of hydrological forecasts. Environ. Model. Softw. 22, 1034–1052 (2007).

    Google Scholar 

  83. Legates, D. R. & Mccabe, G. J. Evaluating the use of ‘goodness-of-fit’ measures in hydrologic and hydroclimatic model validation. Water Resour. Res. 35, 233–241 (1999).

    ADS  Google Scholar 

  84. Willmott, C. J. & Willmott, C. J. Some comments on the evaluation of model performance. Bull. Am. Meteorol. Soc. https://doi.org/10.1175/1520-0477(1982)063%3c1309:SCOTEO%3e2.0.CO;2 (1982).

    Article  MATH  Google Scholar 

  85. Willmott, C. J. On the validation of models. Phys. Geogr. https://doi.org/10.1080/02723646.1981.10642213 (1981).

    Article  MATH  Google Scholar 

  86. Sharafati, A., Yasa, R. & Azamathulla, H. M. Assessment of stochastic approaches in prediction of wave-induced pipeline scour depth. J. Pipeline Syst. Eng. Pract. 9, 04018024 (2018).

    Google Scholar 

  87. Mohammadi, K. et al. A new hybrid support vector machine-wavelet transform approach for estimation of horizontal global solar radiation. Energy Convers. Manag. 92, 162–171 (2015).

    Google Scholar 

  88. Willmott, C. J., Robeson, S. M. & Matsuura, K. A refined index of model performance. Int. J. Climatol. 32, 2088–2094 (2012).

    Google Scholar 

  89. Nash, J. E. & Sutcliffe, J. V. River flow forecasting through conceptual models part I—A discussion of principles. J. Hydrol. 10, 282–290 (1970).

    ADS  Google Scholar 

  90. Yaseen, Z. M. et al. Hourly river flow forecasting: Application of emotional neural network versus multiple machine learning paradigms. Water Resour. Manag. 34, 1075–1091 (2020).

    Google Scholar 

  91. Bhagat, S. K., Tung, T. M. & Yaseen, Z. M. Heavy metal contamination prediction using ensemble model: Case study of Bay sedimentation, Australia. J. Hazard. Mater. 403, 123492 (2021).

    CAS  PubMed  Google Scholar 

  92. Hora, J. & Campos, P. A review of performance criteria to validate simulation models. Expert Syst. 32, 578–595 (2015).

    Google Scholar 

  93. Nourani, V., Kisi, Ö. & Komasi, M. Two hybrid Artificial Intelligence approaches for modeling rainfall-runoff process. J. Hydrol. https://doi.org/10.1016/j.jhydrol.2011.03.002 (2011).

    Article  Google Scholar 

  94. Ertekin, C. & Yaldiz, O. Comparison of some existing models for estimating global solar radiation for Antalya (Turkey). Energy Convers. Manag. 41, 311–330 (2000).

    Google Scholar 

  95. Li, M. F., Tang, X. P., Wu, W. & Liu, H. B. General models for estimating daily global solar radiation for different solar radiation zones in mainland China. Energy Convers. Manag. 70, 139–148. https://doi.org/10.1016/j.enconman.2013.03.004 (2013).

    Article  Google Scholar 

  96. Xu, Z., Hou, Z., Han, Y. & Guo, W. A diagram for evaluating multiple aspects of model performance in simulating vector fields. Geosci. Model Dev. 9, 4365–4380 (2016).

    ADS  Google Scholar 

  97. Dan Foresee, F. & Hagan, M. T. Gauss–Newton approximation to bayesian learning. In IEEE International Conference on Neural Networks—Conference Proceedings. https://doi.org/10.1109/ICNN.1997.614194 (1997).

  98. Akhtar, I. U. H. Pakistan needs a new crop forecasting system (2012).

  99. Stathakis, D., Savina, I. & Nègrea, T. Neuro-fuzzy modeling for crop yield prediction. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 34, 1–4 (2006).

    Google Scholar 

  100. Kumar, P., Gupta, D. K., Mishra, V. N. & Prasad, R. Comparison of support vector machine, artificial neural network, and spectral angle mapper algorithms for crop classification using LISS IV data. Int. J. Remote Sens. 36, 1604–1617 (2015).

    Google Scholar 

  101. Sun, J., Xu, W. & Feng, B. A global search strategy of quantum-behaved particle swarm optimization. In 2004 IEEE Conference on Cybernetics and Intelligent Systems. https://doi.org/10.1109/iccis.2004.1460396 (2004)

  102. Naganna, S. et al. Dew point temperature estimation: Application of artificial intelligence model integrated with nature-inspired optimization algorithms. Water. https://doi.org/10.3390/w11040742 (2019).

    Article  Google Scholar 

  103. Gilles, J. Empirical wavelet transform. IEEE Trans. Signal Process. 61, 3999–4010 (2013).

    ADS  MathSciNet  MATH  Google Scholar 

  104. Bokde, N., Feijóo, A., Al-Ansari, N., Tao, S. & Yaseen, Z. M. The hybridization of ensemble empirical mode decomposition with forecasting models: Application of short-term wind speed and power modeling. Energies 13, 1666 (2020).

    Google Scholar 

  105. Chau, K. W. & Wu, C. L. A hybrid model coupled with singular spectrum analysis for daily rainfall prediction. J. Hydroinform. 12, 458–473 (2010).

    Google Scholar 

Download references

Acknowledgements

The authors are thankful to the Bureau of Statistics, Government of Pakistan for providing the wheat yield data for the respective stations.

Author information

Authors and Affiliations

Authors

Contributions

M.A.: conceptualization, data analysis, writing up the manuscript, software. R.C.D.: conceptualization, data analysis, writing up the manuscript, supervision. Y.X.: conceptualization, data analysis, writing up the manuscript, supervision, R.P.: conceptualization, data analysis, writing up the manuscript, supervision, J.L.: conceptualization, data analysis, writing up the manuscript, supervision. A.F.: discussion, analysis, revision and funding. Z.M.Y.: manuscript revision, writing up the manuscript, validation, visualization.

Corresponding author

Correspondence to Zaher Mundher Yaseen.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ali, M., Deo, R.C., Xiang, Y. et al. Coupled online sequential extreme learning machine model with ant colony optimization algorithm for wheat yield prediction. Sci Rep 12, 5488 (2022). https://doi.org/10.1038/s41598-022-09482-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1038/s41598-022-09482-5

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing