Exogenous variables can provide additional information to greatly improve forecasting accuracy. Some examples include price or future promotions variables for demand forecasting, and weather data for electricity load forecast. In this notebook we show an example on how to add different types of exogenous variables to NeuralForecast models for making day-ahead hourly electricity price forecasts (EPF) for France and Belgium markets. All NeuralForecast models are capable of incorporating exogenous variables to model the following conditional predictive distribution: P(yt+1:t+H  ∣  y[:t],  x[:t](h),  x[:t+H](f),  x(s))\mathbb{P}(\mathbf{y}_{t+1:t+H} \;|\; \mathbf{y}_{[:t]},\; \mathbf{x}^{(h)}_{[:t]},\; \mathbf{x}^{(f)}_{[:t+H]},\; \mathbf{x}^{(s)} ) where the regressors are static exogenous x(s)\mathbf{x}^{(s)}, historic exogenous x[:t](h)\mathbf{x}^{(h)}_{[:t]}, exogenous available at the time of the prediction x[:t+H](f)\mathbf{x}^{(f)}_{[:t+H]} and autorregresive features y[:t]\mathbf{y}_{[:t]}. Depending on the train loss, the model outputs can be point forecasts (location estimators) or uncertainty intervals (quantiles). We will show you how to include exogenous variables in the data, specify variables to a model, and produce forecasts using future exogenous variables.
Important This Guide assumes basic knowledge on the NeuralForecast library. For a minimal example visit the Getting Started guide.
You can run these experiments using GPU with Google Colab. Open In Colab

​
1. Libraries

!pip install neuralforecast

​
2. Load data

The df dataframe contains the target and exogenous variables past information to train the model. The unique_id column identifies the markets, ds contains the datestamps, and y the electricity price. Include both historic and future temporal variables as columns. In this example, we are adding the system load (system_load) as historic data. For future variables, we include a forecast of how much electricity will be produced (gen_forecast) and day of week (week_day). Both the electricity system demand and offer impact the price significantly, including these variables to the model greatly improve performance, as we demonstrate in Olivares et al. (2022). The distinction between historic and future variables will be made later as parameters of the model. 
import pandas as pd
from utilsforecast.plotting import plot_series

df = pd.read_csv(
    'https://datasets-nixtla.s3.amazonaws.com/EPF_FR_BE.csv',
    parse_dates=['ds'],
)
df.head()
unique_iddsygen_forecastsystem_loadweek_day
0FR2015-01-01 00:00:0053.4876905.074812.03
1FR2015-01-01 01:00:0051.9375492.071469.03
2FR2015-01-01 02:00:0048.7674394.069642.03
3FR2015-01-01 03:00:0042.2772639.066704.03
4FR2015-01-01 04:00:0038.4169347.065051.03
Tip Calendar variables such as day of week, month, and year are very useful to capture long seasonalities. 
plot_series(df)
Add the static variables in a separate static_df dataframe. In this example, we are using one-hot encoding of the electricity market. The static_df must include one observation (row) for each unique_id of the df dataframe, with the different statics variables as columns. 
static_df = pd.read_csv('https://datasets-nixtla.s3.amazonaws.com/EPF_FR_BE_static.csv')
static_df.head()
unique_idmarket_0market_1
0FR10
1BR01

​
3. Training with exogenous variables

We distinguish the exogenous variables by whether they reflect static or time-dependent aspects of the modeled data.
  • Static exogenous variables: The static exogenous variables carry time-invariant information for each time series. When the model is built with global parameters to forecast multiple time series, these variables allow sharing information within groups of time series with similar static variable levels. Examples of static variables include designators such as identifiers of regions, groups of products, etc.
  • Historic exogenous variables: This time-dependent exogenous variable is restricted to past observed values. Its predictive power depends on Granger-causality, as its past values can provide significant information about future values of the target variable y\mathbf{y}.
  • Future exogenous variables: In contrast with historic exogenous variables, future values are available at the time of the prediction. Examples include calendar variables, weather forecasts, and known events that can cause large spikes and dips such as scheduled promotions.
To add exogenous variables to the model, first specify the name of each variable from the previous dataframes to the corresponding model hyperparameter during initialization: futr_exog_list, hist_exog_list, and stat_exog_list. We also set horizon as 24 to produce the next day hourly forecasts, and set input_size to use the last 5 days of data as input. 
import logging

from neuralforecast.auto import NHITS, BiTCN
from neuralforecast.core import NeuralForecast

logging.getLogger("pytorch_lightning").setLevel(logging.WARNING)

horizon = 24 # day-ahead daily forecast
models = [NHITS(h = horizon,
                max_steps=100,
                input_size = 5*horizon,
                futr_exog_list = ['gen_forecast', 'week_day'], # <- Future exogenous variables
                hist_exog_list = ['system_load'], # <- Historical exogenous variables
                stat_exog_list = ['market_0', 'market_1'], # <- Static exogenous variables
                scaler_type = 'robust'),
          BiTCN(h = horizon,
                input_size = 5*horizon,
                max_steps=100,
                futr_exog_list = ['gen_forecast', 'week_day'], # <- Future exogenous variables
                hist_exog_list = ['system_load'], # <- Historical exogenous variables
                stat_exog_list = ['market_0', 'market_1'], # <- Static exogenous variables
                scaler_type = 'robust',
                ),                
                ]

Seed set to 1
Seed set to 1
Tip When including exogenous variables always use a scaler by setting the scaler_type hyperparameter. The scaler will scale all the temporal features: the target variable y, historic and future variables.
Important Make sure future and historic variables are correctly placed. Defining historic variables as future variables will lead to data leakage.
Next, pass the datasets to the df and static_df inputs of the fit method. 
nf = NeuralForecast(models=models, freq='h')
nf.fit(df=df, static_df=static_df)

​
4. Forecasting with exogenous variables

Before predicting the prices, we need to gather the future exogenous variables for the day we want to forecast. Define a new dataframe (futr_df) with the unique_id, ds, and future exogenous variables. There is no need to add the target variable y and historic variables as they won’t be used by the model. 
futr_df = pd.read_csv(
    'https://datasets-nixtla.s3.amazonaws.com/EPF_FR_BE_futr.csv',
    parse_dates=['ds'],
)
futr_df.head()
unique_iddsgen_forecastweek_day
0FR2016-11-01 00:00:0049118.01
1FR2016-11-01 01:00:0047890.01
2FR2016-11-01 02:00:0047158.01
3FR2016-11-01 03:00:0045991.01
4FR2016-11-01 04:00:0045378.01
Important Make sure futr_df has informations for the entire forecast horizon. In this example, we are forecasting 24 hours ahead, so futr_df must have 24 rows for each time series.
Finally, use the predict method to forecast the day-ahead prices. 
Y_hat_df = nf.predict(futr_df=futr_df)
Y_hat_df.head()

Predicting: |          | 0/? [00:00<?, ?it/s]

Predicting: |          | 0/? [00:00<?, ?it/s]
unique_iddsNHITSBiTCN
0BE2016-11-01 00:00:0035.29705041.957176
1BE2016-11-01 01:00:0032.35004439.419579
2BE2016-11-01 02:00:0030.09170236.313972
3BE2016-11-01 03:00:0027.31776434.002922
4BE2016-11-01 04:00:0024.31648835.002541
plot_series(df, Y_hat_df, max_insample_length=24*5)
In summary, to add exogenous variables to a model make sure to follow the next steps:
  1. Add temporal exogenous variables as columns to the main dataframe (df).
  2. Add static exogenous variables with the static_df dataframe.
  3. Specify the name for each variable in the corresponding model hyperparameter.
  4. If the model uses future exogenous variables, pass the future dataframe (futr_df) to the predict method.

​
References