Datasets
M5 dataset
Download and evaluate the M5 dataset.
Download data class
source
M5
Test number of series
Evaluation class
source
M5Evaluation
Initialize self. See help(type(self)) for accurate signature.
URL-based evaluation
The method evaluate
from the class
M5Evaluation
can receive a url of a submission to the M5
competiton.
The results compared to the on-the-fly evaluation were obtained from the official evaluation.
Pandas-based evaluation
Also the method evaluate
can recevie a pandas DataFrame of forecasts.
By default you can load the winner benchmark using the following.
Validation evaluation
You can also evaluate the official validation set.
Kaggle-Competition-M5 References
The evaluation metric of the Favorita Kaggle competition was the normalized weighted root mean squared logarithmic error (NWRMSLE). Perishable items have a score weight of 1.25; otherwise, the weight is 1.0.
Kaggle Competition Forecasting Methods | 16D ahead NWRMSLE |
---|---|
LGBM [1] | 0.5091 |
Seq2Seq WaveNet [2] | 0.5129 |
- Corporación Favorita. Corporación favorita grocery sales forecasting. Kaggle Competition Leaderboard, 2018.
- Glib Kechyn, Lucius Yu, Yangguang Zang, and Svyatoslav Kechyn. Sales forecasting using wavenet within the framework of the Favorita Kaggle competition. Computing Research Repository, abs/1803.04037, 2018.