SAP IBP select forecasting algorithm with minimum positive error instead of min negative error?

[former_member856826]

Hello Consultants,

Why does the SAP IBP system select the forecasting algorithm with the minimum positive error instead of the algorithm with the overall lowest error, even when some algorithms have negative errors and others have positive errors, as indicated in the downloaded log file?

[lev_degtyarov]

Hi Sumeet,

just 50cent from my side. I saw you used MPE as error measure in your best-fit model. I just wonder why you decided on MPE. Because from data science community it is non usual, however still possible, to use MPE as metric to fine-tune you forecasting model.

Best practice is:

- MAPE (some times MPE) is used for reporting and dashboarding, to show forecast accuracy to the users

- RMSE or MAE (in SAP we call it also MAD) are used to fine tune hyper parameters in forecasting model, select the best model

- BIC, AIK - these one is for ARIMA class models

The pros and cons of MAPE, MAE, MAD, RMSE are know, you can google it an check youtube.

BR,

Lev