Score clarification

Speed and Structure
1

the score in the leaderboard is in percentage format (multiplied by 100 or no ) in another way the baseline is 3.0744% or 0.030744% @discourse-admin

2

Hi @Mof43d you are correct the baseline score of 0.30744 is 3.0744% error.

ThinkOnward Team

3

Hi @discourse-admin,

Could you please clarify the format of the scores displayed on the predictive leaderboard?

Specifically, using the score of 0.030744 as an example:

  1. Does this displayed value of “0.030744” represent the direct decimal Mean Absolute Percentage Error (MAPE), meaning the actual error is 3.0744%?
    OR
  2. Is this displayed value “0.030744” already in percentage format (i.e., the result of decimal_MAPE * 100), meaning the actual error is 0.030744% (decimal MAPE of 0.00030744)?

Sorry my question might seem redundant and stupid but could you please clarify this??
Thank you

4

Hi @adityaKhetarpal and welcome to the Challenges community :wave:

The baseline score is the mean of all the MAPE’s across all samples in the test dataset (not multiplied by 100).

So in our case baseline score is ~0.0307 which can be interpreted as ~3.07%.

ThinkOnward Team

1 Like