Private vs public leaderboard

Energy-Efficient Ghosts of Holiday Past
1

Hello,

For this challenge, we have to forecast the electricity consumption of Scroodge’s house. To my understanding, you are using ground truth data for Scroodge’s house to compute the public leaderboard score. Does it mean the private leaderboard will be the same as the public one?

Thanks

2

@konstantina.kontoudi

Yes, that is correct. We are using the ground-truth data for both private and public leaderboards.

Best of luck forecasting,
Onward Team

3

Does that mean that the public and private leaderboard are exactly the same?

I don’t think that’s the case because then it would be very easy to overfit the public leaderboard to stay as high as possible.

Thanks in advance.

4

@paco.noa.gut

They are almost the same, but please note that you are not provided with the ground-truth data for evaluation. What you are provided as the ground-truth future energy consumption is a mock data. This is a forecasting problem and different from most of our other challenges on supervised learning where the common practice is having separate holdout and test datasets. Furthermore, for the final score we will separately look into interpretability and generalizability of the codes and models as well.

Thank you for the question and best of luck forecasting,
Onward Team

1 Like