Hi,
I am wondering how many test files will be in the final leaderboard. Will the holdout dataset in the prediction leaderboard also be considered part of the final leaderboard?
Hi @lider.chang and welcome to the ThinkOnward challenge community 
The final leaderboard evaluation will use ~100 wells in the evaluation. The predictive leaderboard will only be used to notify the top participants for submission to the final leaderboard.
Happy challenging!
ThinkOnward Team
1 Like
Hi,
One more question. When Onward requests the models from the top submissions on the Predictive Leaderboard for review, do we have to submit the jupyter notebook which will generate the same result as our best score on the Predictive Leaderboard? Or, can we submit the best model we are confident but it has a little worse score than our best score on the Predictive Leaderboard?
Hi @lider.chang
If selected for final submissions it is up to you to decide which model you would like to submit for scoring on the hold out dataset. So if you have a model you are confident will do better on the hold out dataset you can submit that one. Just remember there is only one final submission allowed.
Happy submitting!
ThinkOnward Team
1 Like