What's the real test metric?

Conflicting information? Which metric is used for leaderboard scoring, is it dice or jaccard?

1 Like

Hi @harshitsheoranlearnt

The predictive leaderboard scoring uses the Jaccard score. Here is a good comparison of the similarities between the two and why we mention both metrics. We will be using the Jaccard score for the final leaderboard as well.

Good luck training!

thinkonward team

@harshitsheoranlearnt real test metric usually refers to the measure used to evaluate a models or systems performance in a realworld scenario; It can vary by context, such as accuracy, precision & recall.