You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The run validator should look out for missing turns. Alternatively, the converter to trec_eval format should populate missing turns with a single bogus document.
By default, trec_eval averages over the intersection of topics (turns) in the run and the qrels. With the -c option, it averages over all topics in the qrels, but it still doesn't report scores for missing topics.
The text was updated successfully, but these errors were encountered:
The run validator should look out for missing turns. Alternatively, the converter to trec_eval format should populate missing turns with a single bogus document.
By default, trec_eval averages over the intersection of topics (turns) in the run and the qrels. With the -c option, it averages over all topics in the qrels, but it still doesn't report scores for missing topics.
The text was updated successfully, but these errors were encountered: