Evaluation

For evaluating the tasks, an evaluation service will be implemented on the Codabench platform, initially with restricted access for participants during the task development phase, and reopened as a public benchmark once the campaign is over.

The evaluation methodology, the submission formats and the evaluation scripts for each task will be published on this page ahead of its start date. A summary of the metrics used in each task is available in the Task Summary.