Selecting Track

Select which track you plan to make a submission with from Switch Actice Track in the top right.


Creating a System

In order to make a submission you will need to create at least one System, unless a System has already been created. Number of allowed system as well as System parameters might vary accoring to the rules of the Evaluation plan.


1.) To create a system, press the New System button on the submission management page and you will be redirected to the New System page.

2.) On the New System page, enter a System Name and set respective system parameters if available.

3.) Review your selection and press the Submit button.

Creating a Submission

On the submission management page you will notice a matrix-like structue with rows representing Sytems and columns representing Evaluation Phases. Each row X column intersection can host a Submission (or a set thereof).

A Submission represents your upload or upload instructions considered to be scored, validated or evaluated in some form thorough a Scoring Run.

To create a new submission:


1.) Press the Upload button in the appropriate System X Phase slot to load the New Submission page.

2.) Select your Submission Parameters if available. Sometimes parameters are visibile but not modifyable by you.

3.) Depending on the type of Submission either:
  1. Select the Browse button to upload a File
  2. Enter a valid URL of your Submission to download including download parameters

4.) Review your submission Parameters and the press the Submit button.
After pressing the Submit button your file will be uploaded and you will be redirected to the Submission Management page. A green/red top bar will report if the file-upload was sucessful.

Submission Status

For each submission the platform generates scoring runs. A scoring run represents the scorer output with specific parameters against a submission. There can be multiple scoring-runs per submission depending on specific Phase setup. From the Submission Management page you can:

  • Access Submission information
  • Inspect Scoring Run status
  • Access Scoring Run results
  • Make new submissions

To view submission information, for example the time of submission and email of uploader, simply click on the View Submission button. The number behind the submission represents a unique submission-id which you can use if you want to refer to a specific submission.

Accessing Results

To access scoring run results, click on the Scoring Run Status button on the Submission Management page.


The content of the button represents the scoring run status and will change over time from: Submitted, to custom messages indicating various steps of the backend scoring pipeline, to Failed, Done/Successful or in most cases a label representing the scoring run results, f.e. a Metric score. The content varies for each Evaluation phase respectively.

Clicking on the button will load the Scoring Run Report page. The content of the page varies throught Evaluations:


The page might be empty in case no results are being shared


Or contain a single metric score:



Or a more complex report