Communications

Model submission for the evaluation phase will open today, July 31, at 8:00 pm EST on Codabench.

• The test set has 174 private cases.
• The validation phase is now closed.
• The same submission format used for validation will apply for evaluation-phase submissions, as outlined in the submission sample.

The AMPLIFAI organizing team

If you have made a submission on Codabench, your model evaluation may show a “Pending” status. Please rest assured that does not imply an issue with your submission, but rather due to delays in our data annotation process for the test set.

We understand how crucial timely evaluations are important for your model development. We sincerely apologize for this disruption.

To help you keep moving forward, we will be opening a validation phase on Codabench on July 17th. This phase will evaluate your submissions on the 59 validation cases from the released dataset, with a limit of 5 submissions per team. These “provisional” results will not be included in the final leaderboard, only the validation leaderboard. Also, it will not count towards your five submission limit for the test set.

We expect to begin the testing phase on July 31st. We will reach out via another email when they transition to the testing phase.

Thank you for your patience and continued participation in the AMPLIFAI challenge!

The AMPLIFAI organizing team

The AMPLIFAI training dataset on Hugging Face has been updated. If you have already downloaded the data, please download the latest version so you are working with the most current training cases and annotations.

Download the latest release on Hugging Face (UM-IHC-CA2i/AMPLIFAI). On the dataset page, use the repository files or revision history to confirm you have the newest version before training or resuming experiments.

For more information about the dataset, see the Data page on this site.

If you run into access or download issues, email amplifai@som.umaryland.edu.

The AMPLIFAI organizing team