PREPARE Challenge - Phase 2: Report Arena

Advance algorithms and analytic approaches for early prediction of Alzheimer's disease and related dementias, with an emphasis on explainability of predictions. [Report Arena] #health

$250,000 in prizes
Completed jan 2025
69 joined

Overview

Alzheimer's disease and Alzheimer's disease related dementias (AD/ADRD) are a set of brain disorders affecting more than 6 million Americans. Early intervention is crucial for successful disease modification, but detecting early signs of cognitive decline and AD/ADRD remains challenging. Current clinical methods often lack the sensitivity needed for early prediction, especially in underrepresented groups.

The objective of this challenge track is to improve early prediction of Alzheimer's disease and related dementias (AD/ADRD) using acoustic biomarkers from voice recordings. Through this initiative, the National Institute on Aging (NIA) aims to improve accuracy across diverse populations and explore understudied factors that may indicate early AD/ADRD.


Prizes

Submission Deadline:

Jan. 22, 2025, 11:59 p.m. UTC

Prize Amount
Overall Prizes $160,000
Special Recognition Prizes $50,000
Explainability Bonus Prizes $40,000
Community Code Bonus Prizes $10,000
Total $260,000

Tracks and Stages

Phase 2 will occur over two stages, each with its own arena:

  1. Model Arena (Oct 22 - Dec 19, 2024): Participants submit predictions in the Model Arena, and scores are displayed on the public leaderboard.
  2. Report Arena (Dec 20, 2024 - Jan 22, 2025): The top 15 leaderboard finalists from each Model Arena (Social Determinants Track + Acoustic Track) are invited to submit reports in the pre-screened Report Arena.

You are currently on the page for the Report Arena, which is only open to the top 15 leaderboard finalists from each Model Arena (Social Determinants Track + Acoustic Track). Eligible teams are automatically registered. If you need to make changes to your team, please contact info@drivendata.org.

Breakdown

Place Amount
1st $40,000
2nd $25,000
3rd $15,000
Overall Prizes

Who is eligible? Top 15 finalists on the Model Arena leaderboard who submit a model report.

Prizes will be awarded to the top three submissions in this track, based on a combination of Model Arena leaderboard score and model report.

Number Awarded Amount
Up to 5 $10,000
Special Recognition Prizes

Who is eligible? Top 15 finalists on the Model Arena leaderboard who (1) submit a model report and (2) do not receive an Overall Prize.

Up to five Special Recognition prizes of $10,000 each will be awarded in total across both tracks to recognize excellence in addressing core challenge goals. Possible categories include: (1) most innovative methodology, (2) best early prediction, (3) best consideration of bias, (4) potential to generalize to populations disproportionately impacted by AD/ADRD, (5) for the social determinants track only, best approach to predicting decline between 2016 and 2021.

Number Awarded Amount
Up to 4 $10,000
Explainability Bonus Prizes

Who is eligible? Top 15 finalists on the Model Arena leaderboard who submit an explainability report. Submitting a model report is not required.

Model Arena finalists have the option of completing a bonus task to create outputs that can be used by patients or care providers to interpret and understand a prediction for a given individual. Up to 4 Explainability Bonus Prizes of $10,000 each will be awarded in total across both tracks for reports that explain local model predictions.

Number Awarded Amount
Up to 4 $2,500
Community Code Bonus Prizes

Who is eligible? Anyone who submits a community code post in the Model Arena, regardless of whether they made a formal submission.

Up to four prizes of $2,500 each will be awarded to the most helpful contributions to the community code board. In particular, we are looking for community code contributions related to: (1) Getting started and EDA; (2) Bias measurement and mitigation; (3) Feature selection and importance; (4) Model interpretability and explainability. Judges will make final selections that consider post content, clarity and documentation, use of code by others, and the number of upvotes and downloads.


Overall Prize winners will be invited to compete for an additional $200,000 in prizes in the PREPARE Challenge - Phase 3: Proof of Principle Demonstration, where solvers will refine their solutions. Invitations may also be extended to Special Recognition prize winners depending on participation.


How to compete

  1. The Report Arena is only open to the top 15 teams on the final, private leaderboard in the Acoustic Track Model Arena or the Social Determinants Track Model Arena. Eligible teams are automatically added to the list of approved participants. If you need to make changes to your team, please contact info@drivendata.org.
  2. Decide whether to submit a model report for an Overall or Special Recognition Prize, an Explainability submission for an Explainability Bonus Prize, or both.
  3. To make a model report submission, follow the instructions on the problem description page. If you had a top 15 leaderboard score in both model tracks (Social Determinants + Acoustic), you may submit two reports (one for each track). Use the "SDoH report submission" or "Acoustic report submission" in the sidebar to submit.
  4. To make an explainability bonus track submission, follow the instructions on the Explainability bonus track page. If you had a top 15 leaderboard score in both tracks (Social Determinants + Acoustic), you may submit two submissions (one for each track). Use the "SDoH bonus submission" or "Acoustic bonus submission" in the sidebar to submit.

Competition rules

The challenge rules are in place to promote fair competition and useful solutions. If you are ever unsure whether your solution meets the competition rules, ask the challenge organizers in the competition forum or send an email to info@drivendata.org. A few key rules are highlighted below. For more details, see the "Official rules" page.

Model Updates

In the Report Arena, participants are not allowed to change the model that was submitted to a model arena. If you believe a small correction is necessary — for example, to fix a bug revealed by the test set labels — please send an email to info@drivendata.org to confirm the change.

Data sharing and retention

Participants are not permitted to share competition data with any other person. Competition data must be deleted after the competition concludes.

Eligibility and Participation Guidelines

To be eligible to win a prize under this challenge, participants:

  • must be 18 years of age or older at the time of submission
  • must be citizens or permanent residents of the United States (in the case of a Team, the Team must identify a Team Captain who is a citizen or permanent resident of the United States; in the case of an Entity, the Entity shall be incorporated in and maintain a primary place of business in the US)
  • must not be a federal entity or federal employee acting within the scope of their employment
  • must not be an employee of the Department of Health and Human Services (HHS, or any other component of HHS) acting in their personal capacity
  • if employed by a federal agency or entity other than HHS (or any component of HHS), should consult with an agency ethics official to determine prize eligibility

Participants who receive federal funds from a grant award or cooperative agreement must either not use their funds to develop their Challenge submissions or to fund efforts in support of their Challenge submissions, or (if use of such funds is consistent with the purpose, terms, and conditions of the grant award or cooperative agreement), must participate in the Challenge as an Entity on behalf of the awardee institution, organization, or entity.

For a full list of eligibility and participation rules, please refer to the rules page.


Challenge sponsor

This challenge is sponsored by the National Institute on Aging (NIA), an institute of the National Institute of Health (NIH)

US NIA Logo


with support from NASA

NASA Logo