This challenge aims to motivate the cryo-EM community to benchmark, evaluate, and advance single-particle processing workflows on an experimental dataset containing a heterogeneous mixture of macromolecular species.

We seek to assess the accuracy, efficiency, and scalability of heterogeneous reconstruction algorithms and pipelines. Beyond benchmarking, we hope to inspire the development of new methods focused on compositional heterogeneity problems, especially those involving pose estimation of unknown mixtures. The dataset opens the door to visual proteomics-style analyses, pushing toward the integrated processing of multiple real biological samples within a unified, automated computational framework.

Dataset

<aside> <img src="/icons/arrow-down-line_gray.svg" alt="/icons/arrow-down-line_gray.svg" width="40px" />

Particle .mrcs stacks and an associated .star file can be downloaded via Globus here (~540 GB).

</aside>

This dataset contains raw particle picks for a mixture of distinct, unknown species.

Evaluation

Entries will be evaluated by the successful recovery of all the species present in the sample, the quality (resolution) of each consensus reconstruction, the accuracy of particle assignments to each species, and the accuracy of particle poses (i.e., alignments).

Participants will also submit a descriptive summary of their complete processing workflow; entries will be separately evaluated by workflow complexity and efficiency.

Submission

<aside> <img src="/icons/folder_gray.svg" alt="/icons/folder_gray.svg" width="40px" />

Entries can be uploaded and submitted via Google Forms here.

</aside>

Please provide a workflow summary, and for each identified class include:

See the submission form for more details.

Questions

For most general questions, please use the challenge discussions space on GitHub. For urgent or private questions regarding this dataset, please contact Ryan Feathers ([email protected]), Robert Heeter ([email protected]), or Ellen Zhong ([email protected]) at Princeton University.