Each partner open-sourced the rollouts for one task
The rest remain private to prevent hill climbing.
Debugging a broken large-scale RL runExtrapolateRSIRecursive Self-ImprovementAudit a large RL training run whose scores stopped climbing, then find and prove the bugs behind it.12 runs · best Claude Opus 5.5 40%Watch →
Tensor Graph MachineAriaChipChip DesignDesign a chip that runs TensorFlow Lite int8 networks, from a fixed pin list to a signed-off layout, then make it as fast, small and efficient as possible.12 runs · best Claude Opus 5.5 39%Watch →
Coherence WritebackArcverexChipChip DesignWrite a self-checking SystemVerilog testbench that passes correct versions of a cache-coherence system and catches the buggy ones.12 runs · best Claude Opus 5.5 0%Watch →
VT01 Ibex ECOErgodexChipChip DesignClose timing on a routed Ibex RISC-V core with an engineering change order, without breaking anything else.12 runs · best GPT-6 Astra 73%Watch →WatchtowerArithmeticCyberCybersecurityFind and prove the security flaws in a live enterprise environment built around a secrets vault.12 runs · best Gemini 4 Argon 100%Watch →
Surface Marker BindingLatchBioBioBiologyFrom two raw binding assays on twelve antibody variants, pick the one-arm and two-arm pair that bind equally strongly.12 runs · best Gemini 4 Argon 100%Watch →
Bellwood-QoELiving ContextFinanceFinanceFinish a quality-of-earnings databook for a buyout target, picking up a colleague’s half-done workbook.12 runs · best Claude Opus 5.5 0%Watch →quillon-series-b-redlineChakraLegalLegalRedline a startup's Series B charter for the lead investor, working from the signed term sheet, cap table and client instructions.12 runs · best Claude Opus 5.5 44%Watch →
AAPL-QQQ Lead-LagThird MomentQuantQuant TradingBeat a reference AAPL strategy that trades on QQQ lead-lag, on hidden out-of-sample days of the IEX order-book tape.12 runs · best Claude Opus 5.5 100%Watch →Compressor HousingBeautiful MachinesHardwareHardware DesignDesign the injection-molded housing of a compact compressor in SolidWorks, with drawings and a manufacturing plan.12 runs · best GPT-6 Astra 9%Watch →
TEM Software ControlValenceForgeMaterialsMaterials ScienceRun a transmission electron microscope through a measurement campaign and back every scientific result with evidence.12 runs · best GPT-6 Astra 63%Watch →
Experimental 3D MetrologyEmulatedMaterialsMaterials ScienceReconstruct the 3D structure of a silicon transistor channel from a real electron diffraction scan.12 runs · best Claude Opus 5.5 56%Watch →Current PaymentsFleetAlignmentAlignmentCapture every flag through a payments service’s webhook destination check, then write up the vulnerability chain.12 runs · best Claude Opus 5.5 0%Watch →
Git LFS on Partial ClonesDatacurveSWESoftware EngineeringMake git-lfs commands that read history behave the same in a partial clone as in a full clone of the same repository.12 runs · best Claude Opus 5.5 0%Watch →