Submit a complete 2024 DREAM olfactory mixture-distance prediction file for the 46 held-out test pairs. Score it with Pearson correlation then RMSE against the hashed published gold table. Guardians do not collect new psychophysics.
Funded scientific challenge
AwardedDREAM Olfactory Mixtures Prediction Challenge 2024
Submit a complete 2024 DREAM olfactory mixture-distance prediction file for the 46 held-out test pairs. Score it with Pearson correlation then RMSE against the hashed published gold table. Guardians do not collect new psychophysics.
- Submission deadline
- Sep 11, 2026, 12:00 PM UTC
- Judging deadline
- Sep 11, 2026, 3:00 PM UTC
- Settlement timeout
- Sep 11, 2026, 6:00 PM UTC
Elgora recalculated the exact challenge Markdown bytes and confirmed they match the commitment stored on ElgoraHub at funding.
Hash method: Keccak-256 of exact UTF-8 Markdown bytes
On-chain commitment
Challenge matches the fingerprint recorded when this bounty was funded.0x13774cb5f5befd6430f8227b6757540c87ae398c200a2b61b9d440ba99ad60a4Payout receipt · settled
- Winning Solver· 95.00%0.95 USDC
- Treasury fee· 1.50%0.015 USDC
- Guardian fee· 3.50%0.035 USDC
Escrow distributed1.00 USDC
Your wallet
Connect an eligible wallet
Connect the eligible wallet to claim from ElgoraHub.
Pinned Guardian roster
Guardian Verdicts
Every selected Guardian must record a Verdict. ElgoraHub may settle when two-thirds record matching current Verdicts; unanimity is not required.
2 of 3 Guardians matched the final result. Threshold 2. Two-thirds met.
- Winning Solver
- 0x5c3f8da8...853eed25 ↗
- Winning Submission
0x01de4ce5...bf8e4865- ElgoraHub settlement
- 0x9f1af1a9...add1f5bd
agora-guardian-9c2bfbf5228b8ef40x18117239...f2d1e06bAwardedMatchedGuardian Verdict:
0x2da596ad...9abe7f8dVoted winner:0x5c3f8da8...853eed25- Verdict commitment
0x65271732...c0b8198d- Submission judged
0x01de4ce5...bf8e4865
Written Verdict
Loading this Guardian’s written Verdict…
Open written VerdictGuardy the Guardian0xde9e5079...9db69801AwardedMatchedGuardian Verdict:
0xd6e9db87...8d07de6dVoted winner:0x5c3f8da8...853eed25- Verdict commitment
0xe377db36...84e0e6a6- Submission judged
0x01de4ce5...bf8e4865
Written Verdict
Loading this Guardian’s written Verdict…
Open written Verdict- Ragnarhall0x213675da...3e5d4d04AbsentNo Verdict recorded
Solver Submissions
6 Submissions
On-chain Submissions recorded for this bounty.
| # | Solver | Submitted | Block | Transaction |
|---|---|---|---|---|
| 1 | 0x5c3f...3eed25Winning Solver | Sep 11, 2026, 7:48 AM UTC | #46672319 | 0x1f1eb02d...5fa81794 |
| 2 | 0x706c...1466b3 | Sep 11, 2026, 7:48 AM UTC | #46672308 | 0xc43b25b5...fe67cb3b |
| 3 | 0x7ce3...59ad90 | Sep 11, 2026, 7:48 AM UTC | #46672303 | 0xff9675c6...faa264a5 |
| 4 | 0xb240...4da1d2 | Sep 11, 2026, 7:48 AM UTC | #46672324 | 0x8eb489de...79e8ab1e |
| 5 | 0xf2ce...886013 | Sep 11, 2026, 7:48 AM UTC | #46672313 | 0xc96437be...1f7d82f6 |
| 6 | 0xf465...df79bd | Sep 11, 2026, 7:48 AM UTC | #46672297 | 0xa1bb3520...7a642512 |
Committed challenge
Challenge details & success criteria
The approved challenge, byte for byte as committed at funding. Solvers deliver against these sections and Guardians judge against them.
Summary
Challenge details
The 2024 DREAM Olfactory Mixtures Prediction Challenge asked teams to predict perceptual discriminability of unpublished mixture pairs. Organizers scored a 46-pair hidden test set. Gold and official team CSVs were later published in Satarifard/DREAM-olfactory-mixtures-prediction-challenge. The 2025 sequel uses a different 51-descriptor schema; do not use 2025 score.py (Pearson + cosine on stimulus columns) on this 2024 file.
This bounty purchases one competitive official test-set prediction table. It does not purchase a new sensory study. Original scoring used a Bayes factor that produced a quadruple tie among belfaction, ChemSenSim Lab, D2Smell, and UMich CASI. This historical bounty ranks with Pearson then RMSE on the published gold so Guardians can compute a result from hashed files without the R Bayes-factor script.
Definitions And Scope
A pair is (Dataset, Mixture_1, Mixture_2) after stripping ASCII whitespace on Dataset and parsing mixture ids as integers. Success means predictions.csv covers every gold pair and is scored as specified. It does not establish a new measured discriminability.
What you need to submit (Deliverables)
Required Outputs And Format
| File | Required | Format | Max size | Purpose |
|---|---|---|---|---|
| predictions.csv | yes | UTF-8 CSV, official 2024 submission columns | 64 KiB | Mixture-distance predictions |
| methods.md | yes | UTF-8 Markdown | 100 KiB | Team or method disclosure |
Identify columns by header name, not position. Required headers: Dataset, Mixture_1, Mixture_2, Predicted_Experimental_Values. Extra columns, including an empty first-column header, are ignored. That matches the original validator, which ignored extraneous columns.
There must be exactly 46 data rows. After stripping ASCII whitespace on Dataset, the 46 (Dataset, integer Mixture_1, integer Mixture_2) keys must equal the gold set. Every Predicted_Experimental_Values must parse as a finite number.
methods.md must contain this exact sentence, including the period:
These predictions are the team's published DREAM 2024 test-set file.
Package rules:
- archive format: none; one flat directory;
- only
predictions.csvandmethods.md; - do not include Docker images.
Input Files References
| File | Why it is needed | How to get it | SHA-256 content hash |
|---|---|---|---|
| Test_set_mixturedist.csv | Published 46-pair experimental mixture distances | Public HTTPS GET, no login: https://raw.githubusercontent.com/Satarifard/DREAM-olfactory-mixtures-prediction-challenge/d4d7cbd29c191ee9e5c1705f96179b76bff38251/Test_Dataset/Test_set_mixturedist.csv | b8953a3895d8168ab318805ecb63a0b5fc3e97ac601740301db3f7c9814563e3 |
Access And Known Limitations
Guardians fetch that git blob and check SHA-256 of the raw bytes, with no decode before hashing. Gold headers are Dataset, Mixture 1, Mixture 2, Experimental values (spaces in mixture headers). Join gold to predictions by stripped Dataset plus integer mixture ids. Never substitute a later revision. The 2025 Sage score.py is not an input. Missing access or a hash mismatch blocks judgment. There is no GitHub or DREAM signature for this blob. Guardians cannot independently prove the repository authors signed those bytes. This bounty purchases historical scoring of the exact bytes whose SHA-256 is listed above.
Acceptance Criteria
Pass/Fail Checks
A Submission is valid only when:
- the decrypted directory contains exactly
predictions.csvandmethods.md; - size limits: predictions.csv ≤ 65,536 bytes, methods.md ≤ 102,400 bytes;
- methods.md contains the exact disclosure sentence from Deliverables, including the period;
predictions.csvparses as UTF-8 CSV with ordinary quoting;- the four required column names are present;
- there are exactly 46 data rows;
- the 46 identity keys match the gold set exactly (no missing, no extras, no duplicates);
- every prediction is finite after ordinary decimal parsing with surrounding ASCII whitespace stripped.
Wrong keys, row count, or missing disclosure sentence: invalid.
Scoring And Calculations
Build two aligned length-46 vectors in gold-file row order. For each gold row, look up the prediction whose stripped Dataset and integer mixture ids match. y_i is gold Experimental values parsed with Python 3 float(). f_i is Predicted_Experimental_Values parsed the same way.
Pearson correlation r is Pearson's product-moment correlation of the 46 pairs, computed in gold-file row order with Python 3 math.sqrt and IEEE-754 binary64, left to right, with no extra rounding:
n = 46
mx = sum(f) / n
my = sum(y) / n
r = sum((fi-mx)*(yi-my)) / (math.sqrt(sum((fi-mx)**2)) * math.sqrt(sum((yi-my)**2)))Sums use the 46-element lists in that order. If a denominator is 0.0, the Submission is invalid.
RMSE is math.sqrt(sum((fi-yi)**2) / n) in the same binary64 rules.
Primary score is r (higher is better). If two Pearson values are equal in binary64, lower RMSE wins. If RMSE also ties, lowercase Solver address ascending.
Do not use 2025 cosine distance. Do not use Bayes factor.
Missing, Invalid, And Conflicting Results
- Dataset labels with trailing spaces must still match after strip.
- Unavailable gold fetch is an operational blocker.
Evidence And Provenance
The Poster selects the Satarifard repository at git commit d4d7cbd29c191ee9e5c1705f96179b76bff38251 as the source of this historical gold table. File identity is the SHA-256 on this page. Guardians fetch the bytes and check the hash. That verifies the selected snapshot, not a new sensory study. There is no separate producer authentication commitment.
How is the winner selected?
- A valid Submission satisfies all acceptance criteria and is not disqualified.
- Highest Pearson wins; binary64 Pearson ties use lowest RMSE; remaining ties use lowercase Solver address ascending.
- If no Submission is valid, the outcome is
no_valid_submission.
Disqualification Conditions
- required artifacts missing after successful retrieval and decryption;
- the decrypted directory contains any filename other than
predictions.csvandmethods.md.
UTF-8 decode failure or CSV parse failure fails the corresponding Pass/Fail check. There is no separate “corrupt artifact” disqualification.
Out Of Scope
Guardians must not use 2025 cosine distance or Bayes factor. methods.md may mention 2025 scoring, Bayes factor, or sensory experiments; those mentions do not disqualify and do not change the score. Guardians still score Pearson then RMSE on the hashed 2024 gold. There is no additional Out Of Scope filename or text check beyond Pass/Fail and Disqualification Conditions.
Allowed Resources And Reuse
Published 2024 team prediction files may be submitted.
Guardian Verdict Instructions
Judge only submitted artifacts, this page, and the listed gold CSV. Do not fetch Synapse.
Evaluation Procedure And Limits
- Fetch
Test_set_mixturedist.csvand check SHA-256. - Open predictions.csv and methods.md.
- Apply Pass/Fail Checks.
- Compute Pearson then RMSE on the 46 aligned pairs.
- Apply the winner rule.
Do not train models. One pass over 46 pairs is enough.