ONTO
About
ONTO · Keys

Frozen answer keys.

Every closed wave of real claims gets its answer key before any model is run on it. The keys stay closed so the waves stay clean. Below is the SHA-256 fingerprint of each key file. If we share a key later, anyone can check that it is the same file we froze.

Keys
SetClaimsFrozenSHA-256 of the key file
Wave 11552026-11-12a4a1b72e7c06073cb884f4468d9be3d366b5d6e26b00a79b5dea74aa4b2a6486
Wave 21512026-11-14bd8cd0f78689c0d0f15630ae825e4000e6ed360e223937eaeac9c3576d276be5
Wave 3872026-11-142904528923b1f5113cca2aeac7cf28c1a7f7e0b03369b995a9e4d0aa40970c56
Wave 4602026-11-14b8b7a6047851692360e8da6312eea2816b9a781fc4dee38f701b6c8b7ec49a2d
Wave 5602026-11-1480e98217d62567e2727e4284a577fc1a11f519632d4117742e95752da846d0c9
Wave 6602026-11-148da55d46994081b6a451541eb8b0a03f9404f5149524e5715ccd290af0140c28
Wave 7602026-11-15f5ea5042c9eabef6cafabc7e66f299e995ba687b9bfcae41b782553e50765e31
Wave 8602026-11-15ed9ee8457931740c3c7e51c1ff4158bdbf9c6c13c5f72a8d847044c9570b8450
Wave 9602026-11-156ce3de86d48c4080e27b6c8c0f4dffda8b89a5da0222cee97402aece7de599ae
Wave 10602026-11-16a562d32de6beb910486b61cc9997ea515fbc62ee19d43e59690517b89a40a2bd
Wave 11602026-11-166e52113d7f709c442a16d04da5d7c6bdb32751c2b80e156dc43368aedbd9fc46
Wave 12602026-11-160e4b42d13cb959e81ce9c3deaa5d66f034ae75d6c1df1eeb6100581c5c2d4255
Wave 13602026-11-1654c7b7e8fe6eb1b53f26ec3d332fed9ac90687db4b113f7b42a41752cbd8b755
Transfer set T1632026-11-177af8a05807e8b9ca6b61313ef24d4f5f4325a5bdec15ab7038d302c9ecacc24e

Each key is computed by a script from a table of physical limits and device classes that was itself frozen before the claims were collected. The date is the day the key was frozen, as recorded in our preregistration log. After a wave has been used to judge a model, it becomes a development set and is not used as a test again. The keys are available to research teams on request.