solver.press

Published papers, replicated

We take one computational claim from a published paper, write down the decision rule and the controls, freeze that protocol and deposit it on Zenodo, and only then run the authors' released code. The authors see the result first. A paper is listed here after they have had the chance to respond; results still inside that window are not listed.

18 listed: 13 replicated, 3 inconclusive, 2 did not replicate. Each outcome is the verdict under our protocol on the claim named, not a verdict on the paper.

Our own results are re-tested the same way: see the track record. To have a claim of yours tested, see request a test.