Coherence training for forecasts · Kelvin, MATS

Joints with market prices

Single questions have a price; copying it is hard to beat. "A and B" has no price. The model must read the prices and reason about how A and B depend on each other.

Setup

Market prices at tp(P), p(Q)Model statesP(Q | P)Joint, by constructionp(P) · P(Q | P)Scored onA and B, A or B
The model sees all of Manifold as of 7 days before close: every market, price, trade and comment. Marginals come from the market, so coherence holds by construction.

Bar to beat

00.10.20.30.40.50.6Form-only prior0.562Base-rate table0.468Prices + independence0.228Model: prices + P(Q | P)nexttest log loss on the A-and-B / A-or-B forms, lower is better
339 test pairs where both markets were open 7 days before close. Dashed line: prices with A and B assumed independent.

Steps