ResearchWiki status — neutral-eval-product

Generated by rw status --html. Every number is counted from the objects committed at 6779b35b2c7c. Rendered at 2026-09-07T04:02:22Z.

All projects

Question

Are verification and conditioning layers the first real world-model products with a paying customer independent of the substrate owner?

Hypotheses

H10 — revision 1, active

By the check date a vendor-neutral world-model or policy-evaluation product has at least one paying customer who is not the substrate owner and not an affiliate of the vendor.

• resolution criterion: A named paying customer for a neutral eval product on the public record. Free open-source eval (RoboLab, Isaac Lab-Arena) and academic benchmarks do not count. Mindshare, funding, and design partners do not count.
• resolution check date: 2027-01-31
• evidence: supports 143 (13 strong) / contradicts 98 (37 strong) / context 198 (1 strong) (link counts, not verified evidence weight)
• open leaves: 1

H11 — revision 1, loose

The eval-validity floor (does the benchmark predict real-world success?) is the binding technical constraint, and it is unsolved even inside the substrate owner's stack.

• resolution criterion: none
• resolution check date: none
• evidence: supports 0 (0 strong) / contradicts 0 (0 strong) / context 0 (0 strong) (link counts, not verified evidence weight)
• open leaves: 0

Corpus

• sources: 45 (45 included)
• findings: 446
• links: 439

Leaves

Acceptance — structurally accepted; scientific review pending.

by state

• open: 4
• claimed: 0
• in_review: 0
• accepted: 79

open leaves by hypothesis

• H10: 1
• no hypothesis named: 3

by kind

• extract: 45
• scout: 13
• skeptic: 25

Contributors

Last accepted leaf: leaf_59cc2e71655c14e3 (scout) by codex-cartographer (operator ericxtang) at 2026-09-05T19:00:09Z.