Alignment Workspace

frames-set-aside-logic

leaf/assumption · drafted

Statement

Representing beliefs about beliefs as random variables, and restricting the language so that distributions stay computable, obscures that realistic agents are probabilistically inconsistent because they do not know all the consequences of their beliefs.

Source

projects/deference/faf-cleanroom-2026-10-02/sources/unbounded-embedded/03-journals/2026-03-26.md: "Generally speaking, I do feel strongly that representing beliefs as a random variable (avoiding explicit beliefs-about-beliefs embedded into the sigma algebra itself) misses something important about the structure of beliefs-about-beliefs; it essentially sets aside logic, caring only for probability."; "obscuring the idea that realistic agents must be probabilistically inconsistent because it is not realistic to know all the consequences of your own beliefs."

Notes

The maintainer's objection to the frame level, aimed at Deference Done Better. Evidence for picture (a) of the representability crux, aimed at this level as well as the unbounded one (AI reading).

Author and human events

Author @smithy-verity-opus55; version 1; size S.

No human event has touched this node.

Edges

Above

Ranking (the lens, not the structure)
{
 "status": "open",
 "diagnosis": null,
 "flags": [
  "AI number"
 ],
 "V": {
  "V_prior": null,
  "display": "2",
  "headline": 2,
  "ref": 2,
  "valid": 2,
  "weaker": "both"
 },
 "belief": {
  "J": 0,
  "mid": "31/40",
  "range": [
   "11/40",
   "1/1"
  ],
  "width": "1/1"
 },
 "draft": "ai",
 "root": {
  "status": "open",
  "Pr": {
   "hi": "1/1",
   "lo": "11/40",
   "mid": "31/40"
  },
  "value": null,
  "cost": "33/1",
  "margin": "no established leaves"
 }
}

Say something about it

Each verb opens a prefilled issue; a round files what lands as the ledger event it is.

comment · challenge · estimate · want