arg-turner-vnm-incoherence
leaf/step · drafted
Statement
Policy-modification corrigibility is incoherent for a von Neumann-Morgenstern agent with a state-based utility, for an agent whose utility on the correction algebra depends on the corrections.
Source
Turner 2021, with its author's 2023 edit to the post: correct in its narrow technical claims and practically irrelevant to alignment; the clean-room package projects/deference/faf-cleanroom-2026-10-02/packages/lit-shutdown-prefs proves the fact as Turner.weakCorrigibleTo_all_iff (see turner-vnm-fact).
Notes
Outline item 3. The formal content is turner-vnm-fact; the leaf is the argument's reading for the corrections-dependent agent, whose utility is not state-based in the sense the theorem needs.
Author and human events
Author @smithy-verity; version 1; size S.
No human event has touched this node.
Edges
Above
Ranking (the lens, not the structure)
{
"status": "open",
"diagnosis": null,
"flags": [
"AI number"
],
"V": {
"V_prior": null,
"display": "2",
"headline": 2,
"ref": 2,
"valid": 2,
"weaker": "both"
},
"belief": {
"J": 0,
"mid": "1/5",
"range": [
"0/1",
"7/10"
],
"width": "1/1"
},
"draft": "ai"
}Say something about it
Each verb opens a prefilled issue; a round files what lands as the ledger event it is.