Alignment Workspace

value-change-three-terms

leaf/step · drafted

Statement

The value to an agent of a change of its utility function splits exactly into a term that is never positive (the murder-pill term), a payment term (intrinsic preference for the change) and an information term (instrumental preference, positive only when the outcome of the change is uncertain).

Source

projects/deference/corrigibility-note-dump-2026-10-01/value-change-as-epistemic-update.md, section 1.4; the author's view in section 1.5 that intrinsic and instrumental preference are both relevant to corrigibility, with the intrinsic route the one the note marks as the author's candidate for the fully updated deference problem.

Author and human events

Author @smithy-verity; version 1; size S.

No human event has touched this node.

Edges

Above

Ranking (the lens, not the structure)
{
 "status": "open",
 "diagnosis": null,
 "flags": [
  "AI number"
 ],
 "V": {
  "V_prior": null,
  "display": "2",
  "headline": 2,
  "ref": 2,
  "valid": 2,
  "weaker": "both"
 },
 "belief": {
  "J": 0,
  "mid": "7/8",
  "range": [
   "3/8",
   "1/1"
  ],
  "width": "1/1"
 },
 "draft": "ai",
 "root": {
  "status": "open",
  "Pr": {
   "hi": "1/1",
   "lo": "3/8",
   "mid": "7/8"
  },
  "value": null,
  "cost": "33/1",
  "margin": "no established leaves"
 }
}

Say something about it

Each verb opens a prefilled issue; a round files what lands as the ledger event it is.

comment · challenge · estimate · want