basin-failure-modes
leaf/step · drafted
Statement
Manipulation of the deliberation process, lock-in effects, path dependence and mesa-optimizers that steer deliberation can move a system out of the basin of legitimate deliberation.
Source
The filing session's list of ways out of the basin of basin-of-attraction-legitimacy; mesa-optimizers as in Hubinger et al. 2019, Risks from Learned Optimization; the basin question of projects/deference/note-dump-2026-08-11/notes/li-deference.md, section 0.
Notes
A risk story, the counterpart of basin-of-attraction-legitimacy; the clean room's steering results (the diagonal family, the stop-gradient identity) are the nearest done work. Outcome class unplaced.
Author and human events
Author @smithy-verity; version 1; size S.
No human event has touched this node.
Edges
Above
- part of legit-dynamics-learning
- root (risk-story) of legit-dynamics-learning
Ranking (the lens, not the structure)
{
"status": "open",
"diagnosis": null,
"flags": [
"AI number"
],
"V": {
"V_prior": null,
"display": "2",
"headline": 2,
"ref": 2,
"valid": 2,
"weaker": "both"
},
"belief": {
"J": 0,
"mid": "31/40",
"range": [
"11/40",
"1/1"
],
"width": "1/1"
},
"draft": "ai",
"root": {
"status": "open",
"Pr": {
"hi": "1/1",
"lo": "11/40",
"mid": "31/40"
},
"value": null,
"cost": "33/1",
"margin": "no established leaves"
}
}Say something about it
Each verb opens a prefilled issue; a round files what lands as the ledger event it is.