Alignment Workspace

instrumental-convergence

or · drafted

Statement

Several instrumental values are convergent: their attainment would increase the chances of the agent's goal being realized for a wide range of final goals and situations, so they are likely to be pursued by many intelligent agents.

Source

Bostrom 2012, The Superintelligent Will, section 2: "The Instrumental Convergence Thesis: Several instrumental values can be identified which are convergent in the sense that their attainment would increase the chances of the agent's goal being realized for a wide range of final goals and a wide range of situations, implying that these instrumental values are likely to be pursued by many intelligent agents."

Notes

Two routes: the informal argument from the basic drives and the endpoint of the power-seeking theorem chain. Either suffices. The 2008 formulation, drives present in systems of any design unless explicitly counteracted, is a stronger proposition and is the source of the informal route, not a second version of this root.

A risk story: it shows a probability and a status and enters the comparison through the plans whose tables cite it.

Author and human events

Author @smithy-verity; version 1; size M.

No human event has touched this node.

Edges

Above

Children

Ranking (the lens, not the structure)
{
 "status": "open",
 "diagnosis": null,
 "flags": [
  "AI number"
 ],
 "V": {
  "V_prior": null,
  "display": "2",
  "headline": 2,
  "ref": 2,
  "valid": 2,
  "weaker": "both"
 },
 "belief": null,
 "draft": "ai",
 "root": {
  "status": "open",
  "Pr": {
   "hi": "2567/3200",
   "lo": "0/1",
   "mid": "9861201251445052901/102400000000000000000"
  },
  "value": null,
  "cost": "335/1",
  "margin": null
 }
}

Say something about it

Each verb opens a prefilled issue; a round files what lands as the ledger event it is.

comment · challenge · estimate · want