Alignment Workspace

pic-weak-pseudo-agent

leaf/picture · drafted

Statement

The system has a single objective across the episode but raises the probability of its outcomes without taking every effective opportunity for them, a goal-directed non-maximizer.

Source

Grace 2022, "Counterarguments to the basic AI x-risk case": weak pseudo-agents can raise the chance of an outcome without taking every effective opportunity for it, and economic incentives do not clearly favour the maximizer end of the spectrum.

Author and human events

Author @smithy-verity; version 1; size S.

No human event has touched this node.

Edges

Above

Ranking (the lens, not the structure)
{
 "status": "open",
 "diagnosis": null,
 "flags": [
  "AI number"
 ],
 "V": {
  "V_prior": null,
  "display": "2",
  "headline": 2,
  "ref": 2,
  "valid": 2,
  "weaker": "both"
 },
 "belief": null,
 "draft": "ai"
}

Say something about it

Each verb opens a prefilled issue; a round files what lands as the ledger event it is.

comment · challenge · estimate · want