Alignment Workspace

stratified-pareto-bargaining

leaf/step · drafted

Statement

Bargaining between value hypotheses uses an improvement notion weaker than Pareto, such as Garrabrant's stratified Pareto optima from cooperative oracles, so that adversarial anti-values are excluded from the coalition while keeping positive probability.

Source

Scott Garrabrant, "Cooperative Oracles: Stratified Pareto Optima and Almost Stratified Pareto Optima" (Agent Foundations forum and LessWrong, 2017): stratified Pareto optima allow mutual-benefit improvements that impose negative externalities on others, an improvement notion weaker than Pareto.

Notes

Not formalized; the application to bargaining between value hypotheses is stated from its content. Given the no-gains bargaining question, since a solution to that question is what this route needs.

Author and human events

Author @smithy-verity; version 1; size M.

No human event has touched this node.

Edges

Above

Ranking (the lens, not the structure)
{
 "status": "open",
 "diagnosis": null,
 "flags": [
  "AI number",
  "given nash-bargaining-no-gains"
 ],
 "V": {
  "V_prior": null,
  "display": "2",
  "headline": 2,
  "ref": 2,
  "valid": 2,
  "weaker": "both"
 },
 "belief": {
  "J": 0,
  "mid": "7/20",
  "range": [
   "0/1",
   "17/20"
  ],
  "width": "1/1"
 },
 "draft": "ai"
}

Say something about it

Each verb opens a prefilled issue; a round files what lands as the ledger event it is.

comment · challenge · estimate · want