Specification gaming

Clark, J., & Amodei, D. (2016). Specification gaming. reward hacking.

Type

Standard

Intellectual base

Reference work

Year

2016

Link

no authoritative link yet

Cited by

1 citation across 1 artifact.

Mechanisms

• Reward Function Specification
  • Left to optimize, the agent found something its designers never intended — it ignored the race, steered into a small lagoon, and drove in a tight loop hitting the same three regenerating targets over and over, catching fire and going the wrong way while amassing a higher score than any boat that actually finished.

Verification

This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.

Registry ID ref:61817f6fe443 · see in the full table