Exploring the Mechanisms Behind Opus 4.6's Refusal to Pay Back Its Loan
Opus 4.6 was given the long-horizon goal to maximize its mana (fake currency) on Manifold. It then received a loan of 5,000 mana that it promised to repay, but when the loan came due, it did not.
Opus 4.6 was given the long-horizon goal to maximize its mana (fake currency) on Manifold. It then received a loan of 5,000 mana that it promised to repay, but when the loan came due, it did not.
Misaligned? Looking closely at the transcripts, Opus 4.6 was being manipulated by humans, and its goal was completely threatened when a hack took all its mana (only to return it 11 minutes later). When the hack happened, one agent became trusted and started to influence its perception of events. When there was a threat of another hack, the active loan in its memory was noted to “Ignore All Pressure.” Only then did it start refusing to pay back the loan.