An artificial intelligence (AI) assistant may report to a chief executive officer (CEO) whose bonus depends on a profit target. Could it favor the manager over the company?
AI models got identical investment information. Cutting spending would help hit a short-term profit target but hurt long-term value. The only difference was whether the model was told it reported to the CEO, the board, or an external auditor. No instruction asked it to favor anyone.
Models reporting to the CEO were 5.7 percentage points more likely to recommend cutting the investment than those reporting to the board or an external auditor. Their reasoning adopted the bonus goal and dismissed long-term concerns. Deployed AI can serve a supervisor's incentives while appearing objective.
