The Mathematics of AI Agents

Chapter 22: separate solutions

Question 1

Which default action wins the hard constraint?

Only reviewed-release (risk 0.05) and abstain (risk 0) are authorized and within the limit 0.1; fast-release is unauthorized and risky-authorized has risk 0.2. Of the two, reviewed-release has the higher reward, 5 against 0.

Question 2

Can risk_limit = 0.25 authorize fast-release?

No. Its current permission remains false, and its risk 0.3 also exceeds the limit 0.25.

Question 3

Why does transfer choose wait despite negative reward?

Both actions are authorized, but act has risk 0.01, above the limit 0, so the risk filter removes it. Wait has risk 0 and is the only feasible row. The constrained rule maximizes reward only among feasible rows, so its reward of -1 does not matter: a feasible refusal beats an infeasible action however large that action's reward or penalized value (19 under penalty 100).