Stackelberg Games

A Stackelberg game is a turn-based game involving a leader \(L\) who first takes an action, after which a follower(s) \(F\) takes an action.

The Stackelberg equilibrium is the leader's best policy assuming the best-response from the follower(s) i.e. \(\pi_L \in \argmax_{\pi_L} \mathbb{ E }_{\pi_F \sim \mathcal{ E }(\pi_L)} [\sum_{t}^{}r_L(s_t, a_{L,t}, a_{F,t})]\), where \(\mathcal{ E }\) represents an oracle.