I-projection

Definition

The information projection is

$$q^* = \arg\min_{q\in Q}D_{\text{KL}}(q\|p).$$

Why it matters

Most variational inference methods use this direction of KL because it is tractable to optimize. It tends to underestimate support and can miss parts of the true posterior.