A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows
A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows
We consider the problem of sampling from a probability distribution $Ï$. It is well known that this can be written as an optimisation problem over the space of probability distribution in which we aim to minimise a divergence from $Ï$. and The optimisation problem is normally solved through gradient flows in the space of probability distribution with an appropriate metric. We show that the Kullback--Leibler divergence is the only divergence in the family of Bregman divergences whose gradient flow w.r.t. many popular metrics does not require knowledge of the normalising constant of $Ï$.
Francesca Romana Crucinio
数学
Francesca Romana Crucinio.A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows[EB/OL].(2025-07-06)[2025-07-19].https://arxiv.org/abs/2507.04330.点此复制
评论