|国家预印本平台
首页|A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows

A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows

A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows

来源:Arxiv_logoArxiv
英文摘要

We consider the problem of sampling from a probability distribution $π$. It is well known that this can be written as an optimisation problem over the space of probability distribution in which we aim to minimise a divergence from $π$. and The optimisation problem is normally solved through gradient flows in the space of probability distribution with an appropriate metric. We show that the Kullback--Leibler divergence is the only divergence in the family of Bregman divergences whose gradient flow w.r.t. many popular metrics does not require knowledge of the normalising constant of $π$.

Francesca Romana Crucinio

数学

Francesca Romana Crucinio.A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows[EB/OL].(2025-07-06)[2025-07-19].https://arxiv.org/abs/2507.04330.点此复制

评论