Aaron Lou
  • about
  • blog(current)
  • cv
  • publications

  • Reflected Diffusion Models

    Diffusion models are trained to reverse a stochastic process through score matching. However, a lot of diffusion models rely on a small but critical implementation detail called thresholding. Thresholding projects the sampling process to the data support after each discretized diffusion step, stabilizing generation at the cost of breaking the theoretical framework. Interestingly, as one limits the number of steps to infinity, thresholding converges to a reflected stochastic differential equation. In this blog post, we will be discussing our recent work on Reflected Diffusion Models, which explores this connection to develop a new class of diffusion models which correctly trains for thresholded sampling and respects general boundary constraints.

    18 min read   ·   April 13, 2023

    2023

© Copyright 2023 Aaron Lou. Powered by Jekyll with al-folio theme. Last updated: May 08, 2023.