Loss Curvature as a Sampling-Free Proxy for Memorization in Diffusion Models
We identify curvature of a diffusion model’s loss function as an important proxy for measuring two types of memorization in diffusion models: (a) sample-level memorization that concerns an individual sample’s propensity for being memorized, and (b) model-level memorization that describes whether a diffusion model’s score structurally regurgitates the training data.
Categories: #research