# Impact of Noise on Diffusion Models B11902147 曹鈞皓 B11902020 簡彣諺 --- ## Related Work - Blue noise for diffusion models --- ## Contents - What is blue noise? - Why blue noise? - Our plan <!-- - Generating blue noise is time consuming. - Analyze performance of different noises - Our plan --> --- ## What is blue noise? ---- | ![image](https://hackmd.io/_uploads/BJ3wkPL1Jx.png) | ![image](https://hackmd.io/_uploads/SkwYkw8ykg.png) | | ---- | ---- | | White Noise | Blue Noise | - Blue noise has no energy in the low-frequency region and consists only of high-frequency components. --- ## Why blue noise? ---- ![image](https://hackmd.io/_uploads/HkHrQSUyyx.png) - Diffusion models generate data in a **coarse-to-fine** manner and have a hidden relationship with frequency components. ---- ![image](https://hackmd.io/_uploads/SkZY7r8J1e.png) - Use a time-varying blended noise which shifts from Gaussian white noise to blue noise as the time step $t$ decreases. --- <!-- ## Generating blue noise is time consuming. ---- $LL^T=\Sigma$ ![image](https://hackmd.io/_uploads/SydpJBUJkl.png) - To create a noise mask with a specified covariance matrix $\Sigma$, apply Cholesky decomposition to generate blue noise on the fly. ---- - Padding/Tiling --- --> ## Analyze performance of different noises ---- ![image](https://hackmd.io/_uploads/Sk7zcNHy1x.png) - FID : compares the distribution of features between the generated images and real images. - Precision: fall within the distribution of real images - Recall: diversity of the generated images --- ## Our Plan ---- - Try violet noise(density $\propto f^2$) - Try combining red and blue noise, as well as exploring other combinations.
{"description":"Blue noise for diffusion models","contributors":"[{\"id\":\"5eb6f27a-7b33-47da-8ae5-6170f4305c6f\",\"add\":2284,\"del\":775},{\"id\":\"6b420e4e-806e-437d-90bc-262d9bde37bb\",\"add\":332,\"del\":110}]","title":"Impact of Noise on Diffusion Models"}
    174 views