Offset Noise
Train models able to create very dark or very bright images
Last updated
Train models able to create very dark or very bright images
Last updated
Using Offset Noise during training improves the contrast in images created by the model. The improvement is especially visible in images with very dark or very bright lighting conditions.
Output of models trained without Offset Noise (left) vs with Offset Noise (right):
Without Offset Noise, Stable Diffusion models struggle to create images that are very dark of very bright. The results always include bright areas even if the prompt describes dimly lit scenes. This is due to limitations in the training procedure that is normally used, which Offset Noise fixes.
The images showcased above come from models that were trained from the same base model (stable-diffusion-v1-5), using the same training parameters and images (1200 steps, LR 1e-6, 16 images) except for the Offset Noise scale. The images were generated using the exact same parameters including seed:
A word of caution: while Offset Noise allows the trained model to produce better images in dark and bright conditions, it will also have a noticeable impact on model outputs in other situations. You may need to adjust your prompts to address this. This is why we don't enable it by default.
Head to the Training page: https://dreamlook.ai/dreambooth
The parameter can be enabled by checking the "Offset Noise" checkbox under "Advanced settings"
🔗 How to train models using the website
When using the API, Offset Noise can be enabled using the boolean parameter enable_offset_noise. This value is false by default, meaning that Offset Noise is not used if you don't specify it explicitly.
🔗 How to train models using the API
The idea of Offset Noise was first introduced in a post by Nicholas Guttenberg from Cross Labs: https://www.crosslabs.org/blog/diffusion-with-offset-noise
The YouTube channel koiboi features a good explainer video:
