221d6dbeba
Updated _encode_prompt_with_clip and encode_prompt in train_dreamboth_sd3 ( #9800 )
...
* updated encode prompt and clip encod prompt
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:17 +05:30
2094e7a2b5
[training] use the lr when using 8bit adam. ( #9796 )
...
* use the lr when using 8bit adam.
* remove lr as we pack it in params_to_optimize.
---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2024-12-23 13:02:17 +05:30
003676e961
[SD3-5 dreambooth lora] update model cards ( #9749 )
...
* improve readme
* style
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:17 +05:30
23cf712349
post-release 0.31.0 ( #9742 )
...
* post-release
* style
2024-12-23 13:02:17 +05:30
85dde53e30
[SD3 dreambooth-lora training] small updates + bug fixes ( #9682 )
...
* add latent caching + smol updates
* update license
* replace with free_memory
* add --upcast_before_saving to allow saving transformer weights in lower precision
* fix models to accumulate
* fix mixed precision issue as proposed in https://github.com/huggingface/diffusers/pull/9565
* smol update to readme
* style
* fix caching latents
* style
* add tests for latent caching
* style
* fix latent caching
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:17 +05:30
64dd1c2f2a
Fix the issue on sd3 dreambooth w./w.t. lora training ( #9419 )
...
* Fix dtype error
* [bugfix] Fixed the issue on sd3 dreambooth training
* [bugfix] Fixed the issue on sd3 dreambooth training
---------
Co-authored-by: 蒋硕 <jiangshuo9@h-partners.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:16 +05:30
275e523ef5
post release 0.30.0 ( #9173 )
...
* post release
* fix quality
2024-12-23 13:02:15 +05:30
1b5d74a9e3
[Training] SD3 training fixes ( #8917 )
...
* SD3 training fixes
Co-authored-by: bghira <59658056+bghira@users.noreply.github.com >
* rewrite noise addition part to respect the eqn.
* styler
* Update examples/dreambooth/README_sd3.md
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
---------
Co-authored-by: bghira <59658056+bghira@users.noreply.github.com >
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
2024-12-23 13:02:14 +05:30
67b04c891d
Improve model card for push_to_hub trainers ( #8697 )
...
* Improve trainer model cards
* Update train_dreambooth_sd3.py
* Update train_dreambooth_lora_sd3.py
* add link to adapters loading doc
* Update train_dreambooth_lora_sd3.py
---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2024-12-23 13:02:14 +05:30
c20d0ec72d
Errata - Fix typos & improve contributing page ( #8572 )
...
* Fix typos & improve contributing page
* `make style && make quality`
* fix typos
* Fix typo
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
492900099c
Update train_dreambooth_lora_sd3.py ( #8600 )
...
* Update train_dreambooth_lora_sd3.py
* Update train_dreambooth_lora_sd3.py
* Update train_dreambooth_sd3.py
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
af2763cf1a
Change the default weighting_scheme in the SD3 scripts ( #8639 )
...
* change to logit_normal as the weighting scheme
* sensible default mote
2024-12-23 13:02:13 +05:30
2fad608d8e
[SD3 training] refactor the density and weighting utilities. ( #8591 )
...
refactor the density and weighting utilities.
2024-12-23 13:02:13 +05:30
acfcfd3003
SD3: update default training timestep / loss weighting distribution to logit_normal ( #8592 )
...
Co-authored-by: bghira <bghira@users.github.com >
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
2024-12-23 13:02:13 +05:30
25b4975285
[SD3 Training] T5 token limit ( #8564 )
...
* initial commit
* default back to 77
* better text
* text correction
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
7cb40ee5ab
Fix the deletion of SD3 text encoders for Dreambooth/LoRA training if the text encoders are not being trained ( #8536 )
...
* Update train_dreambooth_sd3.py to fix TE garbage collection
* Update train_dreambooth_lora_sd3.py to fix TE garbage collection
---------
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
2891f6f116
Implement SD3 loss weighting ( #8528 )
...
* Add lognorm and cosmap weighting
* Implement mode sampling
* Update examples/dreambooth/train_dreambooth_lora_sd3.py
* Update examples/dreambooth/train_dreambooth_lora_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_lora_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_lora_sd3.py
* keep timestamp sampling fully on cpu
---------
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
bcf0f7667f
post release 0.29.0 ( #8492 )
...
post release
2024-12-23 13:02:13 +05:30
d0b14d0f08
Add Stable Diffusion 3 ( #8483 )
...
* up
* add sd3
* update
* update
* add tests
* fix copies
* fix docs
* update
* add dreambooth lora
* add LoRA
* update
* update
* update
* update
* import fix
* update
* Update src/diffusers/pipelines/stable_diffusion_3/pipeline_stable_diffusion_3.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* import fix 2
* update
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* update
* update
* update
* fix ckpt id
* fix more ids
* update
* missing doc
* Update src/diffusers/schedulers/scheduling_flow_match_euler_discrete.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/schedulers/scheduling_flow_match_euler_discrete.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update docs/source/en/api/pipelines/stable_diffusion/stable_diffusion_3.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/pipelines/stable_diffusion/stable_diffusion_3.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* update'
* fix
* update
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
* note on gated access.
* requirements
* licensing
---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-12-23 13:02:12 +05:30
SahilCarterr