df4e3f45c1
Fix name when saving text inversion embeddings in dreambooth advanced scripts ( #8927 )
...
update
2024-12-23 13:02:14 +05:30
2d738e2c71
fix: checkpoint save issue in advanced dreambooth lora sdxl script ( #8926 )
...
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2024-12-23 13:02:14 +05:30
1b5d74a9e3
[Training] SD3 training fixes ( #8917 )
...
* SD3 training fixes
Co-authored-by: bghira <59658056+bghira@users.noreply.github.com >
* rewrite noise addition part to respect the eqn.
* styler
* Update examples/dreambooth/README_sd3.md
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
---------
Co-authored-by: bghira <59658056+bghira@users.noreply.github.com >
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
2024-12-23 13:02:14 +05:30
11307ce964
[Core] remove resume_download from Hub related stuff ( #8648 )
...
* remove resume_download
* fix: _fetch_index_file call.
* remove resume_download from docs.
2024-12-23 13:02:14 +05:30
a4a5a43ef9
Fix multi-gpu case for train_cm_ct_unconditional.py ( #8653 )
...
* Fix multi-gpu case
* Prefer previously created `unwrap_model()` function
For `torch.compile()` generalizability
* `chore: update unwrap_model() function to use accelerator.unwrap_model()`
2024-12-23 13:02:14 +05:30
82a13745a0
[Community Pipelines] Accelerate inference of AnimateDiff by IPEX on CPU ( #8643 )
...
* add animatediff_ipex community pipeline
* address the 1st round review comments
2024-12-23 13:02:14 +05:30
8e64c7f9a5
Remove unnecessary lines ( #8569 )
...
* Remove unused line
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:14 +05:30
67b04c891d
Improve model card for push_to_hub trainers ( #8697 )
...
* Improve trainer model cards
* Update train_dreambooth_sd3.py
* Update train_dreambooth_lora_sd3.py
* add link to adapters loading doc
* Update train_dreambooth_lora_sd3.py
---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2024-12-23 13:02:14 +05:30
1f221b0cf9
Fix saving text encoder weights and kohya weights in advanced dreambooth lora script ( #8766 )
...
* update
* update
* update
2024-12-23 13:02:14 +05:30
fe85e9c4f8
Add vae_roundtrip.py example ( #7104 )
...
* Add vae_roundtrip.py example
* Add cuda support to vae_roundtrip
* Move vae_roundtrip.py into research_projects/vae
* Fix channel scaling in vae roundrip and also support taesd.
* Apply ruff --fix for CI gatekeep check
---------
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
2024-12-23 13:02:14 +05:30
de14a194eb
[advanced dreambooth lora] add clip_skip arg ( #8715 )
...
* add clip_skip
* style
* smol fix
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:14 +05:30
63d5de4846
Update README.md to include Colab link ( #8775 )
2024-12-23 13:02:14 +05:30
3ca7f09a09
Allow SD3 DreamBooth LoRA fine-tuning on a free-tier Colab ( #8762 )
...
* add experimental scripts to train SD3 transformer lora on colab
* add readme
* add colab
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* fix link in the notebook.
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-12-23 13:02:14 +05:30
11c5f6bfcd
Revert "[LoRA] introduce LoraBaseMixin to promote reusability." ( #8773 )
...
Revert "[LoRA] introduce `LoraBaseMixin` to promote reusability. (#8670 )"
This reverts commit a2071a1837
2024-12-23 13:02:14 +05:30
2686552727
[LoRA] introduce LoraBaseMixin to promote reusability. ( #8670 )
...
* introduce to promote reusability.
* up
* add more tests
* up
* remove comments.
* fix fuse_nan test
* clarify the scope of fuse_lora and unfuse_lora
* remove space
2024-12-23 13:02:13 +05:30
c586a8faff
Fix indent in dreambooth lora advanced SD 15 script ( #8753 )
...
update
2024-12-23 13:02:13 +05:30
f5f9f9c083
[Tests] add test suite for SD3 DreamBooth ( #8650 )
...
* add a test suite for SD3 DreamBooth
* lora suite
* style
* add checkpointing tests for LoRA
* add test to cover train_text_encoder.
2024-12-23 13:02:13 +05:30
4d12d764f0
[SD3 LoRA Training] Fix errors when not training text encoders ( #8743 )
...
* fix
* fix things.
Co-authored-by: Linoy Tsaban <linoy.tsaban@gmail.com >
* remove patch
* apply suggestions
---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
Co-authored-by: Linoy Tsaban <linoy.tsaban@gmail.com >
2024-12-23 13:02:13 +05:30
7b3b87f45f
fix the LR schedulers for dreambooth_lora ( #8510 )
...
* update training
* update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2024-12-23 13:02:13 +05:30
19a53baeba
[train_controlnet_sdxl.py] Fix the LR schedulers when num_train_epochs is passed in a distributed training env ( #8476 )
...
* Create diffusers.yml
* num_train_epochs
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
29884169ad
[Community pipeline] SD3 Differential Diffusion Img2Img Pipeline ( #8679 )
...
* new pipeline
2024-12-23 13:02:13 +05:30
94b734163a
[Advanced dreambooth lora] adjustments to align with canonical script ( #8406 )
...
* minor changes
* minor changes
* minor changes
* minor changes
* minor changes
* minor changes
* minor changes
* fix
* fix
* aligning with blora script
* aligning with blora script
* aligning with blora script
* aligning with blora script
* aligning with blora script
* remove prints
* style
* default val
* license
* move save_model_card to outside push_to_hub
* Update train_dreambooth_lora_sdxl_advanced.py
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
f8c8daa0ae
[Sd3 Dreambooth LoRA] Add text encoder training for the clip encoders ( #8630 )
...
* add clip text-encoder training
* no dora
* text encoder traing fixes
* text encoder traing fixes
* text encoder training fixes
* text encoder training fixes
* text encoder training fixes
* text encoder training fixes
* add text_encoder layers to save_lora
* style
* fix imports
* style
* fix text encoder
* review changes
* review changes
* review changes
* minor change
* add lora tag
* style
* add readme notes
* add tests for clip encoders
* style
* typo
* fixes
* style
* Update tests/lora/test_lora_layers_sd3.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/dreambooth/README_sd3.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* minor readme change
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
6f922c2a91
Fix redundant pipe init in sd3 lora ( #8680 )
...
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
58496f6ab4
Errata - Update class method convention to use cls ( #8574 )
...
* Class methods are supposed to use `cls` conventionally
* `make style && make quality`
* An Empty commit
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
f6172748c6
Errata - Fix typos and improve style ( #8571 )
...
* Fix typos
* Fix typos & up style
* chore: Update numbers
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
1ced1c40d8
Discourage using deprecated revision parameter ( #8573 )
...
* Discourage using `revision`
* `make style && make quality`
* Refactor code to use 'variant' instead of 'revision'
* `revision="bf16"` -> `variant="bf16"`
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
2c56360222
Errata - Trim trailing white space in the whole repo ( #8575 )
...
* Trim all the trailing white space in the whole repo
* Remove unnecessary empty places
* make style && make quality
* Trim trailing white space
* trim
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
c20d0ec72d
Errata - Fix typos & improve contributing page ( #8572 )
...
* Fix typos & improve contributing page
* `make style && make quality`
* fix typos
* Fix typo
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
74acd0fb64
[train_lcm_distill_lora_sdxl.py] Fix the LR schedulers when num_train_epochs is passed in a distributed training env ( #8446 )
...
fix num_train_epochs
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
33646098f5
Add extra performance features for EMAModel, torch._foreach operations and better support for non-blocking CPU offloading ( #7685 )
...
* Add support for _foreach operations and non-blocking to EMAModel
* default foreach to false
* add non-blocking EMA offloading to SD1.5 T2I example script
* fix whitespace
* move foreach to cli argument
* linting
* Update README.md re: EMA weight training
* correct args.foreach_ema
* add tests for foreach ema
* code quality
* add foreach to from_pretrained
* default foreach false
* fix linting
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: drhead <a@a.a>
2024-12-23 13:02:13 +05:30
22ebb0ab89
[LoRA] get rid of the legacy lora remnants and make our codebase lighter ( #8623 )
...
* get rid of the legacy lora remnants and make our codebase lighter
* fix depcrecated lora argument
* fix
* empty commit to trigger ci
* remove print
* empty
2024-12-23 13:02:13 +05:30
492900099c
Update train_dreambooth_lora_sd3.py ( #8600 )
...
* Update train_dreambooth_lora_sd3.py
* Update train_dreambooth_lora_sd3.py
* Update train_dreambooth_sd3.py
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
af2763cf1a
Change the default weighting_scheme in the SD3 scripts ( #8639 )
...
* change to logit_normal as the weighting scheme
* sensible default mote
2024-12-23 13:02:13 +05:30
6ad6c79fc7
[LoRA] training fix the position of param casting when loading them ( #8460 )
...
fix the position of param casting when loading them
2024-12-23 13:02:13 +05:30
2fad608d8e
[SD3 training] refactor the density and weighting utilities. ( #8591 )
...
refactor the density and weighting utilities.
2024-12-23 13:02:13 +05:30
acfcfd3003
SD3: update default training timestep / loss weighting distribution to logit_normal ( #8592 )
...
Co-authored-by: bghira <bghira@users.github.com >
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
2024-12-23 13:02:13 +05:30
25b4975285
[SD3 Training] T5 token limit ( #8564 )
...
* initial commit
* default back to 77
* better text
* text correction
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
7cb40ee5ab
Fix the deletion of SD3 text encoders for Dreambooth/LoRA training if the text encoders are not being trained ( #8536 )
...
* Update train_dreambooth_sd3.py to fix TE garbage collection
* Update train_dreambooth_lora_sd3.py to fix TE garbage collection
---------
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
2891f6f116
Implement SD3 loss weighting ( #8528 )
...
* Add lognorm and cosmap weighting
* Implement mode sampling
* Update examples/dreambooth/train_dreambooth_lora_sd3.py
* Update examples/dreambooth/train_dreambooth_lora_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_lora_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_sd3.py
* Update examples/dreambooth/train_dreambooth_lora_sd3.py
* keep timestamp sampling fully on cpu
---------
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
5a1acc82b0
add sentencepiece to requirements.txt for SD3 dreambooth ( #8538 )
...
* add `sentencepiece` requirement for SD3
add `sentencepiece` requirement
* Empty-Commit
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
bcf0f7667f
post release 0.29.0 ( #8492 )
...
post release
2024-12-23 13:02:13 +05:30
5d4603a52c
Update requirements_sd3.txt ( #8521 )
2024-12-23 13:02:13 +05:30
6c9b130bca
Update README_sd3.md ( #8490 )
...
becasue in Readme it was not correct
train_dreambooth_sd3.py to train_dreambooth_lora_sd3
2024-12-23 13:02:12 +05:30
d0b14d0f08
Add Stable Diffusion 3 ( #8483 )
...
* up
* add sd3
* update
* update
* add tests
* fix copies
* fix docs
* update
* add dreambooth lora
* add LoRA
* update
* update
* update
* update
* import fix
* update
* Update src/diffusers/pipelines/stable_diffusion_3/pipeline_stable_diffusion_3.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* import fix 2
* update
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* update
* update
* update
* fix ckpt id
* fix more ids
* update
* missing doc
* Update src/diffusers/schedulers/scheduling_flow_match_euler_discrete.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/schedulers/scheduling_flow_match_euler_discrete.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update docs/source/en/api/pipelines/stable_diffusion/stable_diffusion_3.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/pipelines/stable_diffusion/stable_diffusion_3.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* update'
* fix
* update
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
* Update src/diffusers/models/autoencoders/autoencoder_kl.py
* note on gated access.
* requirements
* licensing
---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-12-23 13:02:12 +05:30
dbc8b516ee
Update README.md to update the MaPO project ( #8470 )
...
Update README.md
2024-12-23 13:02:12 +05:30
d027cb4326
Errata ( #8322 )
...
* Fix typos
* Trim trailing whitespaces
* Remove a trailing whitespace
* chore: Update MarigoldDepthPipeline checkpoint to prs-eth/marigold-lcm-v1-0
* Revert "chore: Update MarigoldDepthPipeline checkpoint to prs-eth/marigold-lcm-v1-0"
This reverts commit fd742b30b4
2024-12-23 13:02:12 +05:30
cce0e5af64
Gligen training ( #7906 )
...
* add training code of gligen
* fix code quality tests.
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:12 +05:30
760e5993de
Modularize train_text_to_image_lora_sdxl inferencing during and after training in example ( #8335 )
...
* Modularized the train_lora_sdxl file
* Modularized the train_lora_sdxl file
* Modularized the train_lora_sdxl file
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:12 +05:30
a1cfb0accc
fix(training): lr scheduler doesn't work properly in distributed scenarios ( #8312 )
2024-12-23 13:02:12 +05:30
Dhruv Nair