23cf712349
post-release 0.31.0 ( #9742 )
...
* post-release
* style
2024-12-23 13:02:17 +05:30
64dd1c2f2a
Fix the issue on sd3 dreambooth w./w.t. lora training ( #9419 )
...
* Fix dtype error
* [bugfix] Fixed the issue on sd3 dreambooth training
* [bugfix] Fixed the issue on sd3 dreambooth training
---------
Co-authored-by: 蒋硕 <jiangshuo9@h-partners.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:16 +05:30
275e523ef5
post release 0.30.0 ( #9173 )
...
* post release
* fix quality
2024-12-23 13:02:15 +05:30
6d11129c5a
[Chore] add LoraLoaderMixin to the inits ( #8981 )
...
* introduce to promote reusability.
* up
* add more tests
* up
* remove comments.
* fix fuse_nan test
* clarify the scope of fuse_lora and unfuse_lora
* remove space
* rewrite fuse_lora a bit.
* feedback
* copy over load_lora_into_text_encoder.
* address dhruv's feedback.
* fix-copies
* fix issubclass.
* num_fused_loras
* fix
* fix
* remove mapping
* up
* fix
* style
* fix-copies
* change to SD3TransformerLoRALoadersMixin
* Apply suggestions from code review
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
* up
* handle wuerstchen
* up
* move lora to lora_pipeline.py
* up
* fix-copies
* fix documentation.
* comment set_adapters().
* fix-copies
* fix set_adapters() at the model level.
* fix?
* fix
* loraloadermixin.
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-12-23 13:02:14 +05:30
a754d9071e
Revert "[LoRA] introduce LoraBaseMixin to promote reusability." ( #8976 )
...
Revert "[LoRA] introduce LoraBaseMixin to promote reusability. (#8774 )"
This reverts commit 527430d0a4
2024-12-23 13:02:14 +05:30
82b37a4cc3
[LoRA] introduce LoraBaseMixin to promote reusability. ( #8774 )
...
* introduce to promote reusability.
* up
* add more tests
* up
* remove comments.
* fix fuse_nan test
* clarify the scope of fuse_lora and unfuse_lora
* remove space
* rewrite fuse_lora a bit.
* feedback
* copy over load_lora_into_text_encoder.
* address dhruv's feedback.
* fix-copies
* fix issubclass.
* num_fused_loras
* fix
* fix
* remove mapping
* up
* fix
* style
* fix-copies
* change to SD3TransformerLoRALoadersMixin
* Apply suggestions from code review
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
* up
* handle wuerstchen
* up
* move lora to lora_pipeline.py
* up
* fix-copies
* fix documentation.
* comment set_adapters().
* fix-copies
* fix set_adapters() at the model level.
* fix?
* fix
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-12-23 13:02:14 +05:30
bcf0f7667f
post release 0.29.0 ( #8492 )
...
post release
2024-12-23 13:02:13 +05:30
e135b4dadf
post release v0.28.0 ( #8286 )
...
* post release v0.28.0
* style
2024-12-23 13:02:12 +05:30
2f6b1ecde2
fix: Fixed few docstrings according to the Google Style Guide ( #7717 )
...
Fixed few docstrings according to the Google Style Guide.
2024-12-23 13:02:12 +05:30
69131fda5c
7529 do not disable autocast for cuda devices ( #7530 )
...
* 7529 do not disable autocast for cuda devices
* Remove typecasting error check for non-mps platforms, as a correct autocast implementation makes it a non-issue
* add autocast fix to other training examples
* disable native_amp for dreambooth (sdxl)
* disable native_amp for pix2pix (sdxl)
* remove tests from remaining files
* disable native_amp on huggingface accelerator for every training example that uses it
* convert more usages of autocast to nullcontext, make style fixes
* make style fixes
* style.
* Empty-Commit
---------
Co-authored-by: bghira <bghira@users.github.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:10 +05:30
08a03e1641
post-release v0.27.0 ( #7329 )
...
* post-release
* quality
2024-12-23 13:02:09 +05:30
dc7e9809a9
[Chore] switch to logger.warning ( #7289 )
...
switch to logger.warning
2024-12-23 13:02:09 +05:30
e5f4534805
[training scripts] add tags of diffusers-training ( #7206 )
...
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add dora tags for drambooth lora scripts
* style
2024-12-23 13:02:08 +05:30
4ff83c7f4f
Modularize Dreambooth LoRA SD inferencing during and after training ( #6654 )
...
* modulize log validation
* run make style and refactor wanddb support
* remove redundant initialization
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:08 +05:30
166641aefa
post release 0.26.2 ( #6885 )
...
* post release
* style
* Empty-Commit
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-12-23 13:02:07 +05:30
72d23f5309
correct hub_token exposition behaviour (thanks to @bghira). ( #6918 )
2024-12-23 13:02:07 +05:30
86e62ae4c5
change to 2024 in the license ( #6902 )
...
change to 2024
2024-12-23 13:02:07 +05:30
14aaf03f7d
fix: keyword argument mismatch ( #6895 )
2024-12-23 13:02:06 +05:30
3a06d3a15e
[Model Card] standardize dreambooth model card ( #6729 )
...
* feat: standarize model card creation for dreambooth training.
* correct 'inference
* remove comments.
* take component out of kwargs
* style
* add: card template to have a leaner description.
* widget support.
* propagate changes to train_dreambooth_lora
* propagate changes to custom diffusion
* make widget properly type-annotated
2024-12-23 13:02:06 +05:30
4e8b2b3b71
[training] fix training resuming problem for fp16 (SD LoRA DreamBooth) ( #6554 )
...
* fix training resume
* update
* update
2024-12-23 13:02:05 +05:30
8ae8108458
Make Dreambooth SD LoRA Training Script torch.compile compatible ( #6534 )
...
support compile
2024-12-23 13:02:05 +05:30
fe32030325
0.25.0 post release ( #6358 )
...
* post release
* style
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-12-23 13:02:05 +05:30
f72503473e
[Training examples] Follow up of #6306 ( #6346 )
...
* add to dreambooth lora.
* add: t2i lora.
* add: sdxl t2i lora.
* style
* lcm lora sdxl.
* unwrap
* fix: enable_adapters().
2024-12-23 13:02:05 +05:30
6943a96d92
[LoRA PEFT] fix LoRA loading so that correct alphas are parsed ( #6225 )
...
* initialize alpha too.
* add: test
* remove config parsing
* store rank
* debug
* remove faulty test
2024-12-23 13:02:04 +05:30
b98b314b7a
[Training] remove depcreated method from lora scripts. ( #6207 )
...
remove depcreated method from lora scripts.
2023-12-18 15:52:43 +05:30
c2717317f0
[PEFT] Adapt example scripts to use PEFT ( #5388 )
...
* adapt example scripts to use PEFT
* Update examples/text_to_image/train_text_to_image_lora.py
* fix
* add for SDXL
* oops
* make sure to install peft
* fix
* fix
* fix dreambooth and lora
* more fixes
* add peft to requirements.txt
* fix
* final fix
* add peft version in requirements
* remove comment
* change variable names
* add few lines in readme
* add to reqs
* style
* fix issues
* fix lora dreambooth xl tests
* init_lora_weights to gaussian and add out proj where missing
* ammend requirements.
* ammend requirements.txt
* add correct peft versions
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-07 09:39:29 +05:30
dadd55fb36
Post Release: v0.24.0 ( #5985 )
...
* Post Release: v0.24.0
* post pone deprecation
* post pone deprecation
* Add model_index.json
2023-12-01 18:43:44 +01:00
6d2e19f746
[Examples] Allow downloading variant model files ( #5531 )
...
* add variant
* add variant
* Apply suggestions from code review
* reformat
* fix: textual_inversion.py
* fix: variant in model_info
---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
2023-11-27 10:43:20 +05:30
13d73d9303
[Lora] Seperate logic ( #5809 )
...
* [Lora] Seperate logic
* [Lora] Seperate logic
* [Lora] Seperate logic
* add comments to explain the code better
* add comments to explain the code better
2023-11-21 18:58:37 +01:00
c896b841e4
Set usedforsecurity=False in hashlib methods (FIPS compliance) ( #5790 )
...
* Set usedforsecurity=False in hashlib methods (FIPS compliance)
* update version dependency
* bump hfh version
* bump hfh version
2023-11-17 14:56:58 +01:00
ded93f798c
[Refactor] refactor loaders.py to make it cleaner and leaner. ( #5771 )
...
* refactor loaders.py to make it cleaner and leaner.
* refactor loaders init
* inits.
* textual inversion to the init.
* inits.
* remove certain modules from the main init.
* AttnProcsLayers
* fix imports
* avoid circular import.
* fix circular import pt 2.
* address PR comments
* imports
* fix: imports.
* remove from main init for avoiding circular deps.
* remove spurious deps.
* fix-copies.
* fix imports.
* more debug
* more debug
* Apply suggestions from code review
* Apply suggestions from code review
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-11-14 12:54:28 +01:00
1477865e48
post release v0.23.0 ( #5730 )
...
* post release
* fix: variant test
* up
* fix: test
2023-11-10 16:35:44 +05:30
64603389da
post release (v0.22.0) ( #5658 )
...
post release
2023-11-06 16:23:38 +01:00
0ea78f9707
chore: fix typos ( #5386 )
...
* chore: fix typos
* Update src/diffusers/pipelines/shap_e/renderer.py
Co-authored-by: psychedelicious <4822129+psychedelicious@users.noreply.github.com >
---------
Co-authored-by: psychedelicious <4822129+psychedelicious@users.noreply.github.com >
2023-10-16 15:23:37 +02:00
0fa32bd674
[Examples] use loralinear instead of depecrecated lora attn procs. ( #5331 )
...
* use loralinear instead of depecrecated lora attn procs.
* fix parameters()
* fix saving
* add back support for add kv proj.
* fix: param accumul,ation.
* propagate the changes.
2023-10-11 13:02:42 +02:00
0513a8cfd8
fix typo in train dreambooth lora description ( #5332 )
2023-10-08 14:54:33 +02:00
d56825e4b4
fix: how print training resume logs. ( #5117 )
...
* fix: how print training resume logs.
* propagate changes to text-to-image scripts.
* propagate changes to instructpix2pix.
* propagate changes to dreambooth
* propagate changes to custom diffusion and instructpix2pix
* propagate changes to kandinsky
* propagate changes to textual inv.
* debug
* fix: checkpointing.
* debug
* debug
* debug
* back to the square
* debug
* debug
* change condition order.
* debug
* debug
* debug
* debug
* revert to original
* clean
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-10-02 18:29:52 +02:00
342c5c02c0
[Release 0.21] Bump version ( #5018 )
...
* [Release 0.21] Bump version
* fix & remove
* fix more
* fix all, upload
2023-09-14 18:28:57 +02:00
d73e6ad050
guard save model hooks to only execute on main process ( #4929 )
2023-09-08 10:30:06 -07:00
7e5587a5ac
instance_prompt->class_prompt ( #4784 )
2023-08-25 20:06:55 +02:00
d0c30cfd37
make post-release ( #4650 )
2023-08-17 14:16:25 +05:30
029fb41695
[Safetensors] Make safetensors the default way of saving weights ( #4235 )
...
* make safetensors default
* set default save method as safetensors
* update tests
* update to support saving safetensors
* update test to account for safetensors default
* update example tests to use safetensors
* update example to support safetensors
* update unet tests for safetensors
* fix failing loader tests
* fix qc issues
* fix pipeline tests
* fix example test
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2023-08-17 10:54:28 +05:30
ea1fcc28a4
[SDXL] Allow SDXL LoRA to be run with less than 16GB of VRAM ( #4470 )
...
* correct
* correct blocks
* finish
* finish
* finish
* Apply suggestions from code review
* fix
* up
* up
* up
* Update examples/dreambooth/README_sdxl.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Apply suggestions from code review
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-08-04 20:06:38 +02:00
160474ac61
train dreambooth fix pre encode class prompt ( #4395 )
2023-08-01 12:00:05 -07:00
4a4cdd6b07
[Feat] Support SDXL Kohya-style LoRA ( #4287 )
...
* sdxl lora changes.
* better name replacement.
* better replacement.
* debugging
* debugging
* debugging
* debugging
* debugging
* remove print.
* print state dict keys.
* print
* distingisuih better
* debuggable.
* fxi: tyests
* fix: arg from training script.
* access from class.
* run style
* debug
* save intermediate
* some simplifications for SDXL LoRA
* styling
* unet config is not needed in diffusers format.
* fix: dynamic SGM block mapping for SDXL kohya loras (#4322 )
* Use lora compatible layers for linear proj_in/proj_out (#4323 )
* improve condition for using the sgm_diffusers mapping
* informative comment.
* load compatible keys and embedding layer maaping.
* Get SDXL 1.0 example lora to load
* simplify
* specif ranks and hidden sizes.
* better handling of k rank and hidden
* debug
* debug
* debug
* debug
* debug
* fix: alpha keys
* add check for handling LoRAAttnAddedKVProcessor
* sanity comment
* modifications for text encoder SDXL
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* denugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* up
* up
* up
* up
* up
* up
* unneeded comments.
* unneeded comments.
* kwargs for the other attention processors.
* kwargs for the other attention processors.
* debugging
* debugging
* debugging
* debugging
* improve
* debugging
* debugging
* more print
* Fix alphas
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* clean up
* clean up.
* debugging
* fix: text
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Batuhan Taskaya <batuhan@python.org >
2023-07-28 19:49:49 +02:00
01b6ec21fa
fix validation option for dreambooth training example ( #4317 )
2023-07-27 09:58:52 -07:00
20e92586c1
0.20.0dev0 ( #4299 )
...
* 0.20.0dev0
* make style
2023-07-26 23:06:18 +02:00
3dd339379d
do not pass list to accelerator.init_trackers ( #4248 )
2023-07-24 21:10:37 -07:00
6427aa995e
[Enhance] Add rank in dreambooth ( #4112 )
...
add rank in dreambooth
2023-07-18 11:30:06 +05:30
ece55227ff
Multiply lr scheduler steps by num_processes. ( #3983 )
...
* Multiply lr scheduler steps by `num_processes`.
* Stop multiplying steps by gradient accumulation.
2023-07-13 17:50:25 +05:30
Sayak Paul