obscura/diffusers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,869 Commits 711 Branches 93 Tags
3cf03face41bec8ae1ce25b07be39e413f1f1291
Commit Graph

861 Commits

Author SHA1 Message Date
Anatoly Belikov 3cf03face4 delete vae and text encoders after use in SDXL training script (#6693) 
delete vae and text encoders after use

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Sayak Paul 08a03e1641 post-release v0.27.0 (#7329) 
* post-release

* quality
 2024-12-23 13:02:09 +05:30
M. Tolga Cangöz c6fa2ee726 [Tests] Update a deprecated parameter in test files and fix several typos (#7277) 
* Add properties and `IPAdapterTesterMixin` tests for `StableDiffusionPanoramaPipeline`

* Fix variable name typo and update comments

* Update deprecated `output_type="numpy"` to "np" in test files

* Discard changes to src/diffusers/pipelines/stable_diffusion_panorama/pipeline_stable_diffusion_panorama.py

* Update test_stable_diffusion_panorama.py

* Update numbers in README.md

* Update get_guidance_scale_embedding method to use timesteps instead of w

* Update number of checkpoints in README.md

* Add type hints and fix var name

* Fix PyTorch's convention for inplace functions

* Fix a typo

* Revert "Fix PyTorch's convention for inplace functions"

This reverts commit 74350cf65b.

* Fix typos

* Indent

* Refactor get_guidance_scale_embedding method in LEditsPPPipelineStableDiffusionXL class
 2024-12-23 13:02:09 +05:30
Linoy Tsaban f86aa42f4c [Advanced DreamBooth LoRA SDXL] Support EDM-style training (follow up of #7126) (#7182) 
* add edm style training

* style

* finish adding edm training feature

* import fix

* fix latents mean

* minor adjustments

* add edm to readme

* style

* fix autocast and scheduler config issues when using edm

* style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Anatoly Belikov ec2acc7dc8 log loss per image (#7278) 
* log loss per image

* add commandline param for per image loss logging

* style

* debug-loss -> debug_loss

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Beinsezii e6851daf70 Change step_offset scheduler docstrings (#7128) 
* Change step_offset scheduler docstrings

* Mention it may be needed by some models

* More docstrings

These ones failed literal S&R because I performed it case-sensitive
which is fun.

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
jnhuang e6e832c0a1 Fix Wrong Text-encoder Grad Setting in Custom_Diffusion Training (#7302) 
fix index in set textencoder grad

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Sayak Paul dc7e9809a9 [Chore] switch to logger.warning (#7289) 
switch to logger.warning
 2024-12-23 13:02:09 +05:30
pravdomil 87ce979fb6 Inline InputPadder (#6582) 
inline InputPadder
 2024-12-23 13:02:09 +05:30
pravdomil 1abab1d268 Fix gmflow_dir (#6583) 
* remove sys.path

* update readme
 2024-12-23 13:02:09 +05:30
Aryan 77961cefcb [docs/nits] Fix return values based on return_dict and minor doc updates (#7105) 
* fix returns and docs

* handle latent output_type correctly

* revert to old tensor2vid impl

* make fix-copies

* fix return in community animatediff pipes

* fix return docstring

* fix return docs

* add missing quote

---------

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-23 13:02:09 +05:30
qqii b31c77fcb3 [Community Pipeline] Skip Marigold depth_colored with color_map=None (#7170) 
[Community Pipeline] Skip Marigold depth_colored generation by passing color_map=None
 2024-12-23 13:02:09 +05:30
Sayak Paul 2e3436d2dc [Easy] fix: save_model_card utility of the DreamBooth SDXL LoRA script (#7258) 
* fix: save_model_card utility.

* fix a little more to make it more lenient.

* remove lower()
 2024-12-23 13:02:08 +05:30
pravdomil ffc485f3d9 use self.device (#6595) 
* use self.device

* use device

* fix

* fix
 2024-12-23 13:02:08 +05:30
Sayak Paul 57a3be2e28 [Examples] fix: prior preservation setting in DreamBooth LoRA SDXL script. (#7242) 
fix: prior preservation setting in DreamBooth LoRA SDXL script.

Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>
 2024-12-23 13:02:08 +05:30
Linoy Tsaban 7c36b6d3df add DoRA training feature to sdxl dreambooth lora script (#7235) 
* dora in canonical script

* add mention of DoRA to readme
 2024-12-23 13:02:08 +05:30
Paakhhi 50b6c20e06 Refactor Prompt2Prompt: Inherit from DiffusionPipeline (#7211) 
refactor: inherit from DiffusionPipeline instead of StableDiffusionPipeline
 2024-12-23 13:02:08 +05:30
Nate Landman 350d21bcbe Update train_dreambooth_lora_sdxl_advanced.py (#7227) 
adding the type gives you

```
TypeError: _StoreTrueAction.__init__() got an unexpected keyword argument 'type'
```
 2024-12-23 13:02:08 +05:30
bram-w 713bd43037 SDXL Turbo support and example launch (#6473) 
* support and example launch for sdxl turbo

* White space fixes

* Trailing whitespace character

* ruff format

* fix guidance_scale and steps for turbo mode

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Radames Ajna <radamajna@gmail.com>
 2024-12-23 13:02:08 +05:30
iczaw 1c7084b305 [Community] PromptDiffusion Pipeline (#6752) 
* Create promptdiffusioncontrolnet.py

* Update __init__.py

Added PromptDiffusionControlNetModel

* Update __init__.py

Added PromptDiffusionControlNetModel

* Update promptdiffusioncontrolnet.py

* Create pipeline_prompt_diffusion.py

Added Prompt Diffusion pipeline.

* Create convert_original_promptdiffusion_to_diffusers.py

* Update convert_from_ckpt.py

Added download_promptdiffusion_from_original_ckpt, convert_promptdiffusion_checkpoint

* Update promptdiffusioncontrolnet.py

* Update pipeline_prompt_diffusion.py

* Update README.md

* Update pipeline_prompt_diffusion.py

* Delete src/diffusers/models/promptdiffusioncontrolnet.py

* Update __init__.py

* Update __init__.py

* Delete scripts/convert_original_promptdiffusion_to_diffusers.py

* Update convert_from_ckpt.py

* Update README.md

* Delete examples/community/pipeline_prompt_diffusion.py

* Create README.md

* Create promptdiffusioncontrolnet.py

* Create convert_original_promptdiffusion_to_diffusers.py

* Create pipeline_prompt_diffusion.py

* Update README.md

* Update pipeline_prompt_diffusion.py

* Update README.md

* Update pipeline_prompt_diffusion.py

* Update convert_original_promptdiffusion_to_diffusers.py

* Update promptdiffusioncontrolnet.py

* Update README.md

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 06de6e0b0f Fix typos (#7181) 
* Fix typos

* Fix typos

* Fix typos and update documentation in lora.md
 2024-12-23 13:02:08 +05:30
Linoy Tsaban e5f4534805 [training scripts] add tags of diffusers-training (#7206) 
* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add dora tags for drambooth lora scripts

* style
 2024-12-23 13:02:08 +05:30
Linoy Tsaban 5b2ab4c269 [advanced dreambooth lora sdxl] add DoRA training feature (#7072) 
* add is_dora arg

* style

* add dora training feature to sd 1.5 script

* added notes about DoRA training

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Sayak Paul 48a9e62978 Update requirements.txt to remove huggingface-cli (#7202) 
Internal message: https://huggingface.slack.com/archives/C03Q18WK18T/p1709529892062479
 2024-12-23 13:02:08 +05:30
Sayak Paul 0c693ca240 Support EDM-style training in DreamBooth LoRA SDXL script (#7126) 
* add: dreambooth lora script for Playground v2.5

* fix: kwarg

* address suraj's comments.

* Apply suggestions from code review

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* apply suraj's suggestion

* incorporate changes in the canonical script./

* tracker naming

* fix: schedule determination

* add: two simple tests

* remove playground script

* note about edm-style training

* address pedro's comments.

* address part of Suraj's comments.

* Apply suggestions from code review

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* remove guidance_scale.

* use mse_loss.

* add comments for preconditioning.

* quality

* Update examples/dreambooth/train_dreambooth_lora_sdxl.py

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* tackle v-pred.

* Empty-Commit

* support edm for sdxl too.

* address suraj's comments.

* Empty-Commit

---------

Co-authored-by: Suraj Patil <surajp815@gmail.com>
 2024-12-23 13:02:08 +05:30
Oleh 58294f94a9 Map speedup (#6745) 
* Speed up dataset mapping

* Fix missing columns

* Remove cache files cleanup

* Update examples/text_to_image/train_text_to_image_sdxl.py

* make style

* Fix code style

* style

* Empty-Commit

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com>
Co-authored-by: Quentin Lhoest <lhoest.q@gmail.com>
 2024-12-23 13:02:08 +05:30
Sayak Paul 64694545de fix: loading problem for sdxl lora dreambooth (#7166) 2024-12-23 13:02:08 +05:30
Quentin Lhoest 5575578b38 Fix vae_encodings_fn hash in train_text_to_image_sdxl.py (#7171) 
Update train_text_to_image_sdxl.py
 2024-12-23 13:02:08 +05:30
YiYi Xu f38417fe30 [ip-adapter] refactor prepare_ip_adapter_image_embeds and skip load image_encoder (#7016) 
* add

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
elucida 14bb45e4e8 refactor: move model helper function in pipeline to a mixin class (#6571) 
* move model helper function in pipeline to EfficiencyMixin

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Sayak Paul 8139fa70c4 fix kwarg in the SDXL LoRA DreamBooth (#7124) 
* fix kwarg

* Empty-Commit
 2024-12-23 13:02:08 +05:30
Sayak Paul 7ccbcb71d4 [Examples] Multiple enhancements to the ControlNet training scripts (#7096) 
* log_validation unification for controlnet.

* additional fixes.

* remove print.

* better reuse and loading

* make final inference run conditional.

* Update examples/controlnet/README_sdxl.md

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

* resize the control image in the snippet.

---------

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 9b15d87fb5 Fix EMA in train_text_to_image_sdxl.py (#7048) 
* Fix typos
 2024-12-23 13:02:08 +05:30
jiqing-feng 862caee47a Resize image before crop (#7095) 
resize first

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Aryan be2e28383a [Community] Bug fix + Latest IP-Adapter impl. for AnimateDiff img2vid/controlnet (#7086) 
* fix img2vid; update to latest ip-adapter impl

* update README

* update animatediff controlnet to latest impl
 2024-12-23 13:02:08 +05:30
Vinh H. Pham 1e6a865d37 Modularize Dreambooth LoRA SDXL inferencing during and after training (#6655) 
* modularize log validation

* run make style

* revert import wandb

* fix code quality & import wandb

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Vinh H. Pham 4ff83c7f4f Modularize Dreambooth LoRA SD inferencing during and after training (#6654) 
* modulize log validation

* run make style and refactor wanddb support

* remove redundant initialization

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Aryan 23e6b32139 Fix truthy-ness condition in pipelines that use denoising_start (#6912) 
* fix denoising start

* fix tests

* remove debug
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 302b3c6b79 [Refactor] StableDiffusionReferencePipeline inheriting from DiffusionPipeline (#7071) 
Refactor StableDiffusionReferencePipeline to inherit from DiffusionPipeline rather than StableDiffusionPipeline
 2024-12-23 13:02:08 +05:30
caiyueliang bc9b342fa4 fix: TensorRTStableDiffusionPipeline cannot set guidance_scale (#7065) 2024-12-23 13:02:08 +05:30
Chong-U Lim eba9562560 Fix docstring of community pipeline imagic (#7062) 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz d38521afa2 Fix typos (#7068) 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 1f3ff03c01 [Refactor] save_model_card function in text_to_image examples (#7051) 
* Refactor save_model_card function to handle images and repo_folder parameters

* Discard changes to examples/text_to_image/train_text_to_image.py

* Discard changes to examples/text_to_image/train_text_to_image_lora_sdxl.py

* Update train_text_to_image_lora.py

* Update train_text_to_image_sdxl.py
 2024-12-23 13:02:08 +05:30
Lincoln Stein 2f7c83fefb Update checkpoint_merger pipeline to pass the "variant" argument (#6670) 
* make checkpoint_merger pipeline pass the "variant" argument to from_pretrained()

* make style

---------

Co-authored-by: Lincoln Stein <lstein@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 38c8227fde Fix typos in text_to_image examples (#7050) 
Update copyright information and fix typos in text_to_image examples
 2024-12-23 13:02:08 +05:30
pravdomil 7342038b31 update header (#6596) 
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:08 +05:30
ustcuna 7df14bf40f [Community Pipelines]Accelerate inference of stable diffusion xl (SDXL) by IPEX on CPU (#6683) 
* add stable_diffusion_xl_ipex community pipeline

* make style for code quality check

* update docs as suggested

---------

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2024-12-23 13:02:08 +05:30
Bhavay Malhotra 2f3c3fd6e7 Update textual_inversion.py (#6952) 
* Update textual_inversion.py

* Apply suggestions from code review

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update examples/textual_inversion/textual_inversion.py

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update textual_inversion.py

* styling

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:07 +05:30
Stephen 56637cb949 Standardize model card for textual inversion sdxl (#6963) 
* standardize model card

* fix tags

* correct import styling and update tags

* run make style and make quality

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:07 +05:30
co63oc c8a06e0c20 Fix procecss process (#6591) 
* Fix words

* Fix

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:07 +05:30