obscura/diffusers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,905 Commits 711 Branches 93 Tags
9feab900e229ddb2447f396da48939ccaeb8c679
Commit Graph

868 Commits

Author SHA1 Message Date
M. Tolga Cangöz 9feab900e2 [Docs] Fix typos (#7451) 
* Fix typos

* Fix typos

* Fix typos

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Sayak Paul 1b917981da [Research Projects] ORPO diffusion for alignment (#7423) 
* barebones orpo

* remove reference model.

* full implementation

* change default of beta_orpo

* add a training command.

* fix: dataloading issues.

* interpreting the formulation.

* revert styling

* add: wds full blown version

* fix: per_gpu_batch_siz

* start debuggin

* debugging

* remove print

* fix

* remove filter keys.

* turn on non-blocking calls.

* device_placement

* let's see.

* add bigger training run command

* reinitialize generator for fair repro

* add: detailed readme and requirements

---------

Co-authored-by: Sayak Paul <sayakpaul@Sayaks-MacBook-Pro-2.local>
 2024-12-23 13:02:09 +05:30
YiYi Xu e6d2af229d add a "Community Scripts" section (#7358) 
* add

* add tiling

* fix

* fix

* fix

* give community script its own readme

* Update examples/community/README_community_scripts.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update examples/community/README_community_scripts.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update examples/community/README_community_scripts.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update examples/community/README_community_scripts.md

---------

Co-authored-by: Alexis Rolland <alexis.rolland@ubisoft.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:09 +05:30
M. Tolga Cangöz 651dac5447 Fix typos (#7411) 
* Fix typos

* Fix typo in SVD.md
 2024-12-23 13:02:09 +05:30
Sayak Paul c2c884a9e6 [LoRA test suite] refactor the test suite and cleanse it (#7316) 
* cleanse and refactor lora testing suite.

* more cleanup.

* make check_if_lora_correctly_set a utility function

* fix: typo

* retrigger ci

* style
 2024-12-23 13:02:09 +05:30
M. Tolga Cangöz 950c7085f5 Update access of configuration attributes (#7343) 
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
M. Tolga Cangöz 4e546762ab Fix Typos (#7325) 
* Fix PyTorch's convention for inplace functions

* Fix import structure in __init__.py and update config loading logic in test_config.py

* Update configuration access

* Fix typos

* Trim trailing white spaces

* Fix typo in logger name

* Revert "Fix PyTorch's convention for inplace functions"

This reverts commit f65dc4afcb.

* Fix typo in step_index property description

* Revert "Update configuration access"

This reverts commit 8d44e870b8.

* Revert "Fix import structure in __init__.py and update config loading logic in test_config.py"

This reverts commit 2ad5e8bca2.

* Fix typos

* Fix typos

* Fix typos

* Fix a typo: tranform -> transform
 2024-12-23 13:02:09 +05:30
Anatoly Belikov 3cf03face4 delete vae and text encoders after use in SDXL training script (#6693) 
delete vae and text encoders after use

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Sayak Paul 08a03e1641 post-release v0.27.0 (#7329) 
* post-release

* quality
 2024-12-23 13:02:09 +05:30
M. Tolga Cangöz c6fa2ee726 [Tests] Update a deprecated parameter in test files and fix several typos (#7277) 
* Add properties and `IPAdapterTesterMixin` tests for `StableDiffusionPanoramaPipeline`

* Fix variable name typo and update comments

* Update deprecated `output_type="numpy"` to "np" in test files

* Discard changes to src/diffusers/pipelines/stable_diffusion_panorama/pipeline_stable_diffusion_panorama.py

* Update test_stable_diffusion_panorama.py

* Update numbers in README.md

* Update get_guidance_scale_embedding method to use timesteps instead of w

* Update number of checkpoints in README.md

* Add type hints and fix var name

* Fix PyTorch's convention for inplace functions

* Fix a typo

* Revert "Fix PyTorch's convention for inplace functions"

This reverts commit 74350cf65b.

* Fix typos

* Indent

* Refactor get_guidance_scale_embedding method in LEditsPPPipelineStableDiffusionXL class
 2024-12-23 13:02:09 +05:30
Linoy Tsaban f86aa42f4c [Advanced DreamBooth LoRA SDXL] Support EDM-style training (follow up of #7126) (#7182) 
* add edm style training

* style

* finish adding edm training feature

* import fix

* fix latents mean

* minor adjustments

* add edm to readme

* style

* fix autocast and scheduler config issues when using edm

* style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Anatoly Belikov ec2acc7dc8 log loss per image (#7278) 
* log loss per image

* add commandline param for per image loss logging

* style

* debug-loss -> debug_loss

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Beinsezii e6851daf70 Change step_offset scheduler docstrings (#7128) 
* Change step_offset scheduler docstrings

* Mention it may be needed by some models

* More docstrings

These ones failed literal S&R because I performed it case-sensitive
which is fun.

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
jnhuang e6e832c0a1 Fix Wrong Text-encoder Grad Setting in Custom_Diffusion Training (#7302) 
fix index in set textencoder grad

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:09 +05:30
Sayak Paul dc7e9809a9 [Chore] switch to logger.warning (#7289) 
switch to logger.warning
 2024-12-23 13:02:09 +05:30
pravdomil 87ce979fb6 Inline InputPadder (#6582) 
inline InputPadder
 2024-12-23 13:02:09 +05:30
pravdomil 1abab1d268 Fix gmflow_dir (#6583) 
* remove sys.path

* update readme
 2024-12-23 13:02:09 +05:30
Aryan 77961cefcb [docs/nits] Fix return values based on return_dict and minor doc updates (#7105) 
* fix returns and docs

* handle latent output_type correctly

* revert to old tensor2vid impl

* make fix-copies

* fix return in community animatediff pipes

* fix return docstring

* fix return docs

* add missing quote

---------

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-23 13:02:09 +05:30
qqii b31c77fcb3 [Community Pipeline] Skip Marigold depth_colored with color_map=None (#7170) 
[Community Pipeline] Skip Marigold depth_colored generation by passing color_map=None
 2024-12-23 13:02:09 +05:30
Sayak Paul 2e3436d2dc [Easy] fix: save_model_card utility of the DreamBooth SDXL LoRA script (#7258) 
* fix: save_model_card utility.

* fix a little more to make it more lenient.

* remove lower()
 2024-12-23 13:02:08 +05:30
pravdomil ffc485f3d9 use self.device (#6595) 
* use self.device

* use device

* fix

* fix
 2024-12-23 13:02:08 +05:30
Sayak Paul 57a3be2e28 [Examples] fix: prior preservation setting in DreamBooth LoRA SDXL script. (#7242) 
fix: prior preservation setting in DreamBooth LoRA SDXL script.

Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>
 2024-12-23 13:02:08 +05:30
Linoy Tsaban 7c36b6d3df add DoRA training feature to sdxl dreambooth lora script (#7235) 
* dora in canonical script

* add mention of DoRA to readme
 2024-12-23 13:02:08 +05:30
Paakhhi 50b6c20e06 Refactor Prompt2Prompt: Inherit from DiffusionPipeline (#7211) 
refactor: inherit from DiffusionPipeline instead of StableDiffusionPipeline
 2024-12-23 13:02:08 +05:30
Nate Landman 350d21bcbe Update train_dreambooth_lora_sdxl_advanced.py (#7227) 
adding the type gives you

```
TypeError: _StoreTrueAction.__init__() got an unexpected keyword argument 'type'
```
 2024-12-23 13:02:08 +05:30
bram-w 713bd43037 SDXL Turbo support and example launch (#6473) 
* support and example launch for sdxl turbo

* White space fixes

* Trailing whitespace character

* ruff format

* fix guidance_scale and steps for turbo mode

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Radames Ajna <radamajna@gmail.com>
 2024-12-23 13:02:08 +05:30
iczaw 1c7084b305 [Community] PromptDiffusion Pipeline (#6752) 
* Create promptdiffusioncontrolnet.py

* Update __init__.py

Added PromptDiffusionControlNetModel

* Update __init__.py

Added PromptDiffusionControlNetModel

* Update promptdiffusioncontrolnet.py

* Create pipeline_prompt_diffusion.py

Added Prompt Diffusion pipeline.

* Create convert_original_promptdiffusion_to_diffusers.py

* Update convert_from_ckpt.py

Added download_promptdiffusion_from_original_ckpt, convert_promptdiffusion_checkpoint

* Update promptdiffusioncontrolnet.py

* Update pipeline_prompt_diffusion.py

* Update README.md

* Update pipeline_prompt_diffusion.py

* Delete src/diffusers/models/promptdiffusioncontrolnet.py

* Update __init__.py

* Update __init__.py

* Delete scripts/convert_original_promptdiffusion_to_diffusers.py

* Update convert_from_ckpt.py

* Update README.md

* Delete examples/community/pipeline_prompt_diffusion.py

* Create README.md

* Create promptdiffusioncontrolnet.py

* Create convert_original_promptdiffusion_to_diffusers.py

* Create pipeline_prompt_diffusion.py

* Update README.md

* Update pipeline_prompt_diffusion.py

* Update README.md

* Update pipeline_prompt_diffusion.py

* Update convert_original_promptdiffusion_to_diffusers.py

* Update promptdiffusioncontrolnet.py

* Update README.md

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 06de6e0b0f Fix typos (#7181) 
* Fix typos

* Fix typos

* Fix typos and update documentation in lora.md
 2024-12-23 13:02:08 +05:30
Linoy Tsaban e5f4534805 [training scripts] add tags of diffusers-training (#7206) 
* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add dora tags for drambooth lora scripts

* style
 2024-12-23 13:02:08 +05:30
Linoy Tsaban 5b2ab4c269 [advanced dreambooth lora sdxl] add DoRA training feature (#7072) 
* add is_dora arg

* style

* add dora training feature to sd 1.5 script

* added notes about DoRA training

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Sayak Paul 48a9e62978 Update requirements.txt to remove huggingface-cli (#7202) 
Internal message: https://huggingface.slack.com/archives/C03Q18WK18T/p1709529892062479
 2024-12-23 13:02:08 +05:30
Sayak Paul 0c693ca240 Support EDM-style training in DreamBooth LoRA SDXL script (#7126) 
* add: dreambooth lora script for Playground v2.5

* fix: kwarg

* address suraj's comments.

* Apply suggestions from code review

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* apply suraj's suggestion

* incorporate changes in the canonical script./

* tracker naming

* fix: schedule determination

* add: two simple tests

* remove playground script

* note about edm-style training

* address pedro's comments.

* address part of Suraj's comments.

* Apply suggestions from code review

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* remove guidance_scale.

* use mse_loss.

* add comments for preconditioning.

* quality

* Update examples/dreambooth/train_dreambooth_lora_sdxl.py

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* tackle v-pred.

* Empty-Commit

* support edm for sdxl too.

* address suraj's comments.

* Empty-Commit

---------

Co-authored-by: Suraj Patil <surajp815@gmail.com>
 2024-12-23 13:02:08 +05:30
Oleh 58294f94a9 Map speedup (#6745) 
* Speed up dataset mapping

* Fix missing columns

* Remove cache files cleanup

* Update examples/text_to_image/train_text_to_image_sdxl.py

* make style

* Fix code style

* style

* Empty-Commit

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com>
Co-authored-by: Quentin Lhoest <lhoest.q@gmail.com>
 2024-12-23 13:02:08 +05:30
Sayak Paul 64694545de fix: loading problem for sdxl lora dreambooth (#7166) 2024-12-23 13:02:08 +05:30
Quentin Lhoest 5575578b38 Fix vae_encodings_fn hash in train_text_to_image_sdxl.py (#7171) 
Update train_text_to_image_sdxl.py
 2024-12-23 13:02:08 +05:30
YiYi Xu f38417fe30 [ip-adapter] refactor prepare_ip_adapter_image_embeds and skip load image_encoder (#7016) 
* add

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
elucida 14bb45e4e8 refactor: move model helper function in pipeline to a mixin class (#6571) 
* move model helper function in pipeline to EfficiencyMixin

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Sayak Paul 8139fa70c4 fix kwarg in the SDXL LoRA DreamBooth (#7124) 
* fix kwarg

* Empty-Commit
 2024-12-23 13:02:08 +05:30
Sayak Paul 7ccbcb71d4 [Examples] Multiple enhancements to the ControlNet training scripts (#7096) 
* log_validation unification for controlnet.

* additional fixes.

* remove print.

* better reuse and loading

* make final inference run conditional.

* Update examples/controlnet/README_sdxl.md

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

* resize the control image in the snippet.

---------

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 9b15d87fb5 Fix EMA in train_text_to_image_sdxl.py (#7048) 
* Fix typos
 2024-12-23 13:02:08 +05:30
jiqing-feng 862caee47a Resize image before crop (#7095) 
resize first

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Aryan be2e28383a [Community] Bug fix + Latest IP-Adapter impl. for AnimateDiff img2vid/controlnet (#7086) 
* fix img2vid; update to latest ip-adapter impl

* update README

* update animatediff controlnet to latest impl
 2024-12-23 13:02:08 +05:30
Vinh H. Pham 1e6a865d37 Modularize Dreambooth LoRA SDXL inferencing during and after training (#6655) 
* modularize log validation

* run make style

* revert import wandb

* fix code quality & import wandb

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Vinh H. Pham 4ff83c7f4f Modularize Dreambooth LoRA SD inferencing during and after training (#6654) 
* modulize log validation

* run make style and refactor wanddb support

* remove redundant initialization

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Aryan 23e6b32139 Fix truthy-ness condition in pipelines that use denoising_start (#6912) 
* fix denoising start

* fix tests

* remove debug
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 302b3c6b79 [Refactor] StableDiffusionReferencePipeline inheriting from DiffusionPipeline (#7071) 
Refactor StableDiffusionReferencePipeline to inherit from DiffusionPipeline rather than StableDiffusionPipeline
 2024-12-23 13:02:08 +05:30
caiyueliang bc9b342fa4 fix: TensorRTStableDiffusionPipeline cannot set guidance_scale (#7065) 2024-12-23 13:02:08 +05:30
Chong-U Lim eba9562560 Fix docstring of community pipeline imagic (#7062) 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz d38521afa2 Fix typos (#7068) 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 1f3ff03c01 [Refactor] save_model_card function in text_to_image examples (#7051) 
* Refactor save_model_card function to handle images and repo_folder parameters

* Discard changes to examples/text_to_image/train_text_to_image.py

* Discard changes to examples/text_to_image/train_text_to_image_lora_sdxl.py

* Update train_text_to_image_lora.py

* Update train_text_to_image_sdxl.py
 2024-12-23 13:02:08 +05:30