obscura/diffusers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,795 Commits 711 Branches 93 Tags
e5f4534805ce9fa0a183d2329f71bcea4e506d98
Commit Graph

840 Commits

Author SHA1 Message Date
Linoy Tsaban e5f4534805 [training scripts] add tags of diffusers-training (#7206) 
* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add tags for diffusers training

* add dora tags for drambooth lora scripts

* style
 2024-12-23 13:02:08 +05:30
Linoy Tsaban 5b2ab4c269 [advanced dreambooth lora sdxl] add DoRA training feature (#7072) 
* add is_dora arg

* style

* add dora training feature to sd 1.5 script

* added notes about DoRA training

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Sayak Paul 48a9e62978 Update requirements.txt to remove huggingface-cli (#7202) 
Internal message: https://huggingface.slack.com/archives/C03Q18WK18T/p1709529892062479
 2024-12-23 13:02:08 +05:30
Sayak Paul 0c693ca240 Support EDM-style training in DreamBooth LoRA SDXL script (#7126) 
* add: dreambooth lora script for Playground v2.5

* fix: kwarg

* address suraj's comments.

* Apply suggestions from code review

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* apply suraj's suggestion

* incorporate changes in the canonical script./

* tracker naming

* fix: schedule determination

* add: two simple tests

* remove playground script

* note about edm-style training

* address pedro's comments.

* address part of Suraj's comments.

* Apply suggestions from code review

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* remove guidance_scale.

* use mse_loss.

* add comments for preconditioning.

* quality

* Update examples/dreambooth/train_dreambooth_lora_sdxl.py

Co-authored-by: Suraj Patil <surajp815@gmail.com>

* tackle v-pred.

* Empty-Commit

* support edm for sdxl too.

* address suraj's comments.

* Empty-Commit

---------

Co-authored-by: Suraj Patil <surajp815@gmail.com>
 2024-12-23 13:02:08 +05:30
Oleh 58294f94a9 Map speedup (#6745) 
* Speed up dataset mapping

* Fix missing columns

* Remove cache files cleanup

* Update examples/text_to_image/train_text_to_image_sdxl.py

* make style

* Fix code style

* style

* Empty-Commit

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com>
Co-authored-by: Quentin Lhoest <lhoest.q@gmail.com>
 2024-12-23 13:02:08 +05:30
Sayak Paul 64694545de fix: loading problem for sdxl lora dreambooth (#7166) 2024-12-23 13:02:08 +05:30
Quentin Lhoest 5575578b38 Fix vae_encodings_fn hash in train_text_to_image_sdxl.py (#7171) 
Update train_text_to_image_sdxl.py
 2024-12-23 13:02:08 +05:30
YiYi Xu f38417fe30 [ip-adapter] refactor prepare_ip_adapter_image_embeds and skip load image_encoder (#7016) 
* add

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
elucida 14bb45e4e8 refactor: move model helper function in pipeline to a mixin class (#6571) 
* move model helper function in pipeline to EfficiencyMixin

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Sayak Paul 8139fa70c4 fix kwarg in the SDXL LoRA DreamBooth (#7124) 
* fix kwarg

* Empty-Commit
 2024-12-23 13:02:08 +05:30
Sayak Paul 7ccbcb71d4 [Examples] Multiple enhancements to the ControlNet training scripts (#7096) 
* log_validation unification for controlnet.

* additional fixes.

* remove print.

* better reuse and loading

* make final inference run conditional.

* Update examples/controlnet/README_sdxl.md

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

* resize the control image in the snippet.

---------

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 9b15d87fb5 Fix EMA in train_text_to_image_sdxl.py (#7048) 
* Fix typos
 2024-12-23 13:02:08 +05:30
jiqing-feng 862caee47a Resize image before crop (#7095) 
resize first

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Aryan be2e28383a [Community] Bug fix + Latest IP-Adapter impl. for AnimateDiff img2vid/controlnet (#7086) 
* fix img2vid; update to latest ip-adapter impl

* update README

* update animatediff controlnet to latest impl
 2024-12-23 13:02:08 +05:30
Vinh H. Pham 1e6a865d37 Modularize Dreambooth LoRA SDXL inferencing during and after training (#6655) 
* modularize log validation

* run make style

* revert import wandb

* fix code quality & import wandb

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Vinh H. Pham 4ff83c7f4f Modularize Dreambooth LoRA SD inferencing during and after training (#6654) 
* modulize log validation

* run make style and refactor wanddb support

* remove redundant initialization

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:08 +05:30
Aryan 23e6b32139 Fix truthy-ness condition in pipelines that use denoising_start (#6912) 
* fix denoising start

* fix tests

* remove debug
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 302b3c6b79 [Refactor] StableDiffusionReferencePipeline inheriting from DiffusionPipeline (#7071) 
Refactor StableDiffusionReferencePipeline to inherit from DiffusionPipeline rather than StableDiffusionPipeline
 2024-12-23 13:02:08 +05:30
caiyueliang bc9b342fa4 fix: TensorRTStableDiffusionPipeline cannot set guidance_scale (#7065) 2024-12-23 13:02:08 +05:30
Chong-U Lim eba9562560 Fix docstring of community pipeline imagic (#7062) 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz d38521afa2 Fix typos (#7068) 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 1f3ff03c01 [Refactor] save_model_card function in text_to_image examples (#7051) 
* Refactor save_model_card function to handle images and repo_folder parameters

* Discard changes to examples/text_to_image/train_text_to_image.py

* Discard changes to examples/text_to_image/train_text_to_image_lora_sdxl.py

* Update train_text_to_image_lora.py

* Update train_text_to_image_sdxl.py
 2024-12-23 13:02:08 +05:30
Lincoln Stein 2f7c83fefb Update checkpoint_merger pipeline to pass the "variant" argument (#6670) 
* make checkpoint_merger pipeline pass the "variant" argument to from_pretrained()

* make style

---------

Co-authored-by: Lincoln Stein <lstein@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 38c8227fde Fix typos in text_to_image examples (#7050) 
Update copyright information and fix typos in text_to_image examples
 2024-12-23 13:02:08 +05:30
pravdomil 7342038b31 update header (#6596) 
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:08 +05:30
ustcuna 7df14bf40f [Community Pipelines]Accelerate inference of stable diffusion xl (SDXL) by IPEX on CPU (#6683) 
* add stable_diffusion_xl_ipex community pipeline

* make style for code quality check

* update docs as suggested

---------

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2024-12-23 13:02:08 +05:30
Bhavay Malhotra 2f3c3fd6e7 Update textual_inversion.py (#6952) 
* Update textual_inversion.py

* Apply suggestions from code review

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update examples/textual_inversion/textual_inversion.py

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update textual_inversion.py

* styling

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:07 +05:30
Stephen 56637cb949 Standardize model card for textual inversion sdxl (#6963) 
* standardize model card

* fix tags

* correct import styling and update tags

* run make style and make quality

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:07 +05:30
co63oc c8a06e0c20 Fix procecss process (#6591) 
* Fix words

* Fix

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:07 +05:30
Paakhhi 2e90dae0ef Fix diffusers import prompt2prompt (#6927) 
* Bugfix: correct import for diffusers

* Fix: Prompt2Prompt example

* Format style

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:07 +05:30
Linoy Tsaban 8183a770e7 [advanced sdxl lora script] - fix #6967 bug when using prior preservation loss (#6968) 
* fix bug in micro-conditioning of class images

* fix bug in micro-conditioning of class images

* style
 2024-12-23 13:02:07 +05:30
Alex Umnov 9477fa618b Updated lora inference instructions (#6913) 
* Updated lora inference instructions

* Update examples/dreambooth/README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update README.md

* Update README.md

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:07 +05:30
Piyush Thakur 1b885c2d9a [Type annotations] fixed in save_model_card (#6948) 
fixed type annotations

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:07 +05:30
Piyush Thakur 1974ec76a9 [Model Card] standardize T2I Adapter Sdxl model card (#6947) 
standardize model card template t21-adapter-sdxl
 2024-12-23 13:02:07 +05:30
Piyush Thakur 60a8bf7639 [Model Card] standardize T2I Sdxl Lora model card (#6944) 
* standardize model card template t2i-lora-sdxl

* type annotations
 2024-12-23 13:02:07 +05:30
Piyush Thakur 3cc84918d5 [Model Card] standardize T2I Sdxl model card (#6942) 
standardize model card template t2i-sdxl
 2024-12-23 13:02:07 +05:30
Piyush Thakur 6edce9ad71 [Model Card] standardize T2I Lora model card (#6940) 
standardize model card t2i-lora
 2024-12-23 13:02:07 +05:30
Piyush Thakur 40ca5be078 [Model Card] standardize T2I model card (#6939) 
* standardize model card

* fix base_model
 2024-12-23 13:02:07 +05:30
Sayak Paul 166641aefa post release 0.26.2 (#6885) 
* post release

* style

* Empty-Commit

---------

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2024-12-23 13:02:07 +05:30
Bingxin Ke fa4a64ca8d [Community Pipeline][Bug Fix] marigold_depth_estimation: input image value range (#6787) 
[FIX] IMPORTANT: rgb normalization
 2024-12-23 13:02:07 +05:30
camaro 181230a64d Standardize model card for Controlnet (#6910) 
* controlnet

* style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:07 +05:30
Sayak Paul 72d23f5309 correct hub_token exposition behaviour (thanks to @bghira). (#6918) 2024-12-23 13:02:07 +05:30
camaro ecfe845374 Standardize model card for Controlnet SDXL (#6908) 
controlnet-sdxl
 2024-12-23 13:02:07 +05:30
camaro d65f583758 Standardize model card for Controlnet flax (#6909) 
* controlnet-flax

* style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:07 +05:30
C Q 6d7c1c8530 Fix Compatibility Issues in stable_diffusion_xl_reference.py (#6251) 
* Fix Compatibility Issues in stable_diffusion_xl_reference.py

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:07 +05:30
shaoxiaowang 8f4e6538e4 fix examples/community/pipeline_stable_diffusion_xl_instantid.py (#6759) 
Co-authored-by: wangshaoxiao <wangshaoxiao@xiaomi.com>
 2024-12-23 13:02:07 +05:30
Michael 075b63882e Remove <cat-toy> validation prompt from examples/textual_inversion/textual_inversion_sdxl.py (#6877) 
Remove <cat-toy> validation prompt from textual_inversion_sdxl.py

The `<cat-toy>` validation prompt is a default choice for the example task in the README. But no other part of `textual_inversion_sdxl.py` references the cat toy and `textual_inversion.py` has a default validation prompt of `None` as well.

So bring `textual_inversion_sdxl.py` in line with `textual_inversion.py` and change default validation prompt to `None`
 2024-12-23 13:02:07 +05:30
Sayak Paul 86e62ae4c5 change to 2024 in the license (#6902) 
change to 2024
 2024-12-23 13:02:07 +05:30
Srimanth Agastyaraju e37350a03a Fix: training resume from fp16 for SDXL Consistency Distillation (#6840) 
* Fix: training resume from fp16 for lcm distill lora sdxl

* Fix coding quality - run linter

* Fix 1 - shift mixed precision cast before optimizer

* Fix 2 - State dict errors by removing load_lora_into_unet

* Update train_lcm_distill_lora_sdxl.py - Revert default cache dir to None

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:06 +05:30
camaro 14aaf03f7d fix: keyword argument mismatch (#6895) 2024-12-23 13:02:06 +05:30