Commit Graph

3738 Commits

Author SHA1 Message Date
M. Tolga Cangöz d38521afa2 Fix typos (#7068) 2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 1f3ff03c01 [Refactor] save_model_card function in text_to_image examples (#7051)
* Refactor save_model_card function to handle images and repo_folder parameters

* Discard changes to examples/text_to_image/train_text_to_image.py

* Discard changes to examples/text_to_image/train_text_to_image_lora_sdxl.py

* Update train_text_to_image_lora.py

* Update train_text_to_image_sdxl.py
2024-12-23 13:02:08 +05:30
Aryan 6a64a211dc IPAdapterTesterMixin (#6862)
* begin IPAdapterTesterMixin



---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:08 +05:30
YiYi Xu 1bb51cba84 re-add unet refactor PR (#7044)
* add

* remove copied from

---------

Co-authored-by: ultranity <1095429904@qq.com>
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:08 +05:30
Hezi Zisman 69389ca806 allow explicit tokenizer & text_encoder in unload_textual_inversion (#6977)
* allow passing tokenizer & text_encoder to unload_textual_inversion


---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Fabio Rigano <fabio2rigano@gmail.com>
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com>
2024-12-23 13:02:08 +05:30
Lincoln Stein 2f7c83fefb Update checkpoint_merger pipeline to pass the "variant" argument (#6670)
* make checkpoint_merger pipeline pass the "variant" argument to from_pretrained()

* make style

---------

Co-authored-by: Lincoln Stein <lstein@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:08 +05:30
M. Tolga Cangöz 38c8227fde Fix typos in text_to_image examples (#7050)
Update copyright information and fix typos in text_to_image examples
2024-12-23 13:02:08 +05:30
YiYi Xu cae3e45cbb fix doc example for fom_single_file (#7015)
* fix doc

* remove use_safetensors from signature

* more

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:08 +05:30
pravdomil 7342038b31 update header (#6596)
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
2024-12-23 13:02:08 +05:30
Dhruv Nair 61ba3f9a45 Remove disable_full_determinism from StableVideoDiffusion xformers test. (#7039)
* update

* update
2024-12-23 13:02:08 +05:30
Dhruv Nair 9ce54dbb1e Fix load_model_dict_into_meta for ControlNet from_single_file (#7034)
update
2024-12-23 13:02:08 +05:30
Dhruv Nair dee747c28f Update ControlNet Inpaint single file test (#7022)
update
2024-12-23 13:02:08 +05:30
Dhruv Nair 7ec59bb36a Fix alt text and image links in AnimateLCM docs (#7029)
update
2024-12-23 13:02:08 +05:30
Nontapat Kaewamporn 5923f0a853 Supper IP Adapter weight loading in StableDiffusionXLControlNetInpaintPipeline (#7031)
* support ip adapter loading

* fix style
2024-12-23 13:02:08 +05:30
Vinh H. Pham 3458c15edf IP-Adapter support for StableDiffusionXLControlNetInpaintPipeline (#6941)
* add ip-adapter support

* support ip image embeds

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:08 +05:30
Dhruv Nair e1577ca648 Add section on AnimateLCM to docs (#7024)
* update

* update

* update
2024-12-23 13:02:08 +05:30
ustcuna 7df14bf40f [Community Pipelines]Accelerate inference of stable diffusion xl (SDXL) by IPEX on CPU (#6683)
* add stable_diffusion_xl_ipex community pipeline

* make style for code quality check

* update docs as suggested

---------

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
2024-12-23 13:02:08 +05:30
Dhruv Nair 5b6c05122e [Refactor] FreeInit for AnimateDiff based pipelines (#6874)
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
2024-12-23 13:02:08 +05:30
YiYi Xu 20e36f1d86 [from_single_file] pass torch_dtype to set_module_tensor_to_device (#6994)
fix

Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:08 +05:30
Dhruv Nair 9b9448e55f Fix Pixart Slow Tests (#6962)
* update

* update
2024-12-23 13:02:08 +05:30
Fabio Rigano 98326b5f04 IP-Adapter attention masking (#6847)
* Add attention masking to attn processors

* Update tensor conversion

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:08 +05:30
Sayak Paul d24eaf6046 [IP2P] Make text encoder truly optional in InstructPi2Pix (#6995)
* make text encoder component truly optional.

* more fixes

* Apply suggestions from code review

Co-authored-by: YiYi Xu <yixu310@gmail.com>

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:08 +05:30
nbpppp 886457a6c3 Fix deprecation warning for torch.utils._pytree._register_pytree_node in PyTorch 2.2 (#7008)
Fixed deprecation warning for torch.utils._pytree._register_pytree_node in PyTorch 2.2

Co-authored-by: Yinghua <yzho0423@uni.sydney.edu.au>
2024-12-23 13:02:08 +05:30
YiYi Xu 160f17966a [SVD] fix a bug when passing image as tensor (#6999)
* fix

* update docstring

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:08 +05:30
Mikhail Koltakov f90e8ea064 Fixed typos in dosctrings of __init__() and in forward() of Unet3DConditionModel (#6663)
* Fixed typos in __init__ and in forward of Unet3DConditionModel

* Resolving conflicts

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:07 +05:30
Thomas Lips 3af4447358 Add documentation for strength parameter in Controlnet_img2img pipelines (#6951)
copy docstring for `strength` from  stablediffusion img2img pipeline to controlnet img2img pipelines
2024-12-23 13:02:07 +05:30
Sayak Paul e2b35d0bd0 start depcrecation cycle for lora_attention_proc 👋 (#7007) 2024-12-23 13:02:07 +05:30
Steven Liu 374cbcbd42 [docs] Video generation (#6701)
* first draft

* fix path

* fix path

* i2vgen-xl

* review

* modelscopet2v

* feedback
2024-12-23 13:02:07 +05:30
Steven Liu 0535a85d52 [docs] Fix callout (#6998)
Update ip_adapter.md
2024-12-23 13:02:07 +05:30
Bhavay Malhotra 2f3c3fd6e7 Update textual_inversion.py (#6952)
* Update textual_inversion.py

* Apply suggestions from code review

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update textual_inversion.py

* Update examples/textual_inversion/textual_inversion.py

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update textual_inversion.py

* styling

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
Stephen 56637cb949 Standardize model card for textual inversion sdxl (#6963)
* standardize model card

* fix tags

* correct import styling and update tags

* run make style and make quality

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
co63oc c8a06e0c20 Fix procecss process (#6591)
* Fix words

* Fix

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:07 +05:30
Sayak Paul c60e5cb9e7 add: peft to the benchmark workflow (#6989) 2024-12-23 13:02:07 +05:30
Paakhhi 2e90dae0ef Fix diffusers import prompt2prompt (#6927)
* Bugfix: correct import for diffusers

* Fix: Prompt2Prompt example

* Format style

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:07 +05:30
Sayak Paul e42e3ef1ab [IP Adapters] feat: allow low_cpu_mem_usage in ip adapter loading (#6946)
* feat: allow low_cpu_mem_usage in ip adapter loading

* reduce the number of device placements.

* documentation.

* throw low_cpu_mem_usage warning only once from the main entry point.
2024-12-23 13:02:07 +05:30
Linoy Tsaban 8183a770e7 [advanced sdxl lora script] - fix #6967 bug when using prior preservation loss (#6968)
* fix bug in micro-conditioning of class images

* fix bug in micro-conditioning of class images

* style
2024-12-23 13:02:07 +05:30
YiYi Xu 51005f69e5 fix IPAdapter unload_ip_adapter test (#6972)
add

Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:07 +05:30
Steven Liu ceb53a65bd [docs] IP-Adapter (#6897)
* use cases

* first draft

* fix image links

* lcm-lora

* feedback

* review

* feedback

* feedback
2024-12-23 13:02:07 +05:30
Sayak Paul 0c78d63e55 fix: controlnet inpaint single file. (#6975) 2024-12-23 13:02:07 +05:30
Sayak Paul 56bb13bfa1 [Core] Harmonize single file ckpt model loading (#6971)
* use load_model_into_meta in single file utils

* propagate to autoencoder and controlnet.

* correct class name access behaviour.

* remove torch_dtype from load_model_into_meta; seems unncessary

* remove incorrect kwarg

* style to avoid extra unnecessary line breaks
2024-12-23 13:02:07 +05:30
Younes Belkada 484c256303 [PEFT / docs] Add a note about torch.compile (#6864)
* Update using_peft_for_inference.md

* add more explanation
2024-12-23 13:02:07 +05:30
Dhruv Nair 32c9362976 Allow passing config_file argument to ControlNetModel when using from_single_file (#6959)
* update

* update

* update
2024-12-23 13:02:07 +05:30
Dhruv Nair dda00daf69 Move SDXL T2I Adapter lora test into PEFT workflow (#6965)
update
2024-12-23 13:02:07 +05:30
Dhruv Nair 66568841f4 Fix flaky IP Adapter test (#6960)
update
2024-12-23 13:02:07 +05:30
YiYi Xu f5b20e00a8 [DPMSolverSinglestepScheduler] correct get_order_list for solver_order=2and lower_order_final=True (#6953)
* add

* change default

---------

Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:07 +05:30
Dhruv Nair ddbf9adb47 Fix configuring VAE from single file mixin (#6950)
* update
2024-12-23 13:02:07 +05:30
Alex Umnov 9477fa618b Updated lora inference instructions (#6913)
* Updated lora inference instructions

* Update examples/dreambooth/README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update README.md

* Update README.md

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
Piyush Thakur 1b885c2d9a [Type annotations] fixed in save_model_card (#6948)
fixed type annotations

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:07 +05:30
Steven Liu 1b6feac509 [docs] Community pipelines (#6929)
fix
2024-12-23 13:02:07 +05:30
Sayak Paul f9d2466609 [Diffusers -> Original SD conversion] fix things (#6933)
* fix: bias loading bug

* fixes for SDXL

* apply changes to the conversion script to match single_file_utils.py

* do transpose to match the single file loading logic.
2024-12-23 13:02:07 +05:30