08a03e1641
post-release v0.27.0 ( #7329 )
...
* post-release
* quality
2024-12-23 13:02:09 +05:30
e272342f3e
Adds docs for gradio.Interface.from_pipeline() ( #7346 )
...
* gradio docs
* Update docs/source/en/api/pipelines/stable_diffusion/overview.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* changes
* changes
* changes
* Update docs/source/en/api/pipelines/stable_diffusion/overview.md
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:09 +05:30
c7c339555c
add edm schedulers in doc ( #7319 )
...
* add edm schedulers in doc
* add in toctree
* address reviewe comments
2024-12-23 13:02:09 +05:30
f08278b391
Add Intro page of TCD ( #7259 )
...
* add tcd intro
* resolve repos
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* revise NFEs related
* change inpainting location
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-12-23 13:02:09 +05:30
87c83dd381
[Pipeline] Add LEDITS++ pipelines ( #6074 )
...
* Setup LEdits++ file structure
* Fix import
* LEditsPP Stable Diffusion pipeline
* Include variable image aspect ratios
* Implement LEDITS++ for SDXL
* clean up LEditsPPPipelineStableDiffusion
* Adjust inversion output
* Added docu, more cleanup for LEditsPPPipelineStableDiffusion
* clean up LEditsPPPipelineStableDiffusionXL
* Update documentation
* Fix documentation import
* Add skeleton IF implementation
* Fix documentation typo
* Add LEDTIS docu to toctree
* Add missing title
* Finalize SD documentation
* Finalize SD-XL documentation
* Fix code style and quality
* Fix typo
* Fix return types
* added LEditsPPPipelineIF; minor changes for LEditsPPPipelineStableDiffusion and LEditsPPPipelineStableDiffusionXL
* Fix copy reference
* add documentation for IF
* Add first tests
* Fix batching for SD-XL
* Fix text encoding and perfect reconstruction for SD-XL
* Add tests for SD-XL, minor changes
* move user_mask to correct device, use cross_attention_kwargs also for inversion
* Example docstring
* Fix attention resolution for non-square images
* Refactoring for PR review
* Safely remove ledits_utils.py
* Style fixes
* Replace assertions with ValueError
* Remove LEditsPPPipelineIF
* Remove unecessary input checks
* Refactoring of CrossAttnProcessor
* Revert unecessary changes to scheduler
* Remove first progress-bar in inversion
* Refactor scheduler usage and reset
* Use imageprocessor instead of custom logic
* Fix scheduler init warning
* Fix error when running the pipeline in fp16
* Update documentation wrt perfect inversion
* Update tests
* Fix code quality and copy consistency
* Update LEditsPP import
* Remove enable/disable methods that are now in StableDiffusionMixin
* Change import in docs
* Revert import structure change
* Fix ledits imports
---------
Co-authored-by: Katharina Kornmeier <katharina.kornmeier@stud.tu-darmstadt.de >
2024-12-23 13:02:09 +05:30
8a422df965
Update Cascade documentation ( #7257 )
...
* updates
* update
* update
* Update docs/source/en/api/pipelines/stable_cascade.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* update
* update
* update
* update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Kashif Rasul <kashif.rasul@gmail.com >
2024-12-23 13:02:09 +05:30
c5c113369b
Adds denoising_end parameter to ControlNetPipeline for SDXL ( #6175 )
...
* Initial commit
* Removed copy hints, as in original SDXLControlNetPipeline
Removed copy hints, as in original SDXLControlNetPipeline, as the `make fix-copies` seems to have issues with the @property decorator.
* Reverted changes to ControlNetXS
* Addendum to: Removed changes to ControlNetXS
* Added test+docs for mixture of denoiser
* Update docs/source/en/using-diffusers/controlnet.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/using-diffusers/controlnet.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-12-23 13:02:09 +05:30
6b2f8109bc
[docs] IP-Adapter image embedding ( #7226 )
...
* update
* fix parameter name
* feedback
* add no mask version
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:09 +05:30
9d10e629af
[docs] Community tips ( #7137 )
...
* tips
* feedback
* callback only
2024-12-23 13:02:08 +05:30
19d9e7d5d9
[docs] Merge LoRAs ( #7213 )
...
* merge loras
* feedback
* torch.compile
* feedback
2024-12-23 13:02:08 +05:30
e5b4915090
Remove the line. Using it create wrong output ( #7075 )
...
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:08 +05:30
48d4cc94b0
[Pipiline] Wuerstchen v3 aka Stable Cascasde pipeline ( #6487 )
...
* initial diffNext v3
* move to v3 folder
* imports
* dry up the unets
* no switch_level
* fix init
* add switch_level tp config
* Fixed some things
* Added pooled text embeddings
* Initial work on adding image encoder
* changes from @dome272
* Stuff for the image encoder processing and variable naming in decoder
* fix arg name
* inference fixes
* inference fixes
* default TimestepBlock without conds
* c_skip=0 by default
* fix bfloat16 to cpu
* use config
* undo temp change
* fix gen_c_embeddings args
* change text encoding
* text encoding
* undo print
* undo .gitignore change
* Allow WuerstchenV3PriorPipeline to use the base DDPM & DDIM schedulers
* use WuerstchenV3Unet in both pipelines
* fix imports
* initial failing tests
* cleanup
* use scheduler.timesterps
* some fixes to the tests, still not fully working
* fix tests
* fix prior tests
* add dropout to the model_kwargs
* more tests passing
* update expected_slice
* initial rename
* rename tests
* rename class names
* make fix-copies
* initial docs
* autodocs
* typos
* fix arg docs
* add text_encoder info
* combined pipeline has optional image arg
* fix documentation
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* use self.config
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* c_in -> in_channels
* removed kwargs from unet's forward
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* remove older callback api
* removed kwargs and fixed decoder guidance > 1
* decoder takes emeds
* check and use image_embeds
* fixed all but one decoder test
* fix decoder tests
* update callback api
* fix some more combined tests
* push combined pipeline
* initial docs
* fix doc_string
* update combined api
* no test_callback_inputs test for combined pipeline
* add optional components
* fix ordering of components
* fix combined tests
* update convert script
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* fix imports
* move effnet out of deniosing loop
* prompt_embeds_pooled only when doing guidance
* Fix repeat shape
* move StableCascadeUnet to models/unets/
* more descriptive names
* converted when numpy()
* StableCascadePriorPipelineOutput docs
* rename StableCascadeUNet
* add slow tests
* fix slow tests
* update
* update
* updated model_path
* add args for weights
* set push_to_hub to false
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
---------
Co-authored-by: Dominic Rampas <d6582533@gmail.com >
Co-authored-by: Pablo Pernias <pablo@pernias.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: 99991 <99991@users.noreply.github.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-12-23 13:02:08 +05:30
6568ee3076
add TCD Scheduler ( #7174 )
...
* add: support TCD scheduler
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:08 +05:30
eb3c60cbde
[Docs] Update callback.md code example ( #7150 )
...
Update callback.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:08 +05:30
06de6e0b0f
Fix typos ( #7181 )
...
* Fix typos
* Fix typos
* Fix typos and update documentation in lora.md
2024-12-23 13:02:08 +05:30
ba756dd5ea
[Docs] more elaborate example for peft torch.compile ( #7161 )
...
more elaborate example for peft torch.compile
2024-12-23 13:02:08 +05:30
f38417fe30
[ip-adapter] refactor prepare_ip_adapter_image_embeds and skip load image_encoder ( #7016 )
...
* add
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:08 +05:30
a3c115949d
[Docs] Fix typos ( #7131 )
...
* Add copyright notice to relevant files and fix typos
* Set `timestep_spacing` parameter of `StableDiffusionXLPipeline`'s scheduler to `'trailing'`.
* Update `StableDiffusionXLPipeline.from_single_file` by including EulerAncestralDiscreteScheduler with `timestep_spacing="trailing"` param.
* Update model loading method in SDXL Turbo documentation
2024-12-23 13:02:08 +05:30
59ed616c16
[Docs] Fix typos ( #7118 )
...
Fix typos, formatting and remove trailing whitespace
2024-12-23 13:02:08 +05:30
d6e432c38a
[docs] Minor updates ( #7063 )
...
* updates
* feedback
2024-12-23 13:02:08 +05:30
85e57454a0
Change images to image. The variable images is not used anywhere ( #7074 )
2024-12-23 13:02:08 +05:30
cae3e45cbb
fix doc example for fom_single_file ( #7015 )
...
* fix doc
* remove use_safetensors from signature
* more
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:08 +05:30
7ec59bb36a
Fix alt text and image links in AnimateLCM docs ( #7029 )
...
update
2024-12-23 13:02:08 +05:30
e1577ca648
Add section on AnimateLCM to docs ( #7024 )
...
* update
* update
* update
2024-12-23 13:02:08 +05:30
98326b5f04
IP-Adapter attention masking ( #6847 )
...
* Add attention masking to attn processors
* Update tensor conversion
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:08 +05:30
374cbcbd42
[docs] Video generation ( #6701 )
...
* first draft
* fix path
* fix path
* i2vgen-xl
* review
* modelscopet2v
* feedback
2024-12-23 13:02:07 +05:30
0535a85d52
[docs] Fix callout ( #6998 )
...
Update ip_adapter.md
2024-12-23 13:02:07 +05:30
e42e3ef1ab
[IP Adapters] feat: allow low_cpu_mem_usage in ip adapter loading ( #6946 )
...
* feat: allow low_cpu_mem_usage in ip adapter loading
* reduce the number of device placements.
* documentation.
* throw low_cpu_mem_usage warning only once from the main entry point.
2024-12-23 13:02:07 +05:30
ceb53a65bd
[docs] IP-Adapter ( #6897 )
...
* use cases
* first draft
* fix image links
* lcm-lora
* feedback
* review
* feedback
* feedback
2024-12-23 13:02:07 +05:30
484c256303
[PEFT / docs] Add a note about torch.compile ( #6864 )
...
* Update using_peft_for_inference.md
* add more explanation
2024-12-23 13:02:07 +05:30
1b6feac509
[docs] Community pipelines ( #6929 )
...
fix
2024-12-23 13:02:07 +05:30
86e62ae4c5
change to 2024 in the license ( #6902 )
...
change to 2024
2024-12-23 13:02:07 +05:30
6d0fe4ea94
fix: typo in callback function name and property ( #6834 )
...
* fix: callback function name is incorrect
On this tutorial there is a function defined and then used inside `callback_on_step_end` argument, but the name was not correct (mismatch)
* fix: typo in num_timestep (correct is num_timesteps)
fixed property name
2024-12-23 13:02:06 +05:30
d44a09475d
Multiple small fixes to Video Pipeline docs ( #6805 )
...
* update
* update
* update
* Update src/diffusers/pipelines/i2vgen_xl/pipeline_i2vgen_xl.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* update
* update
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-12-23 13:02:06 +05:30
804d50ec24
[Feat] add I2VGenXL for image-to-video generation ( #6665 )
...
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-12-23 13:02:06 +05:30
f1e105e664
[IP-Adapter] Support multiple IP-Adapters ( #6573 )
...
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Alvaro Somoza <somoza.alvaro@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-12-23 13:02:06 +05:30
a31ebdc56c
Add PIA Model/Pipeline ( #6698 )
...
* update
* update
* updaet
* add tests and docs
* clean up
* add to toctree
* fix copies
* pr review feedback
* fix copies
* fix tests
* update docs
* update
* update
* update docs
* update
* update
* update
* update
2024-12-23 13:02:06 +05:30
4485d34f2f
add note about serialization ( #6764 )
2024-12-23 13:02:06 +05:30
e0f29a6a85
Update lora.md with a more accurate description of rank ( #6724 )
...
* Update lora.md with a more accurate description of rank
* Update docs/source/en/training/lora.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-12-23 13:02:06 +05:30
7bd61ef799
[Core] move transformer scripts to transformers modules ( #6747 )
...
* move transformer scripts to transformers modules
* move transformer model test
* move prior transformer test to directory
* fix doc path
* correct doc path
* add: __init__.py
2024-12-23 13:02:06 +05:30
6a11a89d76
[docs] AnimateDiff Video-to-Video ( #6712 )
...
* add animatediff vid2vid to docs
* Update docs/source/en/api/pipelines/animatediff.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* apply suggestions from review
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-12-23 13:02:06 +05:30
663019577c
[docs] UViT2D ( #6643 )
...
* uvit2d
* fix
* fix?
* add correct paper
* fix paths
* update abstract
2024-12-23 13:02:06 +05:30
7d3f879501
AnimateDiff Video to Video ( #6328 )
...
* begin animatediff img2video and video2video
* revert animatediff to original implementation
* add img2video as pipeline
* update
* add vid2vid pipeline
* update imports
* update
* remove copied from line for check_inputs
* update
* update examples
* add multi-batch support
* fix __init__.py files
* move img2vid to community
* update community readme and examples
* fix
* make fix-copies
* add vid2vid batch params
* apply suggestions from review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com >
* add test for animatediff vid2vid
* torch.stack -> torch.cat
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com >
* make style
* docs for vid2vid
* update
* fix prepare_latents
* fix docs
* remove img2vid
* update README to :main
* remove slow test
* refactor pipeline output
* update docs
* update docs
* merge community readme from :main
* final fix i promise
* add support for url in animatediff example
* update example
* update callbacks to latest implementation
* Update src/diffusers/pipelines/animatediff/pipeline_animatediff_video2video.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/animatediff/pipeline_animatediff_video2video.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* fix merge
* Apply suggestions from code review
* remove callback and callback_steps as suggested in review
* Update tests/pipelines/animatediff/test_animatediff_video2video.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* fix import error caused due to unet refactor in #6630
* fix numpy import error after tensor2vid refactor in #6626
* make fix-copies
* fix numpy error
* fix progress bar test
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-12-23 13:02:06 +05:30
1e08b1db8b
[Docs] update: tutorials ja | AUTOPIPELINE.md ( #6629 )
...
* add en file
* translate 1-118 lines
* add text
* add toctree
* fix
* fix typo
* fix link
2024-12-23 13:02:06 +05:30
20ecdf6fc3
[Refactor] Update from single file ( #6428 )
...
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update'
* update
* update
* update
* update
* update
* update
* up
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* up
* update
* update
* update
* update
* update'
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* clean
* update
* update
* clean up
* clean up
* update
* clean
* clean
* update
* updaet
* clean up
* fix docs
* update
* update
* Revert "update"
This reverts commit dbfb8f1ea9
2024-12-23 13:02:06 +05:30
48ddd0a803
[Big refactor] move unets to unets module 🦋 ( #6630 )
...
* move unets to module 🦋
* parameterize unet-level import.
* fix flax unet2dcondition model import
* models __init__
* mildly depcrecating models.unet_2d_blocks in favor of models.unets.unet_2d_blocks.
* noqa
* correct depcrecation behaviour
* inherit from the actual classes.
* Empty-Commit
* backwards compatibility for unet_2d.py
* backward compatibility for unet_2d_condition
* bc for unet_1d
* bc for unet_1d_blocks
2024-12-23 13:02:06 +05:30
090a9eb624
[docs] Fix missing API function ( #6604 )
...
fix?
2024-12-23 13:02:06 +05:30
f3e47f4c70
FreeInit ( #6315 )
...
* freeinit
* update freeinit implementation based on review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com >
* fix
* another fix
* refactor
* fix timesteps missing bug
* apply suggestions from review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com >
* add test for freeinit
* apply suggestions from review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com >
* refactor
* fix test
* fix tensor not on same device
* update
* remove return_intermediate_results
* fix broken freeinit test
* update animatediff docs
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-12-23 13:02:06 +05:30
1ac35a457e
Update installation.md ( #6438 )
...
* Update installation.md
* Update installation.md
* Update installation.md
2024-12-23 13:02:06 +05:30
9017578d88
remove omegaconf from the residues 👋 ( #6600 )
...
remove omegaconf 👋
2024-12-23 13:02:06 +05:30
Sayak Paul