obscura/diffusers
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,708 Commits 711 Branches 93 Tags
dbea93cb143dbb58842f38ae326b6991834b2dec
Commit Graph

315 Commits

Author SHA1 Message Date
Michael Tkachuk a27125d589 Enabling gradient checkpointing in eval() mode (#9878) 
* refactored
 2024-12-23 13:02:17 +05:30
Sookwan Han f546404097 Add new community pipeline for 'Adaptive Mask Inpainting', introduced in [ECCV2024] ComA (#9228) 
* Add new community pipeline for 'Adaptive Mask Inpainting', introduced in [ECCV2024] Beyond the Contact: Discovering Comprehensive Affordance for 3D Objects from Pre-trained 2D Diffusion Models
 2024-12-23 13:02:17 +05:30
Raul Ciotescu 4690db221a adds the pipeline for pixart alpha controlnet (#8857) 
* add the controlnet pipeline for pixart alpha

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: junsongc <cjs1020440147@icloud.com>
 2024-12-23 13:02:17 +05:30
Sayak Paul 23cf712349 post-release 0.31.0 (#9742) 
* post-release

* style
 2024-12-23 13:02:17 +05:30
Tolga Cangöz fdc716ffa6 Fix schedule_shifted_power usage in 🪆Matryoshka Diffusion Models (#9723) 
* [matryoshka.py] Add schedule_shifted_power attribute and update get_schedule_shifted method
 2024-12-23 13:02:17 +05:30
hlky ec6bfdf069 Add prompt scheduling callback to community scripts (#9718) 2024-12-23 13:02:17 +05:30
wony617 453ababb3f [docs] refactoring docstrings in community/hd_painter.py (#9593) 
* [docs] refactoring docstrings in community/hd_painter.py

* Update examples/community/hd_painter.py

Co-authored-by: Aryan <contact.aryanvs@gmail.com>

* make style

---------

Co-authored-by: Aryan <contact.aryanvs@gmail.com>
Co-authored-by: Aryan <aryan@huggingface.co>
 2024-12-23 13:02:17 +05:30
Tolga Cangöz bc2cbfba5d [Community Pipeline] Add 🪆Matryoshka Diffusion Models (#9157) 2024-12-23 13:02:17 +05:30
Ryan Lin 0e332644bc Flux - soft inpainting via differential diffusion (#9268) 
* Flux - soft inpainting via differential diffusion

* .

* track changes to FluxInpaintPipeline

* make mask arrangement simplier

* make style

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com>
Co-authored-by: asomoza <somoza.alvaro@gmail.com>
 2024-12-23 13:02:17 +05:30
M Saqlain 1c038d8104 Add Differential Diffusion to Kolors (#9423) 
* Added diff diff support for kolors img2img

* Fized relative imports

* Fized relative imports

* Added diff diff support for Kolors

* Fized import issues

* Added map

* Fized import issues

* Fixed naming issues

* Added diffdiff support for Kolors img2img pipeline

* Removed example docstrings

* Added map input

* Updated latents

Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com>

* Updated `original_with_noise`

Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com>

* Improved code quality

---------

Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com>
 2024-12-23 13:02:16 +05:30
Sayak Paul d8244b52a9 [Community Pipeline] Batched implementation of Flux with CFG (#9513) 
* batched implementation of flux cfg.

* style.

* readme

* remove comments.
 2024-12-23 13:02:16 +05:30
Anatoly Belikov bef6cfa785 adapt masked im2im pipeline for SDXL (#7790) 
* adapt masked im2im pipeline for SDXL

* usage for masked im2im stable diffusion XL pipeline

* style

* style

* style

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:16 +05:30
Linoy Tsaban 502191f3a6 [Flux with CFG] add flux pipeline with cfg support (#9445) 
* true_cfg

* add check negative prompt/embeds inputs

* move to community pipelines

* move to community pipelines

* revert true cfg changes to the orig pipline

* style

---------

Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:16 +05:30
suzukimain 753f0edff2 [docs] Replace runwayml/stable-diffusion-v1-5 with Lykon/dreamshaper-8 (#9428) 
* [docs] Replace runwayml/stable-diffusion-v1-5 with Lykon/dreamshaper-8

Updated documentation as runwayml/stable-diffusion-v1-5 has been removed from Huggingface.

* Update docs/source/en/using-diffusers/inpaint.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Replace with stable-diffusion-v1-5/stable-diffusion-v1-5

* Update inpaint.md

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:16 +05:30
Álvaro Somoza 275e523ef5 post release 0.30.0 (#9173) 
* post release

* fix quality
 2024-12-23 13:02:15 +05:30
Monjoy Narayan Choudhury a46c3d7f90 Add Differential Diffusion to HunyuanDiT. (#9040) 
* Add Differential Pipeline.

* Fix Styling Issue using ruff -fix

* Add details to Contributing.md

* Revert "Fix Styling Issue using ruff -fix"

This reverts commit d347de162d.

* Revert "Revert "Fix Styling Issue using ruff -fix""

This reverts commit ce7c3ff216.

* Revert README changes

* Restore README.md

* Update README.md

* Resolved Comments:

* Fix Readme based on review

* Fix formatting after make style

---------

Co-authored-by: Aryan <aryan@huggingface.co>
 2024-12-23 13:02:15 +05:30
Tolga Cangöz 51f45da25f Update CLIPFeatureExtractor to CLIPImageProcessor and DPTFeatureExtractor to DPTImageProcessor (#9002) 
* fix: update `CLIPFeatureExtractor` to `CLIPImageProcessor` in codebase

* `make style && make quality`

* Update `DPTFeatureExtractor` to `DPTImageProcessor` in codebase

* `make style`

---------

Co-authored-by: Aryan <aryan@huggingface.co>
 2024-12-23 13:02:15 +05:30
asfiyab-nvidia fce5debd8c Update TensorRT txt2img and inpaint community pipelines (#9037) 
* Update TensorRT txt2img and inpaint community pipelines

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

* update tensorrt install instructions

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

---------

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:15 +05:30
Tolga Cangöz c6ac793955 Errata: Fix typos & \s+$ (#9008) 
* Fix typos

* chore: Fix typos

* chore: Update README.md for promptdiffusion example

* Trim trailing white spaces

* Fix a typo

* update number

* chore: update number

* Trim trailing white space

* Update README.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update README.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2024-12-23 13:02:14 +05:30
Anatoly Belikov c7452308f5 handle lora scale and clip skip in lpw sd and sdxl community pipelines (#8988) 
* handle lora scale and clip skip in lpw sd and sdxl

* use StableDiffusionLoraLoaderMixin

* use StableDiffusionXLLoraLoaderMixin

* style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:14 +05:30
Sayak Paul 6d11129c5a [Chore] add LoraLoaderMixin to the inits (#8981) 
* introduce  to promote reusability.

* up

* add more tests

* up

* remove comments.

* fix fuse_nan test

* clarify the scope of fuse_lora and unfuse_lora

* remove space

* rewrite fuse_lora a bit.

* feedback

* copy over load_lora_into_text_encoder.

* address dhruv's feedback.

* fix-copies

* fix issubclass.

* num_fused_loras

* fix

* fix

* remove mapping

* up

* fix

* style

* fix-copies

* change to SD3TransformerLoRALoadersMixin

* Apply suggestions from code review

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* up

* handle wuerstchen

* up

* move lora to lora_pipeline.py

* up

* fix-copies

* fix documentation.

* comment set_adapters().

* fix-copies

* fix set_adapters() at the model level.

* fix?

* fix

* loraloadermixin.

---------

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-23 13:02:14 +05:30
YiYi Xu a754d9071e Revert "[LoRA] introduce LoraBaseMixin to promote reusability." (#8976) 
Revert "[LoRA] introduce LoraBaseMixin to promote reusability. (#8774)"

This reverts commit 527430d0a4.
 2024-12-23 13:02:14 +05:30
asfiyab-nvidia d1e1676b9d Update TensorRT img2img community pipeline (#8899) 
* Update TensorRT img2img pipeline

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

* Update TensorRT version installed

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

* make style and quality

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

* Update examples/community/stable_diffusion_tensorrt_img2img.py

Co-authored-by: Tolga Cangöz <46008593+tolgacangoz@users.noreply.github.com>

* Update examples/community/README.md

Co-authored-by: Tolga Cangöz <46008593+tolgacangoz@users.noreply.github.com>

* Apply style and quality using ruff 0.1.5

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

---------

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>
Co-authored-by: Tolga Cangöz <46008593+tolgacangoz@users.noreply.github.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-23 13:02:14 +05:30
Sayak Paul 82b37a4cc3 [LoRA] introduce LoraBaseMixin to promote reusability. (#8774) 
* introduce  to promote reusability.

* up

* add more tests

* up

* remove comments.

* fix fuse_nan test

* clarify the scope of fuse_lora and unfuse_lora

* remove space

* rewrite fuse_lora a bit.

* feedback

* copy over load_lora_into_text_encoder.

* address dhruv's feedback.

* fix-copies

* fix issubclass.

* num_fused_loras

* fix

* fix

* remove mapping

* up

* fix

* style

* fix-copies

* change to SD3TransformerLoRALoadersMixin

* Apply suggestions from code review

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* up

* handle wuerstchen

* up

* move lora to lora_pipeline.py

* up

* fix-copies

* fix documentation.

* comment set_adapters().

* fix-copies

* fix set_adapters() at the model level.

* fix?

* fix

---------

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
 2024-12-23 13:02:14 +05:30
Sayak Paul 11307ce964 [Core] remove resume_download from Hub related stuff (#8648) 
* remove resume_download

* fix: _fetch_index_file call.

* remove resume_download from docs.
 2024-12-23 13:02:14 +05:30
ustcuna 82a13745a0 [Community Pipelines] Accelerate inference of AnimateDiff by IPEX on CPU (#8643) 
* add animatediff_ipex community pipeline

* address the 1st round review comments
 2024-12-23 13:02:14 +05:30
Tolga Cangöz 8e64c7f9a5 Remove unnecessary lines (#8569) 
* Remove unused line


---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:14 +05:30
Álvaro Somoza 29884169ad [Community pipeline] SD3 Differential Diffusion Img2Img Pipeline (#8679) 
* new pipeline
 2024-12-23 13:02:13 +05:30
Tolga Cangöz 58496f6ab4 Errata - Update class method convention to use cls (#8574) 
* Class methods are supposed to use `cls` conventionally

* `make style && make quality`

* An Empty commit

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:13 +05:30
Tolga Cangöz f6172748c6 Errata - Fix typos and improve style (#8571) 
* Fix typos

* Fix typos & up style

* chore: Update numbers

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:13 +05:30
Tolga Cangöz 1ced1c40d8 Discourage using deprecated revision parameter (#8573) 
* Discourage using `revision`

* `make style && make quality`

* Refactor code to use 'variant' instead of 'revision'

* `revision="bf16"` -> `variant="bf16"`

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:13 +05:30
Tolga Cangöz 2c56360222 Errata - Trim trailing white space in the whole repo (#8575) 
* Trim all the trailing white space in the whole repo

* Remove unnecessary empty places

* make style && make quality

* Trim trailing white space

* trim

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:13 +05:30
Tolga Cangöz c20d0ec72d Errata - Fix typos & improve contributing page (#8572) 
* Fix typos & improve contributing page

* `make style && make quality`

* fix typos

* Fix typo

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:13 +05:30
Sayak Paul 22ebb0ab89 [LoRA] get rid of the legacy lora remnants and make our codebase lighter (#8623) 
* get rid of the legacy lora remnants and make our codebase lighter

* fix depcrecated lora argument

* fix

* empty commit to trigger ci

* remove print

* empty
 2024-12-23 13:02:13 +05:30
Sayak Paul bcf0f7667f post release 0.29.0 (#8492) 
post release
 2024-12-23 13:02:13 +05:30
Tolga Cangöz d027cb4326 Errata (#8322) 
* Fix typos

* Trim trailing whitespaces

* Remove a trailing whitespace

* chore: Update MarigoldDepthPipeline checkpoint to prs-eth/marigold-lcm-v1-0

* Revert "chore: Update MarigoldDepthPipeline checkpoint to prs-eth/marigold-lcm-v1-0"

This reverts commit fd742b30b4.

* pokemon -> naruto

* `DPMSolverMultistep` -> `DPMSolverMultistepScheduler`

* Improve Markdown stylization

* Improve style

* Improve style

* Refactor pipeline variable names for consistency

* up style
 2024-12-23 13:02:12 +05:30
Tolga Cangöz b2abd9e371 Fix Copying Mechanism typo/bug (#8232) 
* Fix copying mechanism typos

* fix copying mecha

* Revert, since they are in TODO

* Fix copying mechanism
 2024-12-23 13:02:12 +05:30
Sayak Paul e135b4dadf post release v0.28.0 (#8286) 
* post release v0.28.0

* style
 2024-12-23 13:02:12 +05:30
Sajad Norouzi b52b0d247e Add Kohya fix to SD pipeline for high resolution generation (#7633) 
add kohya high resolution fix.
 2024-12-23 13:02:12 +05:30
Tolga Cangöz d8d7a0e307 Fix CPU Offloading Usage & Typos (#8230) 
* Fix typos

* Fix `pipe.enable_model_cpu_offload()` usage

* Fix cpu offloading

* Update numbers
 2024-12-23 13:02:12 +05:30
Tolga Cangöz c69aff7798 Fix a grammatical error in the raise messages (#8272) 
Fix grammatical error
 2024-12-23 13:02:12 +05:30
Yifan Zhou ae1fb33d4c [Community Pipeline] FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation (#8239) 
* code and doc

* update paper link

* remove redundant codes

* add example video

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:12 +05:30
Sai-Suraj-27 2f6b1ecde2 fix: Fixed few docstrings according to the Google Style Guide (#7717) 
Fixed few docstrings according to the Google Style Guide.
 2024-12-23 13:02:12 +05:30
Sai-Suraj-27 ce6503f1d8 refactor: Refactored code by Merging isinstance calls (#7710) 
* Merged isinstance calls to make the code simpler.

* Corrected formatting errors using ruff.

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
 2024-12-23 13:02:11 +05:30
Jingyang Zhang 7ae28c17ef [Pipeline] Adding BoxDiff to community examples (#7947) 
add boxdiff to community examples
 2024-12-23 13:02:11 +05:30
Mark Van Aken 2243c67f09 #7535 Update FloatTensor type hints to Tensor (#7883) 
* find & replace all FloatTensors to Tensor

* apply formatting

* Update torch.FloatTensor to torch.Tensor in the remaining files

* formatting

* Fix the rest of the places where FloatTensor is used as well as in documentation

* formatting

* Update new file from FloatTensor to Tensor
 2024-12-23 13:02:11 +05:30
Tolga Cangöz 01d03e3020 Remove dead code and fix f-string issue (#7720) 
* Remove dead code

* PylancereportGeneralTypeIssues: Strings nested within an f-string cannot use the same quote character as the f-string prior to Python 3.12.

* Remove dead code
 2024-12-23 13:02:11 +05:30
Hyoungwon Cho ee1b41e1fe Modification on the PAG community pipeline (re) (#7876) 
* edited_pag_implementation

* update

---------

Co-authored-by: yiyixuxu <yixu310@gmail.com>
 2024-12-23 13:02:11 +05:30
YiYi Xu e560f7a6b8 update the logic of is_sequential_cpu_offload (#7788) 
* up

* add comment to the tests + fix dit

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
 2024-12-23 13:02:11 +05:30
Nilesh 9388258704 Check for latents, before calling prepare_latents - sdxlImg2Img (#7582) 
* Check for latents, before calling prepare_latents - sdxlImg2Img

* Added latents check for all the img2img pipeline

* Fixed silly mistake while checking latents as None
 2024-12-23 13:02:11 +05:30