d5389bdd71
Merge branch 'main' into cnet-union-multiple-fixes
2025-07-10 14:19:37 -04:00
1c6ab9e900
[utils] account for MPS when available in get_device(). ( #11905 )
...
* account for MPS when available in get_device().
* fix
2025-07-10 13:30:54 +05:30
265840a098
[LoRA] fix: disabling hooks when loading loras. ( #11896 )
...
fix: disabling hooks when loading loras.
2025-07-10 10:30:10 +05:30
9f4d997d8f
Bump torch from 2.4.1 to 2.7.0 in /examples/server ( #11429 )
...
Bumps [torch](https://github.com/pytorch/pytorch ) from 2.4.1 to 2.7.0.
- [Release notes](https://github.com/pytorch/pytorch/releases )
- [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md )
- [Commits](https://github.com/pytorch/pytorch/compare/v2.4.1...v2.7.0 )
---
updated-dependencies:
- dependency-name: torch
dependency-version: 2.7.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2025-07-10 09:24:10 +05:30
b41abb2230
[quant] QoL improvements for pipeline-level quant config ( #11876 )
...
* add repr for pipelinequantconfig.
* update
2025-07-10 08:53:01 +05:30
f33b89bafb
The Modular Diffusers ( #9672 )
...
adding modular diffusers as experimental feature
---------
Co-authored-by: hlky <hlky@hlky.ac >
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
Co-authored-by: Aryan <aryan@huggingface.co >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-07-09 16:00:28 -10:00
c99f9c1799
Merge branch 'main' into cnet-union-multiple-fixes
2025-07-09 14:32:53 -04:00
48a6d29550
[SD3] CFG Cutoff fix and official callback ( #11890 )
...
fix and official callback
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2025-07-09 14:31:11 -04:00
2d3d376bc0
Fix unique memory address when doing group-offloading with disk ( #11767 )
...
* fix memory address problem
* add more tests
* updates
* updates
* update
* _group_id = group_id
* update
* Apply suggestions from code review
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
* update
* update
* update
* fix
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2025-07-09 21:29:34 +05:30
db715e2c8c
feat: add multiple input image support in Flux Kontext ( #11880 )
...
* feat: add multiple input image support in Flux Kontext
* move model to community
* fix linter
2025-07-09 11:09:59 -04:00
754fe85cac
[tests] add compile + offload tests for GGUF. ( #11740 )
...
* add compile + offload tests for GGUF.
* quality
* add init.
* prop.
* change to flux.
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2025-07-09 13:42:13 +05:30
cc1f9a2ce3
[tests] mark the wanvace lora tester flaky ( #11883 )
...
* mark wanvace lora tests as flaky
* ability to apply is_flaky at a class-level
* update
* increase max_attempt.
* increase attemtp.
2025-07-09 13:27:15 +05:30
737d7fc3b0
[tests] Remove more deprecated tests ( #11895 )
...
* remove k diffusion tests
* remove script
2025-07-09 13:10:44 +05:30
be23f7df00
[Docker] update doc builder dockerfile to include quant libs. ( #11728 )
...
update doc builder dockerfile to include quant libs.
2025-07-09 12:27:22 +05:30
86becea77f
Pin k-diffusion for CI ( #11894 )
...
* remove k-diffusion as we don't use it from the core.
* Revert "remove k-diffusion as we don't use it from the core."
This reverts commit 8bc86925a0
2025-07-09 12:17:45 +05:30
7e3bf4aff6
[CI] Speed up GPU PR Tests ( #11887 )
...
update
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-07-09 11:00:23 +05:30
de043c6044
Update chroma.md ( #11891 )
...
Fix typo in Inference example code
2025-07-09 09:58:38 +05:30
4c20624cc6
[tests] annotate compilation test classes with bnb ( #11715 )
...
annotate compilation test classes with bnb
2025-07-09 09:24:52 +05:30
0454fbb30b
First Block Cache ( #11180 )
...
* update
* modify flux single blocks to make compatible with cache techniques (without too much model-specific intrusion code)
* remove debug logs
* update
* cache context for different batches of data
* fix hs residual bug for single return outputs; support ltx
* fix controlnet flux
* support flux, ltx i2v, ltx condition
* update
* update
* Update docs/source/en/api/cache.md
* Update src/diffusers/hooks/hooks.py
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
* address review comments pt. 1
* address review comments pt. 2
* cache context refacotr; address review pt. 3
* address review comments
* metadata registration with decorators instead of centralized
* support cogvideox
* support mochi
* fix
* remove unused function
* remove central registry based on review
* update
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2025-07-09 03:27:15 +05:30
e797122f64
fixes
2025-07-08 14:15:52 -04:00
cbc8ced20f
[CI] Fix big GPU test marker ( #11786 )
...
* update
* update
2025-07-08 22:09:09 +05:30
01240fecb0
[training ] add Kontext i2i training ( #11858 )
...
* feat: enable i2i fine-tuning in Kontext script.
* readme
* more checks.
* Apply suggestions from code review
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
* fixes
* fix
* add proj_mlp to the mix
* Update README_flux.md
add note on installing from commit `05e7a854d0a5661f5b433f6dd5954c224b104f0b`
* fix
* fix
---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2025-07-08 21:04:16 +05:30
ce338d4e4a
[docs] LoRA metadata ( #11848 )
...
* draft
* hub image
* update
* fix
2025-07-08 08:29:38 -07:00
bc55b631fd
[tests] remove tests for deprecated pipelines. ( #11879 )
...
* remove tests for deprecated pipelines.
* remove folders
* test_pipelines_common
2025-07-08 07:13:16 +05:30
15d50f16f2
[docs] fix references in flux pipelines. ( #11857 )
...
* fix references in flux.
* Update src/diffusers/pipelines/flux/pipeline_flux_kontext.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-07-07 22:20:34 +05:30
2c30287958
[chore] deprecate blip controlnet pipeline. ( #11877 )
...
* deprecate blip controlnet pipeline.
* last_supported_version
2025-07-07 13:25:40 +05:30
425a715e35
Fix Wan AccVideo/CausVid fuse_lora ( #11856 )
...
* fix
* actually, better fix
* empty commit; trigger tests again
* mark wanvace test as flaky
2025-07-04 21:10:35 +05:30
2527917528
FIX set_lora_device when target layers differ ( #11844 )
...
* FIX set_lora_device when target layers differ
Resolves #11833
Fixes a bug that occurs after calling set_lora_device when multiple LoRA
adapters are loaded that target different layers.
Note: Technically, the accompanying test does not require a GPU because
the bug is triggered even if the parameters are already on the
corresponding device, i.e. loading on CPU and then changing the device
to CPU is sufficient to cause the bug. However, this may be optimized
away in the future, so I decided to test with GPU.
* Update docstring to warn about device mismatch
* Extend docstring with an example
* Fix docstring
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-07-04 19:26:17 +05:30
e6639fef70
[benchmarks] overhaul benchmarks ( #11565 )
...
* start overhauling the benchmarking suite.
* fixes
* fixes
* checking.
* checking
* fixes.
* error handling and logging.
* add flops and params.
* add more models.
* utility to fire execution of all benchmarking scripts.
* utility to push to the hub.
* push utility improvement
* seems to be working.
* okay
* add torchprofile dep.
* remove total gpu memory
* fixes
* fix
* need a big gpu
* better
* what's happening.
* okay
* separate requirements and make it nightly.
* add db population script.
* update secret name
* update secret.
* population db update
* disable db population for now.
* change to every monday
* Update .github/workflows/benchmark.yml
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
* quality improvements.
* reparate hub upload step.
* repository
* remove csv
* check
* update
* update
* threading.
* update
* update
* updaye
* update
* update
* update
* remove peft dep
* upgrade runner.
* fix
* fixes
* fix merging csvs.
* push dataset to the Space repo for analysis.
* warm up.
* add a readme
* Apply suggestions from code review
Co-authored-by: Luc Georges <McPatate@users.noreply.github.com >
* address feedback
* Apply suggestions from code review
* disable db workflow.
* update to bi weekly.
* enable population
* enable
* updaye
* update
* metadata
* fix
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: Luc Georges <McPatate@users.noreply.github.com >
2025-07-04 11:04:17 +05:30
8c938fb410
[docs] Add a note of _keep_in_fp32_modules ( #11851 )
...
* update
* Update docs/source/en/using-diffusers/schedulers.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update schedulers.md
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-07-02 15:51:57 -07:00
f864a9a352
[Flux Kontext] Support Fal Kontext LoRA ( #11823 )
...
* initial commit
* initial commit
* initial commit
* fix import
* fix prefix
* remove print
* Apply style fixes
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-02 16:57:08 +03:00
d6fa3298fa
update: FluxKontextInpaintPipeline support ( #11820 )
...
* update: FluxKontextInpaintPipeline support
* fix: Refactor code, remove mask_image_latents and ruff check
* feat: Add test case and fix with pytest
* Apply style fixes
* copies
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-01 23:34:27 -10:00
6f1d6694df
[lora] tests for exclude_modules with Wan VACE ( #11843 )
...
* wan vace.
* update
* update
* import problem
2025-07-02 14:23:26 +05:30
0e95aa853e
[From Single File] support from_single_file method for WanVACE3DTransformer ( #11807 )
...
* add `WandVACETransformer3DModel` in`SINGLE_FILE_LOADABLE_CLASSES`
* add rename keys for `VACE`
add rename keys for `VACE`
* fix typo
Sincere thanks to @nitinmukesh 🙇♂️
* support for `1.3B VACE` model
Sincere thanks to @nitinmukesh again🙇♂️
* update
* update
* Apply style fixes
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-02 05:55:36 +02:00
5ef74fd5f6
fix norm not training in train_control_lora_flux.py ( #11832 )
2025-07-01 17:37:54 -10:00
64a9210315
[docs] Deprecated pipelines ( #11838 )
...
add warning
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-07-01 14:02:54 -10:00
d31b8cea3e
[docs] Batch generation ( #11841 )
...
* draft
* fix
* fix
* feedback
* feedback
2025-07-01 17:00:20 -07:00
62e847db5f
Use real-valued instead of complex tensors in Wan2.1 RoPE ( #11649 )
...
* use real instead of complex tensors in Wan2.1 RoPE
* remove the redundant type conversion
* unpack rotary_emb
* register rotary embedding frequencies as non-persistent buffers
* Apply style fixes
---------
Co-authored-by: Aryan <aryan@huggingface.co >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-01 13:57:19 -10:00
470458623e
[docs] fix single_file example. ( #11847 )
...
fix single_file example.
2025-07-01 21:23:27 +05:30
a79c3af6bb
[single file] Cosmos ( #11801 )
...
* update
* update
* update docs
2025-07-01 18:02:58 +05:30
3f3f0c16a6
[tests] Fix failing float16 cuda tests ( #11835 )
...
* update
* update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-07-01 11:13:58 +05:30
f3e1310469
reset deterministic in tearDownClass ( #11785 )
...
* reset deterministic in tearDownClass
Signed-off-by: jiqing-feng <jiqing.feng@intel.com >
* fix deterministic setting
Signed-off-by: jiqing-feng <jiqing.feng@intel.com >
---------
Signed-off-by: jiqing-feng <jiqing.feng@intel.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-07-01 10:06:54 +05:30
87f83d3dd9
[tests] add test for hotswapping + compilation on resolution changes ( #11825 )
...
* add resolution changes tests to hotswapping test suite.
* fixes
* docs
* explain duck shapes
* fix
2025-07-01 09:40:34 +05:30
f064b3bf73
Remove print statement in SCM Scheduler ( #11836 )
...
remove print
2025-06-30 09:07:34 -10:00
3b079ec3fa
ENH: Improve speed of function expanding LoRA scales ( #11834 )
...
* ENH Improve speed of expanding LoRA scales
Resolves #11816
The following call proved to be a bottleneck when setting a lot of LoRA
adapters in diffusers:
https://github.com/huggingface/diffusers/blob/cdaf84a708eadf17d731657f4be3fa39d09a12c0/src/diffusers/loaders/peft.py#L482
This is because we would repeatedly call unet.state_dict(), even though
in the standard case, it is not necessary:
https://github.com/huggingface/diffusers/blob/cdaf84a708eadf17d731657f4be3fa39d09a12c0/src/diffusers/loaders/unet_loader_utils.py#L55
This PR fixes this by deferring this call, so that it is only run when
it's necessary, not earlier.
* Small fix
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-06-30 20:25:56 +05:30
bc34fa8386
[lora]feat: use exclude modules to loraconfig. ( #11806 )
...
* feat: use exclude modules to loraconfig.
* version-guard.
* tests and version guard.
* remove print.
* describe the test
* more detailed warning message + shift to debug
* update
* update
* update
* remove test
2025-06-30 20:08:53 +05:30
05e7a854d0
[lora] fix: lora unloading behvaiour ( #11822 )
...
* fix: lora unloading behvaiour
* fix
* update
2025-06-28 12:00:42 +05:30
76ec3d1fee
Support dynamically loading/unloading loras with group offloading ( #11804 )
...
* update
* add test
* address review comments
* update
* fixes
* change decorator order to fix tests
* try fix
* fight tests
2025-06-27 23:20:53 +05:30
cdaf84a708
TorchAO compile + offloading tests ( #11697 )
...
* update
* update
* update
* update
* update
* user property instead
2025-06-27 18:31:57 +05:30
e8e44a510c
[CI] disable onnx, mps, flax from the CI ( #11803 )
...
* disable onnx, mps, flax
* remove
2025-06-27 16:33:43 +05:30
Álvaro Somoza