db083310a3
[Fix bugs] pipeline_controlnet_sd_xl.py ( #6653 )
...
* Update pipeline_controlnet_sd_xl.py
* Update pipeline_controlnet_xs_sd_xl.py
2024-12-23 13:02:06 +05:30
1e08b1db8b
[Docs] update: tutorials ja | AUTOPIPELINE.md ( #6629 )
...
* add en file
* translate 1-118 lines
* add text
* add toctree
* fix
* fix typo
* fix link
2024-12-23 13:02:06 +05:30
b7bd63948f
Add InstantID Pipeline ( #6673 )
...
* add instantid pipeline
* format
* Update README.md
* Update README.md
* format
---------
Co-authored-by: ResearcherXman <xhs.research@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:06 +05:30
ba2c39edf6
[WIP][Community Pipeline] InstaFlow! One-Step Stable Diffusion with Rectified Flow ( #6057 )
...
* Add instaflow community pipeline
* Make styling fixes
* Add lora
* Fix formatting
* Add docs
* Update README.md
* Update README.md
* Remove do LORA
* Update readme
* Update README.md
* Update README.md
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-12-23 13:02:06 +05:30
20ecdf6fc3
[Refactor] Update from single file ( #6428 )
...
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update'
* update
* update
* update
* update
* update
* update
* up
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* up
* update
* update
* update
* update
* update'
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* clean
* update
* update
* clean up
* clean up
* update
* clean
* clean
* update
* updaet
* clean up
* fix docs
* update
* update
* Revert "update"
This reverts commit dbfb8f1ea9
2024-12-23 13:02:06 +05:30
82dbf31d26
[Tests] Test for passing local config file to from_single_file() ( #6638 )
...
make config file local too.
2024-12-23 13:02:06 +05:30
22f5685191
fix dpm related slow test failure ( #6680 )
...
fix
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:06 +05:30
09a7514576
Standardise outputs for video pipelines ( #6626 )
...
* update
* update
* update
* update
* update
* update
* update
* clean up
* clean up
2024-12-23 13:02:06 +05:30
48ddd0a803
[Big refactor] move unets to unets module 🦋 ( #6630 )
...
* move unets to module 🦋
* parameterize unet-level import.
* fix flax unet2dcondition model import
* models __init__
* mildly depcrecating models.unet_2d_blocks in favor of models.unets.unet_2d_blocks.
* noqa
* correct depcrecation behaviour
* inherit from the actual classes.
* Empty-Commit
* backwards compatibility for unet_2d.py
* backward compatibility for unet_2d_condition
* bc for unet_1d
* bc for unet_1d_blocks
2024-12-23 13:02:06 +05:30
8e9e82fe50
Update README ( #6669 )
...
Update number of checkpoints and repositories in README
2024-12-23 13:02:06 +05:30
4dff5f38b0
[Diffusion DPO] apply fixes from #6547 ( #6668 )
...
apply fixes from #6547
2024-12-23 13:02:06 +05:30
3c2a82134e
Add tearDown method to LoRA tests. ( #6660 )
...
* update
* update
2024-12-23 13:02:06 +05:30
5fcaa8ca04
add Sa-Solver ( #5975 )
...
* add Sa-Solver
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: scxue <xueshuchen17@mails.ucas.edu.cn >
Co-authored-by: jschen <chenjunsong4@h-partners.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:06 +05:30
cbccc0ec05
add padding_mask_crop to all inpaint pipelines ( #6360 )
...
* add padding_mask_crop
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-12-23 13:02:06 +05:30
7346713291
fix SDXL-kdiffusion tests ( #6647 )
...
🤞 🤞 🤞
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-12-23 13:02:06 +05:30
dc2ee6b0a9
fix DPM Scheduler with use_karras_sigmas option ( #6477 )
...
* fix
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-12-23 13:02:06 +05:30
a7fceba379
Fixed the bug related to saving DeepSpeed models. ( #6628 )
...
* Fixed the bug related to saving DeepSpeed models.
* Add information about training SD models using DeepSpeed to the README.
* Apply suggestions from code review
---------
Co-authored-by: mhh001 <mahonghao1@huawei.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:06 +05:30
b497302b2f
Modularize InstructPix2Pix SDXL inferencing during and after training in examples ( #6569 )
2024-12-23 13:02:06 +05:30
9e8af9db16
refactor: extract init/forward function in UNet2DConditionModel ( #6478 )
...
* - extract function for stage in UNet2DConditionModel init & forward
- Add new function get_mid_block() to unet_2d_blocks.py
* add type hint to get_mid_block aligned with get_up_block and get_down_block; rename _set_xxx function
* add type hint and use keyword arguments
* remove `copy from` in versatile diffusion
2024-12-23 13:02:06 +05:30
efbbe672b1
[Community] Experimental AnimateDiff Image to Video (open to improvements) ( #6509 )
...
* add animatediff img2vid
* fix
* Update examples/community/README.md
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* fix code snippet between ip adapter face id and animatediff img2vid
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-12-23 13:02:06 +05:30
41ae722e90
Update convert_from_ckpt.py / read checkpoint config yaml contents ( #6633 )
...
Update convert_from_ckpt.py / read config yaml contents
Added missing reading of config yaml file contents
2024-12-23 13:02:06 +05:30
8e81b025c4
Fix failing tests due to Posix Path ( #6627 )
...
update
2024-12-23 13:02:06 +05:30
090a9eb624
[docs] Fix missing API function ( #6604 )
...
fix?
2024-12-23 13:02:06 +05:30
08080a85c7
[bug fix] advanced dreambooth lora sdxl - fixes bugs described in #6486 ( #6599 )
...
* fixes bugs:
1. redundant retraction
2. param clone
3. stopping optimization of text encoder params
* param upscaling
* style
2024-12-23 13:02:06 +05:30
a366a8dcdb
Update pr_test_peft_backend.yml to use 1 process for testing ( #6613 )
2024-12-23 13:02:06 +05:30
f3e47f4c70
FreeInit ( #6315 )
...
* freeinit
* update freeinit implementation based on review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com >
* fix
* another fix
* refactor
* fix timesteps missing bug
* apply suggestions from review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com >
* add test for freeinit
* apply suggestions from review
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com >
* refactor
* fix test
* fix tensor not on same device
* update
* remove return_intermediate_results
* fix broken freeinit test
* update animatediff docs
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-12-23 13:02:06 +05:30
5f3585a1a8
Fixes torch.compile() compatible training ( #6589 )
...
resolve conflicts
2024-12-23 13:02:06 +05:30
1ac35a457e
Update installation.md ( #6438 )
...
* Update installation.md
* Update installation.md
* Update installation.md
2024-12-23 13:02:06 +05:30
9ff776cff6
[Fix] Multiple image conditionings in a single batch for StableDiffusionControlNetPipeline ( #6334 )
...
* [Fix] Multiple image conditionings in a single batch for `StableDiffusionControlNetPipeline`.
* Refactor `check_inputs` in `StableDiffusionControlNetPipeline` to avoid redundant codes.
* Make the behavior of MultiControlNetModel to be the same to the original ControlNetModel
* Keep the code change minimum for nested list support
* Add fast test `test_inference_nested_image_input`
* Remove redundant check for nested image condition in `check_inputs`
Remove `len(image) == len(prompt)` check out of `check_image()`
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Better `ValueError` message for incompatible nested image list size
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Fix syntax error in `check_inputs`
* Remove warning message for multi-ControlNets with multiple prompts
* Fix a typo in test_controlnet.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Add test case for multiple prompts, single image conditioning in `StableDiffusionMultiControlNetPipelineFastTests`
* Improved `ValueError` message for nested `controlnet_conditioning_scale`
* Documenting the behavior of image list as `StableDiffusionControlNetPipeline` input
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-12-23 13:02:06 +05:30
9017578d88
remove omegaconf from the residues 👋 ( #6600 )
...
remove omegaconf 👋
2024-12-23 13:02:06 +05:30
c9ffa6cd90
Change in ip-adapter docs. CLIPVisionModelWithProjection should be im… ( #6597 )
...
Change in ip-adapter docs. CLIPVisionModelWithProjection should be imported from transformers, not diffusers
2024-12-23 13:02:06 +05:30
f6eb3d1a41
[SVD] Return np.ndarray when output_type="np" ( #6507 )
...
[SVD] Fix output_type="np"
2024-12-23 13:02:06 +05:30
b74ce41004
Fixes training resuming: Advanced Dreambooth LoRa Training ( #6566 )
...
* Fixes #6418 Advanced Dreambooth LoRa Training
* change order of import to fix nit
* fix nit, use cast_training_params
* remove torch.compile fix, will move to a new PR
* remove unnecessary import
2024-12-23 13:02:06 +05:30
9144ed9335
Use of Posix to better support Windows compatibility in testing_utils ( #6587 )
...
* changes in utils
* removed loc
2024-12-23 13:02:06 +05:30
12a87c273c
change to posix for better Windows support for lora loaders ( #6590 )
...
* posix lora
* changes and style fix
2024-12-23 13:02:05 +05:30
88d23edabe
Fix path generation in IP Adapter ( #6564 )
...
* Fix path generation on Windows
* Update set_default_attn_processors
* Use pathlib
* Fix quality
* Fix copy
* Revert changes in set_default_attn_processors
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:05 +05:30
4075c49087
update slow test for SDXL k-diffusion pipeline ( #6588 )
...
update expected slice
2024-12-23 13:02:05 +05:30
f8b5cfd0a1
🐛 fix ip-adapter controlnet img2img missing code ( #6528 )
...
* 🐛 fix ip-adapter controlnet img2img missing code
* 📝 edit test
* 📝 edit test
* 📝 run make style and quality
* 🎨 remove slow tests
2024-12-23 13:02:05 +05:30
766a1d2802
Enable image resizing to adjust its height and width in StableDiffusionXLInstructPix2PixPipeline ( #6581 )
...
* Enable image resizing to adjust its height and width in StableDiffusionXLInstructPix2PixPipeline
* Ensure that validation is performed at every 'validation_step', not at every step
2024-12-23 13:02:05 +05:30
4e8b2b3b71
[training] fix training resuming problem for fp16 (SD LoRA DreamBooth) ( #6554 )
...
* fix training resume
* update
* update
2024-12-23 13:02:05 +05:30
3654809062
[Docs] Fix controlnet indent ( #6578 )
2024-12-23 13:02:05 +05:30
fb5bc6539b
[Community Pipeline] IPAdapter FaceID ( #6276 )
...
* Add support for IPAdapter FaceID
* Add docs
* Move subfolder to kwargs
* Fix quality
* Fix image encoder loading
* Fix loading + add test
* Move to community folder
* Fix style
* Revert constant update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:05 +05:30
a4f13da91e
[AnimateDiff+Controlnet] Fix multicontrolnet support ( #6551 )
...
* fix multicontrolnet support
* update README with multicontrolnet example
2024-12-23 13:02:05 +05:30
ea85a1140a
[OmegaConf] replace it with yaml ( #6488 )
...
* remove omegaconf from convert_from_ckpt.
* remove from single_file.
* change to string based ubscription.
* style
* okay
* fix: vae_param
* no . indexing.
* style
* style
* turn getattrs into explicit if/else
* style
* propagate changes to ldm_uncond.
* propagate to gligen
* propagate to if.
* fix: quotes.
* propagate to audioldm.
* propagate to audioldm2
* propagate to musicldm.
* propagate to vq_diffusion
* propagate to zero123.
* remove omegaconf from diffusers codebase.
2024-12-23 13:02:05 +05:30
05cddb9407
Fix a bug of flip in SDXL training script ( #6547 )
...
* Update train_text_to_image_sdxl.py
* Update train_text_to_image_lora_sdxl.py
2024-12-23 13:02:05 +05:30
af863c203a
Make T2I Adapter SDXL Training Script torch.compile compatible ( #6577 )
...
update for t2i_adapter
2024-12-23 13:02:05 +05:30
8f47dc1050
Bump jinja2 from 3.1.2 to 3.1.3 in /examples/research_projects/realfill ( #6539 )
...
Bumps [jinja2](https://github.com/pallets/jinja ) from 3.1.2 to 3.1.3.
- [Release notes](https://github.com/pallets/jinja/releases )
- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst )
- [Commits](https://github.com/pallets/jinja/compare/3.1.2...3.1.3 )
---
updated-dependencies:
- dependency-name: jinja2
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-23 13:02:05 +05:30
73712e2962
Make InstructPix2Pix SDXL Training Script torch.compile compatible ( #6576 )
...
* changes for pix2pix_sdxl
* style fix
2024-12-23 13:02:05 +05:30
acbb060fed
Make InstructPix2Pix Training Script torch.compile compatible ( #6558 )
...
* added torch.compile for pix2pix
* required changes
2024-12-23 13:02:05 +05:30
1fbf1f6d2e
Make text-to-image SDXL LoRA Training Script torch.compile compatible ( #6556 )
...
make compile compatible
2024-12-23 13:02:05 +05:30
Haofan Wang