Sayak Paul
1be1282cbc
[Workflows] add a more secure way to run tests from a PR. ( #7969 )
...
* add a more secure way to run tests from a PR.
* make pytest more secure.
* address dhruv's comments.
* improve validation check.
* Update .github/workflows/run_tests_from_a_pr.yml
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-12-23 13:02:12 +05:30
Sayak Paul
7425b46859
[Chore] run the documentation workflow in a custom container. ( #8266 )
...
run the documentation workflow in a custom container.
2024-12-23 13:02:12 +05:30
Dhruv Nair
84b6effa66
Create custom container for doc builder ( #8263 )
...
* update
* update
2024-12-23 13:02:12 +05:30
Lucain
df6c15ea27
Use HF_TOKEN env var in CI ( #7993 )
2024-12-23 13:02:12 +05:30
Sayak Paul
e9eaea7502
remove unsafe workflow. ( #7967 )
2024-12-23 13:02:11 +05:30
Sayak Paul
02559cc518
[Workflows] add a workflow that can be manually triggered on a PR. ( #7942 )
...
* add a workflow that can be manually triggered on a PR.
* remove sudo
* add command
* small fixes.
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE
a77a28bca7
move to GH hosted M1 runner ( #7949 )
2024-12-23 13:02:11 +05:30
Isamu Isozaki
d8e82de58f
Adding VQGAN Training script ( #5483 )
...
* Init commit
* Removed einops
* Added default movq config for training
* Update explanation of prompts
* Fixed inheritance of discriminator and init_tracker
* Fixed incompatible api between muse and here
* Fixed output
* Setup init training
* Basic structure done
* Removed attention for quick tests
* Style fixes
* Fixed vae/vqgan styles
* Removed redefinition of wandb
* Fixed log_validation and tqdm
* Nothing commit
* Added commit loss to lookup_from_codebook
* Update src/diffusers/models/vq_model.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Adding perliminary README
* Fixed one typo
* Local changes
* Fixed main issues
* Merging
* Update src/diffusers/models/vq_model.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Testing+Fixed bugs in training script
* Some style fixes
* Added wandb to docs
* Fixed timm test
* get testing suite ready.
* remove return loss
* remove return_loss
* Remove diffs
* Remove diffs
* fix ruff format
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-12-23 13:02:11 +05:30
Sayak Paul
e63833dbf2
update to use hf-workflows for reporting the Docker build statuses ( #7938 )
...
update to use hf-workflows for reporting
2024-12-23 13:02:11 +05:30
Dhruv Nair
7563ad6faa
Set max parallel jobs on slow test runners ( #7878 )
...
* set max parallel
* update
* update
* update
2024-12-23 13:02:11 +05:30
Dhruv Nair
e931befdbf
[Refactor] Better align from_single_file logic with from_pretrained ( #7496 )
...
* refactor unet single file loading a bit.
* retrieve the unet from create_diffusers_unet_model_from_ldm
* update
* update
* updae
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* tests
* update
* update
* update
* Update docs/source/en/api/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/loaders/single_file.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update docs/source/en/api/loaders/single_file.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE
8d4f8cb2de
Ci - change cache folder ( #7867 )
2024-12-23 13:02:11 +05:30
Dhruv Nair
18a5b2d98f
Remove installing python again in container ( #7852 )
...
update
2024-12-23 13:02:11 +05:30
Dhruv Nair
ec38dacf45
Update deps for pipe test fetcher ( #7838 )
...
update
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE
585f1f7982
Change GPU Runners ( #7840 )
...
* Move to new GPU Runners for slow tests
* Move to new GPU Runners for nightly tests
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE
5daae497e2
move to new runners ( #7839 )
2024-12-23 13:02:11 +05:30
Dhruv Nair
683cf0cc1f
Update CI cache ( #7832 )
...
update
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:11 +05:30
Dhruv Nair
affaa1832a
Fix hanging pipeline fetching ( #7837 )
...
update
2024-12-23 13:02:11 +05:30
Dhruv Nair
c0410e4d14
Fix for pipeline slow test fetcher ( #7824 )
...
* update
* update
2024-12-23 13:02:11 +05:30
Dhruv Nair
eccd1d3701
SSH Runner Workflow Update ( #7822 )
...
* add debug workflow
* update
2024-12-23 13:02:11 +05:30
Dhruv Nair
bd61b8c1f1
Add debugging workflow ( #7778 )
...
add debug workflow
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE
3cf49fd38f
fix/add tailscale key in case of failure ( #7719 )
...
add tailscale key in case of failure
2024-12-23 13:02:10 +05:30
Guillaume LEGENDRE
bb07c28442
Add tailscale action to push_test ( #7709 )
2024-12-23 13:02:10 +05:30
Sayak Paul
d01453e437
[Workflows] remove installation of redundant modules from flax PR tests ( #7662 )
...
remove installation of redundant modules from flax PR tests
2024-12-23 13:02:10 +05:30
Dhruv Nair
d166f496b6
Don't install PEFT with UV in slow tests ( #7697 )
...
* update
* update
2024-12-23 13:02:10 +05:30
Sayak Paul
5301343fc9
don't install peft from the source with uv for now. ( #7679 )
2024-12-23 13:02:10 +05:30
Sayak Paul
a761390f12
fix: metadata token ( #7631 )
2024-12-23 13:02:10 +05:30
Sayak Paul
ab34f394df
make docker-buildx mandatory. ( #7652 )
2024-12-23 13:02:10 +05:30
Sayak Paul
d6bed5cdf9
[Workflows] remove installation of libsndfile1-dev and libgl1 from workflows ( #7543 )
...
* remove libsndfile1-dev and libgl1 from workflows and ensure that re present in the respective dockerfiles.
* change to self-hosted runner; let's see 🤞
* add libsndfile1-dev libgl1 for now
* use self-hosted runners for building and push too.
2024-12-23 13:02:10 +05:30
Sayak Paul
694e4ea6b4
add utilities for updating diffusers pipeline metadata. ( #7573 )
...
* add utilities for updating diffusers pipeline metadata.
* style
* remove first empty line
2024-12-23 13:02:10 +05:30
Sayak Paul
a0bb00c152
[Chore] increase number of workers for the tests. ( #7558 )
...
* increase number of workers for the tests.
* move to beefier runner.
* improve the fast push tests too.
* use a beefy machine for pytorch pipeline tests
* up the number of workers further.
2024-12-23 13:02:10 +05:30
Sayak Paul
ca78010242
add: utility to format our docs too 📜 ( #7314 )
...
* add: utility to format our docs too 📜
* debugging saga
* fix: message
* checking
* should be fixed.
* revert pipeline_fixture
* remove empty line
* make style
* fix: setup.py
* style.
2024-12-23 13:02:10 +05:30
Sayak Paul
23ac219942
[Release tests] make nightly workflow dispatchable. ( #7541 )
...
* make nightly workflow dispatchable.
* add a note about running the release tests to setup.py
2024-12-23 13:02:10 +05:30
Sayak Paul
0b9833411a
add: a helpful message when quality and repo consistency checks fail. ( #7475 )
2024-12-23 13:02:10 +05:30
Sayak Paul
6476521ef3
Improve nightly tests ( #7385 )
...
* flesh out the nightly tests
* address feedback.
2024-12-23 13:02:10 +05:30
Sayak Paul
c2c884a9e6
[LoRA test suite] refactor the test suite and cleanse it ( #7316 )
...
* cleanse and refactor lora testing suite.
* more cleanup.
* make check_if_lora_correctly_set a utility function
* fix: typo
* retrigger ci
* style
2024-12-23 13:02:09 +05:30
Sayak Paul
e3fd38f54d
clean dep installation step in push_tests ( #7382 )
...
* clean dep installation step in push_tests
* fix: deps
2024-12-23 13:02:09 +05:30
Sayak Paul
b25e428df8
Fix release workflow deps ( #7339 )
...
* pop scale from the top-level unet instead of getting it.
* improve readability.
* fix: pypi workflow deps
* revert
2024-12-23 13:02:09 +05:30
Sayak Paul
23b635123b
add: torch to the pypi step. ( #7328 )
2024-12-23 13:02:09 +05:30
Sayak Paul
14ddd9612a
add: pytest log installation ( #7313 )
2024-12-23 13:02:09 +05:30
Sayak Paul
1cd2104a7e
add: support for notifying maintainers about the nightly test status ( #7117 )
...
* add: support for notifying maintainers about the nightly test status
* add: a tempoerary workflow for validation.
* cancel in progress.
* runs-on
* clean up
* add: peft dep
* change device.
* multiple edits.
* remove temp workflow.
2024-12-23 13:02:09 +05:30
Sayak Paul
59aa7e0fb2
[PyPI publishing] feat: automate the process of pypi publication to some extent. ( #7270 )
...
* feat: automate the process of pypi publication to some extent.
* utility to fetch the latest release branch
* correct package name.
2024-12-23 13:02:09 +05:30
Sayak Paul
fbc7065a76
[Dockerfiles] add: a workflow to check if docker containers can be built in case of modifications ( #7129 )
...
* add: a workflow to check if docker containers can be built if the files are modified.
* type
* unify docker image build test and push
* make it run on prs too.
* check
* check
* check
* check again.
* remove docker test build file.
* remove extra dependencies./
* check
2024-12-23 13:02:09 +05:30
Dhruv Nair
f1916222ef
[CI] Remove max parallel flag on slow test runners ( #7162 )
...
update
2024-12-23 13:02:08 +05:30
Sayak Paul
1022f5a0bd
Fix LCM benchmark test ( #7158 )
...
* make workflow dispatchable.
* fix: lcm lora compile
2024-12-23 13:02:08 +05:30
Sayak Paul
0222544269
[Urgent][Docker CI] pin uv version for now and a minor change in the Slack notification ( #7155 )
...
pin uv version for now.
2024-12-23 13:02:08 +05:30
Sayak Paul
63b79643ba
[CI] fix path filtering in the documentation workflows ( #7153 )
...
fix: path
2024-12-23 13:02:08 +05:30
Sayak Paul
1e7fcd4e17
add: support for notifying the maintainers about the docker ci status. ( #7113 )
2024-12-23 13:02:08 +05:30
Sayak Paul
1de9fcb023
limit documentation workflow runs for relevant changes. ( #7125 )
2024-12-23 13:02:08 +05:30
Sayak Paul
7d1d1afab6
use uv for installing stuff in the workflows. ( #7116 )
...
* use uv for installing stuff in the workflows.
* fix: from source installation command when using uv.
* fix uv venv issue
* edit editable installation.
* fix quality installation
* checking
* make editable.
* more check
* check
* add: export step
* venv handling.
* checking.
* fix: dependency workflows.
* peft tests.
* proper way to initialize env.
* Empty-Commit
* Empty-Commit
2024-12-23 13:02:08 +05:30