Commit Graph

216 Commits

Author SHA1 Message Date
Sayak Paul 1be1282cbc [Workflows] add a more secure way to run tests from a PR. (#7969)
* add a more secure way to run tests from a PR.

* make pytest more secure.

* address dhruv's comments.

* improve validation check.

* Update .github/workflows/run_tests_from_a_pr.yml

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

---------

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
2024-12-23 13:02:12 +05:30
Sayak Paul 7425b46859 [Chore] run the documentation workflow in a custom container. (#8266)
run the documentation workflow in a custom container.
2024-12-23 13:02:12 +05:30
Dhruv Nair 84b6effa66 Create custom container for doc builder (#8263)
* update

* update
2024-12-23 13:02:12 +05:30
Lucain df6c15ea27 Use HF_TOKEN env var in CI (#7993) 2024-12-23 13:02:12 +05:30
Sayak Paul e9eaea7502 remove unsafe workflow. (#7967) 2024-12-23 13:02:11 +05:30
Sayak Paul 02559cc518 [Workflows] add a workflow that can be manually triggered on a PR. (#7942)
* add a workflow that can be manually triggered on a PR.

* remove sudo

* add command

* small fixes.
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE a77a28bca7 move to GH hosted M1 runner (#7949) 2024-12-23 13:02:11 +05:30
Isamu Isozaki d8e82de58f Adding VQGAN Training script (#5483)
* Init commit

* Removed einops

* Added default movq config for training

* Update explanation of prompts

* Fixed inheritance of discriminator and init_tracker

* Fixed incompatible api between muse and here

* Fixed output

* Setup init training

* Basic structure done

* Removed attention for quick tests

* Style fixes

* Fixed vae/vqgan styles

* Removed redefinition of wandb

* Fixed log_validation and tqdm

* Nothing commit

* Added commit loss to lookup_from_codebook

* Update src/diffusers/models/vq_model.py

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Adding perliminary README

* Fixed one typo

* Local changes

* Fixed main issues

* Merging

* Update src/diffusers/models/vq_model.py

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Testing+Fixed bugs in training script

* Some style fixes

* Added wandb to docs

* Fixed timm test

* get testing suite ready.

* remove return loss

* remove return_loss

* Remove diffs

* Remove diffs

* fix ruff format

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
2024-12-23 13:02:11 +05:30
Sayak Paul e63833dbf2 update to use hf-workflows for reporting the Docker build statuses (#7938)
update to use hf-workflows for reporting
2024-12-23 13:02:11 +05:30
Dhruv Nair 7563ad6faa Set max parallel jobs on slow test runners (#7878)
* set max parallel

* update

* update

* update
2024-12-23 13:02:11 +05:30
Dhruv Nair e931befdbf [Refactor] Better align from_single_file logic with from_pretrained (#7496)
* refactor unet single file loading a bit.

* retrieve the unet from create_diffusers_unet_model_from_ldm

* update

* update

* updae

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* tests

* update

* update

* update

* Update docs/source/en/api/single_file.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/single_file.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update docs/source/en/api/loaders/single_file.md

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update src/diffusers/loaders/single_file.py

Co-authored-by: YiYi Xu <yixu310@gmail.com>

* Update docs/source/en/api/loaders/single_file.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/loaders/single_file.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/loaders/single_file.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/api/loaders/single_file.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

---------

Co-authored-by: sayakpaul <spsayakpaul@gmail.com>
Co-authored-by: YiYi Xu <yixu310@gmail.com>
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE 8d4f8cb2de Ci - change cache folder (#7867) 2024-12-23 13:02:11 +05:30
Dhruv Nair 18a5b2d98f Remove installing python again in container (#7852)
update
2024-12-23 13:02:11 +05:30
Dhruv Nair ec38dacf45 Update deps for pipe test fetcher (#7838)
update

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE 585f1f7982 Change GPU Runners (#7840)
* Move to new GPU Runners for slow tests

* Move to new GPU Runners for nightly tests
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE 5daae497e2 move to new runners (#7839) 2024-12-23 13:02:11 +05:30
Dhruv Nair 683cf0cc1f Update CI cache (#7832)
update

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:11 +05:30
Dhruv Nair affaa1832a Fix hanging pipeline fetching (#7837)
update
2024-12-23 13:02:11 +05:30
Dhruv Nair c0410e4d14 Fix for pipeline slow test fetcher (#7824)
* update

* update
2024-12-23 13:02:11 +05:30
Dhruv Nair eccd1d3701 SSH Runner Workflow Update (#7822)
* add debug workflow

* update
2024-12-23 13:02:11 +05:30
Dhruv Nair bd61b8c1f1 Add debugging workflow (#7778)
add debug workflow

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:02:11 +05:30
Guillaume LEGENDRE 3cf49fd38f fix/add tailscale key in case of failure (#7719)
add tailscale key in case of failure
2024-12-23 13:02:10 +05:30
Guillaume LEGENDRE bb07c28442 Add tailscale action to push_test (#7709) 2024-12-23 13:02:10 +05:30
Sayak Paul d01453e437 [Workflows] remove installation of redundant modules from flax PR tests (#7662)
remove installation of redundant modules from flax PR tests
2024-12-23 13:02:10 +05:30
Dhruv Nair d166f496b6 Don't install PEFT with UV in slow tests (#7697)
* update

* update
2024-12-23 13:02:10 +05:30
Sayak Paul 5301343fc9 don't install peft from the source with uv for now. (#7679) 2024-12-23 13:02:10 +05:30
Sayak Paul a761390f12 fix: metadata token (#7631) 2024-12-23 13:02:10 +05:30
Sayak Paul ab34f394df make docker-buildx mandatory. (#7652) 2024-12-23 13:02:10 +05:30
Sayak Paul d6bed5cdf9 [Workflows] remove installation of libsndfile1-dev and libgl1 from workflows (#7543)
* remove libsndfile1-dev and libgl1 from workflows and ensure that re present in the respective dockerfiles.

* change to self-hosted runner; let's see 🤞

* add libsndfile1-dev libgl1 for now

* use self-hosted runners for building and push too.
2024-12-23 13:02:10 +05:30
Sayak Paul 694e4ea6b4 add utilities for updating diffusers pipeline metadata. (#7573)
* add utilities for updating diffusers pipeline metadata.

* style

* remove first empty line
2024-12-23 13:02:10 +05:30
Sayak Paul a0bb00c152 [Chore] increase number of workers for the tests. (#7558)
* increase number of workers for the tests.

* move to beefier runner.

* improve the fast push tests too.

* use a beefy machine for pytorch pipeline tests

* up the number of workers further.
2024-12-23 13:02:10 +05:30
Sayak Paul ca78010242 add: utility to format our docs too 📜 (#7314)
* add: utility to format our docs too 📜

* debugging saga

* fix: message

* checking

* should be fixed.

* revert pipeline_fixture

* remove empty line

* make style

* fix: setup.py

* style.
2024-12-23 13:02:10 +05:30
Sayak Paul 23ac219942 [Release tests] make nightly workflow dispatchable. (#7541)
* make nightly workflow dispatchable.

* add a note about running the release tests to setup.py
2024-12-23 13:02:10 +05:30
Sayak Paul 0b9833411a add: a helpful message when quality and repo consistency checks fail. (#7475) 2024-12-23 13:02:10 +05:30
Sayak Paul 6476521ef3 Improve nightly tests (#7385)
* flesh out the nightly tests

* address feedback.
2024-12-23 13:02:10 +05:30
Sayak Paul c2c884a9e6 [LoRA test suite] refactor the test suite and cleanse it (#7316)
* cleanse and refactor lora testing suite.

* more cleanup.

* make check_if_lora_correctly_set a utility function

* fix: typo

* retrigger ci

* style
2024-12-23 13:02:09 +05:30
Sayak Paul e3fd38f54d clean dep installation step in push_tests (#7382)
* clean dep installation step in push_tests

* fix: deps
2024-12-23 13:02:09 +05:30
Sayak Paul b25e428df8 Fix release workflow deps (#7339)
* pop scale from the top-level unet instead of getting it.

* improve readability.

* fix: pypi workflow deps

* revert
2024-12-23 13:02:09 +05:30
Sayak Paul 23b635123b add: torch to the pypi step. (#7328) 2024-12-23 13:02:09 +05:30
Sayak Paul 14ddd9612a add: pytest log installation (#7313) 2024-12-23 13:02:09 +05:30
Sayak Paul 1cd2104a7e add: support for notifying maintainers about the nightly test status (#7117)
* add: support for notifying maintainers about the nightly test status

* add: a tempoerary workflow for validation.

* cancel in progress.

* runs-on

* clean up

* add: peft dep

* change device.

* multiple edits.

* remove temp workflow.
2024-12-23 13:02:09 +05:30
Sayak Paul 59aa7e0fb2 [PyPI publishing] feat: automate the process of pypi publication to some extent. (#7270)
* feat: automate the process of pypi publication to some extent.

* utility to fetch the latest release branch

* correct package name.
2024-12-23 13:02:09 +05:30
Sayak Paul fbc7065a76 [Dockerfiles] add: a workflow to check if docker containers can be built in case of modifications (#7129)
* add: a workflow to check if docker containers can be built if the files are modified.

* type

* unify docker image build test and push

* make it run on prs too.

* check

* check

* check

* check again.

* remove docker test build file.

* remove extra dependencies./

* check
2024-12-23 13:02:09 +05:30
Dhruv Nair f1916222ef [CI] Remove max parallel flag on slow test runners (#7162)
update
2024-12-23 13:02:08 +05:30
Sayak Paul 1022f5a0bd Fix LCM benchmark test (#7158)
* make workflow dispatchable.

* fix: lcm lora compile
2024-12-23 13:02:08 +05:30
Sayak Paul 0222544269 [Urgent][Docker CI] pin uv version for now and a minor change in the Slack notification (#7155)
pin uv version for now.
2024-12-23 13:02:08 +05:30
Sayak Paul 63b79643ba [CI] fix path filtering in the documentation workflows (#7153)
fix: path
2024-12-23 13:02:08 +05:30
Sayak Paul 1e7fcd4e17 add: support for notifying the maintainers about the docker ci status. (#7113) 2024-12-23 13:02:08 +05:30
Sayak Paul 1de9fcb023 limit documentation workflow runs for relevant changes. (#7125) 2024-12-23 13:02:08 +05:30
Sayak Paul 7d1d1afab6 use uv for installing stuff in the workflows. (#7116)
* use uv for installing stuff in the workflows.

* fix: from source installation command when using uv.

* fix uv venv issue

* edit editable installation.

* fix quality installation

* checking

* make editable.

* more check

* check

* add: export step

* venv handling.

* checking.

* fix: dependency workflows.

* peft tests.

* proper way to initialize env.

* Empty-Commit

* Empty-Commit
2024-12-23 13:02:08 +05:30