SkyCol
cd1d9e9610
Add prompt about wandb in examples/dreambooth/readme. ( #10014 )
...
Add files via upload
2024-12-23 13:02:18 +05:30
Tolga Cangöz
f6172748c6
Errata - Fix typos and improve style ( #8571 )
...
* Fix typos
* Fix typos & up style
* chore: Update numbers
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
Tolga Cangöz
2c56360222
Errata - Trim trailing white space in the whole repo ( #8575 )
...
* Trim all the trailing white space in the whole repo
* Remove unnecessary empty places
* make style && make quality
* Trim trailing white space
* trim
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:02:13 +05:30
Sayak Paul
2c925746cd
[Training utils] add kohya conversion dict. ( #7435 )
...
* add kohya conversion dict.
* update readme
* typo
* add filename
2024-12-23 13:02:09 +05:30
Linoy Tsaban
7c36b6d3df
add DoRA training feature to sdxl dreambooth lora script ( #7235 )
...
* dora in canonical script
* add mention of DoRA to readme
2024-12-23 13:02:08 +05:30
Sayak Paul
0c693ca240
Support EDM-style training in DreamBooth LoRA SDXL script ( #7126 )
...
* add: dreambooth lora script for Playground v2.5
* fix: kwarg
* address suraj's comments.
* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com >
* apply suraj's suggestion
* incorporate changes in the canonical script./
* tracker naming
* fix: schedule determination
* add: two simple tests
* remove playground script
* note about edm-style training
* address pedro's comments.
* address part of Suraj's comments.
* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com >
* remove guidance_scale.
* use mse_loss.
* add comments for preconditioning.
* quality
* Update examples/dreambooth/train_dreambooth_lora_sdxl.py
Co-authored-by: Suraj Patil <surajp815@gmail.com >
* tackle v-pred.
* Empty-Commit
* support edm for sdxl too.
* address suraj's comments.
* Empty-Commit
---------
Co-authored-by: Suraj Patil <surajp815@gmail.com >
2024-12-23 13:02:08 +05:30
Sayak Paul
5bd3eabf19
Update README_sdxl.md to update the LR ( #6432 )
...
Update README_sdxl.md
2024-12-23 13:02:05 +05:30
Younes Belkada
c2717317f0
[PEFT] Adapt example scripts to use PEFT ( #5388 )
...
* adapt example scripts to use PEFT
* Update examples/text_to_image/train_text_to_image_lora.py
* fix
* add for SDXL
* oops
* make sure to install peft
* fix
* fix
* fix dreambooth and lora
* more fixes
* add peft to requirements.txt
* fix
* final fix
* add peft version in requirements
* remove comment
* change variable names
* add few lines in readme
* add to reqs
* style
* fix issues
* fix lora dreambooth xl tests
* init_lora_weights to gaussian and add out proj where missing
* ammend requirements.
* ammend requirements.txt
* add correct peft versions
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-07 09:39:29 +05:30
Sayak Paul
e731ae0ec8
Update README_sdxl.md to include the free-tier Colab Notebook ( #4540 )
...
Update README_sdxl.md
2023-08-09 14:32:14 +05:30
Patrick von Platen
e1b5b8ba13
Make sure fp16-fix is used as default ( #4510 )
...
* Make sue fp16-fix is used as default
* fix vae
* finish
* fix
2023-08-07 15:16:37 +02:00
Patrick von Platen
ea1fcc28a4
[SDXL] Allow SDXL LoRA to be run with less than 16GB of VRAM ( #4470 )
...
* correct
* correct blocks
* finish
* finish
* finish
* Apply suggestions from code review
* fix
* up
* up
* up
* Update examples/dreambooth/README_sdxl.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Apply suggestions from code review
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-08-04 20:06:38 +02:00
Patrick von Platen
66de221409
Update README_sdxl.md ( #4472 )
2023-08-04 16:23:35 +02:00
Patrick von Platen
6a6dfe1cbd
Rename ( #4294 )
...
* up
* Apply suggestions from code review
* Apply suggestions from code review
* up
2023-07-26 20:41:21 +02:00
Ragnar Rova
4e2a021829
Model path for sdxl wrong in dreambooth README ( #4261 )
2023-07-25 18:06:50 +05:30
Sayak Paul
5ef6b8fa53
Update README_sdxl.md to change the note on default hyperparameters ( #4258 )
2023-07-25 16:57:48 +05:30
Sayak Paul
365e8461ac
[SDXL DreamBooth LoRA] add support for text encoder fine-tuning ( #4097 )
...
* Allow low precision sd xl
* finish
* finish
* feat: initial draft for supporting text encoder lora finetuning for SDXL DreamBooth
* fix: variable assignments.
* add: autocast block.
* add debugging
* vae dtype hell
* fix: vae dtype hell.
* fix: vae dtype hell 3.
* clean up
* lora text encoder loader.
* fix: unwrapping models.
* add: tests.
* docs.
* handle unexpected keys.
* fix vae dtype in the final inference.
* fix scope problem.
* fix: save_model_card args.
* initialize: prefix to None.
* fix: dtype issues.
* apply gixes.
* debgging.
* debugging
* debugging
* debugging
* debugging
* debugging
* add: fast tests.
* pre-tokenize.
* address: will's comments.
* fix: loader and tests.
* fix: dataloader.
* simplify dataloader.
* length.
* simplification.
* make style && make quality
* simplify state_dict munging
* fix: tests.
* fix: state_dict packing.
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-07-25 05:35:48 +05:30
Sayak Paul
3d74dc2abd
[Examples] Add a training script for SDXL DreamBooth LoRA ( #4016 )
...
* add dreambooth lora script for SDXL incorporating latest changes.
* remove use_auth_token=True.
* add: documentation
* remove unneeded cli.
* increase the number of training steps in the readme.
* add LoraLoaderMixin to the subclassing mix.
* add sdxl lora dreambooth test.
* add: inference code sample.
* add: refiner output.
* add LoraLoaderMixin to the mix of classes of StableDiffusionXLImg2ImgPipeline.
* change default resolution of DreamBoothDataset.
* better sdxl report path.
* Apply suggestions from code review
Co-authored-by: Pedro Cuenca <pedro@huggingface.co >
---------
Co-authored-by: Pedro Cuenca <pedro@huggingface.co >
2023-07-11 07:38:41 +05:30