Aryan 41ba8c0bf6 Add support for sharded models when TorchAO quantization is enabled (#10256) ...

* add sharded + device_map check

2024-12-19 15:42:20 -10:00

..

bnb

[bitsandbytes] allow directly CUDA placements of pipelines loaded with bnb components (#9840)

2024-12-04 22:27:43 +05:30

gguf

[Single File] Add GGUF support (#9964)

2024-12-17 16:09:37 +05:30

torchao

Add support for sharded models when TorchAO quantization is enabled (#10256)

2024-12-19 15:42:20 -10:00