mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-13 22:18:36 +08:00
ff3b741045
* feat: adding multimodal (only image for now) support in trtllm-bench Signed-off-by: Rakib Hasan <rhasan@nvidia.com> * fix: add in load_dataset() calls to maintain the v2.19.2 behavior Signed-off-by: Rakib Hasan <rhasan@nvidia.com> * re-adding prompt_token_ids and using that for prompt_len Signed-off-by: Rakib Hasan <rhasan@nvidia.com> * updating the datasets version in examples as well Signed-off-by: Rakib Hasan <rhasan@nvidia.com> * api changes are not needed Signed-off-by: Rakib Hasan <rhasan@nvidia.com> * moving datasets requirement and removing a missed api change Signed-off-by: Rakib Hasan <rhasan@nvidia.com> * addressing review comments Signed-off-by: Rakib Hasan <rhasan@nvidia.com> * refactoring the quickstart example Signed-off-by: Rakib Hasan <rhasan@nvidia.com> --------- Signed-off-by: Rakib Hasan <rhasan@nvidia.com>
15 lines
457 B
Plaintext
15 lines
457 B
Plaintext
-f https://storage.googleapis.com/jax-releases/jax_cuda_releases.html
|
|
-c ../constraints.txt
|
|
# WAR the new posting of "nvidia-cudnn-cu12~=9.0".
|
|
# "jax[cuda12_pip]~=0.4.19" specifies "nvidia-cudnn-cu12>=8.9" but actually requires "nvidia-cudnn-cu12~=8.9".
|
|
nvidia-cudnn-cu12~=8.9; platform_machine == "x86_64"
|
|
tensorrt_llm>=0.0.0.dev0
|
|
flax~=0.8.0
|
|
# jax[cuda12_pip]~=0.4.19
|
|
safetensors~=0.4.1
|
|
sentencepiece>=0.1.99
|
|
h5py~=3.12.1
|
|
rouge_score
|
|
nltk
|
|
datasets==3.1.0
|