kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
548b5b7310
TensorRT-LLMs/examples/llm-api
History
石晓伟 548b5b7310
Update TensorRT-LLM (#2532) 
* blossom-ci.yml: run vulnerability scan on blossom

* open source efb18c1256f8c9c3d47b7d0c740b83e5d5ebe0ec

---------

Co-authored-by: niukuo <6831097+niukuo@users.noreply.github.com>
Co-authored-by: pei0033 <59505847+pei0033@users.noreply.github.com>
Co-authored-by: Kyungmin Lee <30465912+lkm2835@users.noreply.github.com>
Co-authored-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>
2024-12-04 21:16:56 +08:00
..
llm_auto_parallel.py Update TensorRT-LLM (#2460) 2024-11-19 18:30:34 +08:00
llm_guided_decoding.py Update TensorRT-LLM (#2532) 2024-12-04 21:16:56 +08:00
llm_inference_async_streaming.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
llm_inference_async.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
llm_inference_customize.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
llm_inference_distributed.py Update TensorRT-LLM (#2436) 2024-11-12 15:27:49 +08:00
llm_inference.py Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00
llm_logits_processor.py Update TensorRT-LLM (#2333) 2024-10-15 15:28:40 +08:00
llm_multilora.py Update TensorRT-LLM (#2363) 2024-10-22 20:27:35 +08:00
llm_quantization.py Update TensorRT-LLM (#2363) 2024-10-22 20:27:35 +08:00
quickstart_example.py Update TensorRT-LLM (#2184) 2024-09-03 12:14:23 +02:00
README.md Update TensorRT-LLM (#2413) 2024-11-05 16:27:06 +08:00

README.md

LLM API Examples

Please refer to the official documentation and examples for detailed information and usage guidelines regarding the LLM API.