TensorRT-LLMs/examples
Lucas Liebenwein 24ac9b5f69
[AutoDeploy] merge feat/ad-2025-06-29 (#5737)
Signed-off-by: Lucas Liebenwein <11156568+lucaslie@users.noreply.github.com>
Signed-off-by: Frida Hou <201670829+Fridah-nv@users.noreply.github.com>
Co-authored-by: Neta Zmora <nzmora@nvidia.com>
Co-authored-by: Fridah-nv <201670829+Fridah-nv@users.noreply.github.com>
2025-07-04 10:21:18 +09:00
..
apps [TRTLLM-5208][BREAKING CHANGE] chore: make pytorch LLM the default (#5312) 2025-06-20 03:01:10 +08:00
auto_deploy [AutoDeploy] merge feat/ad-2025-06-29 (#5737) 2025-07-04 10:21:18 +09:00
bindings/executor Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
cpp/executor refactor: Clean up CMakeLists.txt (#3479) 2025-04-18 14:39:29 +08:00
cpp_library Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
disaggregated Add pd dynamic scaling readme (#5540) 2025-07-02 02:18:51 -04:00
dora Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
draft_target_model Fix: draft target README and set exclude_input_in_output to False (#4882) 2025-06-03 23:45:02 -07:00
eagle test: Get Eagle tests working (#3593) 2025-04-20 00:50:57 +08:00
ep_load_balancer fix (NvBug 5354925): Fix static EPLB (#5411) 2025-06-25 13:14:40 +08:00
infinitebench Update TensorRT-LLM (#1725) 2024-06-04 20:26:32 +08:00
language_adapter Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
llm-api [TRTLLM-5277] chore: refine llmapi examples for 1.0 (part1) (#5431) 2025-07-01 19:06:41 +08:00
llm-eval/lm-eval-harness [TRTLLM-5208][BREAKING CHANGE] chore: make pytorch LLM the default (#5312) 2025-06-20 03:01:10 +08:00
lookahead doc: fix path after examples migration (#3814) 2025-04-24 02:36:45 +08:00
medusa feat: adding multimodal (only image for now) support in trtllm-bench (#3490) 2025-04-18 07:06:16 +08:00
models chore: remove cuda_graph_ prefix from cuda_graph_config filed members. (#5585) 2025-06-30 12:23:14 -04:00
openai_triton Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
prompt_lookup [TRTLLM-5000][feat] Pytorch implementation of ngram drafter (#3936) 2025-05-21 10:40:00 +08:00
python_plugin Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
pytorch chore: remove cuda_graph_ prefix from cuda_graph_config filed members. (#5585) 2025-06-30 12:23:14 -04:00
quantization feat: Add support for fp8 rowwise quantization (#4876) 2025-06-14 06:37:48 -07:00
redrafter ReDrafter support for Qwen (#4875) 2025-06-28 02:33:10 +08:00
sample_weight_stripping chore: Mass integration of release/0.20 (#4898) 2025-06-08 23:26:26 +08:00
scaffolding [TRTLLM-5340] fix: remove the accuracy assert on run_majority_vote_aime24.py (#4784) 2025-06-03 10:41:03 +08:00
serve [TRTLLM-5277] chore: refine llmapi examples for 1.0 (part1) (#5431) 2025-07-01 19:06:41 +08:00
trtllm-eval test: Add LLGuidance test and refine guided decoding (#5348) 2025-06-25 14:12:56 +08:00
constraints.txt chore: bump version to 1.0.0rc2 (#5645) 2025-07-03 12:35:28 +08:00
eval_long_context.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
generate_checkpoint_config.py Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
generate_xgrammar_tokenizer_info.py Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
hf_lora_convert.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
mmlu.py feat: run mmlu and summarize without engine_dir. (#4056) 2025-05-05 19:35:07 +08:00
run.py [TRTLLM-5000][feat] Pytorch implementation of ngram drafter (#3936) 2025-05-21 10:40:00 +08:00
summarize.py [Infra] - Minor clean-up and test Ubuntu mirrors (#4829) 2025-06-02 20:18:20 +08:00
utils.py feat: run mmlu and summarize without engine_dir. (#4056) 2025-05-05 19:35:07 +08:00