TensorRT-LLMs/examples
Tao Li @ NVIDIA 458203d805
update fp8 doc (#3647)
Signed-off-by: taoli <litaotju@users.noreply.github.com>
Co-authored-by: taoli <litaotju@users.noreply.github.com>
2025-04-17 13:16:07 +08:00
..
apps doc: refactor trtllm-serve examples and doc (#3187) 2025-04-04 11:40:43 +08:00
auto_deploy feat: [TRTLLM-3510] DeepseekV3 support in AutoDeploy (#3281) 2025-04-08 21:47:57 +08:00
bert Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
bindings/executor Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
commandr Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
cpp/executor Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
cpp_library Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
deepseek_v3 update fp8 doc (#3647) 2025-04-17 13:16:07 +08:00
disaggregated feat: Add support of chat completion in PD (#2985) 2025-04-11 17:53:28 +08:00
dora Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
draft_target_model Doc: update steps of using Draft-Target-Model (DTM) in the documents. (#3366) 2025-04-09 17:35:01 +08:00
eagle Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
enc_dec doc: use alert formatting (#3153) 2025-03-31 07:30:52 +08:00
exaone Add EXAONE-Deep (#3054) 2025-03-26 14:24:04 +08:00
gemma feat: Add Gemma3 text-only model support (#3247) 2025-04-10 12:34:58 +08:00
glm-4-9b chore: clean some ci of qa test (#3083) 2025-03-31 14:30:41 +08:00
gpt fix: GPT-Next convert failure (#3220) 2025-04-02 17:14:39 +08:00
granite Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
infinitebench Update TensorRT-LLM (#1725) 2024-06-04 20:26:32 +08:00
internlm2 Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
language_adapter Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
llama Minor fixes for documents (#3577) 2025-04-16 07:47:18 +08:00
llm-api docs:update llm api examples and customizations sections' links. (#3566) 2025-04-15 13:55:22 +08:00
llm-eval/lm-eval-harness Update (#2978) 2025-03-23 16:39:35 +08:00
lookahead Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
mamba Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
medusa Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
mixtral Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
mllama Add Llama 4 (#3302) 2025-04-09 03:35:21 +08:00
models/contrib chore: clean some ci of qa test (#3083) 2025-03-31 14:30:41 +08:00
multimodal Add support for Phi-4-MM (#3296) 2025-04-14 14:24:10 +08:00
nemotron Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
nemotron_nas Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
openai_triton Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
phi Add support for Phi-4-MM (#3296) 2025-04-14 14:24:10 +08:00
prompt_lookup Doc: update steps of using Draft-Target-Model (DTM) in the documents. (#3366) 2025-04-09 17:35:01 +08:00
python_plugin Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
pytorch refactor: remove ParallelConfig in tensorrt_llm._torch.distributed module (#3370) 2025-04-11 15:34:20 -07:00
quantization Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
qwen fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
qwen2audio chore: Handle qwen2audio inputs ids expansion during processing (#3080) 2025-03-26 15:00:27 +08:00
qwenvl Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
recurrentgemma Fix .gitmodules (#2852) 2025-03-04 22:34:09 +08:00
redrafter Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
sample_weight_stripping Update (#2978) 2025-03-23 16:39:35 +08:00
scaffolding feat: Add stream generation task scaffolding examples (#3527) 2025-04-16 11:33:55 +08:00
serve doc: add genai-perf benchmark & slurm multi-node for trtllm-serve doc (#3407) 2025-04-16 00:11:58 +08:00
vit Update (#2978) 2025-03-23 16:39:35 +08:00
whisper Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
constraints.txt chore: bump version to 0.19.0 (#3598) 2025-04-16 12:15:19 +08:00
eval_long_context.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
generate_checkpoint_config.py Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
generate_xgrammar_tokenizer_info.py Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
gpqa_llmapi.py feat: add qwen2 moe to torch flow; fix wrong imported KvCacheConfig in gpqa… (#3369) 2025-04-10 22:45:57 +08:00
hf_lora_convert.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
mmlu_llmapi.py test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
mmlu.py test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
run.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
summarize.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
utils.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00