TensorRT-LLMs/examples
nv-guomingz 034f6f2d91
docs:update 0.19 docs (#3986)
Signed-off-by: nv-guomingz <37257613+nv-guomingz@users.noreply.github.com>
Co-authored-by: nv-guomingz <37257613+nv-guomingz@users.noreply.github.com>
2025-04-30 19:25:26 +08:00
..
apps doc: refactor trtllm-serve examples and doc (#3187) 2025-04-04 11:40:43 +08:00
auto_deploy docs:update 0.19 docs (#3986) 2025-04-30 19:25:26 +08:00
bert Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
bindings/executor Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
commandr Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
cpp/executor Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
cpp_library Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
deepseek_v3 add know issue to deepseek doc. (#3800) 2025-04-23 17:21:50 +08:00
disaggregated feat: Add support of chat completion in PD (#2985) 2025-04-11 17:53:28 +08:00
dora Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
draft_target_model [doc] Better document for Draft-Target-Model (DTM) speculative decoding (#3797) 2025-04-24 11:41:35 +08:00
eagle test: Get Eagle tests working (#3593) (#3722) 2025-04-22 13:59:23 +08:00
enc_dec doc: use alert formatting (#3153) 2025-03-31 07:30:52 +08:00
exaone Add EXAONE-Deep (#3054) 2025-03-26 14:24:04 +08:00
gemma feat: Add Gemma3 text-only model support (#3247) 2025-04-10 12:34:58 +08:00
glm-4-9b chore: clean some ci of qa test (#3083) 2025-03-31 14:30:41 +08:00
gpt docs:fix https://nvbugs/5244616 by removing invalid links. (#3918) 2025-04-29 07:58:52 +08:00
granite Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
infinitebench Update TensorRT-LLM (#1725) 2024-06-04 20:26:32 +08:00
internlm2 Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
language_adapter Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
llama Minor fixes for documents (#3577) 2025-04-16 07:47:18 +08:00
llm-api docs:fix https://nvbugs/5244616 by removing new invalid links. (#3939) 2025-04-29 16:49:16 +08:00
llm-eval/lm-eval-harness Update (#2978) 2025-03-23 16:39:35 +08:00
lookahead Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
mamba Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
medusa Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
mixtral Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
mllama docs:fix https://nvbugs/5244616 by removing invalid links. (#3918) 2025-04-29 07:58:52 +08:00
models/contrib chore: clean some ci of qa test (#3083) 2025-03-31 14:30:41 +08:00
multimodal docs:fix https://nvbugs/5244616 by removing invalid links. (#3918) 2025-04-29 07:58:52 +08:00
nemotron Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
nemotron_nas Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
openai_triton Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
phi Add support for Phi-4-MM (#3296) 2025-04-14 14:24:10 +08:00
prompt_lookup Doc: update steps of using Draft-Target-Model (DTM) in the documents. (#3366) 2025-04-09 17:35:01 +08:00
python_plugin Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
pytorch refactor: remove ParallelConfig in tensorrt_llm._torch.distributed module (#3370) 2025-04-11 15:34:20 -07:00
quantization Add thread leak check and fix thread/memory leak issues. (#3270) 2025-04-08 19:03:18 +08:00
qwen fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
qwen2audio chore: Handle qwen2audio inputs ids expansion during processing (#3080) 2025-03-26 15:00:27 +08:00
qwenvl Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
recurrentgemma Fix .gitmodules (#2852) 2025-03-04 22:34:09 +08:00
redrafter Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
sample_weight_stripping docs:fix https://nvbugs/5244616 by removing invalid links. (#3918) 2025-04-29 07:58:52 +08:00
scaffolding feat: Add stream generation task scaffolding examples (#3527) 2025-04-16 11:33:55 +08:00
serve doc: add genai-perf benchmark & slurm multi-node for trtllm-serve doc (#3407) 2025-04-16 00:11:58 +08:00
vit Update (#2978) 2025-03-23 16:39:35 +08:00
whisper Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
constraints.txt chore: bump version to 0.19.0 (#3598) 2025-04-16 12:15:19 +08:00
eval_long_context.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
generate_checkpoint_config.py Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
generate_xgrammar_tokenizer_info.py Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
gpqa_llmapi.py feat: add qwen2 moe to torch flow; fix wrong imported KvCacheConfig in gpqa… (#3369) 2025-04-10 22:45:57 +08:00
hf_lora_convert.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
mmlu_llmapi.py test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
mmlu.py test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
run.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
summarize.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
utils.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00