TensorRT-LLMs/examples
Erin c75d7cd684
move BuildConfig functional args to llmargs (#3036)
Signed-off-by: Erin Ho <14718778+hchings@users.noreply.github.com>
2025-03-29 02:20:18 +08:00
..
apps Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
arctic Update TensorRT-LLM (#1793) 2024-06-18 18:18:23 +08:00
auto_deploy perf: [AutoDeploy] Enable AutoDeploy as a backend in trtllm-bench (#3041) 2025-03-26 14:33:14 -07:00
bert Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
bindings/executor Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
blip2 Update TensorRT-LLM (#1168) 2024-02-27 17:37:34 +08:00
chatglm v1.2 (#3082) 2025-03-26 23:31:29 +08:00
cogvlm Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
commandr Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
cpp/executor Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
cpp_library Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
dbrx Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
deepseek_v3 test: Add gpqa tests for DeepSeek models (#3063) 2025-03-27 19:47:06 +08:00
disaggregated Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
dit Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
dora Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
draft_target_model Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
eagle Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
enc_dec Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
exaone Add EXAONE-Deep (#3054) 2025-03-26 14:24:04 +08:00
gemma Update (#2978) 2025-03-23 16:39:35 +08:00
gpt Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
granite Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
grok Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
infinitebench Update TensorRT-LLM (#1725) 2024-06-04 20:26:32 +08:00
internlm2 Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
jais Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
language_adapter Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
llama fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
llm-api fix: LLM API logits processor example comments (#2962) 2025-03-24 12:22:12 +08:00
llm-eval/lm-eval-harness Update (#2978) 2025-03-23 16:39:35 +08:00
lookahead Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
mamba Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
medusa Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
mixtral Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
mllama Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
mmdit Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
models/contrib test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
multimodal test: add random image test for llama-3.2-11b-vision (#3055) 2025-03-26 15:38:16 +08:00
nemotron Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
nemotron_nas Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
openai_triton Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
phi Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
prompt_lookup Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
python_plugin Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
pytorch move BuildConfig functional args to llmargs (#3036) 2025-03-29 02:20:18 +08:00
quantization Update README.md (#2862) 2025-03-24 13:46:09 +08:00
qwen fix: fix for cp > kvHeadNum (#3002) 2025-03-26 12:39:02 +08:00
qwen2audio chore: Handle qwen2audio inputs ids expansion during processing (#3080) 2025-03-26 15:00:27 +08:00
qwenvl Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
recurrentgemma Fix .gitmodules (#2852) 2025-03-04 22:34:09 +08:00
redrafter Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
sample_weight_stripping Update (#2978) 2025-03-23 16:39:35 +08:00
scaffolding Update (#2978) 2025-03-23 16:39:35 +08:00
sdxl Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
skywork Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
smaug Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
stdit Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
vit Update (#2978) 2025-03-23 16:39:35 +08:00
whisper Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
constraints.txt chore: bump version to "0.19.0.dev2025032500" (#3019) 2025-03-25 10:04:17 +08:00
eval_long_context.py test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
generate_checkpoint_config.py Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
generate_xgrammar_tokenizer_info.py Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
gpqa_llmapi.py test: Add gpqa tests for DeepSeek models (#3063) 2025-03-27 19:47:06 +08:00
hf_lora_convert.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
mmlu_llmapi.py test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
mmlu.py test: Accuracy test improvement (Part 2): Incorporate mmlu to accuracy test suite (#2982) 2025-03-25 07:34:10 +08:00
run.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00
summarize.py Update TensorRT-LLM (#2936) 2025-03-18 21:25:19 +08:00
utils.py Update TensorRT-LLM (#2849) 2025-03-04 18:44:00 +08:00