TensorRT-LLMs/examples
pansicheng e84dc6b3c7
feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354)
* add deepseek-r1 reasoning parser

Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>

* fix test

Signed-off-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>

---------

Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>
Signed-off-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>
Co-authored-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>
2025-05-06 08:13:04 +08:00
..
apps doc: refactor trtllm-serve examples and doc (#3187) 2025-04-04 11:40:43 +08:00
auto_deploy feat: [AutoDeploy] unfusing attention for native support (#3668) 2025-05-02 09:06:49 +08:00
bindings/executor Update TensorRT-LLM (#2582) 2024-12-16 21:50:47 -08:00
cpp/executor refactor: Clean up CMakeLists.txt (#3479) 2025-04-18 14:39:29 +08:00
cpp_library Update TensorRT-LLM (#1274) 2024-03-12 18:15:52 +08:00
disaggregated feat: Add support of chat completion in PD (#2985) 2025-04-11 17:53:28 +08:00
dora Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
draft_target_model chore: bump version to 0.19.0 (#3598) (#3841) 2025-04-29 16:57:22 +08:00
eagle test: Get Eagle tests working (#3593) 2025-04-20 00:50:57 +08:00
infinitebench Update TensorRT-LLM (#1725) 2024-06-04 20:26:32 +08:00
language_adapter Update TensorRT-LLM (#2873) 2025-03-11 21:13:42 +08:00
llm-api feat: LogitsProcessor in PyTorch backend (#3145) 2025-05-01 14:15:30 -07:00
llm-eval/lm-eval-harness Update (#2978) 2025-03-23 16:39:35 +08:00
lookahead doc: fix path after examples migration (#3814) 2025-04-24 02:36:45 +08:00
medusa feat: adding multimodal (only image for now) support in trtllm-bench (#3490) 2025-04-18 07:06:16 +08:00
models add ci and doc for qwen3 (#4022) 2025-05-02 14:13:38 +08:00
openai_triton Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
prompt_lookup move the reset models into examples/models/core directory (#3555) 2025-04-19 20:48:59 -07:00
python_plugin Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
pytorch fix: [nvbug/5252057] Fix kv cache reuse on PyTorch multimodal (#4025) 2025-05-02 10:53:06 -07:00
quantization feat: adding multimodal (only image for now) support in trtllm-bench (#3490) 2025-04-18 07:06:16 +08:00
redrafter feat: adding multimodal (only image for now) support in trtllm-bench (#3490) 2025-04-18 07:06:16 +08:00
sample_weight_stripping doc: fix path after examples migration (#3814) 2025-04-24 02:36:45 +08:00
scaffolding [TRTLLM-4638 ][feat] add best of n support with reward model in scaffolding (#3807) 2025-04-28 17:15:33 +08:00
serve feat: add deepseek-r1 reasoning parser to trtllm-serve (#3354) 2025-05-06 08:13:04 +08:00
constraints.txt chore: bump version to 0.20.0rc2 (#3949) 2025-04-30 11:44:43 +08:00
eval_long_context.py Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338) 2025-04-08 23:51:27 +08:00
generate_checkpoint_config.py Update TensorRT-LLM (#2562) 2024-12-11 00:31:05 -08:00
generate_xgrammar_tokenizer_info.py Update TensorRT-LLM (#2783) 2025-02-13 18:40:22 +08:00
hf_lora_convert.py Update TensorRT-LLM (#2755) 2025-02-11 03:01:00 +00:00
mmlu.py feat: run mmlu and summarize without engine_dir. (#4056) 2025-05-05 19:35:07 +08:00
run.py doc: fix path after examples migration (#3814) 2025-04-24 02:36:45 +08:00
summarize.py feat: run mmlu and summarize without engine_dir. (#4056) 2025-05-05 19:35:07 +08:00
utils.py feat: run mmlu and summarize without engine_dir. (#4056) 2025-05-05 19:35:07 +08:00