TensorRT-LLMs

mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00

History

wili 34e63d07e6 feat: Variable-Beam-Width-Search (VBWS) Part2 (#3133 ) * feat: Variable-Beam-Width-Search Part2 Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search Part2 Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search Part2, fix CPP tests Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search Part3, simplify CPP tests Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search Part4, move beam_width_array param Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search, fix CI error Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search part2 Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search part2 Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search part2, fix pre-commit Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> * feat: Variable-Beam-Width-Search part2, fix review Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> --------- Signed-off-by: wili-65535 <wili-65535@user.noreply.github.com> Co-authored-by: wili-65535 <wili-65535@user.noreply.github.com>		2025-04-02 12:31:28 +08:00
..
cache_transmission	chore: Ucx ip port remove mpi depend (#3101 )	2025-04-02 09:42:29 +08:00
CMakeLists.txt	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
contextPhaseParams.cpp	Update TensorRT-LLM (#2936 )	2025-03-18 21:25:19 +08:00
debugConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
decodingConfig.cpp	Update (#2978 )	2025-03-23 16:39:35 +08:00
disaggServerUtil.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
dynamicBatchConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
dynamicBatchTuner.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
dynamicBatchTuner.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
executor.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
executorConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
executorImpl.cpp	chore: Ucx ip port remove mpi depend (#3101 )	2025-04-02 09:42:29 +08:00
executorImpl.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
executorKVCacheEventManager.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
extendedRuntimePerfKnobConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
guidedDecodingConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
guidedDecodingParams.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
intervalSet.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
jsonSerialization.cpp	feat: Add BW measurement (#3070 )	2025-03-28 10:53:00 +08:00
kvCacheConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
kvCacheRetentionConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
logitsPostProcessorConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
loraConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
model.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
mropeConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
orchestratorConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
orchestratorUtils.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
outputConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
parallelConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
peftCacheConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
promptTuningConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
request.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
requestImpl.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
requestUtils.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
requestUtils.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
requestWithId.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
requestWithId.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
response.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
responseImpl.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
samplingConfig.cpp	feat: Variable-Beam-Width-Search (VBWS) Part2 (#3133 )	2025-04-02 12:31:28 +08:00
schedulerConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
serialization.cpp	feat: Add BW measurement (#3070 )	2025-03-28 10:53:00 +08:00
serializeUtils.h	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
speculativeDecodingConfig.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
tensor.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00
types.cpp	Update TensorRT-LLM (#2873 )	2025-03-11 21:13:42 +08:00