TensorRT-LLMs/cpp/tensorrt_llm
ixlmar fbe4db207d
feat: forward exceptions to Python and catch OOMs (#4497)
Signed-off-by: ixlmar <206748156+ixlmar@users.noreply.github.com>
2025-05-28 11:58:10 +02:00
..
batch_manager [nvbugs/5274894] fix: Sort requests for functional correctness and performance (adapted from #4608) (#4621) 2025-05-26 17:10:55 +08:00
common feat: forward exceptions to Python and catch OOMs (#4497) 2025-05-28 11:58:10 +02:00
cutlass_extensions/include/cutlass_extensions chore: guardword clean for header file. (#4540) 2025-05-23 10:08:14 +08:00
executor fix: Handle additional model outputs based on pipeline parallel rank (#4498) 2025-05-26 09:04:40 +02:00
executor_worker Update TensorRT-LLM (#2792) 2025-02-18 21:27:39 +08:00
kernels fix: fix dsr1 min lat cga ar rate drop(0.2) (#4561) 2025-05-27 21:59:57 +08:00
layers Feat: Variable-Beam-Width-Search (VBWS) part4 (#3979) 2025-05-12 22:32:29 +02:00
plugins Fix bias shape in weightOnlyGroupwiseQuantMatmulPlugin for TRT workflow (#4348) 2025-05-16 10:02:30 +08:00
pybind Fix snake case format (#4559) 2025-05-25 17:57:17 +08:00
runtime Fix: hang on disagg when MNNVL two-shot AllReduce is enabled (#4678) 2025-05-28 13:03:53 +08:00
testing refactor: Move ModelSpec to core library (#3980) 2025-05-04 01:39:09 +08:00
thop feat: forward exceptions to Python and catch OOMs (#4497) 2025-05-28 11:58:10 +02:00
CMakeLists.txt feat: NIXL interface integration (#3934) 2025-05-19 18:18:22 +08:00