mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-02-11 13:33:40 +08:00
ae5671644a
* Add draft scheduler class Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> * Refactor the design Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> * feat: Introduce router class for disaggregated server Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Add unit tests for router class Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Adding tests for disagg_utils Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Fixing missing import Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Fixing disagg integration tests Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> * Addressing MR review comments Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> --------- Signed-off-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> Signed-off-by: Patrice Castonguay <55748270+pcastonguay@users.noreply.github.com> Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co> |
||
|---|---|---|
| .. | ||
| _llmapi_perf_evaluator | ||
| accuracy | ||
| deterministic | ||
| disaggregated | ||
| examples | ||
| perf | ||
| stress_test | ||
| sysinfo | ||
| __init__.py | ||
| _run_llmapi_llm.py | ||
| .test_durations | ||
| agg_unit_mem_df.csv | ||
| ci_profiler.py | ||
| common.py | ||
| conftest.py | ||
| cpp_common.py | ||
| local_venv.py | ||
| pytest.ini | ||
| runner_interface.py | ||
| test_cache.py | ||
| test_cases.yml | ||
| test_cpp.py | ||
| test_e2e.py | ||
| test_list_parser.py | ||
| test_list_validation.py | ||
| test_mlpf_results.py | ||
| test_sanity.py | ||
| test_unittests.py | ||
| trt_test_alternative.py | ||
| turtle_defs.json | ||