mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
44cfd757b2
* agentConnection Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> recv Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> agentState Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> NIXL interfaces Signed-off-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com> update cmakelists Signed-off-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com> nixl improve Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> remove cppzmq Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> fix Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> transferAgent remove register Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> work for cache Test Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> reduce sleep time Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> fix test Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> intergarte Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> nixl env Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> fix rebase error Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> cpp test Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> stash for send metaData Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> loadRemoteMD after fetchRemoteMD Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> workaround for mixed gen and context Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> test_env Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> avoid port conflict in test Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> * format Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> * use std::string Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> * typo Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> * fix transferAgentTest Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> --------- Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| cache_transmission | ||
| cacheTransceiverConfig.cpp | ||
| CMakeLists.txt | ||
| contextPhaseParams.cpp | ||
| debugConfig.cpp | ||
| decodingConfig.cpp | ||
| disaggServerUtil.cpp | ||
| dynamicBatchConfig.cpp | ||
| dynamicBatchTuner.cpp | ||
| dynamicBatchTuner.h | ||
| executor.cpp | ||
| executorConfig.cpp | ||
| executorImpl.cpp | ||
| executorImpl.h | ||
| executorKVCacheEventManager.cpp | ||
| extendedRuntimePerfKnobConfig.cpp | ||
| guidedDecodingConfig.cpp | ||
| guidedDecodingParams.cpp | ||
| intervalSet.h | ||
| jsonSerialization.cpp | ||
| kvCacheConfig.cpp | ||
| kvCacheRetentionConfig.cpp | ||
| logitsPostProcessorConfig.cpp | ||
| loraConfig.cpp | ||
| model.h | ||
| mropeConfig.cpp | ||
| orchestratorConfig.cpp | ||
| orchestratorUtils.h | ||
| outputConfig.cpp | ||
| parallelConfig.cpp | ||
| peftCacheConfig.cpp | ||
| promptTuningConfig.cpp | ||
| request.cpp | ||
| requestImpl.h | ||
| requestUtils.cpp | ||
| requestUtils.h | ||
| requestWithId.cpp | ||
| requestWithId.h | ||
| response.cpp | ||
| responseImpl.h | ||
| samplingConfig.cpp | ||
| schedulerConfig.cpp | ||
| serialization.cpp | ||
| serializeUtils.h | ||
| speculativeDecodingConfig.cpp | ||
| tensor.cpp | ||
| types.cpp | ||