TensorRT-LLMs/cpp/include/tensorrt_llm/batch_manager
石晓伟 59f41c067d
Update TensorRT-LLM (#708)
* Update TensorRT-LLM

* update

* Bump version to 0.7.0
2023-12-20 16:38:28 +08:00
..
BatchManager.h Update 2023-10-10 23:22:17 -07:00
batchScheduler.h Update TensorRT-LLM (#506) 2023-11-30 16:46:22 +08:00
callbacks.h Update 2023-10-10 23:22:17 -07:00
GptManager.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
inferenceRequest.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
kvCacheConfig.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
kvCacheManager.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
llmRequest.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
namedTensor.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00
trtGptModelOptionalParams.h Update TensorRT-LLM (#708) 2023-12-20 16:38:28 +08:00