mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
d31fefde2c
* chore: Remove GptSession/V1 from TRT workflow Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove stateful decoders Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove GptSession buffers Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove GptSession utils Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove GptSession kernels Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove V1 GPT models from tests Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove gptSessionBenchmark from scripts and docs Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove gptSession IO classes Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove GptSession from test lists Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove GptSession from docs Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove useless encoder test Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove mActualBatchSize from DecoderState Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove static batching from ExecutorTest - Updated `validateContextLogits` and `validateGenerationLogits` functions to remove the `batchingType` parameter. - Adjusted related test functions to reflect the changes in parameter lists. - Cleaned up the instantiation of test cases to eliminate unnecessary batchingType references. Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> --------- Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| utils | ||
| bufferManager.cpp | ||
| bufferView.h | ||
| CMakeLists.txt | ||
| cudaMemPool.cpp | ||
| cudaMemPool.h | ||
| decoderState.cpp | ||
| decodingLayerWorkspace.cpp | ||
| decodingLayerWorkspace.h | ||
| decodingOutput.cpp | ||
| eagleBuffers.cpp | ||
| explicitDraftTokensBuffers.cpp | ||
| explicitDraftTokensModule.h | ||
| gptDecoder.cpp | ||
| gptDecoderBatched.cpp | ||
| gptJsonConfig.cpp | ||
| iBuffer.cpp | ||
| ipcNvlsMemory.cpp | ||
| ipcSocket.cpp | ||
| ipcSocket.h | ||
| ipcUtils.cpp | ||
| iTensor.cpp | ||
| jsonSerialization.h | ||
| layerProfiler.cpp | ||
| layerProfiler.h | ||
| lookaheadBuffers.cpp | ||
| loraCache.cpp | ||
| loraManager.cpp | ||
| loraManager.h | ||
| loraModule.cpp | ||
| loraUtils.cpp | ||
| loraUtils.h | ||
| memoryCounters.cpp | ||
| ncclCommunicator.cpp | ||
| ncclCommunicator.h | ||
| promptTuningParams.cpp | ||
| runtimeKernels.cu | ||
| runtimeKernels.h | ||
| tensorView.h | ||
| tllmBuffers.cpp | ||
| tllmBuffers.h | ||
| tllmLogger.cpp | ||
| tllmRuntime.cpp | ||
| tllmRuntime.h | ||
| tllmStreamReaders.cpp | ||
| tllmStreamReaders.h | ||
| torch.h | ||
| torchUtils.h | ||
| torchView.h | ||
| workerPool.cpp | ||
| workerPool.h | ||
| worldConfig.cpp | ||