Wangjue Yao 9865d3d770 [None][feat] Support cached tokens for Openai server (#7637) ... Signed-off-by: wjueyao <wyao123@terpmail.umd.edu> Co-authored-by: Pengyun Lin <81065165+LinPoly@users.noreply.github.com>		2025-10-16 20:51:37 +08:00
..
rpc	[TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543)	2025-10-05 17:28:20 +08:00
__init__.py	chore: rename ExecutorBindingsWorker/Proxy (#4716)	2025-05-29 10:32:35 +08:00
base_worker.py	[https://nvbugs/5510879][fix] Fix pytorch & TRT-python flows fused LoRA adapter modules weight split with TP>1 (#8063)	2025-10-12 12:29:52 -07:00
executor.py	[https://nvbugs/5560921][fix] GenerationExecutor RPC (#8209)	2025-10-16 09:05:22 +08:00
ipc.py	[TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543)	2025-10-05 17:28:20 +08:00
postproc_worker.py	[None][feat] perf_metrics endpoint functionality improvement (#8005)	2025-10-02 17:43:25 -07:00
proxy.py	[None][fix] Fix EventLoopShutdownError (#8260)	2025-10-13 17:31:33 +08:00
ray_executor.py	[TRTLLM-8507][fix] Fix ray resource cleanup and error handling in LoRA test (#8175)	2025-10-14 23:46:30 +08:00
ray_gpu_worker.py	[TRTLLM-7349][feat] Adding new orchestrator type -- ray (#7520)	2025-10-04 08:12:24 +08:00
request.py	[None][fix] using arrival time in llmapi when creating LlmRequest in pytorch workflow (#7553)	2025-09-15 07:26:01 -04:00
result.py	[None][feat] Support cached tokens for Openai server (#7637)	2025-10-16 20:51:37 +08:00
rpc_proxy.py	[TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543)	2025-10-05 17:28:20 +08:00
rpc_worker.py	[TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543)	2025-10-05 17:28:20 +08:00
utils.py	[#7692][fix] recognize RequestError as per-request error in background handler (#7726)	2025-09-24 11:11:17 +08:00
worker.py	[TRTLLM-8189][chore] enhance GenerationExecutor with RPC (part1) (#5543)	2025-10-05 17:28:20 +08:00