Suyog Gupta ac2ab9ba36 [AutoDeploy][perf] Further optimize flashinfer backend in AutoDeploy (#4024) ... * reuse batch_indices, positions across layers Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com> * fix flashinfer unit tests Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com> * simplify call to get_batch_indices_positions Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com> * fix call to get_batch_indices_positions Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com> --------- Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com>		2025-05-06 10:46:36 +08:00
..
compile	feat: [AutoDeploy] generalizing cudagraph to multiple dynamic inputs (#3589)	2025-04-23 03:38:51 +08:00
custom_ops	[AutoDeploy][perf] Further optimize flashinfer backend in AutoDeploy (#4024)	2025-05-06 10:46:36 +08:00
distributed	[AutoDeploy] Make all ranks agree on kv-cache size (#4007)	2025-05-02 04:07:28 +08:00
models	feat: [AutoDeploy] unfusing attention for native support (#3668)	2025-05-02 09:06:49 +08:00
shim	[AutoDeploy][perf] Further optimize flashinfer backend in AutoDeploy (#4024)	2025-05-06 10:46:36 +08:00
transformations	feat: [AutoDeploy] unfusing attention for native support (#3668)	2025-05-02 09:06:49 +08:00
utils	feat: [AutoDeploy] unfusing attention for native support (#3668)	2025-05-02 09:06:49 +08:00
__init__.py	Update TensorRT-LLM (#2820)	2025-02-25 21:21:49 +08:00