Suyog Gupta ac2ab9ba36 [AutoDeploy][perf] Further optimize flashinfer backend in AutoDeploy (#4024) ... * reuse batch_indices, positions across layers Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com> * fix flashinfer unit tests Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com> * simplify call to get_batch_indices_positions Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com> * fix call to get_batch_indices_positions Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com> --------- Signed-off-by: Suyog Gupta <41447211+suyoggupta@users.noreply.github.com>		2025-05-06 10:46:36 +08:00
..
multigpu	feat: [AutoDeploy] generalizing cudagraph to multiple dynamic inputs (#3589)	2025-04-23 03:38:51 +08:00
singlegpu	[AutoDeploy][perf] Further optimize flashinfer backend in AutoDeploy (#4024)	2025-05-06 10:46:36 +08:00