3 people e97f802b2d [FP8][Kernel] Dynamic kv cache scaling factors computation (#11906) ...

Signed-off-by: Gregory Shtrasberg <[email protected]>
Co-authored-by: Micah Williamson <[email protected]>

2025-01-23 18:04:03 +00:00

..

__init__.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

test_encoder_decoder_model_runner.py

[core] clean up cudagraph batchsize padding logic (#10996)

2024-12-13 06:57:50 +00:00

test_model_input.py

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

test_model_runner.py

[core] clean up cudagraph batchsize padding logic (#10996)

2024-12-13 06:57:50 +00:00

test_profile.py

[core] overhaul memory profiling and fix backward compatibility (#10511)

2024-12-16 13:32:25 -08:00

test_swap.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00