vllm/examples/features/speculative_decoding at main - vllm

obscura/vllm

Fork 0

mirror of https://github.com/vllm-project/vllm.git synced 2026-08-23 14:10:14 +00:00

Files

T

History

3af8789559 [Feature] Universal speculative decoding for heterogeneous vocabularies (TLI) (#38174 )

Signed-off-by: wan-danfeng <[email protected]>
Signed-off-by: Wonderful <[email protected]>
Co-authored-by: Wan_DF <[email protected]>
Co-authored-by: Benjamin Chislett <[email protected]>
Co-authored-by: Benjamin Chislett <[email protected]>

2026-07-02 01:34:20 -07:00

extract_hidden_states_offline.py

Hidden states extraction improvements (#43805 )

2026-06-11 09:44:45 -04:00

mlpspeculator_offline.py

[Examples] Resettle features examples. (#40995 )

2026-04-28 00:33:41 -07:00

spec_decode_offline.py

[Feature] Universal speculative decoding for heterogeneous vocabularies (TLI) (#38174 )

2026-07-02 01:34:20 -07:00