Logo
Explore Help
Sign In
obscura/vllm
Watch 2
Star 0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2026-08-12 00:38:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
tpu_v1_optimized
vllm/tests/v1
T
History
Nick HillGitHubRobert Shaw
24b0205f58 [V1][Frontend] Coalesce bunched RequestOutputs (#12298)
Signed-off-by: Nick Hill <[email protected]>
Co-authored-by: Robert Shaw <[email protected]>
2025-01-23 17:17:41 -08:00
..
core
[V1] Add uncache_blocks (#12333)
2025-01-23 04:19:21 +00:00
e2e
[V1] Implement Cascade Attention (#11635)
2025-01-01 21:56:46 +09:00
engine
[V1][Frontend] Coalesce bunched RequestOutputs (#12298)
2025-01-23 17:17:41 -08:00
sample
[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling (#11394)
2024-12-27 09:32:38 +09:00
worker
[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)
2024-12-26 19:02:58 +09:00
__init__.py
[V1] AsyncLLM Implementation (#9826)
2024-11-11 23:05:38 +00:00
test_stats.py
[v1][stats][1/n] Add RequestStatsUpdate and RequestStats types (#10907)
2025-01-21 11:51:13 -08:00
test_utils.py
[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960)
2025-01-17 07:39:35 +00:00
Powered by Gitea Version: 1.27.0 Page: 407ms Template: 5ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API