obscura/vllm
2
0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2026-06-06 00:16:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
17,325 Commits 315 Branches 161 Tags
main
Commit Graph

1373 Commits

Author SHA1 Message Date
Xinyu Chen 639402f5a2 Support FP8 KVCache on XPU (#37731) 
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-04-12 03:53:32 +00:00
Andreas Karatzas 0f7be0f2f7 [ROCm][CI/Build] Fix memory cleanup in MM test (#39555) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-04-12 11:13:34 +08:00
Benjamin Chislett af661a182d Revert "Add nightly b200 test for spec decode eagle correctness (#38577)" (#39512) 
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
 2026-04-10 20:07:32 -04:00
Harry Mellor fc645f1acc Add structure to requirements/ directory (#39024) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-04-10 13:46:41 -07:00
zhanqiuhu e281cb721c [CI] Add MultiConnector (Nixl+Offloading) e2e edge case tests (#39343) 
Signed-off-by: ZhanqiuHu <zhu@redhat.com>
 2026-04-10 17:35:03 +00:00
Jee Jee Li ecd1ea1363 [Kernel] Porting the TRTLLM minimax_allreduce_rms kernels (#37045) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-11 00:20:20 +08:00
Nicolò Lucchesi c9dddc144b [CI] Add Nixl+OffloadingConnector e2e integration tests (#39200) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-10 21:40:40 +08:00
Rishi Puri adaabb8a55 Add nightly b200 test for spec decode eagle correctness (#38577) 
Signed-off-by: Rishi Puri <riship@nvidia.com>
 2026-04-09 20:09:09 +00:00
Cyrus Leung 3b1d9c3156 [CI/Build] Fix memory cleanup in MM test (#39411) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-04-09 08:50:45 -07:00
Shengqi Chen b6c9be509e [CI] fix possible user permission issues in nightly index generation (#39390) 
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
 2026-04-09 08:14:07 +00:00
liuzhenwei 83aea2147f [XPU][UT] update UTs in CI (#39296) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-04-09 09:38:16 +08:00
Roberto L. Castro b55d830ec7 [Perf][Kernel] Persistent TopK scheduler: unified CUDAGraph-safe kernel with dynamic per-row dispatch - DeepSeek-V3.2 DSA decode (#37421) 
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
 2026-04-08 13:35:57 -04:00
Andrey Talman 2111997f96 [release 2.11] Update to torch 2.11 (#34644) 2026-04-07 18:55:48 -07:00
Flora Feng 5af684c319 [CI] Add reasoning parser tests to CI (#37025) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-08 00:57:36 +00:00
Giancarlo Delfin 5daf62271d [Model Runner V2] Fuse probabilistic rejection sample kernels (#38496) 
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
 2026-04-07 17:37:37 -07:00
bnellnm f01482408c [MoE Refactor][Test] FusedMoE layer test (#24675) 
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-04-06 17:17:23 +00:00
Andreas Karatzas 780ba37458 [ROCm][Quantization] Add asymmetric INT8 quantization support to TritonInt8ScaledMMLinearKernel (#38501) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-04-06 09:42:10 +08:00
Micah Williamson 9570654c6d [ROCm][CI] Run Kernels Core Operation Test On MI325 and mitigate flakiness (#38184) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-04-06 09:42:02 +08:00
Kevin H. Luu 56de443db1 [ci] Switch some CI jobs to H200 MIG slices (#38956) 2026-04-05 13:26:11 -07:00
Kevin H. Luu f0d3ad9f3e [ci] Remove soft fail for AMD image build job (#38941) 
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
 2026-04-03 20:42:33 +00:00
Divin Honnappa 121ea5a21f Removed GPU state confirmation and cleanup steps. (#38238) 
Signed-off-by: Divin Honnappa <divin.honnappa@amd.com>
 2026-04-03 13:11:08 -07:00
Jeffrey Wang ab79863e6c Remove MQ multi-node tests (#38934) 
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
 2026-04-03 20:00:08 +00:00
Nick Hill 5f1de2b14b [Model Runner V2] Add config validation for not-yet-supported features (#38758) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-04-03 12:08:08 -07:00
xiangdong 40ee64c00e [XPU][CI] Skip test_topp_only and test_topk_and_topp cases on Intel GPU in CI (#38904) 
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
 2026-04-03 20:44:52 +08:00
Anton Ivanov abebd9323d [CPU] Replace OMP initialization (#36487) 
Signed-off-by: Anton Ivanov <anton.ivanov@cambridgegreys.com>
 2026-04-03 18:42:43 +08:00
xiangdong cb4ff07f8b [XPU][CI] Skip test_topk_only cases on Intel GPU in CI (#38899) 
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
 2026-04-03 09:50:41 +00:00
Varun Sundar Rabindranath 2ad7c0335f [Model] Add Phi4ForCausalLMV for microsoft/Phi-4-reasoning-vision-15B (#38306) 
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
 2026-04-02 21:14:57 -07:00
Carl Y 1f5ec2889c [mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205) 
Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Signed-off-by: Carl Y <4531192+carlyou@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-04-02 21:16:11 -04:00
Stefano Castagnetta 188defbd0b [CI] Add flashinfer.py to attention test source deps (#38792) 
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2026-04-02 19:24:29 +00:00
Yanan Cao ecd5443dbc Bump helion dependency from 0.3.2 to 0.3.3 (#38062) 
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-04-02 10:59:33 -07:00
Jeffrey Wang de5e6c44c6 [Feat][Executor] Introduce RayExecutorV2 (#36836) 
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
 2026-04-01 14:34:29 -07:00
Luka Govedič 40bb175027 [vLLM IR] 1/N Implement IR skeleton and rms_norm op (#33825) 
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Luka Govedič <ProExpertProg@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
 2026-03-31 22:15:05 -04:00
Yi Liu 0dd25a44ea [Quantization][Autoround][XPU] Add W4A16 Support (#37986) 
Signed-off-by: yiliu30 <yi4.liu@intel.com>
 2026-03-31 16:48:24 +00:00
wenjun liu e8057c00bc [CI] Avoid concurrent docker pull in intel XPU CI runners to prevent rate limit issues (#38594) 
Signed-off-by: wendyliu235 <wenjun.liu@intel.com>
 2026-03-31 22:23:18 +08:00
Ilya Markov abdbb68386 [EPLB] Add alternative communication for EPLB weight exchange (#33176) 
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
Co-authored-by: Markov Ilya <markovilya19@gmail.com>
 2026-03-31 08:17:12 -04:00
Yintong Lu f09daea261 [CPU] Support int8 compute mode in CPU AWQ (#35697) 
Signed-off-by: Yintong Lu <yintong.lu@intel.com>
 2026-03-31 15:27:37 +08:00
Kevin H. Luu 42318c840b [ci] Remove benchmarks job (#38611) 2026-03-31 06:46:21 +00:00
Louie Tsai 44eef0ca1e vLLM Benchmark Suite perf regression after PR#32723 (#38576) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-03-31 05:23:17 +00:00
Li, Jiang 6557f4937f [Bugfix][CPU] Skip set_num_threads after thread binding (#38535) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-03-30 20:13:00 +08:00
Kevin H. Luu fec5aeca12 [ci] Soft fail and disable retry for AMD build image job (#38505) 
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
 2026-03-29 23:05:26 -07:00
Andreas Karatzas 4f2ed5fddb [ROCm][CI] Enable hybrid chunked prefill test (#38317) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-30 10:30:26 +08:00
Kyle Sayers d28d86e8a3 [QeRL] Fix online quantized reloading (#38442) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
 2026-03-29 14:56:41 -06:00
TJian 58a249bc61 [ROCm] [Release] Update ROCm variant from rocm700 to rocm721 (#38413) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-03-28 06:07:03 +00:00
Sage Moore 497e234d38 [EPLB] Cleanup the transfer logic for the various eplb maps (#34520) 
Signed-off-by: Sage Moore <sagmoore@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2026-03-27 10:18:46 +01:00
Shengqi Chen 84e439a9cb [CI/Build] Move nightly wheel index generation to a single post-build step (#38322) 
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2026-03-27 07:44:18 +00:00
wenjun liu d86060122a [CI/Build] enable Intel XPU test flow with prebuilt image (#37447) 
Signed-off-by: wendyliu235 <wenjun.liu@intel.com>
 2026-03-26 18:16:04 -07:00
Giancarlo Delfin c32e97602d [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) 
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
 2026-03-26 13:38:12 -07:00
TJian bc9c6fbbe6 [ROCm] [Bugfix] [Release] Fix nightly rocm release pipeline (#38263) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-03-26 18:47:10 +00:00
Andreas Karatzas bff9a1c266 [ROCm][CI] Override PYTORCH_ROCM_ARCH with detected GPU arch in test containers (#38165) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-26 18:33:45 +00:00
Andreas Karatzas 9c3ae04bfe [ROCm][CI] Add LM Eval Qwen3.5 Models test for MI355 (#38155) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-26 16:51:18 +00:00