obscura/vllm
2
0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2026-08-22 13:40:15 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix] Fix Step3 pipeline parallel KeyError for residual tensor (#37622)

Browse Source 
Co-authored-by: Jee Jee Li <[email protected]>
This commit is contained in:
Joaquín Mondéjar
2026-05-29 03:04:02 -07:00
committed by GitHub
co-authored by Jee Jee Li
parent 7ebc0ec104
commit 60a7a2214f
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
vllm/model_executor/models/step3_text.py
+1 -1
View File
@@ -345,7 +345,7 @@ class Step3TextModel(nn.Module):
self.norm = PPMissingLayer()
self.make_empty_intermediate_tensors = make_empty_intermediate_tensors_factory(
["hidden_states"], config.hidden_size
["hidden_states", "residual"], config.hidden_size
)
def embed_input_ids(self, input_ids: torch.Tensor) -> torch.Tensor: