obscura/vllm
2
0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2026-06-06 00:16:14 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix] Fix Step3 pipeline parallel KeyError for residual tensor (#37622)

Browse Source 
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
This commit is contained in:
Joaquín Mondéjar
2026-05-29 12:04:02 +02:00
committed by GitHub
parent 7ebc0ec104
commit 60a7a2214f
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
vllm/model_executor/models/step3_text.py
+1 -1
View File
@@ -345,7 +345,7 @@ class Step3TextModel(nn.Module):
self.norm = PPMissingLayer()
self.make_empty_intermediate_tensors = make_empty_intermediate_tensors_factory(
["hidden_states"], config.hidden_size
["hidden_states", "residual"], config.hidden_size
)
def embed_input_ids(self, input_ids: torch.Tensor) -> torch.Tensor: