obscura/vllm
2
0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2026-08-24 14:40:09 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix shape comment in extract_hidden_states example (#38723)

Browse Source 
Signed-off-by: Fynn Schmitt-Ulms <[email protected]>
This commit is contained in:
Fynn Schmitt-Ulms
2026-04-01 07:29:33 -07:00
committed by GitHub
parent 7cf56a59a2
commit fa246d5231
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
examples/offline_inference/extract_hidden_states.py
+1 -1
View File
@@ -54,5 +54,5 @@ with tempfile.TemporaryDirectory() as tmpdirname:
print("Extracted token ids:", token_ids) # Matches prompt token ids
print(
"Extracted hidden states shape:", hidden_states.shape
) # [num_hidden_layers, prompt len, hidden size]
) # [prompt len, num_hidden_layers, hidden size]
print("Extracted hidden states:", hidden_states)