Skip to content

Commit 1f6fd40

Browse files
committed
Use get_input_embeddings
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
1 parent 5e02178 commit 1f6fd40

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

vllm/model_executor/models/llama_eagle3.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -249,8 +249,7 @@ def get_input_embeddings(
249249
multimodal_embeddings: Optional[NestedTensors] = None,
250250
is_multimodal: Optional[torch.Tensor] = None,
251251
) -> torch.Tensor:
252-
# The llama3 drafter only processes text embeddings
253-
return self.model.embed_tokens(input_ids)
252+
return self.model.get_input_embeddings(input_ids)
254253

255254
def forward(
256255
self,

0 commit comments

Comments
 (0)