Skip to content

Conversation

@haiyuewa
Copy link
Contributor

Test 'Q4_K_M' quantization on https://huggingface.co/pfnet/plamo-2-translate

The 'suffix_to_score' size is 193510, it needs 19 memory allocation with final capacity 262144 to hold the value, if not preserve the memory.

Make sure to read the contributing guidelines before submitting a PR

Test 'Q4_K_M' quantization on https://huggingface.co/pfnet/plamo-2-translate

The 'suffix_to_score' size is 193510, it needs 19 memory allocation with final
capacity 262144 to hold the value, if not preserve the memory.

Signed-off-by: Haiyue Wang <haiyuewa@163.com>
@CISC
Copy link
Collaborator

CISC commented Nov 18, 2025

Nice catch, thank you!

@CISC CISC merged commit a045492 into ggml-org:master Nov 18, 2025
72 of 74 checks passed
@haiyuewa haiyuewa deleted the reserve-std-vector-size branch November 19, 2025 00:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants