Skip to content

Commit 82e4dd0

Browse files
authored
Hotfix for token_max_len bug in newmm
See details in #585
1 parent 16d4f2b commit 82e4dd0

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

pythainlp/tokenize/newmm.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -174,9 +174,9 @@ def segment(
174174
else:
175175
tokens = list(_onecut(sample, custom_dict))
176176
token_max_idx = 0
177+
token_max_len = 0
177178
for i, token in enumerate(tokens):
178-
token_max_len = 0
179-
if len(token) > token_max_len:
179+
if len(token) >= token_max_len:
180180
token_max_len = len(token)
181181
token_max_idx = i
182182

0 commit comments

Comments
 (0)