Skip to content

Commit 6c6bec2

Browse files
authored
Update _utils.py
fix empty string bug #911
1 parent a38fd5e commit 6c6bec2

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

pythainlp/tokenize/_utils.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -61,8 +61,8 @@ def rejoin_formatted_num(segments: List[str]) -> List[str]:
6161
connected_token += segments[segment_idx]
6262
pos += len(segments[segment_idx])
6363
segment_idx += 1
64-
65-
tokens_joined.append(connected_token)
64+
if connected_token :
65+
tokens_joined.append(connected_token)
6666
match = next(matching_results, None)
6767
else:
6868
tokens_joined.append(token)

0 commit comments

Comments
 (0)