Skip to content

Commit 79432c2

Browse files
authored
Add Tokenizer from pythainlp.tokenize.Tokenizer
1 parent 4094632 commit 79432c2

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pythainlp/__init__.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,6 @@
2727
from pythainlp.soundex import soundex
2828
from pythainlp.spell import spell
2929
from pythainlp.tag import pos_tag
30-
from pythainlp.tokenize import sent_tokenize, tcc, word_tokenize
30+
from pythainlp.tokenize import sent_tokenize, tcc, word_tokenize, Tokenizer
3131
from pythainlp.transliterate import romanize, transliterate
3232
from pythainlp.util import collate, thai_strftime

0 commit comments

Comments
 (0)