Hi, I'm trying to run tokenizer training using token_train.py, but I'm running into this error:
Traceback (most recent call last):
File "token_train.py", line 11, in <module>
from data import preprocess_morph_tag
ImportError: cannot import name 'preprocess_morph_tag' from 'data'
Is a file missing from the repo? Can you point me to preprocess_morph_tag?
Thanks!