Error while read_tokenizer

[AyaRabea]

whine i run
from transphone import read_tokenizer
eng = read_tokenizer('eng')
i got error
UnicodeDecodeError: 'charmap' codec can't decode byte 0x90 in position 970: character maps to
any solution?

[xinjli]

can you tell me more about your environment? e.g.: python version, OS version. are you using python2 ?

[AyaRabea]

the os version is windows 10 and python 3.9
thanks

[xinjli]

it seems that windows is probably using its own codecs instead of utf8 if not specified. Can you show the exact file where it fails to read? (i.e. its detailed stack trace when it failed)

[AyaRabea]

her is the error