Tokenizer test cases and reformatting of tokenizer training file#41

chandanms merged 14 commits intosimple-stories:devsimple-stories/simple_stories_train:devfrom

chandanms:feature/tokenizer_test_caseschandanms/simple_stories_train:feature/tokenizer_test_casesCopy head branch name to clipboard