GitHub - kayces/gpt_tokenizer: BPE tokenizer used for Dart/Flutter applications when calling ChatGPT APIs

kayces / gpt_tokenizer Public

forked from SimonWang9610/gpt_tokenizer

Notifications You must be signed in to change notification settings
Fork 0
Star 1

BPE tokenizer used for Dart/Flutter applications when calling ChatGPT APIs

pub.dev/packages/flutter_gpt_tokenizer

1 star 7 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 17 Commits
assets		assets
packages		packages
scripts		scripts
.gitignore		.gitignore
Cargo.toml		Cargo.toml
README.md		README.md
analysis_options.yaml		analysis_options.yaml
melos.yaml		melos.yaml
pubspec.yaml		pubspec.yaml

Repository files navigation

cargo build only re-run tokenizer/build.rs when the symbols are changed
cocopods 1.12.0 supports slice_type: .dylib. see github
build-apple.sh
- if LIBNAME=libgpt_tokenizer.a, everything works well

About

BPE tokenizer used for Dart/Flutter applications when calling ChatGPT APIs

pub.dev/packages/flutter_gpt_tokenizer

Report repository

Releases

No releases published

Packages

No packages published

Languages

Dart 33.4%
Rust 24.5%
CMake 12.1%
C++ 11.7%
C 8.1%
Shell 6.6%
Other 3.6%