Unsupervised text tokenizer and detokenizer
https://github.com/google/sentencepiece
License: Apache-2.0
Formula JSON API: /api/formula/sentencepiece.json
Formula code: sentencepiece.rb
on GitHub
Bottle (binary package) installation support provided for:
Apple Silicon | sequoia | ✅ |
---|---|---|
sonoma | ✅ | |
ventura | ✅ | |
monterey | ✅ | |
Intel | sonoma | ✅ |
ventura | ✅ | |
monterey | ✅ | |
64-bit linux | ✅ |
Current versions:
stable | ✅ | 0.2.0 |
head | ⚡️ | HEAD |
Depends on when building from source:
cmake | 3.31.3 | Cross-platform make |
Analytics:
Installs (30 days) | |
---|---|
sentencepiece |
89 |
sentencepiece --HEAD |
1 |
Installs on Request (30 days) | |
sentencepiece |
80 |
sentencepiece --HEAD |
1 |
Build Errors (30 days) | |
sentencepiece |
0 |
Installs (90 days) | |
sentencepiece |
227 |
sentencepiece --HEAD |
1 |
Installs on Request (90 days) | |
sentencepiece |
194 |
sentencepiece --HEAD |
1 |
Installs (365 days) | |
sentencepiece |
896 |
sentencepiece --HEAD |
1 |
Installs on Request (365 days) | |
sentencepiece |
794 |
sentencepiece --HEAD |
1 |