Unsupervised text tokenizer and detokenizer
https://github.com/google/sentencepiece
License: Apache-2.0
Formula JSON API: /api/formula/sentencepiece.json
Formula code: sentencepiece.rb
on GitHub
Bottle (binary package) installation support provided for:
Apple Silicon | sequoia | ✅ |
---|---|---|
sonoma | ✅ | |
ventura | ✅ | |
monterey | ✅ | |
Intel | sonoma | ✅ |
ventura | ✅ | |
monterey | ✅ | |
64-bit linux | ✅ |
Current versions:
stable | ✅ | 0.2.0 |
head | ⚡️ | HEAD |
Depends on when building from source:
cmake | 3.31.5 | Cross-platform make |
Analytics:
Installs (30 days) | |
---|---|
sentencepiece |
238 |
sentencepiece --HEAD |
2 |
Installs on Request (30 days) | |
sentencepiece |
218 |
sentencepiece --HEAD |
2 |
Build Errors (30 days) | |
sentencepiece |
0 |
Installs (90 days) | |
sentencepiece |
407 |
sentencepiece --HEAD |
3 |
Installs on Request (90 days) | |
sentencepiece |
364 |
sentencepiece --HEAD |
3 |
Installs (365 days) | |
sentencepiece |
1,088 |
sentencepiece --HEAD |
3 |
Installs on Request (365 days) | |
sentencepiece |
975 |
sentencepiece --HEAD |
3 |