sentencepiece
Install command:
brew install sentencepieceUnsupervised text tokenizer and detokenizer
https://github.com/google/sentencepiece
License: Apache-2.0
Development: Pull requests
Formula JSON API: /api/formula/sentencepiece.json
Formula code: sentencepiece.rb on GitHub
Bottle (binary package) installation support provided for:
| macOS on Apple Silicon |
tahoe | ✅ |
|---|---|---|
| sequoia | ✅ | |
| sonoma | ✅ | |
| ventura | ✅ | |
| macOS on Intel |
sonoma | ✅ |
| ventura | ✅ | |
| Linux | ARM64 | ✅ |
| x86_64 | ✅ | |
Current versions:
| stable | ✅ | 0.2.1 |
| head | ⚡️ | HEAD |
Depends on when building from source:
| cmake | 4.2.3 | Cross-platform make |
Analytics:
| Installs (30 days) | |
|---|---|
sentencepiece |
200 |
| Installs on Request (30 days) | |
sentencepiece |
87 |
| Build Errors (30 days) | |
sentencepiece |
1 |
| Installs (90 days) | |
sentencepiece |
501 |
| Installs on Request (90 days) | |
sentencepiece |
246 |
| Installs (365 days) | |
sentencepiece |
3,677 |
sentencepiece --HEAD |
13 |
| Installs on Request (365 days) | |
sentencepiece |
3,310 |
sentencepiece --HEAD |
13 |