sentencepiece
Install command:
brew install sentencepieceUnsupervised text tokenizer and detokenizer
https://github.com/google/sentencepiece
License: Apache-2.0
Development: Pull requests
Formula JSON API: /api/formula/sentencepiece.json
Formula code: sentencepiece.rb on GitHub
Bottle (binary package) installation support provided for:
| macOS on Apple Silicon |
golden gate | ✅ |
|---|---|---|
| tahoe | ✅ | |
| sequoia | ✅ | |
| Linux | ARM64 | ✅ |
| x86_64 | ✅ |
Current versions:
| stable | ✅ | 0.2.2 |
| head | ⚡️ | HEAD |
Depends on:
| abseil | 20260817.0 | C++ Common Libraries |
| protobuf | 36.2 | Protocol buffers (Google's data interchange format) |
Depends on when building from source:
| cmake | 4.4.4 | Cross-platform make |
Binaries:
spm_decode,
spm_encode,
spm_export_vocab,
spm_normalize,
spm_train
Analytics:
| 30 days | 90 days | 365 days | |
|---|---|---|---|
| Installs | 250 | 756 | 3,135 |
| Installs on Request | 97 | 252 | 943 |
| Build Errors | 1 |