sentencepiece
Install command:
brew install sentencepieceUnsupervised text tokenizer and detokenizer
https://github.com/google/sentencepiece
License: Apache-2.0
Development: Pull requests
Formula JSON API: /api/formula/sentencepiece.json
Formula code: sentencepiece.rb on GitHub
Bottle (binary package) installation support provided for:
| macOS on Apple Silicon |
golden gate | ✅ |
|---|---|---|
| tahoe | ✅ | |
| sequoia | ✅ | |
| Linux | ARM64 | ✅ |
| x86_64 | ✅ |
Current versions:
| stable | ✅ | 0.2.3 |
| head | ⚡️ | HEAD |
Depends on:
| abseil | 20260817.0 | C++ Common Libraries |
| protobuf | 36.2 | Protocol buffers (Google's data interchange format) |
Depends on when building from source:
| cmake | 4.4.5 | Cross-platform make |
| flatbuffers | 25.12.19 | Serialization library for C++, supporting Java, C#, and Go |
| pybind11 | 3.1.0 | Seamless operability between C++11 and Python |
| python-setuptools | 84.2.1 | Easily download, build, install, upgrade, and uninstall Python packages |
| python@3.15 | 3.15.2 | Interpreted, interactive, object-oriented programming language |
Binaries:
spm_decode,
spm_encode,
spm_export_vocab,
spm_normalize,
spm_train
Analytics:
| 30 days | 90 days | 365 days | |
|---|---|---|---|
| Installs | 1,113 | 1,540 | 4,108 |
Installs (--HEAD) | 1 | 1 | 1 |
| Installs on Request | 349 | 497 | 1,215 |
Installs on Request (--HEAD) | 1 | 1 | 1 |
| Build Errors | 0 |