sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.

Latest version: 0.2.1

Add to xmake.lua

add_requires("sentencepiece 0.2.1")

Learn how to add and link packages with Xmake →

Information

License: Apache-2.0
Recipe updated: 2026-04-08T08:46:11.000Z

Platforms

linux: i386, x86_64, armv7, armv7s, arm64, mips, mips64, mipsel, mips64el, loong64, riscv64, s390x, ppc, ppc64, ppc64el, sparc64
macosx: x86_64, arm64
windows: x86, x64, arm, arm64, arm64ec

Options

builtin_protobuf: Use built-in protobuf. · Type: boolean · Default: true
external_abseil: Use external abseil. · Type: boolean · Default: false
tcmalloc: Use tcmalloc (gperftools) for better memory allocation performance. · Type: boolean · Default: false

Versions

v0.1.97
v0.1.99
v0.2.0
v0.2.1

Dependencies

cmake

Install with xrepo

Install the package independently of a project and inspect its available configuration.

install

xrepo install "sentencepiece 0.2.1"

show info

xrepo info "sentencepiece"

Link a library to your target

Declare the requirement, then attach the library to the target that uses it.

xmake.lua

add_requires("sentencepiece 0.2.1")

target("demo")
    set_kind("binary")
    add_files("src/*.cpp")
    add_packages("sentencepiece")

Open a package environment

Open a shell with the environment exported by this package. Use the executable names documented by the package.

enter shell

xrepo env -b "sentencepiece 0.2.1" shell