cl100k-base

Open repos and models their makers tagged cl100k-base, most starred first. The same for everyone.

GitHubRepo

Tiktoken

High-performance .NET BPE tokenizer — up to 618 MiB/s, competitive with Rust. Zero-allocation counting, multilingual cache, o200k/cl100k/r50k/p50k encodings + HuggingFace tokenizer.json support.

  • 93
  • C#
  • MIT
  • 5 d ago
tryAGITake it
Search GitHub and Hugging Face for cl100k-base

Get , open it once and sign in. Then come back here and press the button again.