Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
flexitok 's Collections
flexitok-mod-tokenizers-zero-padded
flexitok/mod-tokenizers
flexitok/fineweb2-hq-superset-tokenizers
Fineweb2-HQ-Tokenizers
merging-toksuite
baselines

flexitok/mod-tokenizers

updated 2 days ago
Upvote
-

  • flexitok/mod-tokenizers-individual

    3.42M • Updated about 19 hours ago • 35

  • flexitok/mod-tokenizers-ltr_3digit

    3.93M • Updated about 19 hours ago • 77

  • flexitok/mod-tokenizers-ltr_2digit

    3.46M • Updated about 19 hours ago • 70

  • flexitok/mod-tokenizers-ltr_4digit

    8.53M • Updated about 19 hours ago • 50

  • flexitok/mod-tokenizers-ltr_5digit

    Updated about 19 hours ago

  • flexitok/mod-tokenizers-rtl_2digit

    3.46M • Updated about 19 hours ago • 70

  • flexitok/mod-tokenizers-rtl_3digit

    3.93M • Updated about 19 hours ago • 71

  • flexitok/mod-tokenizers-rtl_4digit

    8.53M • Updated about 19 hours ago • 64

  • flexitok/mod-tokenizers-rtl_5digit

    Updated about 19 hours ago

  • flexitok/mod-arithmetic

    Viewer • Updated 2 days ago • 2.73M • 59

  • flexitok/supertokenizer-mod_tokenizers

    54.6M • Updated about 20 hours ago • 106
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs