Metadata-Version: 2.1
Name: tokenizers
Version: 0.0.2
Summary: Fast and Customizable Tokenizers
Home-page: https://github.com/huggingface/tokenizers
Author: Anthony MOI
Author-email: anthony@huggingface.co
License: Apache License 2.0
Platform: UNKNOWN

UNKNOWN


