Enter a valid HuggingFace model ID (e.g., "mistralai/Mistral-7B-Instruct-v0.3")
The model must have a tokenizer available and must be not restricted. (with some exceptions)
Also some models have restrictions. You can use mirrored versions, like unsloth to omit that.
Like ("unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit") instead of original path.
Loaded
Token Visualization
Note: Showing preview of first 8096 characters. Stats are calculated on the full file.
Note: Only showing first 50,000 tokens. Total token count: 0