Stable Diffusion Tokenizer

How your prompt/words gets turned into tokens. Privately. For Stable Diffusion models.

# tokens
Tokens:
Input ids:

Notes

End of word character </w>

End of word character (</w>) is part of the token to represent a token that is at the end of the word. This is different than if it was at the start of word, or in the middle of a word.

Token highlighting

Tokens have alternating background colors to represent how the words can be broken up.