I have a hammer hanging above the hard drive on a string, and every time I want to access it, I have to convince an AI it's really me. If doubt level rises above 20%, the hammer drops.
Tokens are well-defined groups of bytes ranged by frequency of occurrence in texts to efficiently translate them into a sequence of 32 or 64-bit binary integers, an LLM-optimised form if compression. They are well-known, you can play with them here: https://gpt-tokenizer.dev/
It is an old, 7 months old thread about a different situation. I linked the repo so you would read beginning of README.