Why Your Vision Transformer Dumps Garbage Into Random Pixels Your transformer dumps computational garbage into random pixels because math forces it to. Register tokens solve this by providing proper workspace for the model's messy calculations.