BPE Tokenization: A Trailing Space in My Prompt Broke 41 of 300 Labels
DEV Community
BPE Tokenization: A Trailing Space in My Prompt Broke 41 of 300 Labels
BPE tokenization glues spaces onto the next word, so a trailing space in your prompt pushes the model off-distribution. Cause and fix.
0 comments
No comments yet.