bge-reranker Truncates at 512 Tokens: 31% of My Chunks Got Cut
DEV Community
bge-reranker Truncates at 512 Tokens: 31% of My Chunks Got Cut
Why a cross-encoder reranker truncates at 512 tokens, which part of your chunk it silently drops, and how to detect and fix it in RAG.
0 comments
No comments yet.