โ‰ˆ the.bay.news

Code Search RAG: Chunk by Function With tree-sitter, Not by 512 Tokens

DEV Community
Code Search RAG: Chunk by Function With tree-sitter, Not by 512 Tokens
Fixed token windows cut functions in half. A runnable tree-sitter chunker that splits Python by function and class, scored against plain token windows.

0 comments

Sign in to join the discussion โ€” your thebay.events account works here.

No comments yet.