the.bay.news

Context window sizing for fine-tuning: how long should your training examples be?

DEV Community
Context window sizing for fine-tuning: how long should your training examples be?
Fine-tuning example length is a design decision, not a byproduct of your data. Pad too short and you teach a distribution you'll never see at inference; let examples sprawl and you pay quadratic training cost to memorize context you should be retrieving. How to size training sequences to the context you'll actually serve.

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.