the.bay.news

What a Code Completer's Eval Never Measures: Ghost Text

DEV Community
What a Code Completer's Eval Never Measures: Ghost Text
A hybrid n-gram and 2.48M-parameter code completer that gets 54.6% of tokens right, tuned dial by dial against its own held-out eval. Then I scored the one feature that emits more than a single token and it came back at 0.070, because the eval hands the model a true prefix and the feature hands it its own output.

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.