โ‰ˆ the.bay.news

A 2.6B model on an iPhone that always answers in valid JSON

DEV Community
A 2.6B model on an iPhone that always answers in valid JSON
Running LFM2-2.6B with llama.cpp fully offline on an iPhone 15: numbers, grammar-constrained JSON, and five problems we had to solve.

0 comments

Sign in to join the discussion โ€” your thebay.events account works here.

No comments yet.