A 2.6B model on an iPhone that always answers in valid JSON
DEV Community
A 2.6B model on an iPhone that always answers in valid JSON
Running LFM2-2.6B with llama.cpp fully offline on an iPhone 15: numbers, grammar-constrained JSON, and five problems we had to solve.
0 comments
No comments yet.