Run a 48 GB AI Model on a 32 GB Laptop: Janas Streams Model Experts From Your SSD at 37 tok/s
DEV Community
Run a 48 GB AI Model on a 32 GB Laptop: Janas Streams Model Experts From Your SSD at 37 tok/s
The wall everyone hits with local models is always the same one: the model you actually want to run...
0 comments
No comments yet.