≈ the.bay.news

Llama.cpp: lack of configuration tutorial videos

NixOS Discourse
Llama.cpp: lack of configuration tutorial videos
I’ve wanted to use llama-cpp but the biggest barrier I have right now is figuring out how to configure it into my configuration.nix file. I’ve seen millions of tutorials on how to configure ollama and it’s very easy to setup. Even the NixOS wiki is pretty straight forward and easy. I’m currently still use ollama, but I still want to shift to llama-cpp. I feel like we’re lacking a tutorial or video on how to configure llama-cpp, and I think if there were more, it’d probably get more people to ...

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.