Last-llama.cpp.zig v0.1.0 - GGUF Inference for Zig on Windows
Ziggit
Last-llama.cpp.zig v0.1.0 - GGUF Inference for Zig on Windows
Last-llama.cpp.zig My first public release of Last-llama.cpp.zig, a standalone Windows runtime and CLI for running local GGUF language models with Zig and llama.cpp. It provides separate CPU and NVIDIA CUDA workers, a simple command-line interface, and a versioned JSON-lines protocol that Zig applications can call directly. It supports explicit backend selection, structured JSON output, model aliases, lifecycle cleanup, and runtime/model identity information. It does not download models au...
0 comments
No comments yet.