the.bay.news

Last-llama.cpp.zig v0.1.0 - GGUF Inference for Zig on Windows

Ziggit
Last-llama.cpp.zig v0.1.0 - GGUF Inference for Zig on Windows
Last-llama.cpp.zig My first public release of Last-llama.cpp.zig, a standalone Windows runtime and CLI for running local GGUF language models with Zig and llama.cpp. It provides separate CPU and NVIDIA CUDA workers, a simple command-line interface, and a versioned JSON-lines protocol that Zig applications can call directly. It supports explicit backend selection, structured JSON output, model aliases, lifecycle cleanup, and runtime/model identity information. It does not download models au...

0 comments

Sign in to join the discussion — your thebay.events account works here.

No comments yet.