Kinetic: a new open-source LLM engine in Rust. Runs your GGUFs on Windows and Linux, replaces llama-server with the same flags
Hey r/LocalLLM :) We just open-sourced Kinetic, a new inference engine written in Rust. runs the GGUF files you already have, no conversion Windows and Linux, one binary CPU, NVIDIA (CUDA), and AMD and Intel GPUs (Vulkan) replaces llama-server with the same flags; OpenAI, llama-server and Ollama AP…
Read the full story at r/LocalLLM ↗