Running ggml-org/Laya-GGUF in your own app with NobodyWho, no server
laya is a decision model: it scores a set of answers you define instead of writing text. the Q8_0 file on ggml-org/Laya-GGUF is 449 MB and apache-2.0. nobodywho, an open-source engine for running models on-device, now loads it in all six of its bindings: python, flutter, react native, swift, kotlin…
Read the full story at r/huggingface ↗
Timeline · 1 report
- 2026-10-29 16:50 · r/huggingface
Running ggml-org/Laya-GGUF in your own app with NobodyWho, no server