Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

Article URL: https://github.com/cobanov/PS5LM Comments URL: https://news.ycombinator.com/item?id=50122431 Points: 116 # Comments: 33

Read the full story at Hacker News Front Page ↗

Timeline · 1 report

2026-10-16 18:32 · Hacker News Front Page
Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

More stories

Fully local, private voice + chat AI assistant (zero cloud) — Qwen3.8-27B on 2× RTX PRO — r/LocalLLM
Qwen3.8 Flash Next (Low Quant) vs 27B Q5: Is Strata Worth It on a 32GB VRAM + 32GB RAM System? — r/LocalLLM
MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis — arXiv cs.CL
QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases — r/LocalLLaMA
Gemini leaked its thinking tokens by just asking what tag it uses to end thinking — r/ArtificialInteligence
Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels. — r/LocalLLaMA
P100 (sm_60) patches for llama.cpp: +42% decode and +74% short-prefill on a 2×P100 tensor split — r/LocalLLM
Qwen3.8FN vLLM vs. llama.cpp vs Ninfer6000 — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →