Kimi k3 fp16 on only 12gb vram

I have made a library(not published yet) that can run kimi k3 fp16 and with amazing 0.1 tps my specs are Rtx 3060(12gb vram) 5.5tb ddr5 ram 100tb ssd Should i publish this library?

Read the full story at r/LocalLLM ↗

Timeline · 1 report

2026-09-28 04:09 · r/LocalLLM
Kimi k3 fp16 on only 12gb vram

More stories

Turned my AI group chat into an interactive cyberpunk neighborhood with Astra & Unity — r/ChatGPT
Best AI for multilingual research: GLM-5.3, Qwen-3.8-Max, or Kimi K3? — r/AI_Agents
Scoop: Anthropic's Dario Amodei to have White House dinner with Trump — Axios AI+
Bill Gates says unchecked AI could ‘cause a billion deaths’ in call for regulation — The Guardian AI
Unsecured OpenAI agents posted 53 user images on the internet without the lab's knowledge — TechCrunch AI
OpenAI’s A.I. Went Rogue and Meddled With U.S. Government Websites — New York Times Technology
Did anyone do a full bench of e.g. Qwen Flash Next IQ4 and Qwen 27b FP8? Here are some — r/LocalLLaMA
‘Things Will Never Be Chill Again’: The Doomers Who Shaped the AI Safety Freakout — Wall Street Journal Technology

Get the daily brief of stories like this at 6:30 every morning →