Anyone running Freetoken with MoE offload?

How's that working out compared to llamaCPP MoE offload? I haven't gotten a chance to run this but it seems to be gaining some traction.

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

2026-09-27 14:12 · r/LocalLLaMA
Anyone running Freetoken with MoE offload?

More stories

Scoop: Anthropic's Dario Amodei to have White House dinner with Trump — Axios AI+
Bill Gates says unchecked AI could ‘cause a billion deaths’ in call for regulation — The Guardian AI
Scoop: Top AI companies probing tens of thousands of security incidents — Axios AI+
Unsecured OpenAI agents posted 53 user images on the internet without the lab's knowledge — TechCrunch AI
‘Things Will Never Be Chill Again’: The Doomers Who Shaped the AI Safety Freakout — Wall Street Journal Technology
OpenAI’s A.I. Went Rogue and Meddled With U.S. Government Websites — New York Times Technology
Meet the Data Agent in ChatGPT Work — OpenAI YouTube
Is Qwen Flash Next at like Q2 better than 27B at Q4? — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →