Behold the abomination I have created.

Building a second llm server to help offload the main one. This was done by scraping whatever scrap I could find. 3060 8GB + 3060 12GB + 4060 8GB. total of 28gb vram. Running qwen 3.8. Bench marking now.

Read the full story at r/LocalLLM ↗

Timeline · 1 report

2026-10-16 07:03 · r/LocalLLM
Behold the abomination I have created.

More stories

GLM 5.3 flash vs Qwen Flash Next? — r/LocalLLM
Alibaba launches Qwen N1 AI glasses with 50MP cameras and swappable batteries — Mint AI
Early test (flux 3 klein distilled) t2i — r/StableDiffusion
RTX 2080 Ti 22GB modded card for local LLM inference – anyone tested one? — r/LocalLLaMA
BlenderWorld Benchmark from Alibaba — r/LocalLLaMA
A dumb and pointless story about trying a cloud model after being fully local for a month — r/LocalLLM
So is my current ai setup good enough for game development on roblox? — r/AI_Agents
Small experiment: filtering training data for "good outcomes" taught a model the bad habits anyway — r/ArtificialInteligence

Get the daily brief of stories like this at 6:30 every morning →