AINewsnow

I ran local AI inference (AMD GPU) for 30 days and measured every watt — here's the real cost vs cloud APIs

I spent the last month tracking my local AI inference costs down to the wall plug. Here's what I found: Setup: AMD Radeon RX 7900 XTX (24 GB VRAM), llama.cpp, various Qwen/Ornith models in GGUF format. Over 30 days: 964 million input tokens consumed 13 million output tokens generated 30.20 kWh of e…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-25 12:20 · r/LocalLLM
    I ran local AI inference (AMD GPU) for 30 days and measured every watt — here's the real cost vs cloud APIs

More stories

  1. Qwen 3.8 Flash Next (Q4) got stuck on this loop for hours. I wonder if this is the AI equivalent of having a nightmare and not being able to wake up — r/LocalLLM
  2. Massive B70 spec-decoding improvement - Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp — r/LocalLLaMA
  3. I ran a blind test on local AI agents. Here are the results, guess who's who — r/AI_Agents
  4. What's the best front-end for LLM assisted studying? — r/LocalLLM
  5. It is not clear to me which parameter we should use for LoRA training—shift or sigmoid—in the new models (Qwen 2.1, LLaMA 2, and MOSS) within the AI ​​toolkit. — r/comfyui
  6. GitHub - vincalkr/DS41Engine: DeepSeek-V4.1-Flash 1017 on 1x-2x RX 7900 XTX (gfx1100, ROCm/HIP): max optimizations — r/LocalLLM
  7. How to Compare Quantized LLMs Fairly in llama.cpp: Same Bytes, Same Windows, Same GPU — DEV Community — Machine Learning
  8. LLM on Android Phone updates — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →