AINewsnow

I track how much each provider charges for the same open LLM: Llama 3.3 70B ranges from $0.155 to $0.78 per 1M tokens

Disclosure: this is my own project. If you call an open-weight model through an API, the price you pay depends heavily on who serves it. The same model, same weights, can cost several times more at one provider than at another. I built a small monitor that checks this every 5 minutes. Here's how it…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-11-04 02:24 · DEV Community — AI
    I track how much each provider charges for the same open LLM: Llama 3.3 70B ranges from $0.155 to $0.78 per 1M tokens

More stories

  1. Anthropic releases FlashProve, an open-source prototype that cryptographically verifies an AI response came from a given model, not one that a router swapped in (Anthropic) — Techmeme
  2. NVIDIA Shrinks DeepSeek V4.1 Flash by 75 GiB With Almost No Quality Loss — AlphaSignal
  3. The 40% Performance Tax of Ollama: Why Developers Are Moving Back to Raw llama.cpp and vLLM — DEV Community — AI
  4. [llama.cpp fork]: QFN + [specific quant] + [ultra specific hardware config] = [incredible and irreproducible pp and tg] — r/LocalLLaMA
  5. Anthropic open-sources FlashProve, zkSNARK proofs for 400B Llama 4 Maverick inference (110 tok/s on 1 H100) — r/machinelearningnews
  6. gemma4: graph optimizations (massive gains on pp for E2B and E4B) by max-krasnyansky · Pull Request #31356 · ggml-org/llama.cpp — r/LocalLLaMA
  7. SillyTavern LLM settings for an OpenAI-compatible API — DEV Community — AI
  8. Choosing the Right Base Model for Fine-Tuning LLMs: Strategy Before Execution — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →