AINewsnow

I made Ignis: an open-source engine that only runs Qwen3.8-27B on one RTX 5090, and that's the point. 512K context, Very Fast and JEV-live Support for Images and long text/logs retrival

This story is from 2026-10-04. It is preserved in the archive; the latest stories are on the live feed.

Hi r/LocalLLM , Everything started from Ninfer... But it was not enough. So for the last few weeks I've been building from scratch (except for some kernels) Ignis , an Apache-2.0 inference engine in rust that deliberately gives up generality: one model family (Qwen3.8-27B NVFP4), one class of card…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-04 18:07 · r/LocalLLM
    I made Ignis: an open-source engine that only runs Qwen3.8-27B on one RTX 5090, and that's the point. 512K context, Very Fast and JEV-live Support for Images and long text/logs retrival

More stories

  1. pgEdge Adds TypeSafe's Jev to Workbench Beta for PostgreSQL Alert Triage — Unite.AI
  2. Stop Paying LLM Prices for an if Statement: A Field Guide to Decision Models in Late 2026 — DEV Community — Machine Learning
  3. Jev’s Typed Outputs Replace LLM Output Parsing for Closed-Set Decisions — DEV Community — AI
  4. "Where is all the automation?" — Diogo Almeida, TypeSafe AI — AI Engineer (YouTube)
  5. Google enters decision model market as AI Engineer demos highlight classifier use cases — Latent Space
  6. Jev creator urges developers to automate everything at AI Engineer Code Summit — Latent Space
  7. OpenAI launches GPT-6.2 Astra and Sol as Google ships Gemini 4 Neon and Microsoft unveils MAI Code 2 — OpenAI News
  8. Anthropic debuts on Nasdaq with record $81.3 billion IPO, hitting $2 trillion value — Anthropic (X)

Read the Daily Brief: the day's most important AI stories →