AINewsnow

I built STROT: An open "decision compiler": an LLM writes the pipeline once, then a model makes every decision locally, $0/record, no API at runtime

STROT compiles a decision task — "route these tickets", "score this feedback", "classify this text" — into a standalone pipeline. A large LLM is used once, at compile time, to synthesize the labels, the input projection, and the handlers. At runtime a small local model (144M, CPU) makes every decis…

Read the full story at r/huggingface ↗

Timeline · 1 report

  1. 2026-10-23 04:09 · r/huggingface
    I built STROT: An open "decision compiler": an LLM writes the pipeline once, then a model makes every decision locally, $0/record, no API at runtime

More stories

  1. OpenAI and Poland’s NASK partner to advance AI safety and security — OpenAI News
  2. Chinese state media: DeepSeek and MiniMax completed registration and won approval to open-source and deploy AI models overseas under proposed export controls (Bloomberg) — Techmeme
  3. The Signal Chats That Cost OpenAI Researchers Their Jobs — Wall Street Journal Technology
  4. Anthropic says it partnered with Theorem to use Claude to formally prove security properties at the assembly level across 100+ real-world open-source libraries (Anthropic) — Techmeme
  5. Sources: Anthropic and London-based PE firm Hg agree to launch a consultancy by the end of 2026 to embed AI consultants and engineers into European businesses (Financial Times) — Techmeme
  6. Sundar Pichai says Google is far from the ‘end state’ of self-improving AI — Business Insider AI
  7. Things will get ‘a lot worse before they get better’, experts warn amid AI security panic — The Independent Tech
  8. Anthropic strikes deal to launch European consultancy — Financial Times AI

Get the daily brief of stories like this at 6:30 every morning →