AINewsnow

We tested Qwen3.6 27B, Qwen3.8 27B and GLM-5.3 Flash on real tasks in Elixir, OCaml, Haskell and 10 other less common languages

Hi! My team and I built a benchmark of 202 real GitHub tasks in 13 languages that rarely show up in coding benchmarks: Elixir, OCaml, Haskell, Clojure, Kotlin, Swift, Julia, R and others. I think a lot of people do local development in these languages too. We didn’t have a huge compute budget, so I…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-10 14:48 · r/LocalLLaMA
    We tested Qwen3.6 27B, Qwen3.8 27B and GLM-5.3 Flash on real tasks in Elixir, OCaml, Haskell and 10 other less common languages

More stories

  1. China Mobile Cloud and Zhipu Plan GLM Integration and Joint AI Coding Products — Pandaily
  2. GLM-5.3-CYBERSECURITY-FP8: Inside the Refusal-Removed AI Model for Red Teaming — DEV Community — Machine Learning
  3. AI-Assisted Development Cost Reduction 2026: Real Savings & Pitfalls — DEV Community — AI
  4. Scantist Shrinks GLM-5.3 by 25% to Fit on a Single NVIDIA B200 — AlphaSignal
  5. Google rolls out Gemini 4 Carbon across Copilot, API, and subscription tiers — Google DeepMind Blog
  6. OpenAI launches Businesses in ChatGPT in beta with claimable profiles and agents — OpenAI News
  7. Anthropic brings Claude to Google Meet and launches AI office productivity tools — Anthropic (X)
  8. Anthropic launches IPO roadshow targeting up to $1.4 trillion valuation — CNBC Technology

Get the daily brief of stories like this at 6:30 every morning →