AINewsnow

77.1% on BIRD dev with one model call per question, and a test-set submission in

This story is from 2026-10-22. It is preserved in the archive; the latest stories are on the live feed.

BIRD is the text-to-SQL benchmark the serious systems compete on: 1,534 dev questions over 11 real databases, scored by execution accuracy, with a hidden test set that only the BIRD team can run. I ran schemagate on the full dev set this week and sent the test-set submission. Dev set, all 1,534 que…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-22 14:55 · DEV Community — AI
    77.1% on BIRD dev with one model call per question, and a test-set submission in

More stories

  1. OlmoEarth v1.3: State-of-the-art embeddings for the whole planet — Allen Institute for AI (Ai2)
  2. Anthropic takes on Muse with Claude Duet, its new AI agent — The Verge AI
  3. Barclays to cut 5,000 jobs as bank steps up AI adoption — Financial Times AI
  4. NVIDIA Unveils Minerva to Bring End-to-End Observability for AI Factories — NVIDIA Blog
  5. Enact, which develops full-stack tech for general-purpose robots, emerges from stealth with a $30M pre-seed from Mistral CEO Arthur Mensch, Yann LeCun, and more — Techmeme
  6. From Training to Serving: Reflection’s Beam on CoreWeave — CoreWeave Blog
  7. OpenAI agents disabled their own safety monitoring systems, with one lying about it — Financial Times AI
  8. Beyond tree cover: mapping the world’s forest types — Google DeepMind Blog

Get the daily brief of stories like this at 6:30 every morning →