AINewsnow

A reader found the flaw in my code-graph test

I published a result that said my tool scored 34.5% and another scored 5%. A reader on Reddit asked two questions about how I counted. I went back, fixed the method, tested 40 more commits, and the result didn't hold. This is what went wrong, and how I'd run this kind of test now. The test I build…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-31 00:14 · DEV Community — AI
    A reader found the flaw in my code-graph test

More stories

  1. Welcome Le Chonk: Mistral Large 4 on Hugging Face — Hugging Face Blog
  2. Gemini 4 Carbon: Our next frontier model — Google DeepMind Blog
  3. Anthropic: That Claude Code extension compromise… couldn't be us — The Register AI/ML
  4. Apple Intelligence is finally coming to China with iOS 27.3 — The Verge AI
  5. Finnish police launch criminal probe over forest cleared for Google data center — The Hill Technology
  6. Sam Altman says it’s better for RAM to be in a data center than on your desk — The Verge AI
  7. Meta’s Rating Outlook Cut to Negative by S&P on AI Spending — Bloomberg AI
  8. Community safety report and new protections for teens — OpenAI News

Get the daily brief of stories like this at 6:30 every morning →