AINewsnow

Almost half the AI tool vendors I checked forbid benchmarking

In 1982 David DeWitt ran a database benchmark and Oracle didn’t do well in it, so Oracle’s lawyers added a licence clause saying nobody could publish a benchmark without permission. It’s still in Oracle’s download licence today. I run a site that grades the tools AI agents use (model APIs, MCP serv…

Read the full story at r/AI_Agents ↗

Timeline · 1 report

  1. 2026-10-20 08:58 · r/AI_Agents
    Almost half the AI tool vendors I checked forbid benchmarking

More stories

  1. US bans China's DeepSeek from government in race for AI dominance — BBC Technology
  2. DHS Orders DeepSeek Technology Removed From Federal Civilian IT Systems — Wall Street Journal Technology
  3. DeepSeek V4.1 Flash (1017) Now Leads Open-Weight Models — r/LocalLLaMA
  4. Welcome to Google Gemini 4 Argon — Towards Data Science
  5. Nscale, Anthropic in Talks for $45 Billion AI Computing Deal — Bloomberg AI
  6. DeepSeek open-sources DeepInfer, its internal production stack designed to accelerate inference, optimize chip performance, and reduce energy and compute costs — Techmeme
  7. Homebase Launches AI Assistant to Fill Shifts and Ease Hiring and Payroll — Unite.AI
  8. You need a better headshot. — OpenAI YouTube

Get the daily brief of stories like this at 6:30 every morning →