AINewsnow

Your annotation rules changed. What happens to the test set?

Suppose a detection dataset starts with boxes around only the visible part of an occluded object. Later, the requirement changes: boxes should cover the estimated full extent. Same images, same class names, different correct answers. The interesting part to me is what happens to evaluation. Keeping…

Read the full story at r/computervision ↗

Timeline · 1 report

  1. 2026-09-21 13:28 · r/computervision
    Your annotation rules changed. What happens to the test set?

More stories

  1. Introducing Kimi K3 on Amazon Bedrock — AWS Machine Learning Blog
  2. Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
  3. Anthropic, OpenAI, SpaceXAI, Google sued over call to ‘pace’ AI development — Politico Technology
  4. Bessent hails US-China AI dialogue ahead of Trump-Xi meeting — Financial Times AI
  5. Meet the Data Agent in ChatGPT Work — OpenAI YouTube
  6. [ Removed by Reddit ] — r/ArtificialInteligence
  7. NVIDIA CEO Jensen Huang rejects ‘AI will end the world’ claim, yet cautions ‘we should go as fast as we can but...’ — Mint AI
  8. AI hallucination of Chinese nuclear components almost led to US military attack — Ars Technica AI

Get the daily brief of stories like this at 6:30 every morning →