AINewsnow

One Bias Score, Two Factors: How Mitigations Affect Option Bias in Multiple-Choice Evaluation

arXiv:2610.20993v1 Announce Type: new Abstract: Reordering multiple-choice options can change a model's answer, an effect studied as selection bias (a preference for certain option letters) and as order sensitivity (changes in answers across option orderings). We connect these perspectives through…

Read the full story at arXiv cs.CL ↗

Timeline · 1 report

  1. 2026-10-16 04:00 · arXiv cs.CL
    One Bias Score, Two Factors: How Mitigations Affect Option Bias in Multiple-Choice Evaluation

More stories

  1. Meta releases 816B Muse Spark Open; NVIDIA launches Nemotron 3.5 models — AWS Machine Learning Blog
  2. Google launches Universal Cart shopping tool in the US — Google Gemini Blog
  3. Meta and Apple Partner to Run Open-Weight Muse AI Model on Macs — Wall Street Journal Technology
  4. Black Forest Labs releases open-weight FLUX.3 Klein image model — Hugging Face Blog
  5. Hong Kong launches embodied AI hub to boost robotics sector — South China Morning Post Tech
  6. Hugging Face details 2.8 trillion token Indic pretraining pipeline — Hugging Face Blog
  7. Microsoft and Nvidia launch RTX Spark laptops optimized for AI — NVIDIA Blog
  8. Liquid AI releases d1-ultra multimodal decision model — Vercel Blog

Get the daily brief of stories like this at 6:30 every morning →