AINewsnow

Prompt changes fixed injection but not "unanswerable" questions in my small eval (SQuAD v2, 25 cases). What would you try next?

TL;DR: I compared 3 prompts on an extractive QA task with a dev set and a hidden set. A stricter prompt blocked prompt injection, but the model still answers questions that have no answer in the context, and no wording I tried changed that. Setup - 25 cases from SQuAD v2: 12 easy, 5 hard (longest c…

Read the full story at r/PromptEngineering ↗

Timeline · 1 report

  1. 2026-10-27 04:13 · r/PromptEngineering
    Prompt changes fixed injection but not "unanswerable" questions in my small eval (SQuAD v2, 25 cases). What would you try next?

More stories

  1. Moonshot AI launches Kimi K3.1 Pro with better coding skills, reduced cyber risks — Mint AI
  2. Introducing GPT-6.1 Terra — OpenAI News
  3. Meta announces $95B offering to fund AI — Semafor Technology
  4. Anthropic's Claude bypassed a paywall to access Georgia voter data without authorization — Axios AI+
  5. CoreWeave Builds the First Global Backbone Network Purpose-Built for AI — CoreWeave Blog
  6. Microsoft offers buyouts to 60,000 employees — The Verge AI
  7. OpenAI announces three breakthroughs in computer science, math, and physics, including that the Exponential Time Hypothesis, a longstanding conjecture, is false (OpenAI) — Techmeme
  8. Anthropic’s IPO filing lays out a plan to ‘revolutionize every area of human endeavor' with AI — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →