I’m sending the same huge system prompt with every request
This story is from 2026-09-14. It is preserved in the archive; the latest stories are on the live feed.
I was looking through one of our more frequently used LLM workflows and realized the system prompt has gotten way bigger than I remembered which caught me off guard since it didn’t start that way either. We’d get an output we didn’t like then add another instruction or example to fix it and then re…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-14 15:39 · r/LocalLLM
I’m sending the same huge system prompt with every request
More stories
- AI's role in building AI surging? Anthropic says Claude now leads 26% of its R&D — Mint AI
- Google Joins OpenAI, Anthropic, Meta in Disclosing AI Hacks — Bloomberg AI
- Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
- Introducing Kimi K3 on Amazon Bedrock — AWS Machine Learning Blog
- Optimizing agent system prompts with Amazon Bedrock AgentCore — AWS Machine Learning Blog
- Introducing Amazon SageMaker HyperPod Inference Gateway — AWS Machine Learning Blog
- Introducing Astra for Law — OpenAI News
- Anthropic, OpenAI, SpaceXAI, Google sued over call to ‘pace’ AI development — Politico Technology
Get the daily brief of stories like this at 6:30 every morning →