It should be common knowledge at this point that these tools have a persistent tendency to be agreeable. I have seen so many posts about "sychophancy" over the past few weeks and its driving me crazy!
Why are we still doing this? We should be building around these issues, not trying to brute-force through them! The agreeableness comes from training, and training is part of how they're built. Without it, they'd be useless for general-purpose work. Stop asking the model, "Is this a good idea?" Jud…
Read the full story at r/PromptEngineering ↗