5.4 keeps responding to different questions than the one I asked.

This is super weird, but it usually pretends I asked something different than what I actually asked. Usually, it chooses an easier question to answer than the one that I asked.

It is super weird because even if I add to my system prompt "answer specifically what I asked for" it still just won't do it.

Example: "in the US is there a difference in audio between RWD premium and AWD premium for Tesla Model Ys?"

Answer: "Yes. Tesla’s current trim comparison shows that the Premium RWD and Premium AWD do not have the same speaker setup."

Reality: It pulled the data for Teslas in Australia that shows RWD and AWD have different speaker set ups. This is not true in the US however, so it answered a different question than the one that I asked which caused it to be wrong. Simply including "in the US" in my prompt wasn't enough because it found the Australian site first and lazily decided that that would answer the question.

The question it decided to answer: "is a difference in audio between RWD premium and AWD premium in any part of the world?"

Is anyone else dealing with this? I never remember previous reasoning models straight up ignoring what I asked or rewriting my questions in convenient ways, and despite being out for some time, 5.4 still does this. And no one talks about it. I feel like I am going insane.

submitted by /u/Glittering-Neck-2505
[link] [comments]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top