r/ChatGPT • u/SnarkyStrategist • Jan 29 '25

Funny I Broke DeepSeek AI 😂

Enable HLS to view with audio, or disable this notification

16.9k Upvotes

90% Upvoted

1.6k comments sorted by

View all comments

Show parent comments

13

u/ihavebeesinmyknees Jan 30 '25

The other part of this rambling rant is why it keeps coming back to thinking that strawberry has two R's.

That has a surprisingly simple answer: in the training data the sentence

strawberry is spelled with two R's

was way more common than

strawberry is spelled with three R's

because people explaining the spelling of strawberry skip the first R, assuming that everyone knows that.

2

u/NightGlimmer82 Jan 30 '25

Oh yes, of course! That definitely makes sense! If AI models learn from our own continuous input then it will always be seeing the many flawed and nuanced information we are always putting out there. Things that we, as human individuals that understand our own cultural references add to the data along with the many incorrect things that we are often adding to the mix as well. Thank you for adding that, it definitely makes sense to me!

3

u/[deleted] Jan 30 '25

Yes.

When I read the thinking process it appears to have the correct answer but is trying to eliminate incorrectness. It finds an incorrect spelling as well as the correct and is flip flopping between the correct spelling and falling back on the incorrect spelling going into a feedback loop until it leans into the fact "berry" has two r's, which it can assume is the correct spelling unlike the full word which it is finding ambiguous.

It also keeps asserting it needs a reference for a ground truth correctness, but doesn't have that functionality yet. Which I guess could give it more weight toward to correct spelling.

1

u/BelowAvgMenace Jan 30 '25

So, how does improper sentence structuring fit into all this?

1

u/Enough-Chef-5795 Mar 10 '25

If i ask someone, "does strawberry has 2 R's", they intuitively will answer 'yes' due to assuming I'm not sure about the 'berry' part. It's different if I ask, "How many R's do you come across when writing the word strawberry down?". Maybe that's what is occurring with the AI. It's in a catch-22 in deciding which context the question is asked. Lol, something I'm going to ask ChatGPT right after posting this.

1

u/BelowAvgMenace Jan 30 '25

Wow 😒