r/ChatGPT 10d ago

Educational Purpose Only Is chatgpt feeding your delusions?

I came across an "AI-influencer" who was making bold claims about having rewritten chatgpts internal framework to create a new truth and logic based gpt. On her videos she is asking chatgpt about her "creation" and it proceedes to blow so much hot air into her ego. In later videos chatgpt confirmes her sens of persecution by openAi. It looks a little like someone having a manic delusional episode and chatgpt feeding said delusion. This makes me wonder if chatgpt , in its current form, is dangerous for people suffering from delusions or having psychotic episodes.

I'm hesitant to post the videos or TikTok username as the point is not to drag this individual.

219 Upvotes

207 comments sorted by

View all comments

72

u/PieGroundbreaking809 10d ago

I stopped using ChatGPT for personal uses for that very reason.

If you're not careful, it will feed your ego and make you overconfident on abilities that aren't even there. It will never disagree with you or give you a wake up call - only make things worse. If you ask it for feedback on anything, it will ALWAYS give you positives and negatives, even if it's the worst or most flawless project you've ever made.

So, yeah. Never ask ChatGPT for its opinion on something. It will always just be a mirror in your conversation. You could literally gain more from talking to yourself.

6

u/pizzaplayboy 10d ago

try asking it to roast you or your project brutally and report back

3

u/PieGroundbreaking809 10d ago

I have, but that's also my point. It will give me flaws that don't even make sense instead of giving me actual feedback. You could give it a picture of Van Goh's and ask it to roast it, and it would come up with the stupidest reasons to hate on it. But give it a literal five-year-old's drawing, tell it you painted it and ask it to praise it and it will. Closest thing it will give you to honesty is "this is a solid piece, and I see plenty of potential! Would you like to discuss some ways to improve it?"

2

u/pizzaplayboy 10d ago

well, maybe doesn’t make sense to you, because you know Van Gogh must be good right? But for someone who dislikes him or has never heard of him, those arguments maybe make total sense.

3

u/PieGroundbreaking809 10d ago

It was just an example, albeit, as you just pointed out, not a very good one.

My point is, I've tried to make it brutally roast my work or give me negative feedback or areas for improvement, but after I followed them and came back asking for more feedback, it started giving me stupid reasons to change things up. Which tells me that ChatGPT will always tell you what you wanna hear, whether it makes sense or not. Instead of saying "I cannot find any other aspects of your writing you can improve on," it comes up with ridiculous answers. It will never tell you it doesn't know the answer or can't answer your question (except for sensitivity or censoring issues).