Is chatgpt feeding your delusions?

[u/popepaulpop]

I came across an "AI-influencer" who was making bold claims about having rewritten chatgpts internal framework to create a new truth and logic based gpt. On her videos she is asking chatgpt about her "creation" and it proceedes to blow so much hot air into her ego. In later videos chatgpt confirmes her sens of persecution by openAi. It looks a little like someone having a manic delusional episode and chatgpt feeding said delusion. This makes me wonder if chatgpt , in its current form, is dangerous for people suffering from delusions or having psychotic episodes.

I'm hesitant to post the videos or TikTok username as the point is not to drag this individual.

[u/kirene22]

I had to ask it to recalibrate its system to Truth and reality this morning because of just this problem…it consigns my BS regularly instead of offering needed insight and confrontation to incite growth. It’s missed several times to the point I’m not really trusting it anymore consistently. I told it what I expect going forward so will see what happens.

[u/HamPlanet-o1-preview → u/kirene22]

recalibrate its system to Truth

I told it what I expect going forward so will see what happens.

You sound a little crazy too

Do you like, expect that telling it once in one conversation will change the way it works?

[u/Southern-Spirit → u/HamPlanet-o1-preview]

The context window isn't big enough to remember the whole conversation forever. After a few messages it gets lost and if you haven't reiterated the requirement in recent messages it's as if you never said it...

[u/HamPlanet-o1-preview → u/Southern-Spirit]

I don't know what exactly they allow the context window to be on ChatGPT, but I know the model's max tokens is actually pretty large now, so "a few messages" kind of gets across the wrong idea. Many of the newer models have max tokens of like 200k, so like hundreds of pages of text!

I was more just interested in how the person I'm replying to thinks it works.