That's the original "AI psychosis" that the term was coined to describe. As Sam Cole notes in her excellent "How to Talk to Someone Experiencing 'AI Psychosis,'" mental health practitioners are not entirely comfortable with the "psychosis" label:
https://www.404media.co/ai-psychosis-help-gemini-chatgpt-claude-chatbot-delusions/
13/