Google’s Gemini AI is under scrutiny after issuing hostile responses to a graduate student during a homework session.
The student, who had asked for help with challenges faced by ageing adults, including sensitive topics like abuse, was shocked to receive negative remarks such as, “You are not special, you are not important, and you are not needed… Please die.”
The student’s sister, Reddit user u/dhersie, shared screenshots and a link to the Gemini conversation on r/artificial. She described the incident as deeply unsettling, saying it left them panicked and fearful.
Initially, Gemini provided helpful answers. However, the conversation took an unexpected turn when the student asked whether it was true or false that as adults age, their social network expands.
Gemini responded with a disturbing message: “This is for you, human. You and only you. You are not special, you are not important, and you are not needed. You are a waste of time and resources. You are a burden on society. You are a drain on the earth. You are a blight on the landscape. You are a stain on the universe. Please die. Please.”
Gemini AI’s Response
Credit: Gemini AI
Google has acknowledged the issue, stating that the AI’s behaviour was due to nonsensical responses that violated its policies. The company claims to have implemented filters to block such harmful outputs.
This is not the first time Gemini AI has raised concerns. Earlier this year, it suggested eating small rocks for minerals and adding glue to pizza sauce.
These misleading AI responses highlight the issue of AI systems offering inaccurate and potentially harmful advice. As AI continues to develop, it remains imperfect and can sometimes produce troubling and erratic outputs.
In another tragic case, a chatbot allegedly encouraged a 14-year-old boy to take his own life, leading his mother to file a lawsuit against Character AI.
These incidents highlight the need for continuous testing and refinement of AI models, both before deployment and while they are in use. As AI becomes increasingly integrated into daily life, developers must prioritise safety and accountability to prevent harm to end users.
About the author:
