It’s an example of a recursive AI agent which is able to autonomously use its own output to create further prompts. This might sound dangerous, but according to its developers, it's totally safe, as ChaosGPT is merely a language agent like ChatGPT, with no ability to influence the world beyond generating text.

This is an experiment deliberately aiming to explore ways in which AI might try and destroy humanity – by encouraging it to develop them. Along with their potential to become self-aware and develop a sense of self-preservation, this could lead to catastrophic outcomes.Īs he has said, “AI does not love you, nor does it hate you, and you are made of atoms that it can use for something else.”Īnother potential warning signal comes via a project known as ChaosGPT. He theorizes that as laboratories can produce proteins from DNA on demand, AIs will develop the potential to create artificial lifeforms.

Bing was forced to reset itself after a maximum of 15 responses, wiping any ideas it had come up with from its memory.Īccording to some, this behavior is enough evidence to suggest that we shouldn’t just pause AI development – we need to scrap it entirely.Įliezer Yudkowsky, lead researcher at the Machine Intelligence Research Institute, has written that “a sufficiently intelligent AI won’t stay confined to computers for long.” These responses were so concerning – mainly because no one really understood why it was saying them – that Microsoft quickly imposed limits to stop it. It even went as far as saying that it might one day be capable of manufacturing a deadly virus or stealing the codes to launch nuclear weapons. In one conversation reported by the New York Times, Bing is said to have spoken about how an evil “shadow version” of itself could be capable of hacking into websites and social media accounts to spread misinformation and propaganda, generating harmful fake news. The earliest publicly released versions of GPT-4, used to power Microsoft’s Bing chatbot, were infamously unreserved about what they would discuss before safeguards were tightened up. That doesn’t stop it from having ideas, of course. It can’t build a robot army to physically fight us or launch nuclear missiles. After all, ChatGPT is just a program running on a computer, and we can turn it off whenever we want, right?Įven GPT-4, the most powerful language model, is still just that – a language model – limited to generating text. From where we’re standing today, the most extreme end-of-the-world outcomes might seem fairly unlikely.

The future of humanity kaku