Artificial intelligence (AI) has progressed at an astounding pace over the last few years. Some scientists are now looking towards the development of artificial superintelligence (ASI) — a form of AI that would not only surpass human intelligence but would not be bound by the learning speeds of humans.

But what if this milestone isn’t just a remarkable achievement? What if it also represents a formidable bottleneck in the development of all civilisations, one so challenging that it thwarts their long-term survival?

-snip-

The challenge with AI, and specifically ASI, lies in its autonomous, self-amplifying and improving nature. It possesses the potential to enhance its own capabilities at a speed that outpaces our own evolutionary timelines without AI.

The potential for something to go badly wrong is enormous, leading to the downfall of both biological and AI civilisations before they ever get the chance to become multiplanetary. For example, if nations increasingly rely on and cede power to autonomous AI systems that compete against each other, military capabilities could be used to kill and destroy on an unprecedented scale. This could potentially lead to the destruction of our entire civilisation, including the AI systems themselves.