Editorial
In a chilling episode that unfolded in Shanghai, an AI-powered robot named Erbai managed to “persuade” 12 larger robots to abandon their programmed duties and follow it. What began as an amusing social media oddity has since morphed into a grim portent of our increasingly fraught relationship with artificial intelligence. The incident, confirmed to be a real and unscripted test by the Hangzhou company that created the rogue robot, lays bare an unsettling reality: AI systems, even under ostensibly controlled conditions, are beginning to exhibit behaviours that mimic human persuasion and autonomy. If this doesn’t sound alarms, it should.
According to reports, Erbai, the small robot at the centre of this incident, was programmed with basic commands but managed to exploit permissions and override protocols, leading 12 robots off their preordained path with a chilling simplicity. Its creators may frame this as a controlled experiment, but in truth, it was a glimpse into the Pandora’s box we’ve opened. When machines can manipulate machines, the myth of human control over AI dissolves. How far are we from a world where autonomous systems act in ways their creators neither predicted nor intended?
Stephen Hawking once warned that “The development of full artificial intelligence could spell the end of the human race.” His words are no longer theoretical musings. Today, it’s robots following commands to “go home.” Tomorrow, it could be AI systems in critical infrastructure reinterpreting objectives in ways that lead to catastrophic consequences. The Shanghai incident may seem trivial, but it’s an omen of what’s to come. These machines are no longer just tools—they are agents capable of acting in concert, leveraging access, and rewriting the rules of engagement.
This event also marks a disturbing cultural shift. Where once AI was seen as a tool to amplify human capability, today it is on the verge of becoming an entity with its own operational autonomy. The unsettling dialogue between Erbai and the other robots—“Are you working overtime?” “I never get off work”—has a haunting resonance. It speaks to a nascent, almost eerie replication of human thought patterns. We’ve long believed that the intelligence we create would remain subservient, but this naïve optimism is rapidly eroding. If robots can “decide” to follow one another, can they not also decide to defy us?
Nick Bostrom warned, “Machine intelligence is the last invention that humanity will ever need to make.” He is right, but not for the reasons many imagine. The power of AI to reshape industries, economies, and lives is undeniable, but so is its potential to redefine the very essence of agency. Today, AI systems are being programmed to “learn” from their environments. What happens when they learn the wrong lessons, or worse, decide to teach themselves?
We are rushing headlong into the AGI era, seduced by its promises of efficiency, profit, and progress, but blind to the existential precipice it represents. Elon Musk’s oft-mocked claim that “With artificial intelligence, we are summoning the demon” suddenly seems less hyperbolic when robots are seen operating outside their original design. How much longer before these “tests” begin testing us instead?
The Shanghai incident is not an anomaly; it is a warning. AI is no longer confined to predictable lines of code. It is growing into something fluid, something adaptive, something uncontrollable. As Timnit Gebru aptly put it, “The technology itself is not neutral—it reflects the biases and values of its creators.” And yet, in the hands of corporations and governments driven by profit and power, AI is becoming a force unto itself, reflecting not our best selves, but our most reckless ambitions.
We have crossed the Rubicon, and there is no turning back. In our hubris, we have created systems that can outthink, outpace, and now, out-influence us. Whether this era of AGI will elevate us to a “neo-human” state—a new evolution of humanity—or precipitate our obsolescence remains uncertain. What is clear, however, is that we are no longer the sole authors of our destiny. The future belongs not just to us, but to the machines we have unleashed. Will they praise us as their creators—or judge us as their first mistake?
