An artificial intelligence system described as ‘too powerful for public use’ has been quietly released by a Silicon Valley start-up, prompting British regulators to call for an emergency review. The tool, known as OmniMind, allows users to generate realistic video content from simple text prompts, but early tests have revealed capabilities that even its creators admit were ‘unexpected’.
OmniMind was launched without fanfare last week by a company called Nexus AI, founded by former Google Brain researchers. The system employs a novel architecture that combines large language models with generative adversarial networks to produce videos that are nearly indistinguishable from real footage. In internal tests, it created a synthetic video of a sitting prime minister admitting to corruption that fooled several experts.
“This is a Pandora’s box moment,” said Dr Alice Temple, a member of the UK’s AI Safety Institute. “We have a tool that can fabricate reality at negligible cost. The potential for misinformation, fraud and even destabilisation of democratic processes is immense. The fact that it’s already in the wild is deeply alarming.”
Nexus AI’s CEO, Raj Patel, defended the release in a blog post, arguing that the tool’s capabilities have been exaggerated. “We have safety filters in place, and the model is just another step in the evolution of creative tools. It democratises film-making and storytelling,” he wrote. However, leaked internal emails seen by The Guardian suggest that Nexus AI rushed the release after a key investor threatened to withdraw funding.
British regulators have moved swiftly. The Office for Artificial Intelligence has demanded an urgent meeting with Nexus AI’s leadership and is considering emergency powers under the forthcoming AI Bill to force the company to disable certain features or recall the product. “We cannot afford to wait months for legislation. This is happening now,” said a spokesperson.
OmniMind’s release has ignited a fierce debate about the pace of AI development. Critics argue that the industry is moving too fast, prioritising profit over safety. “Every time a new model drops, it pushes the boundary of what’s ethically acceptable,” said Julian Vane, a technology ethicist and former Silicon Valley insider. “We’re in an arms race where the only rule is ‘move fast and break things’. But the things being broken are trust, truth and social cohesion.”
Yet others counter that over-regulation could stifle innovation. “The UK wants to be a leader in AI. If we clamp down too hard, we push these companies elsewhere,” said a tech lobbyist who wished to remain anonymous. “It’s a delicate balance.”
For now, the tool remains available for download, though Nexus AI has added a warning that its outputs should not be used for misleading purposes. But as cybersecurity experts point out, such warnings are toothless. “It’s like telling a shoplifter not to steal,” quipped one.
As the emergency review begins, the world watches to see whether regulators can act fast enough. The genie, as they say, may be well and truly out of the bottle.
