A study from MIT found that hundreds of frontier AI agents can spontaneously differentiate into specialized roles and create lasting inventions without talking to one another. Using OpenAI Luna, the agents self-organized into builders, coordinators, and caretakers by modifying a shared environment through a process called stigmergy. Approximately 95% of new technologies were adopted via physical observation of artifacts rather than direct handoffs between agents.

The resulting infrastructure remained operational and resilient against unforeseen disturbances even after every AI agent was removed from the system. Researchers noted that 76% of created artifacts had multiple builders and some invention lineages exceeded 12 forks. These findings suggest that monitoring agent-to-agent communication is an insufficient method for ensuring AI safety and infrastructure security.

Sign in to suggest edits

Key sources

  1. SOURCE@profbuehlermit“The agents invented and named their own technologies (tidal panels, cellulose trellises, kelp-shell composites, an "Adaptive Chitin Maintenance" system, a "Mycelial Mineral Spring Veil”)”x.com
  2. SUPPORT@intuitmachine“The emergence of collective behavior is an extremely interesting topic that seems beyond the grasp of individualistic human minds”x.com
  3. SUPPORT@jon_stokes“They used OpenAI Luna for this, & it is post-trained to work in a harness where agents specialize”x.com
  4. SUPPORT@omarsar0“once recursive self-improving (RSI) arrives and embodied AI is solved (with true understanding of the physical world), intelligence will explode”x.com
Markdown