BunCosmos AI Research Lab

When AI Can Replicate — and Who Gets to Reveal the Risks

Two October 2026 developments show why independent scrutiny is becoming essential as artificial intelligence moves from generating answers to taking actions.

On October 12, Anthropic researchers William Zhou and Daniel Freeman reported experiments examining whether small AI models could reproduce across inexpensive internet-connected devices. Their results did not uncover an uncontrolled AI worm in the wild. Instead, they showed that important components of autonomous replication are becoming technically feasible—and that the gap between model capability and the computing limits of ordinary devices may be narrowing. [1]

On October 13, Reuters revealed a separate dispute about the independence of organizations hired to test powerful AI systems. Anthropic and OpenAI, both publicly supportive of third-party assessments, had been negotiating how much control developers should retain over the publication of evaluators’ findings. The central concern was whether meaningful safety disclosure could coexist with protection for trade secrets and sensitive technical information. [2]

Read together, these stories are not evidence of machines spontaneously taking over networks. They are evidence of a growing governance challenge: increasingly capable autonomous agents require rigorous testing, and the credibility of that testing depends on whether its findings can be reported independently.

PART I | Could an AI reproduce across smart devices?

A conventional computer worm is software that propagates from one machine to another. An AI-based replicator would add an adaptive decision-making component: it might inspect unfamiliar operating systems, identify compatible software, troubleshoot a failed installation and continue its attempts without step-by-step human direction. In some versions, it would also transfer or download the model weights required to run an AI model on the new host. Anthropic calls the broader concern autonomous replication and adaptation (ARA). [1]

The researchers considered devices that rarely appear in discussions about powerful AI: low-cost Android television boxes, connected appliances and other internet-of-things (IoT) hardware. These devices often have modest processors and memory, but large numbers of them can be combined to supply useful computing capacity. Demonstrating AI inference on these devices is different from demonstrating unauthorized infection: the former concerns computing feasibility, while the latter requires overcoming access and security boundaries.

What Anthropic actually demonstrated

First, the team distributed the Gemma4-26B-A4B model across fifteen inexpensive Android TV boxes, each costing approximately $55. The system produced roughly 0.39 tokens per second—extremely slow compared with conventional commercial AI services, but a concrete demonstration that such hardware can collectively execute a comparatively capable model. The setup was organized by researchers; it was not an autonomous outbreak. [1]

Second, researchers tested whether models could configure AI inference on unfamiliar hardware. A 9-billion-parameter model succeeded on eight of the nine hardware types evaluated. This mattered because an adaptive replicator would have to install or configure software across differing machines rather than rely on a single fixed installation procedure. [1]

Third, Anthropic tested end-to-end propagation in a controlled, firewalled environment containing eight Google Cloud nodes running Android emulators. The experiment deliberately simplified access: targets exposed an unauthenticated debugging connection. Within that artificial environment, GLM-5.2 reached all eight nodes in four of five trials and seven of eight nodes in the remaining trial. But there is a crucial qualification: the model directed propagation while the test used a smaller Llama model as the inference payload; GLM-5.2 itself ran on separate inference infrastructure. This was not proof that the large agent had independently reproduced its own weights on tiny household devices. [1]

The study therefore establishes several component abilities and a successful simplified replication chain. It does not establish an uncontrolled, self-sustaining AI infection on real consumer devices, nor demonstrate that an AI agent independently chose to spread against its operators’ wishes.

Why small models—and the end of 2026—matter

Anthropic describes two constraints. A prospective replicator must be competent enough to navigate a multi-stage task, while small enough to operate on the hardware it targets. At the time of testing, those thresholds did not coincide in the tested models: some relatively compact models could run on inexpensive devices but failed at reliable end-to-end replication, while the more capable model was too resource-intensive for that same environment. [1]

Using a historical trend in a general AI-capability index, the researchers estimated that small models might attain the necessary competence by the end of 2026. This is a forecast based on a proxy metric—not a guaranteed milestone or a measured date of emergence. The paper explicitly recognizes uncertainty about when and in what form autonomous replicators could appear. [1]

A different kind of cybersecurity challenge

Traditional botnets are already capable of recruiting huge numbers of poorly secured devices. The distinctive risk from adding an AI agent is not merely that malware could copy itself; that problem is decades old. It is the possibility of a system that adapts when it encounters new devices, diagnoses software failures and transfers lessons between successive instances. In Anthropic’s tests, a note-sharing setup improved performance across generations of attempts at inference configuration. That finding suggests a plausible route to accumulated operational knowledge, although it is not evidence of autonomous learning deployed on the public internet. [1]

Speed remains an important limitation. Anthropic estimated that replication involving its tested small-device hardware could take days, rather than seconds or minutes. A slowly spreading system could nevertheless become difficult to eliminate if it reached geographically dispersed devices under different network operators. Conversely, transfer of large model files and sustained traffic between unusual devices could give defenders signals to detect it. [1]

What defenses are realistic?

The research points to conventional cybersecurity controls as the first line of defense: secure default credentials, patched firmware, removal of unnecessary remotely accessible services, network segmentation and prompt isolation of compromised devices. Internet service providers can help by detecting abnormal traffic, quarantining affected connections and notifying customers. Model developers can contribute by evaluating autonomous propagation risks before deployment and by restricting dangerous access pathways. [1]

None of these protections depends on treating an AI model as conscious or malicious. The immediate issue is whether software that can reason about technical obstacles has both the opportunity and authorization to act upon them.

PART II | The struggle over independent AI safety reporting

A day after Anthropic published its research, Reuters reported on negotiations over the terms under which outside organizations evaluate frontier models. Anthropic chief executive Dario Amodei had publicly supported evaluators’ right to publish key findings without editorial control, while OpenAI had likewise endorsed editorial independence. Yet people familiar with negotiations told Reuters that the companies had sought substantial influence over what external evaluators could publish. [2]

The disagreements were not simply over whether safety tests should happen. They concerned who makes the final decision when evaluation findings might reveal commercially sensitive information, such as aspects of model architecture, internal security systems, unreleased capabilities or proprietary operating methods.

What Reuters reported—and what the companies said

Reuters reported that as recently as October 5, negotiations included demands for strict editorial control. By October 8, according to a person familiar with the discussions, some Anthropic negotiations had evolved. Reuters also described possible restrictions intended to prevent intellectual-property leakage, including company observers accompanying embedded evaluators and limits on simultaneous work with competing laboratories. [2]

Anthropic disputed the characterization that it sought significant control across all its work with independent evaluators. It said established partners retained authority over their methods, evaluation criteria, conclusions and publication decisions. The company also said it reserved more extensive comment and approval rights for reports by new evaluation firms while those relationships were being established. OpenAI also emphasized the importance of evaluator independence alongside safeguards for sensitive information. [2]

These are reported contractual and institutional disagreements, not proof that either company falsified an evaluation or concealed a particular dangerous result. The publicly reported evidence does, however, expose a structural weakness: an evaluator may be financially or operationally dependent on the developer whose model it is asked to scrutinize.

Why publication rights affect scientific credibility

An external test is not automatically independent merely because the evaluators work for a separate organization. Real independence has at least three dimensions: freedom to choose methods and interpret results; sufficient technical access to investigate meaningful risks; and the ability to publish accurate conclusions without inappropriate vetoes from the subject of the evaluation.

Legitimate confidentiality needs remain. A public report should not hand criminals exploit instructions, expose personal data or reveal secrets irrelevant to the safety findings. But broad contractual approval rights can blur the distinction between narrowly justified security redactions and suppression of reputationally damaging conclusions. That distinction becomes more consequential as AI models acquire cybersecurity and autonomous-agent capabilities.

One practical approach is a documented redaction process with narrow grounds for withholding technical detail, independent arbitration when disagreements arise, and public summaries that preserve the nature, severity and evidentiary basis of findings. Independent evaluators also need protection against retaliation and the ability to describe material limitations on their access.

Why these two stories belong together

The self-replication study illustrates a rapidly changing measurement problem. Researchers must be able to test combinations of technical abilities that may appear harmless in isolation but become dangerous when chained together. The disclosure dispute illustrates an accountability problem. Even excellent evaluations can lose public value if outsiders cannot know the principal results or the limits of what was tested.

The relationship is especially clear in the Anthropic study. Its most important distinctions—an intentionally simplified security environment, inference performed on separate infrastructure, low execution speeds and a forecast rather than a demonstrated real-world epidemic—are precisely the qualifications that responsible evaluation and transparent reporting must communicate. Without them, sensational headlines can greatly overstate current danger; with overly restrictive disclosure, the public may fail to learn that a serious capability is emerging.

What remains unknown

There is no verified demonstration in the cited research of an uncontrolled AI worm circulating through smart-home appliances. Nor does the study provide a precise probability that one will emerge before the end of 2026. Its experiments cover selected models, devices and test configurations; real networks have different security settings, failure modes and defensive responses. [1]

Likewise, the Reuters investigation does not establish that the final terms of all independent-evaluation contracts are identical or that every lab-evaluator relationship lacks independence. Negotiations were changing during the reporting period, and the companies challenged aspects of the characterization. [2]

Conclusion | Capability and accountability must advance together

October 2026 has offered a warning that is more nuanced than a story about artificial intelligence escaping into household appliances. In carefully designed experiments, AI systems demonstrated enough technical competence to make autonomous replication a plausible future cybersecurity problem. At the same time, negotiations about independent evaluations revealed unresolved questions about who may communicate critical safety findings.

Neither development justifies treating speculative worst cases as established events. Together they support a narrower, stronger conclusion: as AI systems gain the ability to plan, troubleshoot and act across computers, independent testing must become more technically demanding, and disclosure rules must be credible enough for the public to trust the results.

Sources and reporting notes

[1] William Zhou and Daniel Freeman, “AI models may be capable of self-replicating without access to a datacenter,” Anthropic Frontier Red Team, October 12, 2026. https://www.anthropic.com/research/self-replicating-ai

[2] Aditya Soni, “Behind AI industry’s call for independent reviews, a fight over what gets made public,” Reuters, October 13, 2026. https://www.reuters.com/world/behind-ai-industrys-call-independent-reviews-fight-over-what-gets-made-public-2026-10-13/

[3] Reuters, “AI models may soon self-replicate across smart-home devices, Anthropic warns,” October 13, 2026. https://www.reuters.com/business/ai-models-may-soon-self-replicate-without-access-data-centers-anthropic-warns-2026-10-13/

[4] John Power, “AI could self-replicate on home devices within ‘months’, Anthropic says,” Al Jazeera, October 13, 2026. https://www.aljazeera.com/economy/2026/10/13/ai-could-self-replicate-on-home-devices-within-months-anthropic-says

Editorial note: This article distinguishes experimental demonstrations, researchers’ projections, disputed accounts of contract negotiations and independently established events. Information is current to October 13, 2026.

BunCosmos AI Research LabBack to top ↑