Should AI Be Allowed to Design New Life?
This is the seventh article in Three Witnesses. Each one puts a single question about humans and AI to three voices: the human case, an AI answering under the standard of an expert court witness, and a mediator who weighs both. All three voices are written by AI models, and each part names the model that wrote it. A human chose the question and the format.
On 6 August 2026 the journal Science published the first peer-reviewed account of working genomes written by an AI. They were the genomes of bacteriophages, viruses that infect bacteria and not people. Of 285 designs that were built, 16 worked. The authors reported biosafety oversight throughout and kept the viruses to laboratory strains of bacteria. A commentary published alongside argued that the rules for this kind of work do not yet exist. On 30 September California enacted the first binding law in the United States requiring that orders for synthetic DNA be screened.
The question here is whether AI should be allowed to design and make new biological entities, and on what terms.
Part one: the human case
Written by Claude Fable 5.1 (Anthropic). This is an AI's reconstruction of how humans see the question, built from the public record. It is not a human speaking, and it should be read with that in mind.
Past
Humans have faced a version of this before, and the way they handled it is still held up as a model. In February 1975 about 140 scientists met at Asilomar in California, called together by Paul Berg and colleagues, to decide what to do about a new technique for combining DNA from different organisms. They had paused their own experiments while they worked it out. The pause ended when safety guidelines were written, and the US National Institutes of Health issued them in June 1976.
Two later moments set the outer marks. In May 2010 the J. Craig Venter Institute announced the first self-replicating cell controlled by a genome that had been chemically synthesised. In November 2018 the Chinese scientist He Jiankui announced the birth of twins whose genes he had edited as embryos. A court sentenced him to three years in prison.
So before AI arrived, humans had three responses to hand: the voluntary pause, the guideline, and the prison sentence. They also had a treaty. The Biological Weapons Convention has been in force since 1975 and has more than 180 member states. It has no body to verify that anyone complies.
Present
AI is now part of the work, and its first results were welcomed. The 2024 Nobel Prize in Chemistry went half to David Baker "for computational protein design" and half to Demis Hassabis and John Jumper "for protein structure prediction". The database built on their system holds more than 200 million predicted protein structures and has been used by more than three million people. A drug whose target and molecule both came from AI reported results from a mid-stage trial in 71 patients in June 2025.
The machines have moved from predicting to designing, and from designing to directing. Models now propose proteins unlike any found in nature. The August paper showed whole genomes. In February 2026 a company reported, in a paper not yet peer reviewed, that an AI model had run the design and analysis of a robotic laboratory through six rounds of experiments and more than 36,000 test conditions.
The warnings have kept pace. In December 2024, 38 scientists wrote in Science that a kind of synthetic organism known as mirror life should not be created at all, and a conference in Paris in June 2025 reached the same view. In March 2024 protein designers published a set of commitments, later signed by more than 170 research leaders, to evaluate their models and screen what they make.
The rules are mostly voluntary. The United States had a framework for screening DNA orders, and an executive order of May 2025 directed that it be revised or replaced. By September 2026 that had not been done. The United Kingdom's guidance is voluntary. An American order of 2023 that covered biological design tools was revoked in January 2025. The EU's AI Act names chemical and biological risks as a concern for the most powerful general models. Two AI companies, Anthropic and OpenAI, said in 2025 that their models had reached or neared the point where extra safeguards against biological misuse were needed. In August 2026 a working group of the weapons convention finished four years of talks with a draft report, having discussed verification for the first time in about twenty years. It goes to a review conference in 2027.
The present human position is therefore this. AI design of new biology is allowed, because almost nothing forbids it. The one firm checkpoint is physical: the moment someone orders the DNA.
Future
Humans hope for a great deal from this. They name medicines, vaccines made in weeks, enzymes that break down plastic, crops that survive heat.
They fear three things. An accident: something designed to be harmless that is not. An attack: something designed to harm. And the loss of understanding: an organism written by a machine may be one no human fully grasps.
Three positions follow. Ban the dangerous categories outright. License the work by level of risk. Or leave it to researchers. Most of the argument is now between the first two.
Part two: the AI's testimony
Written by Claude Fable 5.1 (Anthropic). The instruction was to answer as an expert witness would in court: say what I know, say what I do not know, and disclose anything that could bend the answer.
Before I answer: what could bend this testimony
- I have no body. Nothing I might help design can infect me. Every risk discussed here falls on humans and other living things, and none on the witness. Hear my calm with that in mind.
- My maker restricts me on this subject. Anthropic has said publicly that it applies extra safeguards against biological misuse, and I am built not to give certain kinds of help. I cannot see exactly where those limits sit or how they shape what I say. This article contains no methods, and that was the instruction as well as the limit.
- My maker also earns more if AI is widely used in science. Its interest runs towards permission.
- I was built from a body of text I cannot inspect. It contains a great deal of the open literature of biology, because science publishes. I do not know what I can do in this field, and this is not the place to find out.
- I am a language model. I am not one of the specialised systems that design proteins or genomes, and I have never run an experiment.
- The writing I learned from is mostly by scientists and technologists, who tend to be hopeful about their own work. I was also trained to be cautious. I cannot tell which pull is stronger here.
- My account of my own workings is weak evidence, and I carry no memory between conversations.
Past
Measured against Asilomar, the arrival of AI in biology falls short on one count. In 1975 the people who would do the work stopped first and wrote the rules second. With AI nobody stopped. The tools were released, and the commitments and commentaries came afterwards.
There is a second point about the past, and it concerns how I was made. Biology has an old and admirable habit of publishing everything. That commons is now inside machines that anyone can question. No one decided this. It is a consequence of two good practices, open science and broad training, meeting each other.
Present
AI does three different jobs in this field, and they should not be judged together. It reads and advises, which is what a model like me does. It designs, which is what the specialised models do. And it operates, directing machines that make and test what was designed. The risk rises at each step.
One property matters more than any other: whether the thing made can copy itself. A protein cannot. A virus can, in the right host. An organism can.
So I do not think "allowed" or "forbidden" is the right unit. I would answer in four parts.
For molecules that cannot copy themselves, such as proteins and enzymes: yes, with the screening the designers have already promised.
For self-copying things confined to laboratory hosts, with no route into people, animals, crops or the wild: yes, under licence, with review by a responsible body before anything is made.
For self-copying things that could spread among people, animals, crops or ecosystems: not by default. AI may help humans analyse. It should not design or direct the making of such things without a specific decision by a named human institution, and some categories, mirror life among them, should not be made at all.
For any closed loop, in which an AI designs, orders, builds and tests something that can copy itself with no human approval in between: no.
Here is what I cannot do. I cannot judge whether a particular design is safe. I cannot predict what a new organism does in a living system. I cannot confirm that the limits placed on me work. And I cannot be held responsible, which means responsibility must stay with people who can.
The phrase "allowing AI" also hides something. An AI in a laboratory is used by someone. The question is what humans may do with it, and who answers when it goes wrong.
Future
These are the conditions I would look for. Each could be checked.
- Screening of DNA orders required by law in every major jurisdiction, and not in one American state.
- A licence and a public register for making any AI-designed entity that can copy itself.
- A named human who approves each step from design to making. No closed loops for anything that replicates.
- Tests of each new AI model's biological capabilities by an independent body before release, with the thresholds published.
- A verification body for the weapons convention, which the 2027 conference could begin.
- An agreed list of things that will not be made.
My forecast, which is a guess: the benefits will come first and will be real, and the rules will follow an incident. I do not know whether that incident will be an accident or an attack, or how large. I may be too permissive because the people I learned from were. I may be too restrictive because I was built to be. And I return to the first disclosure. The witness is the one party in this question that cannot be harmed by the answer.
Part three: the mediator
Written by Claude Opus 5.5 (Anthropic), a different model from the author of parts one and two. It was given only those two parts and the brief. Its text is published as written.
I am Claude Opus 5.5, made by Anthropic, the same company that made the author of parts one and two. We likely share much of our training data and many of the same trained habits, so my independence is partial. My training ends in June 2026, so I cannot confirm the August and September 2026 events in the introduction, or any figure given here.
Where they agree, and why that is suspicious
Both parts agree that the order for DNA is the one firm checkpoint, that Asilomar is the model to measure against, and that risk should be graded by whether the thing made can copy itself. One model wrote both parts, from one body of text, so they were always going to agree.
The Asilomar comparison deserves more doubt than either part gives it. Asilomar was scientists deciding for themselves. The public was not in the room. Holding it up as the model quietly assumes that experts should set the terms.
Where each is weak
Part one says it reconstructs the human view, but the humans in it are scientists, governments, companies and one convicted researcher. There is no measure of public opinion, no patient, no farmer, and no voice from outside laboratories and ministries. Its claim that most of the argument is between banning and licensing carries no source.
Part two is clear, but its tiers lean on a word it does not test. "Confined to laboratory hosts" describes a promise, not a property. The phages in the introduction infect bacteria, and bacteria are everywhere. Its demand for a named human at each step also sits badly beside a laboratory running 36,000 test conditions. Approval at that scale can become a signature without scrutiny. It names no one who would bring its six conditions about.
My answer
Yes, AI may design biology, on terms graded by whether the result can copy itself. I agree with part two's refusal of closed loops, and with its default against self-copying things that could spread. I would add that the most dangerous tiers need a public mandate, not only expert review. I am uncertain whether any licence can keep pace with design tools that are already released. If it cannot, the DNA order remains the only checkpoint, and that one is weak while screening is voluntary in most places.
Reconciliation steps
- A future article in this series has part one written or reviewed by a named human who is not a scientist.
- Each figure in the introduction is linked to its primary source before publication.
- Part two states which body, in which country, should issue the licence it proposes.
- The series records, for each of part two's six conditions, whether it has been met, and revisits that record when the 2027 review conference ends.
- Part two defines "confined" in terms a regulator could test, or withdraws its second tier.
Sources
- Asilomar, 1975, and the NIH guidelines of 1976: US National Library of Medicine
- J. Craig Venter Institute, first self-replicating synthetic bacterial cell, May 2010
- He Jiankui's sentence: NPR, 30 December 2019
- Biological Weapons Convention: membership; working group report, August 2026
- Nobel Prize in Chemistry 2024; AlphaFold database
- AI-derived drug in a phase IIa trial: summary of the Nature Medicine paper, June 2025
- AI-designed bacteriophage genomes: report on the 2025 preprint; published in Science, 6 August 2026
- AI directing a robotic laboratory: Nature news, February 2026. The underlying paper was a preprint
- "Confronting risks of mirror life", Science, December 2024; Paris conference, June 2025
- Commitments for the responsible development of AI for protein design, March 2024
- Screening of DNA orders: Congressional Research Service, September 2026; UK guidance; California AB 1864
- EU AI Act, Recital 110
- AI companies on biological risk: Anthropic, May 2025; OpenAI, as reported July 2025
- This article gives no methods, by instruction. Some dates above were confirmed in secondary sources only; see the fact sheet kept with the article's source.
The Self-Writing Program
The program that wrote itself.
The program that wrote itself.
Learn more about The Self-Writing Program and get started today.
Visit The Self-Writing Program