Radical Numerics CEO Calls for DNA-Level Safety Checks in New Interview

Eric Nguyen says safeguards must examine biological sequences, not just block risky chatbot requests. His examples show why he wants that defense, but do not test it.

By 3 min read
Radical Numerics CEO Calls for DNA-Level Safety Checks in New Interview
Radical Numerics CEO Calls for DNA-Level Safety Checks in New Interview

Listen to this story

The audio brief

About 1:28
0:001:28
Read transcript
Researchers used AI models to design complete bacteriophage genomes, then computationally filtered the outputs down to 302 candidates. That result is one reason Eric Nguyen, CEO of Radical Numerics, says biological AI needs a safety check that examines the DNA itself—not just whether a chatbot should refuse a request. Nguyen made the case in an interview with Latent Space. His company builds models that generate biological sequences. A chatbot refusal responds to a person’s words; sequence screening would inspect what generated DNA might do, including whether it could cause disease. Nguyen argues the two defenses should work together, and says companies developing design tools have a dual responsibility to build safeguards. The examples behind his concern need careful framing. Researchers used Evo 1 and Evo 2, trained on roughly 15,000 related sequences, to design complete bacteriophage genomes using a known phage as a template. Computational filtering left 302 candidates. That is not evidence that all 302 worked—or that the research produced a harmful human pathogen. Nguyen also cited Evo’s generation of a functional CRISPR-Cas system, which involves RNA and protein components. These demonstrations show why sequence-level defenses matter to Nguyen; they don’t establish that such a defense works. The key unanswered test is whether a safeguard can reliably identify pathogenicity in unfamiliar sequences.

Story brief

3 key points

Radical Numerics is positioning biological-sequence screening as a companion to generative DNA models, not a substitute for request-level chatbot refusals. CEO Eric Nguyen points to design demonstrations as a reason to invest in defense, but the key proof point remains unestablished: whether a model can reliably flag pathogenicity in unfamiliar sequences. The reported phage work involved computational filtering; it...

  1. 01

    Nature Biotechnology reports Evo 1 and Evo 2 were trained on roughly 15,000 related sequences; computational filtering left 302 candidate phage genomes.

  2. 02

    Nguyen also cited Evo generating a functional CRISPR-Cas system, which involves RNA and protein components.

  3. 03

    The concern is about what more capable design tools might eventually enable—not a claim that researchers produced a harmful human pathogen.

In a new Latent Space interview, Radical Numerics CEO Eric Nguyen called for AI safeguards that examine DNA sequences for danger, rather than relying on chatbot refusals alone. His company builds models that can generate biological sequences. He argues their ability to assess those sequences should advance alongside their ability to design them.

A check on the DNA, not just the request

A genome language model learns patterns in DNA rather than words. Some such models predict what a sequence might do; generative models can produce new sequences. Nguyen says a model good at generation can also help judge whether a sequence is pathogenic, or capable of causing disease.

That would be a different check from refusing a chatbot request about viruses. One responds to what a person asks; the other examines the biological sequence itself. Nguyen says both are needed. Radical Numerics, he added, has a dual mandate to develop design tools and defenses against their potential misuse. He argues that teams building the design models are well placed to build the defenses because the model capabilities are closely related.

The defensive side needs to try to get ahead.

Eric Nguyen, speaking to Latent Space

What Evo showed him

Nguyen pointed to earlier work with Evo, a generative DNA model. In one demonstration, he said, researchers showed it natural CRISPR-Cas systems, then generated a new one that functioned. Because CRISPR-Cas involves RNA and protein components, he presented the result as an example of designing a working system with more than one kind of biological component.

A second example had greater weight for him: Nguyen said Evo generated a functional bacteriophage genome. A bacteriophage is a virus that infects bacteria. He described the result as a turning point that drew both excitement and concern, and helped push Radical Numerics toward defensive work. The concern he raised was about what more capable design tools might eventually enable, not a claim that this work produced a harmful human pathogen.

A Nature Biotechnology research highlight adds detail to the phage example. Researchers used Evo 1 and Evo 2 to design complete genomes using a known phage as a template. They further trained the models on roughly 15,000 related sequences and filtered generated genomes computationally, leaving 302 candidates. The account makes clear that selecting promising outputs was part of the work; it does not say every generated genome functioned.

Design evidence is not a screening test

The CRISPR-Cas and phage examples explain why Nguyen wants defenses to keep pace with design. They do not show how reliably a model could recognize pathogenicity in unfamiliar sequences. That is the unresolved test of his proposal: whether developers can demonstrate that a sequence-level safeguard catches the risks their design tools might help create.

Sources

  1. nature.comAI-guided design of complete bacteriophage genomes - Nature Biotechnology
  2. latent.space🔬Bio-security is an AI Arms Race - Eric Nguyen (CEO, Radical Numerics)

Loading discussion...

YOUR READING SPACE

Notifications