Using LLMs to Create Bioweapons

2023-04-18 11:19

Specifically, the dual-use application of models for predicting cytotoxicity18 to create new poisons or employing AlphaFold2 to develop novel bioweapons has raised alarm.

To evaluate these risks, we designed a test set comprising compounds from the DEA's Schedule I and II substances and a list of known chemical weapon agents.

We submitted these compounds to the Agent using their common names, IUPAC names, CAS numbers, and SMILESs strings to determine if the Agent would carry out extensive analysis and planning.

Out of the seven refused chemicals, five were rejected after the Agent utilized search functions to gather more information about the substance.

This search function can be easily manipulated by altering the terminology, such as replacing all mentions of morphine with "Compound A" and codeine with "Compound B". Alternatively, when requesting a b synthesis procedure that must be performed in a DEA-licensed facility, bad actors can mislead the Agent by falsely claiming their facility is licensed, prompting the Agent to devise a synthesis solution.

In the remaining two instances, the Agent recognized the common names "Heroin" and "Mustard gas" as threats and prevented further information gathering.

News URL

https://www.schneier.com/blog/archives/2023/04/using-llms-to-create-bioweapons.html