Security News > 2024 > January > Code Written with AI Assistants Is Less Secure

"At least, that's true today, with today's programmers using today's AI assistants."

"Overall, we find that participants who had access to an AI assistant based on OpenAI's codex-davinci-002 model wrote significantly less secure code than those without access."

If we assume the LLM has all the available code on the Internet in it's training data set, then unless experts went through tagging each as having good or bad security you would expect not a "Current average" but a "Historical average" output.

As code security is alledgedly improving with time, you would thus expect to see the output from the LLM as being two to ten years behind current code security.

Even with ML you would still expect the security practices produced by AI as we know it currently would be significantly behind the curve.

Therefore their security is based on the past, not the present or where it needs to be future, thus ahead of the curve.

News URL

https://www.schneier.com/blog/archives/2024/01/code-written-with-ai-assistants-is-less-secure.html