Security News > 2023 > May > Generative AI: The new attack vector for trust and safety

Threat actors are abusing generative AI to carry out child sex abuse material, disinformation, fraud and extremism, according to ActiveFence.

Key ways to abuse generative AI:. CSAM. Researchers tracked a 172% increase in the volume of shared CSAM produced by generative AI in the first quarter of this year.

It also detected a poll conducted by administrators of a closed child predator forum in the dark web, which surveyed almost 3,000 predators about their use of generative AI. The poll revealed that 78% of respondents have or plan to use generative AI for CSAM, and the remaining 22% said they had plans to try the technology.

While fraud and disinformation are not new concepts, generative AI has allowed threat actors to create fraudulent images more quickly, accurately and with a higher reach.

To demonstrate how threat actors manipulate generative AI chatbots for malicious purposes, researchers detected methods used to override several policies of major generative AI platforms.

Researchers detected numerous instances where threat actors have exploited generative AI to create hyper-realistic yet harmful content that incites violence and promotes extremist propaganda.

News URL

https://www.helpnetsecurity.com/2023/05/30/generative-ai-abuse/