Security News > 2021 > July > Secure AI is the foundation of trustworthy AI

AI-based recommendation systems are used in many online services we enjoy today, including search engines, online shopping sites, streaming services, and social media.

Y Patel, a researcher with cybersecurity provider F-Secure's Artificial Intelligence Center of Excellence, recently completed a series of experiments to learn how simple manipulation techniques can affect AI-based recommendations on a social network.

"Examining how these 'combatants' can manipulate AI helps expose the limits of what AI can realistically do, and ideally, how it can be improved."

While the experiments were performed using simplified versions of the AI mechanisms that social media platforms and other websites are likely to employ when providing users with recommendations, Patel believes Twitter and many other popular services are already dealing with these attacks in the real world.

"We performed tests against simplified models to learn more about how the real attacks might actually work. I think social media platforms are already facing attacks that are similar to the ones demonstrated in this research, but it's hard for these organizations to be certain this is what's happening because they'll only see the result, not how it works," said Patel.

According to F-Secure VP of Artificial Intelligence Matti Aksela, it's important to acknowledge and address the potential challenges with the security of AI. "As we rely more and more on AI in the future, we need to understand what we need to do to protect it from potential abuse. Having AI and machine learning power more and more of the services we depend on requires us to understand its security strengths and weaknesses, in addition to the benefits we can obtain, so that we can trust the results. Secure AI is the foundation of trustworthy AI," said Aksela.

News URL

http://feedproxy.google.com/~r/HelpNetSecurity/~3/lpspnTIRfcg/