Security News > 2023 > June > Fiddler Auditor: Open-source tool evaluates the robustness of large language models
2023-06-15 04:00
Fiddler Auditor is an open-source tool designed to evaluate the robustness of Large Language Models and Natural Language Processing models.
LLMs can sometimes produce unwarranted content, potentially create hostile responses, and may disclose confidential information they were trained with, regardless of whether they were explicitly asked to do so.
The tool uses adversarial examples, out-of-distribution inputs, and linguistic variations to help developers and researchers identify potential weaknesses and improve the performance of their LLMs and NLP solutions.