Open-weight AI models are more vulnerable to manipulation and can lack oversight. Here’s what to know.
The revelation last month that Claude was used “in ways that could support biological weapons development” was made possible, in part, because Anthropic’s AI models operate on a closed system overseen by the company. Anthropic said it banned and reported accounts engaging in misuse of its AI and used the findings to strengthen safeguards. But…