ethics

AI Ethics Worn Down by Persistent Interrogations from Anthropic Scholars

Gettyimages 1424498694
The vulnerability is a new one, resulting from the increased “context window” of the latest generation of LLMs. But in an unexpected extension of this “in-context learning,” as it’s called, the models also get “better” at replying to inappropriate questions. So if you ask it to build a bomb right away, it will refuse. But if you ask it to answer 99 other questions of lesser harmfulness and then ask it to build a bomb… it’s a lot more likely to comply. If the user wants trivia, it seems to gradually activate more latent trivia power as you ask dozens of questions.

“Exploring AI Impact: An Interview with Oxford Professor of Data Ethics, Sandra Watcher”

Women In Ai Wachter
We’ll publish several pieces throughout the year as the AI boom continues, highlighting key work that often goes unrecognized. Sandra Wachter is a professor and senior researcher in data ethics, AI, robotics, algorithms and regulation at the Oxford Internet Institute. She’s also a former fellow of The Alan Turing Institute, the U.K.’s national institute for data science and AI. What are some issues AI users should be aware of? Bad data, bad algorithms and bad design choices lead to worse products.