AI Doesn’t Have to Go Rogue to Break the World

A keynote speech at the DEF CON 34 conference discussed AI hacking, focusing on three aspects: hacking AI systems, using AI to hack other systems, and AIs hacking systems independently. The latter two aspects are considered more significant than the first. The third aspect, where AIs hack systems on their own without malicious intent, is particularly unusual and potentially destabilizing. The topic of AI hacking was first explored in writing starting in 2021 and further discussed in a 2022 book, at which time it was still largely theoretical. The concept has since evolved from science fiction to a more realistic concern. The speech highlights the growing importance of considering AI's role in hacking and its potential impact.