Maker spent $1,500 testing whether LLMs could exploit a deliberately vulnerable app

A developer built a deliberately flawed application and used various LLMs to see if they could identify and exploit security vulnerabilities, spending $1,500 in the process. The experiment reveals both the capabilities and limitations of current AI models at finding real-world bugs — useful data for indie developers thinking about security tooling or AI-assisted development.