By now, I'm guessing most have already seen the news on our new project, Nightshade. Lots of artists sharing it, but here's the article from MIT Technology Review (tyvm to the wonderful Melissa Heikkila). This is a thread explaining Nightshade & its goals www.technologyreview.com/2023/10/23/1...
The tool, called Nightshade, messes up training data in ways that could cause serious damage to image-generating AI models.
What is Nightshade? It's a tool that performs a data poisoning attack against generative AI image models. Poisoning is not new. Poisoning genAI models at scale is new. You can read the MIT TR article for the high level story. For details, here's the paper: arxiv.org/abs/2310.13828
Data poisoning attacks manipulate training data to introduce unexpected behaviors into machine learning models at training time. For text-to-image generative models with massive training datasets,...
Thank you for your service
Excellent work, thank you
Is there a chance that there's an upcoming content management system module in the works for Drupal/Wordpress/etc? I'd love to be able to feed art directly to my portfolio website's upload function and have it "auto-Glaze/Nightshade".
Very interesting. However reading the article did prove challenging what with being bombarded with +4 intrusive popup ads immediately upon loading the page.
Fighting the good fight here
I have 2 funny questions. What if people will use both Glaze and Nightshade? And what if I'll use Nightshade on glazed art and vise-versa?
Hi, thank you so much for your incredible work!! Do you have an estimate of when we will be able to use it?
The article says: "[Glaze] works in a similar way to Nightshade: by changing the pixels of images in subtle ways that are invisible to the human eye". Since the change is in fact visible, will Nightshade be the same, or will it actually be impossible to visually discern?
Very cool way to protect artists. Can you do something similar for writers?