South Africa’s biggest forum. Discuss, discover, and connect with thousands of members.
Um, yeah, no, thats not going to work… models are trained from images that are curated by humans.
So far, we have created poison data by pairing prototypical, generated images of A with optimized text prompts of C .
Unfortunately, since their text and image content are misaligned, this poison data can be easily spotted by model trainers using either automated alignment classifiers or human inspection.
To overcome this, Nightshade takes an additional step to replace the generated images of A with perturbed, natural images of C that bypass poison detection while providing the same poison effect.
This step is inspired by clean-label poisoning for classifiers. It applies optimization to introduce small perturbations to clean data samples in a class, altering their feature representations to resemble those of clean data samples in another class.
Also, the perturbation is kept sufficiently small to evade human inspection.
We extend the concept of “guided perturbation” to build Nightshade’s poison data.
Given the generated images of A, hereby referred to as “anchor images,” our goal is to build effective poison images that look visually identical to natural images of C.
Still sounds like a waste of time and effort for little payoff, those who end up with "poisoned" image models will implement something to overcome nightshade or come up with a workaround.
Still sounds like a waste of time and effort for little payoff, those who end up with "poisoned" image models will implement something to overcome nightshade or come up with a workaround.
Things are getting more interesting with IP stuff. If this tweet is true things are gonna get wild in 2024. Will be interesting if big corporates also start using nightshade:At the end of the day, if this does get used, it just means that, at worst, models will have to be trained using original images, which will only improve them, since original images are of much higher quality.
I think that's the most commas I've ever used in a sentence.
I learned some about art as wify is heavily into art and an artist. This is up to page 85 the winner imho, and wify agrees with me. Very abstract novel idea, well executed with contrast and perspectives in balance. Very striking. What is the obsession with monsters and skulls?( question aimed at many other here).
We are all dying and humans have always been fascinated by death and the afterlife. And as for monsters - while we are afraid of them - humans are the worst monsters. Monsters live in our heads and in the dark - and under our beds.I learned some about art as wify is heavily into art and an artist. This is up to page 85 the winner imho, and wify agrees with me. Very abstract novel idea, well executed with contrast and perspectives in balance. Very striking. What is the obsession with monsters and skulls?( question aimed at many other here).