RICOCHET has been a huge help for Call of Duty’s anti-cheat efforts, and this year’s update – which coincides with Modern Warfare 3’s release – includes the unique potential to punish hackers in the funniest possible way.
New anti-AI tool 'poisons' generative models to protect artwork from unauthorized robo-Rembrandts
27.10.2023 - 15:03 / pcgamer.com / New / Ai
A new tool from researchers at the University of Chicago promises to protect art from being hoovered up by AI models and used for training without permission by «poisoning» image data.
Known as Nightshade, the tool tweaks digital image data in ways that are claimed to be invisible to the human eye but cause all kinds of borkage for generative training models, such as DALL-E, Midjourney, and Stable Diffusion.
The technique, known as data poisoning, claims to introduce «unexpected behaviors into machine learning models at training time.» The University of Chicago team claim their research paper shows such poisoning attacks can be «surprisingly» successful.
Apparently, the poison samples images look «visually identical» to benign images. It's claimed the Nightshade poison samples are «optimized for potency» and can corrupt an Stable Diffusion SDXL prompt in fewer than 100 poison samples.
The specifics of how the technology works isn't entirely clear, but involves altering image pixels in ways that are invisible to the human eye while causing the machine-learning models to misinterpret the content. It's claimed that the poisoned data is very difficult to remove, with the implication that each poisoned image must be manually identified and removed from the model.
Using Stable Diffusion as a test subject, the researchers found that it took just 300 poison samples to confuse the model into think a dog was a cat or a hat is a cake. Or is it the other way round?
Anyway, they also say that the impact of the poisoned images can extend to related concepts, allowing a moderate number of Nightshade attacks to «destabilize general features in a text-to-image generative model, effectively disabling its ability to generate meaningful images.»
Best gaming monitor: Pixel-perfect panels for your PC.
Best high refresh rate monitor: Screaming quick.
Best 4K monitor for gaming: When only high-res will do.
Best 4K TV for gaming: Big-screen 4K gaming.
All that said, the team concedes that bringing down the larger models isn't quite so easy. Thousands of poisoned images would be required. Which is probably a good thing from a malicious actor perspective. In other words, it would take a concerted effort to undermine any given large generative model.
So, is that—boom!—your AI imaging model up in smoke? Perhaps, but might one also imagine the mighty AI generative hive mind require all of three picoseconds to register, adjust for and render entirely redundant such measures now that the technology has been unveiled? At which point man fights back with a new attack vector and the eternal struggle continues as the skulls and machine parts pile up across the post-thermonuclear wasteland.
Or something like that. It will certainly be
The website gametalkz.com is an aggregator of news from open sources. The source is indicated at the beginning and at the end of the announcement. You can send a complaint on the news if you find it unreliable.
Top Authors
Popular Topics
tech.hindustantimes.com
04.11.2023 / 15:25
AQI at crisis level in Delhi! Protect yourself from air pollution, just check out these 5 gadgets
As November ushers in the winter months, Delhi's air quality plunges to hazardous levels, with some areas registering an alarming AQI of 700. This recurring nightmare of polluted air, primarily caused by shifting weather patterns, festive fireworks, crop residue burning, construction activity and vehicle emissions, poses severe health risks, particularly to those with respiratory conditions like asthma. To combat this silent menace, the government advises limiting outdoor activities and closing schools while urging everyone to stay informed about air quality levels.
gamesradar.com
02.11.2023 / 18:17
Massive new Dark Souls modding tool is an "absolute game changer" for the Fromsoftware classic
One prominent Dark Souls modder has created a massive new modding tool that could allow for even wackier, cooler creations to pop out of Lordran.
gamesradar.com
01.11.2023 / 22:01
Ultimate Universe #1 sets up the rise of "hundreds" of new Ultimate Marvel heroes
Writer Jonathan Hickman's new Ultimate Universe has officially launched. And while readers previously got some hints from Marvel about what's in store, with some particularly interesting news about the new Ultimate Spider-Man already being teased by the publisher.
wccftech.com
01.11.2023 / 15:39
New Spider-Man 2 Update 1.001.004 Released for PlayStation 5; Addresses Various Issues
Insomniac Games has just rolled out Spider-Man 2 update 1.001.004 for PlayStation 5, which addresses various issues and improves stability.
gameinformer.com
01.11.2023 / 15:29
New Marvel's Spider-Man 2 Update Includes Several Bug Fixes, Increased Stability, And More
Marvel's Spider-Man 2 hit PlayStation 5 exclusively on October 20 and quickly became Sony's fastest-selling first-party game. While we loved the game – read Game Informer's Marvel's Spider-Man 2 review here – players have discovered bugs and issues leading to laughter and, in some cases, progress impediment. Fortunately, developer Insomniac Games has been quick to fix issues with updates, like one last week that fixed an incorrect flag and the infamous white cube model issue.
gamesradar.com
01.11.2023 / 12:19
Marvel's Spider-Man 2 swing comparison shows just how much faster you can travel through New York City
This Marvel's Spider-Man 2 swing comparison video has made fans realize just how much more nimble Peter and Miles are in the sequel.
techradar.com
01.11.2023 / 10:01
New Nintendo Switch OLED Mario Kart 8 Deluxe bundle revealed just in time for Black Friday
It’s finally November and, with Black Friday approaching at a rapid pace, it’s no surprise that we’re already seeing some good deals popping up here and there. This year’s Black Friday officially kicks off on November 24 and will be the perfect opportunity to score some great Black Friday gaming deals.
radiotimes.com
31.10.2023 / 15:59
Does Spider-Man 2 have New Game Plus? Your options after the ending explained
If you're anything like us, then you've already played all there is to offer in Insomniac's excellent superhero romp and are left pondering, «Does Spider-Man 2 have New Game Plus?»
tech.hindustantimes.com
31.10.2023 / 10:25
New York Times Tech Workers to Strike Over Return-to-Office Rules, Contract Delays
New York Times Co. technology workers plan to mount a half-day strike Monday afternoon, accusing the media company of trying to unilaterally force them back to the office without negotiating in good faith.
pcgamer.com
31.10.2023 / 00:29
US President Joe Biden signs executive order 'to protect Americans from the potential risks of AI systems'
In a legislative attempt to stave off the inevitable demise of humanity at the hands of roaming hunter-killer robots, US President Joe Biden has issued an executive order establishing a new set of standards that will guide the development of AI. The order includes requirements to «develop standards, tools, and tests to help ensure that AI systems are safe, secure, and trustworthy,» and to share relevant data about AI models with the US government.
tech.hindustantimes.com
30.10.2023 / 11:39
Protect yourself from fake e-challan scams! Stop money and ID loss
In recent times, India has faced an alarming rise in cybercrime, with cybercriminals continuously developing new and innovative methods to deceive unsuspecting citizens. Among these tactics, the proliferation of fake e-challan scams has become a serious concern. These scams prey on individuals' fear of traffic violations, demanding payments for offenses that never occurred. The Information Security Awareness (ISEA) by MeitY has issued a warning about this growing threat.