My how fast the AI tech bros move to protect corporations but don’t move to protect the average coder, artists, writers.
Don’t worry! Its STILL okay to reverse engineer the work of photographers artists writers actors voice over musicians modelers animators academics etc etc (feel free to add. the exploitation is literally everywhere!)
Only if you’re a corporation! If you’re a filthy worker then you have no rights.
The “There’s no way we can stop our agents from going rogue” people, suddenly have a burst of ability to reign in their creation when it suits their interests.
Funny that…
Does anyone think that perhaps what they are afraid is that source code of such clone would be compared to the original and show evidence that maybe the model was already trained on the code of the game?
I think this is definitely a concern, yes.
I think it’s very likely that these models are effectively being tricked into retrieving source code of projects from memory of seeing the actual source code in the biases. This is why some project are much easier to uncover than others.
I’m no expert, but if my understanding of LLMs as ‘probability calculators’ is correct, then if you prompted one properly to produce code which does x (a Photoshop function for example) and it had only been trained on one example of this (the Photoshop source code) it would reproduce the PS source code because that has the highest probability of that being the correct ‘answer’.
This is baasically correct, though what the models actually produce is a little more randomized than that. Though, if there aren’t any words that are anywhere cllose to being likely to follow next, then there won’t be a any other valid options to choose.
They aren’t being tricked. They are doing exactly what they were designed to do
The models don’t store access to their training data. So no, there’s no source code in the model to retrieve.
The models are essentially a giant lossy compression applied to the training data.
They don’t store the loseless version of the training data sure, but that doesn’t mean it can’t reproduce something close enough to it, it’s literally how the whole thing works.
It’s long been proven that LLMs can produce exact copies of their training data. Not every piece of training data, of course, but enough where spitting out exact replicas of proprietary code is a legitimate concern. Not to mention that copies don’t need to be exact in order to be a problem.
The purpose of Al is to allow wealth to access skill while removing from the skilled the ability to access wealth.
The purpose of capitalism…
The purpose of capitalism is to leverage capital (assets) for private enterprise. It’s objective seems accumulation, but it’s really just human nature. People hoard, and wealth seems akin to hoarding.
Pretty much. Regardless of AI, workers, white, blue, even managers, are nothing more than a cost account to the majority of corporations.
So they took out two of the most useful things that LLMs can do.
Yes, apparently they’re suddenly worried that stealing other people’s work—which is their business model—might backfire on them. I assume this is a measure intended to give the impression—in the face of one of the countless lawsuits against Anthropic—that they’re actually taking licensing or intellectual property rights seriously. I can’t think of any other explanation, because Anthropic simply can’t afford to have questions raised about where the training data used by their models actually comes from.
Pulling up the stolen ladder before anyone can steal it to use to steal more stuff while it’s still enforceable to do so.
Mabey just make all ladders illegal, unless you have a government contracted monopoly.
The entire idea of copyright is going to be tested at many levels, and most people don’t even understand why yet.
Interesting times.
Government contracted monopoly
You mean like when that town tried to force an xAI data center to not use methane turbines, and they got shut down by the government because the military was allegedly using Grok?
No, they just enabled Chinese LLMs to be the forefront of reverse engineering. Because people will do what they want to do.
No, they just enabled Chinese LLMs to be the forefront of reverse engineering. Because people will do what they want to do.
Their goal is simple… everything they are doing right now is striving to make the US ban individual hardware.
Chinese models are open, anyone can get them… stopping the flow of data on private computers is impossible. Hardware however is getting more expensive, hardware manufacturers are already deciding to move out of the consumer market on their own. The US government is already establishing laws to prevent shipping foreign hardware into the country.
Altman’s giving the game away when he does this “it’s so sad that all this ram is sitting around in people’s home computers unappreciated when it could do so much more in a data center”.
The idea is to sell the message "AI is out of the bag, and it’s world ending technology. Basically they are going to imply that the guardrails in their data centers are the only thing that’s preventing all AIs from destroying the software industry, and teaching teenagers to build bombs and hacking the CIA, and the only possible response would be to stop all direct to consumer hardware sales with anything more than the bare minimum needed to stream a PC out of a data center.
This is all pretty obvious and I agree. They can no longer protect their imaginary property if they allow it to be ran in your computer’s memory or stored on your computers hard drive.
The cat is definitely out of the bag, as in their own AI models are making them obselete. The race to make money before the end is what motivates them. They will ride the roller coaster to our societal demise because they only care about money. These people shouldn’t be in charge of a small fast food restaurant let alone multi-billion dollar companies.
When it hurts jobs, AI is the future, when it hurts rich friends needs moderation.
This is part of the reason they don’t want anyone running models locally offline, the models and their entire business are commoditized
- LLM bubble pops.
- Market gets flooded with $200b worth of hardware (this is how much is not used to Zitrons knowledge).
- ???
- Subscription based LLM gets cooked.
Government bales out AI companies and the bill they write to do it will make local LLMs illegal.
I think you are right, but that seems VERY unenforceable.
Successful enforcement doesn’t look like catching every pivate LLM owner.
This is what winning the AI race looks like.
To those who say “but what about game preservation?”:
GenAI slop ruined communities around game preservation. And for every time a AAA dev getting this treatment, there’s at least 3 indies getting it worse.
“AI is going to make everything free!!” Proceeds to make video games free. “No, not that, shut it down!”
Would you spend 13 years making GTA VI if it was going to be cracked day 1? Why bother? Just let the users vibe code it.
It’s probably done via a system prompt and not actual weights, so you could probably work around it if you say the right things.
But yeah this is very much “rules for thee not for me”
Yeah, it’s sysprompt only, so you can trivially sidestep it via:
- Jailbreak prompt
- tweakcc to alter the prompting baked into claude code
- Any other non-CC harness
- Scripted API calls
As usual, Anthropic are just opticsmaxxing because they don’t want to get completely buried in a courtroom. And as other people have pointed out upthread already, it’s already a bit of a moot point since the Chinese models are already eating Claude’s lunch and will do the same stuff without complaint.
“It’s so powerful! You’re only allowed to use it how we want you to”.
Allowed eh? How about go fuck yourself?
So this is how these companies are going to safeguard against IP theft lawsuits! Leave our theft be, or we’ll tell everyone how to get in.
Also it’s incredibly telling how Anthropic doesn’t add code to stop suicide ideation in teens (what they are their ilk are being sued for) but can somehow very quickly stop reverse engineering. A tool that values the captial holders through & through. Their “democratization of intelligence” schtick is obvious now.
OpenSource frontier models ASAP! Obviously never gonna happen, but a fool can dream atleast.
Also it’s incredibly telling how Anthropic doesn’t add code to stop suicide ideation in teens (what they are their ilk are being sued for) but can somehow very quickly stop reverse engineering.
This.
I’m hopeful this is positive, they’ll start loosing a lot more to Chinese models and I can assure you local models will blow up too.
I can assure you local models will blow up too.
Why?
