• 0 Posts
  • 140 Comments
Joined 3 years ago
cake
Cake day: January 26th, 2024

help-circle
  • Obviously fuck Meta, but the difference is the publishing. Scraping and copying for personal or business use is a civil matter. And machine learning from unlicensed material is also fine - as long as the material isn’t “memorized” and an AI model can’t reproduce it.

    Aaron bravely published the papers which is a criminal matter. That is why I believe copyright and IP law is the real theft, they take down copies for people to learn from.

    There are many many millions of people who read and learned from pirated textbooks and who use those skills to do things. Who watched pirated amines or comics use that to learn how to draw.

    Basically we should not be siding with the unethical side of IP law just to oppose AI corporations. They can afford to buy the books and media, and a simple purchase will do. And they can afford the lawsuits. And they will figure out the memorization problem, so that AI models learn but not memorize (which is only happens in like 1% of the cases and only when you specifically ask for something “just like that”).

    China (so far) is saying that the AI models they produce should be open weight and be available to all people on earth. So if we have any issues it should be with the monopolization of AI models that concentrate this new developing immense power of AI in the hands of a few plutocrats. Which the IP laws might actually help them with.





  • I couldn’t find anything about concurrency. But I assumed it’s more like ~1000 users? B300 has something like 100,000+ tok/s, not sure about context size. I also was wrong on my math for the solar panels, see above. It’s more like +50% costs than 10%. Obviously all of this is napkin math, but even 50% isn’t too bad. My point is that with a slightly saner rollout of AI there seems to be absolutely no problem to make it sustainable. And if you buy your tokens in China you can select a data center that gets it’s power from nuclear or solar.

    And yeah we don’t know how long they will release open weight models. Once hardware to run such open weight models become available they might change tactics. But right now China releasing these open models has a serious impact on the stock price of these AI companies, which is a good thing. The sooner the AI bubble pops the better.

    And like 7 of the top 10 suppliers of tokens right now is from China apparently. What Xi himself said is that the world needs a multilateral approach and AI should not become a monopoly. And while that is clearly propaganda aimed at the global south, China does have a different approach. They spend peanuts on their AI models compared to the west (and the algorithmic breakthroughs done by Chinese AI researches afaik have also been published).

    But you actually can use an existing model to generate training data for a new model. Which is what the US corporations are currently accusing China of doing, which is of course hilarious. Of course China has generated huge amounts of training data themselves. So basically any industrial country could in the future fund a research effort to produce a new AI model and make it open weights. A monopoly situation would be another huge issue with AI.

    Basically in regulation, sustainability and democratizing access China is doing very good. And in poking the AI bubble.





  • Obviously the AI rollout should be slowed down and AI use regulated, like stopping any replacement of workers by AI.

    But China is set to win the AI race with their open weight models on par with the current frontier models. And they are building nuclear power and solar and wind like no tomorrow. And they just started to produce sodium ion batteries to solve the grid storage problem.

    Spurned by the embargo they are developing more efficient algorithms and “Extreme UV lithography” to catch up to the embargoed chips. The neoliberal model of the west is now falling behind even the high tech sectors.

    In case anyone is curious it takes 8 Nvidia B300 cards to run this Kima K3 frontier model yourself (2.8 trillion parameters), costs about half a million. For a big corporation or institutions even in the global south that is relatively cheap and that is the top tier option for running a frontier model. Including complete data sovereignty. Using AMD will be cheaper, and prices will go down once China catches up in like 2030. And you could run that on solar panels and batteries and regenerative water cooling. 8x 1.4kW x24 so maybe 300 kWh LiFePo4 battery so another 50k. To power one complete AI server you’d need about 134 m² in solar panels which are basically free these days.

    For solar panels you’d need about 270 / 6 * 24 = ~1000kW. With about 175€/kWp panels that is another 175 thousand plus installation. And something like 4000m². Plus chargers, and large public pool to cool those 270kW. But that is all the energy costs for 30 years up front. The bigger constraint is the land use then.

    So basically less than 10% 50% extra costs upfront to make AI data centers sustainable. This is a capitalism problem, both the hype / bubble / psychosis (b2b marketing induced) as well as the sustainability question.


  • Even Linus is conflating “doing more” with “being more productive”.

    No he isn’t:

    Torvalds’ broader argument is that generating code has become easy, while maintaining a system over years or decades remains hard — and AI does not close that gap on its own. Without a working understanding of the underlying architecture, he suggested, AI assistance can help someone make mistakes faster rather than build something durable.


  • This is a pretty bananas idea, but I wondered if in the future we’ll be able to have something like a large robot arm “throw” a small plane from the top of a skyscraper as well as catch it for landing. Something like a modified trebuchet, slowly storing energy in a suspended weight to power throwing the plane, or to store the energy from catching the plane. We’d probably need further advances in robotics control, and the arm might need to be too heavy to be fast enough. And overall this makes even less sense than a catapult / puller that is already in use for gliders.


  • Since a plane requires the most thrust at takeoff, you could use ground-based

    Actually dragging (or wheeling in) a wire or having a wire car supplying the plane with electricity during takeoff would work too.

    I think the only realistic use case is going to be short trips. For long range offsetting the carbon for jet fuel just makes more sense.

    But really small personal vehicles could be interesting. There is the Pivotal BlackFly which can VTOL and uses less electricity than a big electric car - and it needs to roads. So for commuting this could actually work to save on infrastructure.


  • I do think with advanced porn technology we could see some serious societal issues. Especially if they are controlled for profit by a single megacorp like all the dating websites.

    But ultimately AI girlfriends are just porn, even if you’d have like an advanced version in virtual reality with cyberdildonics going down on you every night. I suspect most dudes will have no problem separating the fantasy because… aehm men won’t get addicted to one AI girlfriend because they’ll want a whole harem of them lol.

    So if you had a local AI software running on a solar powered PC and graphics card, it would even be a completely ethical form of pornography, since it’s both sustainable and you do not contribute to the demand for young women to do for money what most wouldn’t do just for fun.

    AI porn fundamentally changes the dynamics of the industry, basically a few open source software / open weight models made not for profit could completely “democratize” the access to porn. I honestly think being able to cut out the transactional aspect of porn is a major moral stepping stone of human evolution. Similar to a technology that could fully replace meat and make animal slaughter superfluous.






  • Sorry for ranting lol. But it pisses me off especially when it comes from science news. Elsevier and sciencedirect is another service that blocks me, and I’m not even using a VPN or super secure browser.

    Soon more and more webpages will only work with “authentic Chrome” or some shit, and block all VPNs. And then soon you’ll have to log into chrome. And that will create a permanent link with your government ID. I’m just tired of this predictable evil trajectory of technology. The internet was supposed to destroy tyranny, not join it!