• 36 Posts
  • 205 Comments
Joined 3 years ago
cake
Cake day: June 1st, 2023

help-circle
  • and has fuck all to do with charity

    That’s what I said?

    you absolutely can inspect the weights

    Current techniques cannot give you anything close to the level of inspection you can with software. Worse still, techniques of frontier AI labs are moving in the opposite direction with it getting harder to understand over time and less going into things like chain of thought

    There also projects like petals for doing distributed training

    You always be at a massive disadvantage because of the severally more limited compute available. Additionally, distributed computing not inside the same data center adds massively increased latency

    Training a model also does nothing for the environmental side of things and just makes things worse

    instead of whinging endlessly as if OpenAI or Anthropic give a flying fuck that some brave lib made yet another ‘AI slop’ comment on a niche social media platform.

    That’s 100% missing the point. The point is to not encourage more people to use the tool that gives control to Anthropic, OpenAI, etc. Social stigma and pushback is the point. People use things less when it’s seen as uncool. Normalizing AI use just means it’s going to be used more against your interests


  • Only a handful of companies make open weight models, and those models are not made for charity. They want either market share and/or control. Making your own model is not like making your own software because the capital cost are extraordinarily high. The masses will not have the billions in funds they would need need to train these models

    Unlike open source code, you cannot check what’s actually in the open weight models. Worse still, you can hide things that trigger on very specific words (poison attacks can be intentional by the model maker or put by other actors in the public data). Fine tuning attempts are also no escape from hidden features you don’t even know to look for



  • The open source software movement was very much founded on the idea of being concerned about what kinds of tools we use as a society. Software that’s “just a tool” can lock you down and out of what you can do with it. Same argument can just as well be made that people were “shying away from using new and interesting tools” by running free software instead of Microsoft’s new priority stuff that locks you in

    AI similarly gives massive control to a handful of companies. They have already used that leverage to intentionally sandbag tasks without telling you, when they think it’s against their economic interests (model distillation and AI research). Is it not possible to imagine that goes further, they would use that leverage to slip in backdoor, not report classes of bugs, etc.?





  • There is some amount of traction for similar ideas. From the article:

    The campaign calls on local councils to take action on advertising that promotes meat, dairy, and factory farming to “make room for more honest conversations about food.” In a UK-first, Zoe Garbett, the Mayor of Hackney, has pledged to end meat and dairy advertising on all council-owned land in the East London borough.

    […]

    Earlier this year, Amsterdam became the first capital city in the world to introduce a ban on advertisements for fossil fuels and meat







  • Humans and human ancestors have also been consuming large quantities of plants for far earlier than that. Here’s another paper looking 780,000 years ago finding a wide amount of plants consumed

    we demonstrate that a wide variety of plants were processed by Middle Pleistocene hominins at the site of Gesher Benot Ya’aqov in Israel (33° 00’ 30” N, 35° 37’ 30” E), at least 780,000 y ago. These results further indicate the advanced cognitive abilities of our early ancestors, including their ability to collect plants from varying distances and from a wide range of habitats and to mechanically process them using percussive tools.

    https://www.pnas.org/doi/10.1073/pnas.2418661121

    I am not saying that hunting didn’t happen (it definitely did). I am just saying that more recent research is painting a very different picture of the level of consumption of it