• 33 Posts
  • 149 Comments
Joined 3 years ago
cake
Cake day: November 5th, 2023

help-circle


  • The human brain contains roughly 86 billion neurons, while ChatGPT, a large language model, has 175 billion parameters (often referred to as “artificial neurons” in the context of neural networks). While ChatGPT has more “neurons” in this sense, it’s important to note that these are not the same as biological neurons, and the comparison is not straightforward.

    86 billion neurons in the human brain isn’t that much compared to some of the larger 1.7 trillion neuron neural networks though.











  • TangledHyphae@lemmy.worldtoTechnology@lemmy.world•*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    1
    ·
    edit-2
    2 years ago

    Does Intel make its main CPUs in China for those high tariffs?

    Looked it up and found this info at least:

    Key US Locations:

    Arizona (Fab 52 and 62), New Mexico (Fab 9 and 11x), and Oregon (Hillsboro) are major Intel manufacturing hubs in the US, with the new Fab 42 and 32 also being part of a larger campus in Arizona. Ohio is also a major site with construction well underway for two new leading-edge chip factories.

    Global Footprint:

    Intel also has manufacturing facilities in locations like Israel (Jerusalem, Kiryat Gat) and Ireland (Leixlip).

    Expansion and Future:

    Intel is actively expanding its global network with new fabs in Ohio, Germany, and other locations, according to Intel Newsroom and plans to make the German fab one of the most advanced in the world.






  • One of the major breakthroughs wasn’t just compute hardware, it was things like the “Attention Is All You Need” whitepaper that spawned all the latest LLMs and multi-modal models (video generation, music generation, classification, sentiment analysis, etc etc.) So there has been an insane amount of improvement on the whole neural network architectures themselves. (LSTM, Transformers, recurrent neural nets, convolutional neural nets, etc.) RNN’s were 1972, LSTMs only came out in 1999 come to find out.

    2009-2011 was when we got good image recognition. Transformers started after the Attention whitepaper in 2017. Now the models are improving themselves at this point, singularity is heading our way pretty quickly.