

21·
1 year agoIs it not an apt analogue to describe the behavior, though? After all, one well known failure mode of LLMs has been formally dubbed “hallucination”.


Is it not an apt analogue to describe the behavior, though? After all, one well known failure mode of LLMs has been formally dubbed “hallucination”.


Isn’t it pretty clear that human intelligence isn’t only high-dimensional statistical modelling by showing how even small children have “context windows” vastly surpassing even the most advanced and resource intensive models, and their brains only take a few snacks every few hours to power?
IMO in the same way everyone learns arithmetic but doesn’t necessarily go into mathematics or finance, I think everyone should learn basic logic and coding, enough to basically use spreadsheet formulas, which is a half step away functional programming. (I’m pretty sure Excel even supports named functions and lambdas)