Everything you described would be a small improvement, not a leap towards AGI that is needed. That is why it isn’t being researched further. Massive investment for minimal gain.

What does it mean to think? This is a open-ended philosophical question and has any number of answers.

I completely agree with your 2nd and 3rd paragraph.

There are similarities and there are clear differences. The reason why we say LLMs are different from us is because we DO have general intelligence, LLMs have not displayed such capabilities despite the intense pressure to prove so. THIS is why we say LLMs couldn’t possibly be like us. Because evidence shows they aren’t, despite the similarities.

I would be interested to hear what developments in the last month you’re referring to, would be exciting to see a breakthrough.

I believe the people in frontier labs are doing their best to push in that direction.

I believe the investors believe they will have AGIs in a few years.

I believe the human species has throughout history repeatedly proven the height of its hubris and the depth of its stupidity.

Disagree.

It is true there were massive strides in the last 8 years. But fundamentally, the tech is still the same large language model it was before, just bigger and better optimized.

It’s like going from an ancient, slow, Ford Model T that topped out at 45mph to a Bugatti that can do 260mph in 8 short years. It’s impressive, it boosts productivity, it is a marvel of modern technology, but that’s not my point of contention.

The issue is that AI companies have been funded on the promise that with enough advancements and upgrades this tech will achieve AGI. Which is an absurd statement to anyone in the field actually developing these things. That is the equivalent of promising that this 260mph Bugatti, with a few years of upgrades and advancements, will become a Harrier Jump Jet!

It’s just not happening, a fundamental shift in model architecture or technology used is needed. And from what we’ve seen so far, no one has discovered any.

Linus Torvalds = Linux

Linus Sebastian ≠ Linux

Good for entertainment. Never take anything they say seriously.