☆ Yσɠƚԋσʂ ☆@lemmy.ml to AI@lemmy.mlEnglish · 2 days agoStop Thinking of LLMs as Next-Token Predictorsgmcgoldr.github.ioexternal-linkmessage-square22fedilinkarrow-up19
arrow-up19external-linkStop Thinking of LLMs as Next-Token Predictorsgmcgoldr.github.io☆ Yσɠƚԋσʂ ☆@lemmy.ml to AI@lemmy.mlEnglish · 2 days agomessage-square22fedilink
minus-squarereallykindasorta@slrpnk.netlinkfedilinkarrow-up3·1 day agoYeah and he basically argues that you shouldn’t see it as next-token even though he agrees that it is lol
minus-squarem532@lemmygrad.mllinkfedilinkarrow-up3·1 day agoAnd a mouse is technically a blob of molecules. But does calling a mouse a blob of molecules explain why it moves away from cats?
minus-squarefreagle@lemmy.mllinkfedilinkEnglisharrow-up2·1 day agoBut it’s different because “it does it’s own exploration of infinite space which is exactly like knowing how to win all chess positions through a brute force solution to the finite game space”
Yeah and he basically argues that you shouldn’t see it as next-token even though he agrees that it is lol
And a mouse is technically a blob of molecules. But does calling a mouse a blob of molecules explain why it moves away from cats?
But it’s different because “it does it’s own exploration of infinite space which is exactly like knowing how to win all chess positions through a brute force solution to the finite game space”