ElCanut to solarpunk memes@slrpnk.net · 2 years agoBaybe what's wrong? You've barely touched your Strawberrumexternal-linkmessage-square76linkfedilinkarrow-up1558arrow-down18
arrow-up1550arrow-down1external-linkBaybe what's wrong? You've barely touched your StrawberrumElCanut to solarpunk memes@slrpnk.net · 2 years agomessage-square76linkfedilink
minus-squareramirezmike@programming.devlinkfedilinkarrow-up1·2 years agodoesn’t it work literally by passing in everything it said to determine what the next word is?
minus-squareadderaline@beehaw.orglinkfedilinkEnglisharrow-up1·2 years agoit chunks text up into tokens, so it isn’t processing the words as if they were composed from letters.
doesn’t it work literally by passing in everything it said to determine what the next word is?
it chunks text up into tokens, so it isn’t processing the words as if they were composed from letters.