stabby_cicada@slrpnk.net to solarpunk memes@slrpnk.net · 1 day agoone more shitty techbrofad downslrpnk.netimagemessage-square130fedilinkarrow-up1434arrow-down146file-text
arrow-up1388arrow-down1imageone more shitty techbrofad downslrpnk.netstabby_cicada@slrpnk.net to solarpunk memes@slrpnk.net · 1 day agomessage-square130fedilinkfile-text
minus-squarePriorityMotif@lemmy.worldlinkfedilinkarrow-up7·7 hours agoYou can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
minus-squareTherapyGary@lemmy.blahaj.zonelinkfedilinkarrow-up5·6 hours agoYou can already run 3B llms on cheap phones using MLCChat, it’s just hella slow
You can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
You can already run 3B llms on cheap phones using MLCChat, it’s just hella slow