@Wilshire@lemmy.world to Technology@lemmy.worldEnglish • 10 months agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square61fedilinkarrow-up1215arrow-down117
arrow-up1198arrow-down1external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.com@Wilshire@lemmy.world to Technology@lemmy.worldEnglish • 10 months agomessage-square61fedilink
minus-square@2001zhaozhao@sh.itjust.workslinkfedilinkEnglish1•10 months agoTime to buy a thread ripper and 800gb of ram so that I can run this model at 1 token per hour.
its around 800gb
God damn.
That’s some thick model
Time to buy a thread ripper and 800gb of ram so that I can run this model at 1 token per hour.