@misk@sopuli.xyz to Technology@lemmy.worldEnglish • 3 months agoFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.comexternal-linkmessage-square288fedilinkarrow-up1647arrow-down110
arrow-up1637arrow-down1external-linkFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.com@misk@sopuli.xyz to Technology@lemmy.worldEnglish • 3 months agomessage-square288fedilink
minus-square@Acters@lemmy.worldlinkfedilinkEnglish2•3 months agoMany LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Would 256GB/s be too slow for large llms?
It runs on the gpu
Many LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Huh?