@POTOOOOOOOO@reddthat.com to Asklemmy@lemmy.mlEnglish • 19 days agoHave you found any cool uses/life hacks for AI?message-square86fedilinkarrow-up182arrow-down122
arrow-up160arrow-down1message-squareHave you found any cool uses/life hacks for AI?@POTOOOOOOOO@reddthat.com to Asklemmy@lemmy.mlEnglish • 19 days agomessage-square86fedilink
minus-square@yo_scottie_oh@lemmy.mllinkfedilinkEnglish2•19 days agoDo you run this on NVIDIA or AMD hardware?
minus-square@brucethemoose@lemmy.worldlinkfedilink4•19 days agoNvidia. Back then I had a 980 TI RN I am lucky enough to have snagged a 3090 before they shot up. I would buy a 7900, or a 395 APU, if they were even reasonably affordable for the VRAM, but AMD is not pricing their stuff well… But FYI you can fit Qwen 32B on a 16GB card with the right backend/settings.
Do you run this on NVIDIA or AMD hardware?
Nvidia.
Back then I had a 980 TI RN I am lucky enough to have snagged a 3090 before they shot up.
I would buy a 7900, or a 395 APU, if they were even reasonably affordable for the VRAM, but AMD is not pricing their stuff well…
But FYI you can fit Qwen 32B on a 16GB card with the right backend/settings.