This is the key factor here. I have a 3080, with 16GB of Memory, but still have ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

giancarlostoro on March 27, 2024 | parent | context | favorite | on: DBRX: A new open LLM

This is the key factor here. I have a 3080, with 16GB of Memory, but still have to run some models on CPU since the memory is not unified at all.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact