TFA says it can bump the spec to 768 GB but that it's then more like $2500 than ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		TacticalCoder on Feb 1, 2025 \| parent \| context \| favorite \| on: How to Run DeepSeek R1 671B Locally on a $2000 EPY... TFA says it can bump the spec to 768 GB but that it's then more like $2500 than $2000. At 768 GB that'd be the full, 8 bit, model. Seems indeed like a good price compared to $6000 for someone who wants to hack a build. I mean: $6 K is doable but I take it take many who'd want to build such a machine for fun would prefer to only fork $2.5K.

manmal on Feb 1, 2025 [–]

The Q8 model will likely slow this down to 50%, probably not a very useful speed. The 6k setup will probably do 10-12t/s at Q4.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact