Why is the 4bit version 1.2TB and the non-4bit version 650GB? https://huggingfac... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ElijahLynn 4 months ago \| parent \| context \| favorite \| on: Kimi K2 Thinking, a SOTA open-source trillion-para... Why is the 4bit version 1.2TB and the non-4bit version 650GB? https://huggingface.co/mlx-community/Kimi-K2-Thinking-4bit https://huggingface.co/mlx-community/Kimi-K2-Thinking

kachapopopow 4 months ago [–]

I think it the default version here might be 2.5bit or something

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact