isn't that what the mixture of experts trick that all the big players do is? Bun... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		agoodusername63 4 months ago \| parent \| context \| favorite \| on: The RAM shortage comes for us all isn't that what the mixture of experts trick that all the big players do is? Bunch of smaller, tightly focused models

irthomasthomas 4 months ago [–]

Not exactly. MoE uses a router model to select a subset of layers per token. This makes them faster but still requires the same amount of RAM.

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact