> Making an LLM from raw data is value-add. > Distillation is just value extract... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

scotty79 54 days ago | parent | context | favorite | on: Who's afraid of Chinese models?

> Making an LLM from raw data is value-add. > Distillation is just value extract.

There is a value-add in selecting the valuable parts out of the garbage. And let's face it. Largest models contain a lot of garbage.

bluegatty 54 days ago [–]

I think that's kind of fair, but it still fits within the context of 'some things are value add' and 'more or less than others'.

We ought to identify that and integrate that into our thinking.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact