Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Training data without the training regime is useless. A cake is not open source because they list the ingredients.


Wrong. The data (and compute) matters infinitely more than the training regime/architecture. This is the Bitter lesson.

I could rerun Kimi K3 with full transformers instead of the hybrid mamba architecture and it would only get better.


Open source captures a practical utility as well as a philosophy. When those two cease to converge, the practical prerogative wins.

The correct battle would have been weights + regime. But extremists insisted on data, too, which left Meta as the only other real voice arguing with anything practical. They had open weights. I think eventually open use was negotiated and that closed the case except for the folks still arguing about how to pronounce GIF.


Isn't open source not the ingredients but the recipe?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: