Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
zozbot234
4 months ago
|
parent
|
context
|
favorite
| on:
Caveman: Why use many token when few token do tric...
Grug says prompt caching just store KV-cache which is sequenced by token. Easy cut it back to just before edit. Then regenerate after is just like prefill but tiny.
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: