The default context is 128k for the smaller Gemma 4’s and 256k for the bigger on... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

alfiedotwtf 4 months ago | parent | context | favorite | on: Running Gemma 4 locally with LM Studio's new headl...

The default context is 128k for the smaller Gemma 4’s and 256k for the bigger ones, so you’re cutting off context and it doesn’t know how to continue.

Bump it to native (or -c 0 may work too)

pshirshov 4 months ago | [–]

In that case the model descriptor on ollama.com is incorrect, because it defaults to 16k. So I have to manually change that to 64/128k. I think you are talking about maximum context size.

trvz 4 months ago | [–]

No, the default context in Ollama varies by the memory available: https://docs.ollama.com/context-length

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact