keep_alive setting

[kanoai7]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

i wonder where can i set keep_alive for ollama? seems already support

Solution

No response

[tranquochuy645]

Hi @kanoai7 ,

You can set this value by editing your config.json, the default value is 60*30 (30 minutes)

Take a look at their documentation: https://docs.continue.dev/reference#completionoptions

It's something like this:

{
"models":[
"title": "Ollama",
"provider": "ollama",
"model": "AUTODETECT"
"completionOptions":{
"keepAlive": 9999999,
}
]
}

[kanoai7]

Hi @kanoai7 ,

You can set this value by editing your config.json, the default value is 60*30 (30 minutes)

Take a look at their documentation: https://docs.continue.dev/reference#completionoptions

It's something like this:

{ "models":[ "title": "Ollama", "provider": "ollama", "model": "AUTODETECT" "completionOptions":{ "keepAlive": 9999999, } ] }

sorry, i should check doc more careful.