Ldelalande/model settings #651
Conversation
lily-de
force-pushed
the
ldelalande/model-settings
branch
from
ee492b0 to
56df3f7
Compare
| @@ -73,6 +75,13 @@ async fn create_agent( | |||
| return Err(StatusCode::UNAUTHORIZED); | |||
| } | |||
|
|
|||
| // Set the environment variable for the model if provided | |||
| if let Some(model) = &payload.model { | |||
| let env_var_key = format!("{}_MODEL", payload.provider.to_uppercase()); | |||
There was a problem hiding this comment.
Should this be payload.model.to_uppercase()?
There was a problem hiding this comment.
It's provider pretty sure ... like OPENAI_MODEL, ANTHROPIC_MODEL, DATABRICKS_MODEL etc
There was a problem hiding this comment.
seems to work based on log statements!
There was a problem hiding this comment.
I see. I guess I was just confused by the surface level param mapping
We have payload.model and payload.provider but we set {}_MODEL to payload.provider
Not a big deal though!
There was a problem hiding this comment.
oh yeah i see how that is confusing.. it's just to match what we are looking for in the backend when we set up an agent with a specific provider -- eg here's where we set up anthropic with a model or default to sonnet
No description provided.