Documentation of system prompts?

[simonw]

Is there any documentation for which system prompts are used by which models in the arena?

I'm interested in deepseek-r1 for example - I searched this repo and couldn't find anything that looked like it might be that system prompt.

Exposing these in the UI would be ideal, but having somewhere else we can see them (a GitHub repo for example) would be useful too.

[infwinston]

Hey @simonw! for most models, we do not set any system prompt. For instance, in deepseek API we follow the instructions here https://api-docs.deepseek.com/guides/reasoning_model (which doesn't use any system prompt). But I agreed that we should expose the model configuration more explicitly in the UI/leaderboard. will put this on our list!

[kpetr01]

Hi, small follow-up question: Is there any way to find out also settings of parameters (e.g. temperature or top-p) which are used by models in arena? Thank you.