WIP: AI Agent v0

[mvanniasingheTT]

Description

This PR adds support for the search agent using the Llama 70B Instruct model. Using the ChatUI, a user is able to switch between using their standard LLM of choice and using the search agent to access real time information from the web.

Instructions to Setup Agent

Build Docker Image

Once you have done the typical setups with the weights and persistent volume, follow the below:

Visit https://tavily.com/ to generate an API key to use the search tool. Update the tt-studio/app/.env.default with the API key

TAVILY_API_KEY=<your-tavily-api-key>

cd tt-studio/app/api/agent_control
docker build -t agent_image:v1 .
cd tt-studio/app
docker compose up --build

Refer to the below video for an example of what the agent can be used to do:

SearchAgent_Demo.mov

To Do:

• Add generalizable support for all llm models
• Add in loading bar to show search is taking place
• Add agent image to GHCR (?)
• Parse agent output so use only the final answer in the response (intermediate step will correspond to the loading bar)
• Thread id of agent should by dynamic based on which chat being used in ChatUI

[github-actions]

Our automated SPDX license verification process has discovered that the following files are missing a license header:

./app/api/agent_control/agent.py
./app/api/agent_control/code_tool.py
./app/api/agent_control/custom_llm.py
./app/api/agent_control/utils.py

Please ensure each indicated file includes a valid SPDX license identifier. This is essential for maintaining licensing compliance. Your attention and cooperation in updating these files are greatly appreciated. Thank you.

[github-actions]

Our automated SPDX license verification process has discovered that the following files are missing a license header:

./app/api/agent_control/agent.py
./app/api/agent_control/code_tool.py
./app/api/agent_control/custom_llm.py
./app/api/agent_control/utils.py

Please ensure each indicated file includes a valid SPDX license identifier. This is essential for maintaining licensing compliance. Your attention and cooperation in updating these files are greatly appreciated. Thank you.

[github-actions]

Our automated SPDX license verification process has discovered that the following files are missing a license header:

./app/api/agent_control/agent.py
./app/api/agent_control/code_tool.py
./app/api/agent_control/custom_llm.py
./app/api/agent_control/utils.py

Please ensure each indicated file includes a valid SPDX license identifier. This is essential for maintaining licensing compliance. Your attention and cooperation in updating these files are greatly appreciated. Thank you.

[github-actions]

Our automated SPDX license verification process has discovered that the following files are missing a license header:

./app/api/agent_control/agent.py
./app/api/agent_control/code_tool.py
./app/api/agent_control/custom_llm.py
./app/api/agent_control/utils.py

Please ensure each indicated file includes a valid SPDX license identifier. This is essential for maintaining licensing compliance. Your attention and cooperation in updating these files are greatly appreciated. Thank you.