Skip to content

Commit

Permalink
Revert "Merge branch 'main' of github.com:tenstorrent/tt-studio into …
Browse files Browse the repository at this point in the history
…staging …"

This reverts commit 4490e8a.
  • Loading branch information
bgoelTT authored Jan 22, 2025
1 parent 4490e8a commit f4eb07a
Show file tree
Hide file tree
Showing 5 changed files with 14 additions and 213 deletions.
38 changes: 0 additions & 38 deletions .github/ISSUE_TEMPLATE/bug_report.md

This file was deleted.

20 changes: 0 additions & 20 deletions .github/ISSUE_TEMPLATE/feature_request.md

This file was deleted.

128 changes: 0 additions & 128 deletions CODE_OF_CONDUCT.md

This file was deleted.

15 changes: 0 additions & 15 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,18 +34,3 @@ We actively welcome your pull requests! To ensure quality contributions, any cod
- When merging from `staging` into `main`, we do **not** use squashing. This ensures that the full commit history between these branches is preserved.

Please ensure that this process is followed when submitting PRs to keep the repository organized and maintainable.

### Versioning Standards

To ensure consistency in versioning, we follow the principles of **semantic versioning**:

- **MAJOR**: Increment for incompatible or breaking changes to backend or frontend APIs or functionality:
- Removing or significantly altering existing features.
- Changing the current networking design.
- Altering backend API flows.
- Changing frontend API calls and/or redoing entire components.

- **MINOR**: Increment when adding new features or capabilities in a backward-compatible manner:
- For example, supporting new models like YOLOv4 or adding new functionalities.

- **PATCH**: Increment for bug fixes and minor improvements that are backward-compatible.
26 changes: 14 additions & 12 deletions app/api/shared_config/model_config.py
Original file line number Diff line number Diff line change
Expand Up @@ -59,18 +59,6 @@ def __post_init__(self):
self.docker_config["environment"]["HF_HOME"] = Path(
backend_config.model_container_cache_root
).joinpath("huggingface")

# Set environment variable if N150 or N300x4 is in the device configurations
if DeviceConfigurations.N150 in self.device_configurations or DeviceConfigurations.N300x4 in self.device_configurations:
self.docker_config["environment"]["WH_ARCH_YAML"] = "wormhole_b0_80_arch_eth_dispatch.yaml"

if self.env_file:
logger.info(f"Using env file: {self.env_file}")
# env file should be in persistent volume mounted
env_dict = load_dotenv_dict(self.env_file)
# env file overrides any existing docker environment variables
self.docker_config["environment"].update(env_dict)


# Set environment variable if N150_WH_ARCH_YAML or N300x4_WH_ARCH_YAML is in the device configurations
if (
Expand Down Expand Up @@ -227,6 +215,20 @@ def base_docker_config():
service_route="/v1/chat/completions",
env_file=os.environ.get("VLLM_LLAMA31_ENV_FILE"),
),
ModelImpl(
model_name="Mistral7B-instruct-v0.2",
model_id="id_tt-metal-mistral-7bv0.0.2",
image_name="ghcr.io/tenstorrent/tt-inference-server/tt-metal-mistral-7b-src-base",
image_tag="v0.0.3-tt-metal-v0.52.0-rc33",
hf_model_path="mistralai/Mistral-7B-Instruct-v0.2",
device_configurations={DeviceConfigurations.N300x4_WH_ARCH_YAML},
docker_config=base_docker_config(),
user_uid=1000,
user_gid=1000,
shm_size="32G",
service_port=7000,
service_route="/inference/mistral7b",
),
#! Add new model vLLM model implementations here
# ModelImpl(
# model_name="", #? Add the model name for the vLLM model based on persistent storage
Expand Down

0 comments on commit f4eb07a

Please sign in to comment.