Skip to content

Commit

Permalink
Merge branch 'Document-Custom-Model-Files' of https://github.com/Para…
Browse files Browse the repository at this point in the history
…gEkbote/lighteval into Document-Custom-Model-Files
  • Loading branch information
ParagEkbote committed Dec 30, 2024
2 parents bf65e27 + 3ca0960 commit 9b753af
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 6 deletions.
4 changes: 2 additions & 2 deletions src/lighteval/models/endpoints/endpoint_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -91,10 +91,10 @@ def from_path(cls, path: str) -> "ServerlessEndpointModelConfig":
@dataclass
class InferenceEndpointModelConfig:
"""
This class is designed to manage and define settings for deploying inference endpoints in machine learning models.
This class defines the settings used to deploy inference endpoints automatically. (Inference endpoint docs: https://huggingface.co/docs/inference-endpoints/index)
Attributes:
endpoint_name (str, optional):The name of the inference endpoint.
endpoint_name (str, Optional): Inference endpoint name (to use at creation or reuse)
model_name (str, optional): The name of the model for inference.
reuse_existing (bool, default: False): Indicates whether to reuse an existing endpoint.
accelerator (str, default: "gpu"): Specifies the type of hardware accelerator.
Expand Down
7 changes: 3 additions & 4 deletions src/lighteval/models/endpoints/openai_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -62,11 +62,10 @@
@dataclass
class OpenAIModelConfig:
"""
A configuration class for OpenAI models. This class is used to specify settings related to OpenAI models,
including the model name or identifier.
Configuration class to create an [[OpenAIModel]], to call via its API at inference for evaluation.
Attributes:
model: It specifies the name or identifier of the OpenAI model to be used.
model: name or identifier of the OpenAI model to be used for inference.
"""
model: str

Expand Down

0 comments on commit 9b753af

Please sign in to comment.