[models] add gpt-4o-mini

pkelaita · Jul 19, 2024 · 4acc6f0 · 4acc6f0
1 parent f969534
commit 4acc6f0
Show file tree

Hide file tree

Showing 3 changed files with 21 additions and 3 deletions.
diff --git a/README.md b/README.md
@@ -1,12 +1,12 @@
 # L2M2: A Simple Python LLM Manager 💬👍
 
-[![Tests](https://github.com/pkelaita/l2m2/actions/workflows/tests.yml/badge.svg?timestamp=1720807924)](https://github.com/pkelaita/l2m2/actions/workflows/tests.yml) [![codecov](https://codecov.io/github/pkelaita/l2m2/graph/badge.svg?token=UWIB0L9PR8)](https://codecov.io/github/pkelaita/l2m2) [![PyPI version](https://badge.fury.io/py/l2m2.svg?timestamp=1720807924)](https://badge.fury.io/py/l2m2)
+[![Tests](https://github.com/pkelaita/l2m2/actions/workflows/tests.yml/badge.svg?timestamp=1721419447)](https://github.com/pkelaita/l2m2/actions/workflows/tests.yml) [![codecov](https://codecov.io/github/pkelaita/l2m2/graph/badge.svg?token=UWIB0L9PR8)](https://codecov.io/github/pkelaita/l2m2) [![PyPI version](https://badge.fury.io/py/l2m2.svg?timestamp=1721419447)](https://badge.fury.io/py/l2m2)
 
 **L2M2** ("LLM Manager" &rarr; "LLMM" &rarr; "L2M2") is a tiny and very simple LLM manager for Python that exposes lots of models through a unified API. This is useful for evaluation, demos, production applications etc. that need to easily be model-agnostic.
 
 ### Features
 
-- <!--start-count-->15<!--end-count--> supported models (see below) – regularly updated and with more on the way
+- <!--start-count-->16<!--end-count--> supported models (see below) – regularly updated and with more on the way
 - Session chat memory – even across multiple models
 - JSON mode
 - Prompt loading tools
@@ -26,6 +26,7 @@ L2M2 currently supports the following models:
 | Model Name          | Provider(s)                                                        | Model Version(s)                                    |
 | ------------------- | ------------------------------------------------------------------ | --------------------------------------------------- |
 | `gpt-4o`            | [OpenAI](https://openai.com/product)                               | `gpt-4o-2024-05-13`                                 |
+| `gpt-4o-mini`       | [OpenAI](https://openai.com/product)                               | `gpt-4o-mini-2024-07-18`                            |
 | `gpt-4-turbo`       | [OpenAI](https://openai.com/product)                               | `gpt-4-turbo-2024-04-09`                            |
 | `gpt-3.5-turbo`     | [OpenAI](https://openai.com/product)                               | `gpt-3.5-turbo-0125`                                |
 | `gemini-1.5-pro`    | [Google](https://ai.google.dev/)                                   | `gemini-1.5-pro`                                    |
@@ -426,6 +427,7 @@ The following models natively support JSON mode:
 <!--start-json-native-->
 
 - `gpt-4o` (Openai)
+- `gpt-4o-mini` (Openai)
 - `gpt-4-turbo` (Openai)
 - `gpt-3.5-turbo` (Openai)
 - `gemini-1.5-pro` (Google)

diff --git a/l2m2/__init__.py b/l2m2/__init__.py
@@ -1 +1 @@
-__version__ = "0.0.25"
+__version__ = "0.0.26"
diff --git a/l2m2/model_info.py b/l2m2/model_info.py
@@ -121,6 +121,22 @@ class ModelEntry(TypedDict):
             "extras": {"json_mode_arg": {"response_format": {"type": "json_object"}}},
         },
     },
+    "gpt-4o-mini": {
+        "openai": {
+            "model_id": "gpt-4o-mini-2024-07-18",
+            "params": {
+                "temperature": {
+                    "default": PROVIDER_DEFAULT,
+                    "max": 2.0,
+                },
+                "max_tokens": {
+                    "default": PROVIDER_DEFAULT,
+                    "max": 4096,
+                },
+            },
+            "extras": {"json_mode_arg": {"response_format": {"type": "json_object"}}},
+        },
+    },
     "gpt-4-turbo": {
         "openai": {
             "model_id": "gpt-4-turbo-2024-04-09",