add ci tests/lint #1
Conversation
mxyng
force-pushed
the
mxyng/tests
branch
2 times, most recently
from
9903840 to
319037d
Compare
mxyng
force-pushed
the
mxyng/tests
branch
3 times, most recently
from
f45c8d4 to
eedfcc2
Compare
| ### Using the Synchronous Client | ||
|
|
||
| ```python | ||
| from ollama import Client |
There was a problem hiding this comment.
Is this much different than just calling ollama.chat?
There was a problem hiding this comment.
Yes, you can change the base url. ollama.chat uses the default base url of https://127.0.0.1:11434. Client will likely need to support other things like TLS and proxies pretty soon
There was a problem hiding this comment.
Nice, so this is using a "custom client" effectively
| Requires Python 3.8 or higher. | ||
|
|
||
| ```sh | ||
| pip install ollama |
|
Looking very solid - a few minor |
| return response.json() | ||
|
|
||
| async def _stream(self, method, url, **kwargs): | ||
| async def inner(): |
There was a problem hiding this comment.
This is necessary because _stream needs to return a coroutine and a generator. Otherwise the caller will need to decide whether to return await or just return based on stream since an async generator cannot be awaited
mxyng
force-pushed
the
mxyng/tests
branch
3 times, most recently
from
8f3029b to
677be58
Compare
TODO: