Skip to content
This repository has been archived by the owner on Oct 29, 2024. It is now read-only.

feat(openai): use batch inference for embedding #375

Merged
merged 1 commit into from
Sep 27, 2024
Merged

Conversation

donch1989
Copy link
Member

Because

  • We used concurrent API calls for the OpenAI TaskEmbedding. But actually, OpenAI provide the batch inference for embedding.

This commit

  • Uses the batch inference provided by OpenAI.

Copy link

linear bot commented Sep 27, 2024

@donch1989 donch1989 merged commit cc897af into main Sep 27, 2024
9 checks passed
@donch1989 donch1989 deleted the huitang/ins-6384 branch September 27, 2024 09:08
donch1989 added a commit that referenced this pull request Sep 27, 2024
Because

- We used concurrent API calls for the OpenAI TaskEmbedding. But
actually, OpenAI provide the batch inference for embedding.

This commit

- Uses the batch inference provided by OpenAI.
donch1989 pushed a commit that referenced this pull request Sep 30, 2024
🤖 I have created a release *beep* *boop*
---


##
[0.29.0-beta](v0.28.0-beta...v0.29.0-beta)
(2024-09-27)


### Features

* **compogen:** add table css and update doc
([#370](#370))
([c59b167](c59b167))
* **document:** improve image extraction from pdf
([#372](#372))
([39cdb2c](39cdb2c))
* **openai:** use batch inference for embedding
([#375](#375))
([cc897af](cc897af))


### Bug Fixes

* **compogen:** fix json format
([#364](#364))
([e6619ce](e6619ce))
* **text:** bug about table judgement in markdown chunking
([#367](#367))
([1ab13e2](1ab13e2))
* the input validator can not validate array format
([#379](#379))
([38074c8](38074c8))
* **web:** fix bugs and improve the performance
([#377](#377))
([f0f4f89](f0f4f89))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
No open projects
Status: No status
Development

Successfully merging this pull request may close these issues.

2 participants