Skip to content
This repository has been archived by the owner on Oct 29, 2024. It is now read-only.

refactor(openai): adjust batch execution #345

Merged
merged 1 commit into from
Sep 17, 2024
Merged

refactor(openai): adjust batch execution #345

merged 1 commit into from
Sep 17, 2024

Conversation

donch1989
Copy link
Member

@donch1989 donch1989 commented Sep 17, 2024 •
edited
Loading

Because

  • We should use smaller batches when sending requests to OpenAI.

This commit

  • Adjusts batch execution.
  • Updates the HTTP keep-alive settings.
  • Upgrades golang version.

@linear Linear
Copy link

linear bot commented Sep 17, 2024

INS-6300 implement a proper graceful shutdown for `pipeline-backend`

@donch1989 donch1989 merged commit 2ee2bfa into main Sep 17, 2024
10 checks passed
@donch1989 donch1989 deleted the huitang/ins-6300 branch September 17, 2024 19:54
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@pinglin pinglin Awaiting requested review from pinglin pinglin is a code owner

@xiaofei-du xiaofei-du Awaiting requested review from xiaofei-du xiaofei-du is a code owner

@jvallesm jvallesm Awaiting requested review from jvallesm jvallesm is a code owner

Assignees
No one assigned
Labels
instill component
Projects
No open projects
🔮 Instill Core
Status: 👋 Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@donch1989 @droplet-bot