Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cloudwatch_logs: callout support for multiple workers #1212

Merged
merged 2 commits into from
Dec 1, 2023
Merged

cloudwatch_logs: callout support for multiple workers #1212

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
805509d
cloudwatch_logs: callout support for multiple workers
matthewfala Sep 29, 2023
547d2e2
Update pipeline/outputs/cloudwatch.md
patrick-stephens Dec 1, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions pipeline/outputs/cloudwatch.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -81,7 +81,8 @@ The following AWS IAM permissions are required to use this plugin:

### Worker support

Fluent Bit 1.7 adds a new feature called `workers` which enables outputs to have dedicated threads. This `cloudwatch_logs` plugin has partial support for workers. **The plugin can support a single worker; enabling multiple workers will lead to errors/indeterminate behavior.**
Fluent Bit 1.7 adds a new feature called `workers` which enables outputs to have dedicated threads. This `cloudwatch_logs` plugin has partial support for workers in Fluent Bit 2.1.11 and prior. **2.1.11 and prior, the plugin can support a single worker; enabling multiple workers will lead to errors/indeterminate behavior.**
Starting from Fluent Bit 2.1.12, the `cloudwatch_logs` plugin added full support for workers, meaning that more than one worker can be configured.

Example:

Expand All @@ -96,7 +97,9 @@ Example:
workers 1
```

If you enable a single worker, you are enabling a dedicated thread for your CloudWatch output. We recommend starting without workers, evaluating the performance, and then enabling a worker if needed. For most users, the plugin can provide sufficient throughput without workers.
If you enable workers, you are enabling one or more dedicated threads for your CloudWatch output.
We recommend starting with 1 worker, evaluating the performance, and then enabling more workers if needed.
For most users, the plugin can provide sufficient throughput with 0 or 1 workers.

### Log Stream and Group Name templating using record\_accessor syntax

Expand Down