Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use detect-exceptions plugin to detect exceptions in unstructured log streams. #12

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

thomasschickinger
Copy link

@thomasschickinger thomasschickinger commented Mar 9, 2017

No description provided.

@igorpeshansky igorpeshansky self-assigned this Apr 13, 2017
@igorpeshansky igorpeshansky self-requested a review April 13, 2017 23:10
Copy link
Member

@igorpeshansky igorpeshansky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As a heads-up, we plan to move away from purely text-based default configs to more structured default configs (#10). So the usefulness of this change may be somewhat short-lived.

@@ -5,7 +5,7 @@
path /var/log/cassandra/system.log
pos_file /var/lib/google-fluentd/pos/cassandra-system.pos
read_from_head true
tag cassandra
tag detect_exceptions_java.cassandra
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should these be detect-exceptions-java.cassandra instead?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, thanks.

max_lines 500
</match>

<match detect-exceptions-go-ruby.**>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems somewhat arbitrary, and implies that we might need to add tags with multiple combinations of configs... I wonder if we could somehow extract the languages from the tag instead?..

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Transmitting the info which languages to consider via the tag is a valid idea. However, since only Gitlab is affected by this and the limitation of the languages to consider is anyway a kind of micro-optimization (the plugin runs fine in production e.g. on GAE flex with considering all languages), I decided to rather get rid of this special case for now.

@thomasschickinger
Copy link
Author

Hi Igor, comments addressed. PTAL.

@igorpeshansky igorpeshansky changed the title Use detect-exceptions plugin to detect exceptions in unstructured log… Use detect-exceptions plugin to detect exceptions in unstructured log streams. Sep 1, 2018
Copy link
Member

@igorpeshansky igorpeshansky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM :shipit: but I'd like @bmoyles0117 to approve as well.

@igorpeshansky
Copy link
Member

igorpeshansky commented Sep 1, 2018

Sorry, @thomasschickinger, this got lost in the ether for a while.

@jkohen
Copy link

jkohen commented Aug 12, 2019

@igorpeshansky can we resolve this PR?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants