Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve diagnostics for datalog/NT queue capacity warnings #7843

Open
PeterJohnson opened this issue Mar 1, 2025 · 0 comments
Open

Improve diagnostics for datalog/NT queue capacity warnings #7843

PeterJohnson opened this issue Mar 1, 2025 · 0 comments
Labels
type: feature Brand new functionality, features, pages, workflows, endpoints, etc.

Comments

@PeterJohnson
Copy link
Member

PeterJohnson commented Mar 1, 2025

Both NT and DataLogManager have queues that are limited in size to prevent running out of memory. While a warning is printed when they reach capacity, it’s a fairly coarse warning and it is sometimes difficult to diagnose what in a user program is excessively logging. A common problem is the user logging an unbounded array, where a single log call can fill up a significant amount of the queue. Setting a lower threshold for individual log calls and overall providing more insight into what log calls are driving the top-level warning (eg largest 5-10 log entries in the queue with size+count) would be helpful diagnostic info to teams trying to identify the underlying cause.

@PeterJohnson PeterJohnson added the type: feature Brand new functionality, features, pages, workflows, endpoints, etc. label Mar 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: feature Brand new functionality, features, pages, workflows, endpoints, etc.
Projects
None yet
Development

No branches or pull requests

1 participant