Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] No metrics collected for containers with short runtime #31002

Open
Nevon opened this issue Nov 12, 2024 · 0 comments
Open

[BUG] No metrics collected for containers with short runtime #31002

Nevon opened this issue Nov 12, 2024 · 0 comments

Comments

@Nevon
Copy link

Nevon commented Nov 12, 2024

Agent Environment
7.59.0

Describe what happened:
When running the Datadog agent as a sidecar in an ECS Fargate task that starts end exits within a short period of time, metrics for the containers are not available in Datadog, even if the other containers in the task wait for the Datadog agent to be healthy (agent health) before they themselves start.

Describe what you expected:
I would expect to always see my containers in the Containers view in Datadog and for there to be some metrics submitted for any task that has a Datadog agent running, even if the runtime of the task is brief. It is understandable that checks that run on an interval might never have run by the time the task is going to shut down, but today you can't find any trace of the container ever having existed.

Steps to reproduce the issue:
Deploy a task with the Datadog agent in one container and another container that just starts up and then exits in <1 minute.

Additional environment details (Operating System, Cloud provider, etc):
In this case I am deploying the agent as a sidecar in an ECS Fargate task, but I would expect the same in a k8s pod or any other environment that relies on container autodiscovery. The key point seems to be that the total runtime of the containers should be brief enough that the agent doesn't have time to discover the containers, collect metrics and submit them to Datadog.

I have also opened support request #1920828 for this issue, which contains more specific information such as the task definition used.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant