Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BP-2.0][FLINK-34227][runtime] Makes the JobMaster close procedure more robust to IO thread leaks from the scheduler side #26114

Open
wants to merge 2 commits into
base: release-2.0
Choose a base branch
from

Conversation

XComp
Copy link
Contributor

@XComp XComp commented Feb 6, 2025

This is a combined PR of the two parent PRs #24489 and #26095

No conflicts observed while cherry-picking the commits from master

XComp and others added 2 commits February 6, 2025 11:42
…pache#24489)

* Makes stopping the job execution in JobMaster run in the main thread
* Makes JobMaster#closeAsync more robust to disconnect calls during shutdown
* Adds test to cover FLINK-34227 scenario
…duler instance (i.e. the JobMaster)

- Adds test for checking whether the scheduler closing leaks an IO thread via the CheckpointsCleaner to the *SchedulerTests
- Makes CheckpointsCleaner available in AdaptiveBatchSchedulerFactory.createScheduler
@XComp XComp changed the title [FLINK-34227][runtime] Makes the JobMaster close procedure more robust to IO thread leaks from the scheduler side [BP-2.0][FLINK-34227][runtime] Makes the JobMaster close procedure more robust to IO thread leaks from the scheduler side Feb 6, 2025
@flinkbot
Copy link
Collaborator

flinkbot commented Feb 6, 2025

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants