Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Manager] Support schedule engine configuration #11504

Open
1 of 2 tasks
emptyOVO opened this issue Nov 17, 2024 · 0 comments
Open
1 of 2 tasks

[Feature][Manager] Support schedule engine configuration #11504

emptyOVO opened this issue Nov 17, 2024 · 0 comments

Comments

@emptyOVO
Copy link
Contributor

emptyOVO commented Nov 17, 2024

Description

According pr: #11484 and pr: #11486

  1. At present, manager and dashboard only support the selection of third-party engines, but they cannot be configured directly, requiring manual modification of the properties file and then recompilation, which makes it inefficient and not easy to use from the user's perspective. If we need to change the relevant configuration in the configuration file every time, we will not be able to handle multiple tasks that require multiple engines to schedule

194463f6-9cce-430d-8f69-db2dbe12ce5d
we can see there is no place for configure engine details
personally think related configuration can be configured in dashboard and call in service may be a good idea

  1. The present configuration of DolphinScheduler is incorrect, DS engine also be able to select schedule interval and unit, which can be handle in DolphinScheduleUtils in pr: [INLONG-11401][Manager] Support Dolphinscheduler schedule engine #11468
    1c24badc-2828-43d7-ae38-a4405e823e28

  2. Some configuration may needs to be config in dashboard

# Airflow API URL
airflow.baseUrl=
airflow.connection.id=
airflow.username=
airflow.password=
# Please confirm if it is a loopback address
inlong.manager.host=
# DAG Deleter and Creator ID
airflow.cleaner.id=
airflow.creator.id=
# DolphinScheduler related config
inlong.schedule.dolphinscheduler.url=
inlong.schedule.dolphinscheduler.token=

Use case

No response

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant