Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deprecate google async provider #1411

Closed
15 tasks done
Lee-W opened this issue Jan 2, 2024 · 5 comments · Fixed by #1480
Closed
15 tasks done

Deprecate google async provider #1411

Lee-W opened this issue Jan 2, 2024 · 5 comments · Fixed by #1480
Assignees
@Lee-W
Labels
feature New feature or request
Milestone
1.19.0

Comments

@Lee-W
Copy link
Contributor

Lee-W commented Jan 2, 2024 •
edited
Loading

Is your feature request related to a problem? Please describe.

as most of the functionality has been contributed back to OSS airflow, we're going to leverage the code there and deprecate this project

Describe the solution you'd like

  1. Contribute the delta to the OSS provider
  2. Point the astronomer provider to the OSS provider
  3. Do the release and wait for a month or so before we remove the astronomer provider in a major release

Describe alternatives you've considered

Additional context

Current Progress

  • Number of operator changes on OSS airflow needed: 3 (finished: 3)
  • Number of operators to deprecate: 15 (finished: )
  1. GCSObjectExistenceSensorAsync
    • Note: mostly the same
    • Action: deprecate directly
    • Deprecation PR: Deprecate GCS sensors #1444
    • OSS Airflow PR: -
    • Minimum Provider Version: -
  2. GCSObjectsWithPrefixExistenceSensorAsync
    • Note: mostly the same
    • Action: deprecate directly
    • Deprecation PR: Deprecate GCS sensors #1444
    • OSS Airflow PR: -
    • Minimum Provider Version: -
  3. GCSUploadSessionCompleteSensorAsync
    • Note: mostly the same
    • Action: deprecate directly
    • Deprecation PR: Deprecate GCS sensors #1444
    • OSS Airflow PR: -
    • Minimum Provider Version: -
  4. GCSObjectUpdateSensorAsync
    • Note: mostly the same
    • Action: deprecate directly
    • Deprecation PR: Deprecate GCS sensors #1444
    • OSS Airflow PR: -
    • Minimum Provider Version: -
  5. GKEStartPodOperatorAsync (Wait for the upstream review)
  6. BigQueryInsertJobOperatorAsync
  7. BigQueryCheckOperatorAsync
  8. BigQueryGetDataOperatorAsync
  9. BigQueryIntervalCheckOperatorAsync
  10. BigQueryValueCheckOperatorAsync
  11. BigQueryTableExistenceSensorAsync
  12. DataprocCreateClusterOperatorAsync
  13. DataprocDeleteClusterOperatorAsync
  14. DataprocSubmitJobOperatorAsync
  15. DataprocUpdateClusterOperatorAsync
@Lee-W Lee-W added the feature New feature or request label Jan 2, 2024
@Lee-W Lee-W added this to the 2.0.0 milestone Jan 2, 2024
@Lee-W Lee-W self-assigned this Jan 2, 2024
@Lee-W Lee-W changed the title Drepcreate google provider Deprecate google async provider Jan 2, 2024
@Lee-W Lee-W modified the milestones: 2.0.0, 1.19.0 Jan 19, 2024
@Lee-W
Copy link
Contributor Author

Lee-W commented Jan 24, 2024 •
edited
Loading

As of Jan 24th

@Lee-W
Copy link
Contributor Author

Lee-W commented Jan 29, 2024 •
edited
Loading

As of Jan 29th

  • WIP
    • GKEStartPodOperatorAsync

@Lee-W
Copy link
Contributor Author

Lee-W commented Jan 30, 2024

As of Jan 30th

@phanikumv
Copy link
Collaborator

Waiting for OSS provider release

@Lee-W
Copy link
Contributor Author

Lee-W commented Feb 16, 2024

#1464

@pankajkoti pankajkoti mentioned this issue Feb 18, 2024
Merged
@Lee-W Lee-W closed this as completed Feb 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Lee-W Lee-W

Labels
feature New feature or request
Projects
None yet
Milestone
1.19.0
Development

Successfully merging a pull request may close this issue.

Update upstream providers versions from RC versions astronomer/astronomer-providers
2 participants
@Lee-W @phanikumv