Releases: flyteorg/flyte
Releases · flyteorg/flyte
flytectl/v0.8.24
Flyte v1.12.1-rc0 milestone release
Flyte 1.12.1-rc0 Release Notes
Flyte 1.12.1-rc0 is a release candidate that focuses on documentation enhancements, bug fixes, and improvements to the core infrastructure. This release also includes contributions from a new member of the Flyte community. Below are the highlights of this release.
🚀 New Features & Improvements
-
Documentation Improvements
- Removed the source code renderer section from the Decks article.
- Added documentation for OpenAI batch agent backend setup.
- Updated the example Flyte agent Dockerfile.
- Fixed documentation link to testing agent on local cluster.
- Fixed Kubeflow webhook error in the documentation.
- Updated Flytekit version to 1.12.1b2 in monodocs requirements.
- Updated Flytefile.md and replaced SHA instead of master in RLI links.
-
Infrastructure and Configuration
-
Bug Fixes
-
Miscellaneous
- Updated the lock file.
- Added executionClusterLabel for better execution cluster management.
🆕 New Contributors
Contributors
EraYaN
Assets 3
flytectl/v0.8.23
flytectl/v0.8.21
flytectl/v0.8.20
flytectl/v0.8.19
Changelog
- b5d78aa #minor Documentation fix and refactoring in sandbox (#131)
- 8db28dd #minor Revert "Adopt flyteidl's ordered variable map change" (#180)
- 936a24a #minor Updated Sandbox config, with automated data configuration (#440)
- 2766c18 #minor feat: pagination support for get commands (#234)
- 41e0a40 #none Fix DCO make target (#139)
- 5da69f5 #none add go mod tidy in flyteidl release workflow (#151)
- 81471f1 #none fixed storage config in docs (#138)
- d75142c 3 usability improvements -Named executions, improved connection handling and better logging (#349)
- 2a25558 Absolute path for Source dir (#126)
- dd4655d Add ContentMD5 to fast register upload request (#303)
- 90e01a6 Add Slack button to README (#198)
- 2d65956 Add ability to recover executions (#149)
- 3e4323a Add additional nil check (#156)
- 3e9525f Add commands to fetch active and archived launchplans (#331)
- e2ed562 Add console endpoint config section and init arg (#361)
- 26d976d Add default input default behavior check for scheduler workflow registration (#368)
- 9deb2ec Add deployment docs (#127)
- d330473 Add extra host to start command (#369)
- ab171cd Add pflag binding and fix loading of config (#135)
- aa1f211 Add prefetch functionality for paginator (#5310)
- a64a416 Add support dev cluster (#353)
- d69f4b7 Add support for gate nodes (#399)
- 89cb374 Add upgrade command with some refactor (#152)
- d7e0624 Added Create command (#17)
- bb499a9 Added Github workflow for generating docs (#85)
- 73e4aa3 Added HOMEDIR/.flyte to search path for config.yaml (#59)
- a101cd6 Added Update Execution cli (#261)
- a144275 Added
config initcommand (#123) - 6453fab Added arm support (#206)
- 852d7ab Added boilerplate automation (#74)
- 89f6e6f Added capability to relaunch an execution (#52)
- 8924563 Added check before creating empty k8s config (#211)
- 34d7614 Added cluster resource attribute support (#65)
- c2c5649 Added command delete along with subcommand executions for terminating (#34)
- 712fdf8 Added customizable fields during registration (#80)
- b5f332a Added dco signoff preecommit (#89)
- 676f0cf Added different repo for brew release (#46)
- 3b49630 Added docs for demo and updated docs for workflow execution config with more details (#316)
- fc3c99e Added dryRun flag for printing docker command for demo and sandbox (#367)
- 02cf19e Added enableSchedule option on registration and linked missing docs (#324)
- e6855b4 Added endpoint suffix to service user for pkce token saved in token cache (#264)
- 39add71 Added env flag for sandbox start (#273)
- fdd1b15 Added error data and abort data in get execution output (#79)
- 8b1c844 Added exec command in sandbox (#122)
- 19ba5fd Added fast register functionality (#112)
- 2d2c145 Added filters flag (#82)
- 1a904e0 Added flag to pass in CAcerts (#245)
- fe72730 Added flags for using local images in sandbox (#216)
- 517beb9 Added flytectl config by env variable (#91)
- 696065c Added goreleaser dry run in build (#47)
- 400d4b6 Added gpg sign commit for flyte-bot (#92)
- 7a43a97 Added latest version check added (#111)
- 0a23db3 Added launchplan update command and moved namedentity (#170)
- 31ad383 Added minio port in sandbox (#203)
- 002d176 Added node execution data to show inputs and outputs (#136)
- 0f708dd Added non zero return code on error and AlreadyExists as success condition (#71)
- cfde70d Added option to update labels & description in project (#260)
- d5c3133 Added port for postgres in sandbox lite (#308)
- 07fccb1 Added reading of archive files for registration to flyte (#31)
- 6947a2a Added reuseable workflow (#276)
- c5ab11a Added sandbox command (#86)
- bd1d4e5 Added script for checking diff of generated code (#229)
- 5c71337 Added separate release workflow for releasing the binary (#132)
- 179da66 Added source flags in sandbox (#99)
- 0a2ddb2 Added support for arm64 in install.sh (#209)
- 4d43aee Added support for execution queue attribute (#66)
- 2762f97 Added support for pyflyte serialize fast register (#248)
- 26f139a Added support for tar.gz in register (#199)
- 4bb9675 Added transparent Get call when fetching latest version of workflow objects (#73)
- caa38e5 Added unit test for covarage (#83)
- b11a9e8 Added unit test for docker (#110)
- cf3ffa1 Added update for named entity (#54)
- 06458f5 Added validation for scheduled workflow during registration (#215)
- 3904146 Added version command (#41)
- 03be16b Added version flag in sandbox (#137)
- 36c1e4f Added version support to workflow command (#64)
- a94cbdd Added workflow flag for get launchplan (#287)
- 3749e3f Adding changes for project level matchable attr api (#357)
- 3da647f Adding flytectl.rst to index (#257)
- c68c5c2 Adding open-source boilerplate (#1)
- d04b1e2 Adding overriden filter for get workflow (#310)
- 9bcf5cc Adding support for ArrayNode (#406)
- 6cf6d1e Adding support for execution cluster label (#68)
- 5f9a2fb Adding support for structured dataset and also for node outputs in details flag (#390)
- 9b05df0 Adding support for workflow execution config (#144)
- 7c31c1e Adopt flyteidl's ordered variable map change (#158)
- 5af33e3 Always use sha for sandbox image (#266)
- a056102 Archive and Update project command (#24)
- 79e8fdd Auto rendering of JSON entities using path (#13)
- 3fb5080 Autodoc generation for cobra commands (#29)
- 790a965 Bind 30080 to 30081 in the case of sandbox (#313)
- dd369af Bind pflags to default variable fields && Remove short flags as they're not supported by pflags (#124)
- 3a48b4a Bug fix in sandbix start (#161)
- 50ee307 Bug fix in sandbox start when sandbox exist (#145)
- b55026e Bump github.com/containerd/containerd from 1.5.10 to 1.6.26 in /flytectl (#5307)
- 8db9901 Bump github.com/docker/distribution in /flytectl (#5313)
- 7b82397 Bump github.com/docker/docker in /flytectl (#5363)
- 8d2b83b Bump github.com/opencontainers/image-spec from 1.0.1 to 1.0.2 (#217)
- cb57beb Bump golang.org/x/net to v0.23.0 (#5333)
- f05acc7 Bump idna from 3.6 to 3.7 in /flytectl (#5315)
- b36a1f3 Bump jinja2 from 3.1.3 to 3.1.4 in /flytectl (#5329)
- c7d02df Bumped up flyteidl to 0.19.2 (#94)
- 29740e0 Bumped up idl to use insecureVerify flag for remote and fixed docs (#125)
- c673d3b Bumped up the flyteidl version to fix create execution issue (#53)
- 73d9cb7 Bumping go version to 1.19 (#384)
- fc2ac0a Change extra host to host-gateway (#380)
- e3977b1 Changes to 'use' in cmd folder (#235)
- dafa5d7 Changing the default log level which is used by sandbox (#129)
- 35e67f6 Check kubeConfig before starting sandbox (#363)
- b092146 Compile command (#321)
- ee25d67 Consistent language about 'git revision SHA1' (#414)
- 68324ce Consuming device flow IDL (#350)
- e5d11a8 Create executions in flytectl (#39)
- c751289 Created separate rst files for every resource (noun) (#230)
- 440ad31 Demo fit and finish (#317)
- 3414946 Devflow, boilerplate, improved code, formatting and bug fixes (#11)
- 6e20a25 Do not bump version on docs or boilerplate update (#200)
- ce0fd45 Do not upload codecoverage data from boilerplate (#478)
- 083cdbd Doc updates (#398)
- 62dfd32 Documentation setup for FlyteCTL (#26)
- 2cec59b Editorial review (#256)
- e2adac4 Expose buildkit port (#413)
- 931c651 Expose webhook service (#323)
- 2811f53 Feature/get workflow,Task,Domain,Project (#9)
- 22c203b Feature/goreleaser (#27)
- a9a45b3 Feature: update launchplan --archive to --deactivate (#449)
- a4702fb Filtering on activation state of workflows (#305)
- 3be778c Fix "Sandbox" typo on Demo page. (#346)
- 92104a8 Fix --clusterPool argument override (#360)
- 0e3f2a8 Fix case for No string to no (#419)
- a66e669 Fix config init command fails if no flyte dir doesn't exist (#150)
- d033369 Fix docs contribution guide (#197)
- b8770ee Fix docs for updating description using workflow-meta subcommand (#394)
- 1fe32fa Fix flytectl sandbox crash on M1 macs due to json-iterate (#342)
- 8dd8b05 Fix flytectlt tests (#5325)
- b03e86d Fix get task resource attribute comment (#469)
- 86e7647 Fix getAllExample (#320)
- caf9bbc Fix goreleaser (#40)
- 3e329ad Fix grammar test (#272)
- dcc2c09 Fix panic in rendering LP input descriptions (#174)
- d963c7a Fix pod task fast registration template substitution (#184)
- 2e49f75 Fix project status change on update for archived projects (#438)
- 664a604 Fix self-upgrade (#437)
- 09013f7 Fix small bug in rendering table (#14)
- 2657b26 Fix struct generation in execution file (#434)
- c516596 Fix testutils.TearDownAndVerify #none (#424)
- 95fccea Fix the error message for the update cmd (#411)
- 8cad4ed Fix typos
- 8362431 Fix: Check for git authentication when GITHUB_TOKEN exists (#463)
- 7a6ba14 Fixed continueonError bug (#292)
- f3f6765 Fixed create project (#277)
- b58b748 Fixed the non-zero return code issue in archive path (#194)
- 51226d5 Fixed the version bug and also added force flag (#246)
- 9cb07f9 Fixed validation logic for launch plan schedule registration (#280)
- e569acb Fixes in Flytectl (#109)
- 9af534f Fixes the project name and workflow name in the flytectl documentation. (#339)
- f59e5ae Fixup flytectl (#5309)
- 61eb8f2 Flyte Add Enable/Disable Options for Agent Services (#420)
- 3eb2ea3 Flytectl Doc fixes (#38)
- 514375f Flytectl get started updated (#58)
- 6923203 Force go 1.19.10 in goreleaser (#415)
- c17ee3b GH workflow change - publish binary when tag is pushed (#5)
- fb6eb2d Graphviz does not like hyphens #patch (#141)
- ec7c344 Hide global flags by overriding usage template of cobra. (#430)
- 24710f7 Hotfix register example (#172)
- 409c01c Hotfix/config init validation (#250)
- dda6460 Hydrate failure node (#456)
- e8bffb6 Image migration to ...
Flyte v1.12.0 milestone release
Flyte 1.12.0 Release Notes
Flyte 1.12.0 brings a host of new features, optimizations, and fixes, enhancing the platform's functionality and user experience. This release also welcomes several new contributors to the Flyte community. Below are the highlights of this release.
🚀 New Features & Improvements
-
Admin & Core Enhancements
- Implemented the
GetProjectendpoint in FlyteAdmin. - Added tracking for active node and task execution counts in Propeller.
- Set FlyteAdmin gRPC port correctly in config and included separate gRPC Ingress flag.
- Implemented the
-
Helm Charts & Manifests
- CI workflow enhancements for Helm charts and manifests.
- Fixed syntax issues and rendering errors in Helm charts.
- Updated Spark-on-K8s-operator address in Helm charts.
-
Documentation Improvements
- Enhanced documentation across various modules, including a guide for running the newest Flyteconsole in Flyte sandbox and a troubleshooting guide for Docker errors.
- Updated Propeller architecture documentation and added a guide for enabling/disabling local caching.
-
Performance & Bug Fixes
- Improved lint error detection, fixing multiple issues across components.
- Optimized Flyte components, including Golang, Protobuf, and GRPC versions.
- Fixed several bugs related to execution phases, GPU resource overrides, and Databricks errors.
🔧 Housekeeping & Deprecations
-
Deprecated Configuration
- Deprecated
MaxDatasetSizeBytespropeller config in favor ofGetLimitMegabytesstorage config. - Removed obsolete Flyte config files.
- Deprecated
-
Miscellaneous
- Simplified boilerplate.
- Regenerated Ray pflags.
- Upgraded various dependencies, including cloudevents, logrus, and go-restful.
🆕 New Contributors
- @RRap0so for implementing the
GetProjectendpoint. - @cjidboon94 for adding the GKE starter values file.
- @ddl-rliu for improving audience mismatch debugging.
- @pbrogan12 for fixing Helm chart rendering.
- @austin362667 for showing diff structure when re-registering tasks.
- @ssen85 for updating environment setup documentation.
- @dansola for changing retry error types.
- @noahjax for adding identity to task execution metadata.
- @ongkong for fixing ID bigint conversion issues.
- @sshardool for tracking active node and task execution counts.
- @Jeinhaus for adding a missing key in the auth guide.
- @yini7777 for fixing secret mounting issues.
- @Sovietaced for fixing grammatical errors in the documentation.
- @agiron123 for configuring the RunLLM widget.
- @mark-thm for removing the upper bound on FlyteIDL's protobuf dependency.
Contributors
agiron123, Sovietaced, and 13 other contributors
Assets 3
Flyte v1.12.0-b0 milestone release
Flyte v1.12.0-b0
What's Changed
- [Docs] Remove kustomize link in secrets.md doc by @lowc1012 in #5043
- CI workflow for helm charts and manifests by @lowc1012 in #5027
- Update spark-on-k8s-operator address in helm charts by @eapolinario in #5057
- Fix wrong syntax for path filtering in validate-helm-charts.yaml by @lowc1012 in #5056
- Fix: flyte-secret-auth secret not mounted properly in flyte-core by @lowc1012 in #5054
- Match flytekit versions used to register and run functional tests by @eapolinario in #5059
- integration test config by @troychiu in #5058
- Add org as an optional request param to dataproxy CreateUploadLocation by @katrogan in #5060
- Add k8s env from by @neilisaur in #4969
- Implement GetProject endpoint in FlyteAdmin by @RRap0so in #4825
- Prepopulate ArrayNode output literals with TaskNode interface output variables by @hamersaw in #5080
- [House Keeping] deprecate MaxDatasetSizeBytes propeller config in favor of GetLimitMegabytes storage config by @pvditt in #4852
- Fix lint errors caught by
chart-testingby @eapolinario in #5072 - Update Flyte components by @flyte-bot in #5093
- sagemaker agent backend setup documentation by @samhita-alla in #5064
- add first version of gke-starter values file by @cjidboon94 in #5026
- Fix open ai secret name by @eapolinario in #5098
- Allow setting a ExecutionClusterLabel when triggering a Launchplan/Workflow/Task by @RRap0so in #4998
- Improve audience mismatch debugging by @ddl-rliu in #5078
- docs(sandbox): Add guide for running newest flyteconsole in flyte sandbox by @MortalHappiness in #5100
- Remove unnecessary step and fix numbering in code examples by @eapolinario in #5104
- fix rendering of flyte-core and flyteagent charts by @pbrogan12 in #5048
- Bump golang.org/x/net from 0.3.1-0.20221206200815-1e63c2f08a10 to 0.7.0 in /docker/sandbox-bundled/bootstrap by @dependabot in #3390
- Update repeated value filters with ValueNotIn support by @troychiu in #5110
- Update container builds from go 1.21.5 to 1.21.latest by @ddl-ebrown in #5097
- Add optional org param to ProjectGetRequest by @katrogan in #5118
- Stop building read-the-docs for flyteidl by @eapolinario in #5120
- Bump google.golang.org/grpc and otelgrpc by @eapolinario in #5121
- Fix broken link in "Mapping Python to Flyte types" table by @neverett in #5122
- Bump version of otel and grpc in flytestdlib by @eapolinario in #5123
- [flyteadmin] Show diff structure when re-registration two different task with same ids by @austin362667 in #4924
- Set flyteadmin grpc port correctly in config / Flyte-core flyteadmin / datacatalog expose ports by @ddl-ebrown in #5013
- Add flyte-core missing priorityClassName to webhook values by @ddl-ebrown in #4987
- Update environment_setup.md by @ssen85 in #4963
- [Docs] Open external links in new tab by @MortalHappiness in #4966
- Fix separateGrpcIngress flag not working in flyte-binary helm chart by @lowc1012 in #4946
- docs(contribute): Change go mod tidy to make go-tidy by @MortalHappiness in #5131
- Fix execution phase by @troychiu in #5127
- Add trailing slash to compile make target by @eapolinario in #4648
- Change retry error from RuntimeError to FlyteRecoverableException by @dansola in #5128
- Adapt ray flyteplugin to Kuberay 1.1.0 by @ByronHsu in #5067
- Boilerplate simplification by @eapolinario in #5134
- Upgrade cloudevents to v2.15.2 by @ddl-ebrown in #5142
- update sagemaker agent setup doc as secrets aren't required anymore by @samhita-alla in #5138
- Upgrade logrus to v1.9.3 everywhere by @ddl-ebrown in #5139
- Upgrade go-restful to v3.12.0 by @ddl-ebrown in #5140
- Regenerate ray pflags by @eapolinario in #5149
- Split access token into half and store to avoid "securecookie: the value is too long" error by @yubofredwang in #4863
- Update Flyte components by @flyte-bot in #5150
- Bump golang.org/x/crypto from 0.11.0 to 0.17.0 in /boilerplate/flyte/golang_support_tools by @dependabot in #5148
- use javascript to open new tab for external links by @cosmicBboy in #5159
- Update K8s plugin config docs by @davidmirror-ops in #5070
- Update Propeller architecture documentation by @davidmirror-ops in #5117
- update protobuf v1.32.0 -> v1.33.0 by @ddl-ebrown in #5156
- Update boilerplate version by @flyte-bot in #5143
- Upgrade grpc health probe 0.4.11 -> 0.4.25 by @ddl-ebrown in #5153
- Upgrade go-jose v3.0.0 -> v3.0.3 by @ddl-ebrown in #5154
- docs: update agent development documentation by @pingsutw in #5130
- Add variables to ease separate bucket config by @davidmirror-ops in #5015
- Bump golang.org/x/net from 0.12.0 to 0.17.0 in /boilerplate/flyte/golang_support_tools by @dependabot in #5146
- Bump google.golang.org/protobuf from 1.30.0 to 1.33.0 in /boilerplate/flyte/golang_support_tools by @dependabot in #5147
- Upgrade lestrrat-go/jwx to v1.2.29 by @ddl-ebrown in #5141
- Revert "Pin flyteconsole version in release process (#5037)" by @eapolinario in #5176
- Add identity to task execution metadata by @noahjax in #5105
- Bump k8s.io/client-go from 0.0.0-20210217172142-7279fc64d847 to 0.17.16 in /boilerplate/flyte/golang_support_tools by @dependabot in #5145
- Upgrade jackc/pgconn v1.14.1 -> v1.14.3 / pgx/v5 v5.4.3 -> v5.5.5 / pgproto3 v2.3.2 -> v2.3.3 by @ddl-ebrown in #5155
- fix make link error by @novahow in #5175
- Stop admin launcher copying shard key from parent workflow by @Tom-Newton in #5174
- Fix Id bigint conversation for not yet created table by @ongkong in #5157
- Add tracking for active node and task execution counts in propeller by @sshardool in #4986
- [House keeping] include container statuses for all container exit errors by @pvditt in #5161
- docs: add missing key in auth guide by @Jeinhaus in #5169
- Shallow copying EnvironmentVariables map before injecting ArrayNode env vars by @hamersaw in #5182
- Feature/array node workflow parallelism by @pvditt in #5062
- Fix streak length metric reporting by @Tom-Newton in #5172
- Fix path to AuthMetadataService in flyte-binary chart by @eapolinario in #5185
- Change phase to queue on job submit for webapi plugins by @pingsutw in #5188
- [Docs] Testing agents in the development environment by @Future-Outlier in #5106
- Use ratelimiter config in webapi plugins by @kumare3 in #5190
- docs(ray): Update kuberay documentation by @MortalHappiness in #5179
- Change phase to WaitingForResources when quota exceeded by @pingsutw in #5195
- Fix: Update spark operator helm repository by @fg91 in #5198
- docs(troubleshoot): Add docker error troubleshooting guide by @MortalHappiness in #4972
- add cache client read and write otel tracing by @pvditt in #5184
- Fix FlyteIDL docs link by @neverett in #5199
- [easy] [flyteagent] Add
ExecuteTaskSyncfunction timeout setting by @Future-Outlier in https://github.com/flyte...
Contributors
neverett, eapolinario, and 38 other contributors
Assets 3
Flyte v1.11.1-b1 milestone release
Flyte v1.11.1-b1
What's Changed
- sagemaker agent backend setup documentation by @samhita-alla in #5064
- add first version of gke-starter values file by @cjidboon94 in #5026
- Fix open ai secret name by @eapolinario in #5098
- Allow setting a ExecutionClusterLabel when triggering a Launchplan/Workflow/Task by @RRap0so in #4998
- Improve audience mismatch debugging by @ddl-rliu in #5078
- docs(sandbox): Add guide for running newest flyteconsole in flyte sandbox by @MortalHappiness in #5100
- Remove unnecessary step and fix numbering in code examples by @eapolinario in #5104
- fix rendering of flyte-core and flyteagent charts by @pbrogan12 in #5048
- Bump golang.org/x/net from 0.3.1-0.20221206200815-1e63c2f08a10 to 0.7.0 in /docker/sandbox-bundled/bootstrap by @dependabot in #3390
- Update repeated value filters with ValueNotIn support by @troychiu in #5110
- Update container builds from go 1.21.5 to 1.21.latest by @ddl-ebrown in #5097
- Add optional org param to ProjectGetRequest by @katrogan in #5118
- Stop building read-the-docs for flyteidl by @eapolinario in #5120
- Bump google.golang.org/grpc and otelgrpc by @eapolinario in #5121
- Fix broken link in "Mapping Python to Flyte types" table by @neverett in #5122
- Bump version of otel and grpc in flytestdlib by @eapolinario in #5123
- [flyteadmin] Show diff structure when re-registration two different task with same ids by @austin362667 in #4924
- Set flyteadmin grpc port correctly in config / Flyte-core flyteadmin / datacatalog expose ports by @ddl-ebrown in #5013
- Add flyte-core missing priorityClassName to webhook values by @ddl-ebrown in #4987
- Update environment_setup.md by @ssen85 in #4963
- [Docs] Open external links in new tab by @MortalHappiness in #4966
- Fix separateGrpcIngress flag not working in flyte-binary helm chart by @lowc1012 in #4946
- docs(contribute): Change go mod tidy to make go-tidy by @MortalHappiness in #5131
- Fix execution phase by @troychiu in #5127
- Add trailing slash to compile make target by @eapolinario in #4648
- Change retry error from RuntimeError to FlyteRecoverableException by @dansola in #5128
- Adapt ray flyteplugin to Kuberay 1.1.0 by @ByronHsu in #5067
- Boilerplate simplification by @eapolinario in #5134
- Upgrade cloudevents to v2.15.2 by @ddl-ebrown in #5142
- update sagemaker agent setup doc as secrets aren't required anymore by @samhita-alla in #5138
- Upgrade logrus to v1.9.3 everywhere by @ddl-ebrown in #5139
- Upgrade go-restful to v3.12.0 by @ddl-ebrown in #5140
- Regenerate ray pflags by @eapolinario in #5149
- Split access token into half and store to avoid "securecookie: the value is too long" error by @yubofredwang in #4863
New Contributors
- @cjidboon94 made their first contribution in #5026
- @ddl-rliu made their first contribution in #5078
- @pbrogan12 made their first contribution in #5048
- @austin362667 made their first contribution in #4924
- @ssen85 made their first contribution in #4963
- @dansola made their first contribution in #5128