Releases: flyteorg/flyte
Flyte v1.10.6-b0 milestone release
Flyte v1.10.6-b0 Release
Beta release.
Flyte v1.10.0 milestone release
Flyte v1.10.0 Release
This release marks the move to the (monorepo](#4014). From now on the development of backend components is going to be done in the Flyte main repo.
Flyte Agents are also getting a major lift. They are not only more performant, but we're also announcing support for a variety of agents, including Airflow, Memverge, Snowflake, Databricks.
Programmatically consuming inputs and outputs using flyteremote became a lot easier with the introduction of code snippets directly in the UI. For example, notice the small blurbs below inputs and outputs in the side panel:
You'll now be able to use offloaded types in eager workflows.
More ergonomic improvements to pyflyte, including the inclusion of a progress bar, the ability to activate launchplans, and the ability to interact with gate nodes in local executions.
And much more. Here's the exhaustive list of changes:
Flytekit
- Better error messaging for overrides by @kumare3 in flyteorg/flytekit#1807
- Run remote Launchplan from
pyflyte run
by @kumare3 in flyteorg/flytekit#1785 - Add is none function by @pingsutw in flyteorg/flytekit#1757
- Dynamic workflow should not throw nested task warning by @oliverhu in flyteorg/flytekit#1812
- Add a manual image building GH action by @wild-endeavor in flyteorg/flytekit#1816
- Enable Azure Workload Identity for
fsspec
inflytekit
by @fiedlerNr9 in flyteorg/flytekit#1813 - Fix list of annotated structured dataset by @wild-endeavor in flyteorg/flytekit#1817
- Support the flytectl config.yaml admin.clientSecretEnvVar option in flytekit by @chaohengstudent in flyteorg/flytekit#1819
- Async agent delete function for while loop case by @Future-Outlier in flyteorg/flytekit#1802
- fix docs warnings by @samhita-alla in flyteorg/flytekit#1827
- Fix extract_task_module by @pingsutw in flyteorg/flytekit#1829
- Feat: Add type support for pydantic BaseModels by @ArthurBook in flyteorg/flytekit#1660
- Make FlyteRemote example slightly more copy/pastable by @katrogan in flyteorg/flytekit#1830
- Pyflyte meta inputs by @kumare3 in flyteorg/flytekit#1823
- Use mashumaro to serialize/deserialize dataclass by @hhcs9527 in flyteorg/flytekit#1735
- Databricks Agent by @Future-Outlier in flyteorg/flytekit#1797
- Prometheus metrics by @pingsutw in flyteorg/flytekit#1815
- Pyflyte register optionally activates schedule by @kumare3 in flyteorg/flytekit#1832
- Remove versions 3.9 and 3.10 by @wild-endeavor in flyteorg/flytekit#1831
- Snowflake agent by @hhcs9527 in flyteorg/flytekit#1799
- Update agent metric name by @pingsutw in flyteorg/flytekit#1835
- MemVerge MMCloud Agent by @edwinyyyu in flyteorg/flytekit#1821
- Add download badges to the readme by @pingsutw in flyteorg/flytekit#1836
- Eager local entrypoint and support for offloaded types by @cosmicBboy in flyteorg/flytekit#1833
- update requirements and add snowflake agent to api reference by @samhita-alla in flyteorg/flytekit#1838
- Fix: Make sure decks created in elastic task workers are transferred to parent process by @fg91 in flyteorg/flytekit#1837
- add accept grpc by @wild-endeavor in flyteorg/flytekit#1841
- Feat: Enable
flytekit
to authenticate with proxy in front of FlyteAdmin by @fg91 in flyteorg/flytekit#1787 - Backfill command now supports failure-policy by @kumare3 in flyteorg/flytekit#1840
- Pass cluster pool when creating executions by @iaroslav-ciupin in flyteorg/flytekit#1208
- Add more clear error message when fetching secrets by @ysysys3074 in flyteorg/flytekit#1847
- Pyflyte run workflows correctly handles Optional[TYPE] = None by @cosmicBboy in flyteorg/flytekit#1849
- Bump gitpython from 3.1.32 to 3.1.35 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1828
- Bump cryptography from 41.0.3 to 41.0.4 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1844
- update codecov config in pythonbuild ci by @cosmicBboy in flyteorg/flytekit#1852
- Improved gate node handling by @kumare3 in flyteorg/flytekit#1850
- update codecov yaml, make eager wf test more stable by @cosmicBboy in flyteorg/flytekit#1854
- more codecov updates by @cosmicBboy in flyteorg/flytekit#1856
- make mlflow plugin work with python 3.11 by @bcvanmeurs in flyteorg/flytekit#1855
- Agent get secret function by @Future-Outlier in flyteorg/flytekit#1851
- Better Azure blob storage support by @Tom-Newton in flyteorg/flytekit#1842
- Remove Envd from dockerfile by @pingsutw in flyteorg/flytekit#1814
- Update agent uri format by @hhcs9527 in flyteorg/flytekit#1861
- modified setup.py in flytekit-mmcloud by @helenzhangyc in flyteorg/flytekit#1864
- Label request_failure metric with error_code by @pingsutw in flyteorg/flytekit#1862
- add back Edwin's name by @helenzhangyc in flyteorg/flytekit#1868
- Fix py38 aync agent service and add async agent test by @Future-Outlier in flyteorg/flytekit#1866
- Pin because not installing by @wild-endeavor in flyteorg/flytekit#1872
- Bump pillow from 10.0.0 to 10.0.1 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1867
- Prune hosted github runner to free up space for sandbox by @jeevb in flyteorg/flytekit#1875
- Fixes Auth issue, where refresh token is expired by @kumare3 in flyteorg/flytekit#1873
- Name field is incorrect assigned by @kumare3 in flyteorg/flytekit#1874
- [Docs]Updated examples for customizing resources by @LunarMarathon in flyteorg/flytekit#1871
- change key path to SNOWFLAKE_PRIVATE_KEY by @hhcs9527 in flyteorg/flytekit#1879
- Run notebook task on aws batch by @pingsutw in flyteorg/flytekit#1859
- Automatically Convert
name
Argument andregistry
Argument to Lowercase in ImageSpec by @Future-Outlier in flyteorg/flytekit#1881 - Dep: Pin min required flytekit version in IAP plugin by @fg91 in flyteorg/flytekit#1878
- Remove duplicate click option by @wild-endeavor in flyteorg/flytekit#1883
- Bump urllib3 from 1.26.16 to 1.26.17 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1865
- Improve error message in ListTransformer when not passing a list by @fg91 in flyteorg/flytekit#1882
- Update
typing_extension
Any import to typing due totyping_extension
version compatibility by @hfurkanvural in flyteorg/flytekit#1877 - Bump gitpython from 3.1.35 to 3.1.37 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in flyteorg/flytekit#1885
- Airflow agent by @pingsutw in flyteorg/flytekit#1725
- Add mmcloud plugin into the agent image by @pingsutw in flyteorg/flytekit#1891
- Fix map_task sensitive to argument order by @chaohengstudent in flyteorg/flytekit#1888
- Add enable_deck to task decorator by @eapolinario in flyteorg/flytekit#1898
- Add image transformer by @pingsutw in flyteorg/flytekit#1901
- add default project domain in execute launch plan by @troychiu in flyteorg/flytekit#1894
- Add Databricks and Snowflake agent to Dockerfile by @Future-Outlier in flyteorg/flytekit#1905
- Fix module loading bug in instance tracker class by @cosmicBboy in flyteorg/flytekit#1902
Flyteadmin
- Fixed bug for incorrect name (#4175)
- Add version control for ArrayNode eventing (#4165)
- Update golang experimental dep (#4177)
- Add Additional gRPC service handler hook (#4171)
- Handle batched TaskExecutionEvent reasons (#615)
- Lint flyteadmin/auth/handlers_test.go
- #patch Update FromWorkflowModel API (#617)
- add codespell: config, workflow and have typos fixed (#4054)
- Handle batched TaskExecutionEvent reasons (#615)
- Update FromWorkflowModel API (#617)
- Update boilerplate version (#605)
- Reduce a warning to info (#612)
- Logout hook plugin (#611)
- Expire flyte_idt cookie at logout (#610)
- Use configured domain on expired cookie...
Flyte v1.9.1 milestone release
Flyte v1.9.1 Patch Release
Change routing in single binary.
#3978
Flyte v1.9.0 milestone release
Flyte v1.9.0 Release
In this release we're announcing two experimental features, namely (1) ArrayNode map tasks, and (2) Execution Tags.
ArrayNode map tasks
ArrayNodes are described more fully in RFC 3346, but the summary is that ArrayNode map tasks are a drop-in replacement for regular map tasks, the only difference being the submodule used to import the map_task
function.
More explicitly, let's say you have this code:
from typing import List
from flytekit import map_task, task, workflow
@task
def t(a: int) -> int:
...
@workflow
def wf(xs: List[int]) -> List[int]:
return map_task(t)(a=xs)
In order to switch to using array node map tasks you should import map_task from the flytekit.experimental
module like so:
from typing import List
from flytekit import task, workflow
from flytekit.experimental import map_task
@task
def t(a: int) -> int:
...
@workflow
def wf(xs: List[int]) -> List[int]:
return map_task(t)(a=xs)
Execution tags
Execution tags allow users to can discover their executions and other flyte entities more easily, by creating smarter groupings. The feature is described in this RFC.
As mentioned before, this feature is shipped in an experimental capacity, the idea being that we're going to incorporate the feedback of the community as we iterate. More work is expected to give prominence to the feature in flyteconsole, in the meanwhile, the feature is supported via Remote.
Flytekit
- Improve error handling in ShellTask by @pradithya in flyteorg/flytekit#1732
- use default settings for timeline deck width by @cosmicBboy in flyteorg/flytekit#1748
- Raise an exception in case of local execution of raw containers tasks by @eapolinario in flyteorg/flytekit#1745
- Update contributing.rst by @eapolinario in flyteorg/flytekit#1753
- Skip problematic pyyaml versions by @eapolinario in flyteorg/flytekit#1752
- Fail CI tests faster by @eapolinario in flyteorg/flytekit#1756
- Run unit tests on macos-latest by @eapolinario in flyteorg/flytekit#1749
- add rdzv_configs to kfpytorch elastic by @Nan2018 in flyteorg/flytekit#1751
- Fix: Disable rich logging handler when env var
FLYTE_SDK_RICH_TRACEBACKS=0
is set by @fg91 in flyteorg/flytekit#1760 - Throw warning for nested @task functions by @oliverhu in flyteorg/flytekit#1727
- Remove dependency on responses by @honnix in flyteorg/flytekit#1762
- Fix mlflow test error by @pingsutw in flyteorg/flytekit#1766
- Use phrase 'git revision SHA1' in comments and docs by @DavidMertz in flyteorg/flytekit#1761
- Dockerize docs requirements generation by @eapolinario in flyteorg/flytekit#1764
- Restrict grpcio<1.53.1 by @eapolinario in flyteorg/flytekit#1767
- Array node map task by @eapolinario in flyteorg/flytekit#1640
- Add agent ctrl-c handler to call the delete function. (Reupload) by @Future-Outlier in flyteorg/flytekit#1782
- Add tags to execution by @pingsutw in flyteorg/flytekit#1723
Flyteadmin
- Alter ID sequence to bigint by @honnix in flyteorg/flyteadmin#578
- Remove content md5 requirement by @wild-endeavor in flyteorg/flyteadmin#587
- Propagate request id on incoming and outgoing requests by @EngHabu in flyteorg/flyteadmin#582
- Update boilerplate version by @flyte-bot in flyteorg/flyteadmin#589
- Update boilerplate version by @flyte-bot in flyteorg/flyteadmin#594
- Update boilerplate version by @flyte-bot in flyteorg/flyteadmin#596
- Bumping flytestdlib by @gvashishtha in flyteorg/flyteadmin#597
- Flyte Execution tags by @pingsutw in flyteorg/flyteadmin#571
Flyteplugins
- Add support for using task execution ID fields in log URI templates by @jeevb in flyteorg/flyteplugins#372
- Fix generate check in CI by @jeevb in flyteorg/flyteplugins#377
- Remove welcomebot from boilerplate by @eapolinario in flyteorg/flyteplugins#375
- Carry over hash value for all literal types in remote caching by @nicholasjng in flyteorg/flyteplugins#378
- Send task execution metadata to out-core plugin by @honnix in flyteorg/flyteplugins#369
- Support gRPC config for agent-service plugin by @honnix in flyteorg/flyteplugins#368
- Use agent as name where it fits by @honnix in flyteorg/flyteplugins#381
- Fix deletion of elastic task resource requests by @fg91 in flyteorg/flyteplugins#379
Flytepropeller
- Update boilerplate version by @flyte-bot in flyteorg/flytepropeller#591
- fixing max parallelism by @hamersaw in flyteorg/flytepropeller#594
- Updated flytestdlib 1.0.20 by @hamersaw in flyteorg/flytepropeller#593
- Update boilerplate version by @flyte-bot in flyteorg/flytepropeller#597
- Instrument ArrayNode by @hamersaw in flyteorg/flytepropeller#550
- make singular unions castable to their underlying type by @hamersaw in flyteorg/flytepropeller#599
- correct propagation of launchplan start error by @hamersaw in flyteorg/flytepropeller#598
- Bumping flytestdlib and stow versions by @gvashishtha in flyteorg/flytepropeller#602
- Update boilerplate version by @flyte-bot in flyteorg/flytepropeller#601
- Bump flyteplugins to 1.1.15 by @eapolinario in flyteorg/flytepropeller#603
- updated flyteplugins to 1.1.16 by @hamersaw in flyteorg/flytepropeller#604
Flyteconsole
- feat: Add localStorage for selected Project/Domain by @jsonporter in flyteorg/flyteconsole#774
- Fix project selector failing test by @FrankFlitton in flyteorg/flyteconsole#780
- fix: node executions list going blank by @ursucarina in flyteorg/flyteconsole#788
- fix: launch form fixes by @ursucarina in flyteorg/flyteconsole#785
- chore: fix 404 due to bad state by @ursucarina in flyteorg/flyteconsole#797
- Fix: Launch Form fixes by @ursucarina in flyteorg/flyteconsole#798
- fix: map tasks should report caching status accurately by @ursucarina in flyteorg/flyteconsole#800
- feat: add support from structured datasets by @ursucarina in flyteorg/flyteconsole#801
- Top level masonry refactor by @FrankFlitton in flyteorg/flyteconsole#771
- fix: Tasks status out of sync by @ursucarina in flyteorg/flyteconsole#802
- chore: fix test_coverage by @ursucarina in flyteorg/flyteconsole#803
- Fix: breadcrumb feature flag priority order by @FrankFlitton in flyteorg/flyteconsole#804
- chore: fix yarn.lock by @ursucarina in flyteorg/flyteconsole#805
- fix: releases by @ursucarina in flyteorg/flyteconsole#806
- chore: fix release retry by @ursucarina in flyteorg/flyteconsole#807
- fix: specify node18, semantic release with exec and git plugins by @FrankFlitton in flyteorg/flyteconsole#808
- fix: commit linter running on generated messages by @FrankFlitton in flyteorg/flyteconsole#810
- chore: remove release git step by @FrankFlitton in flyteorg/flyteconsole#811
- fix: union value handling in launch form by @ursucarina in flyteorg/flyteconsole#812
New Contributors
- @Nan2018 made their first contribution in flyteorg/flytekit#1751
- @oliverhu made their first contribution in flyteorg/flytekit#1727
- @DavidMertz made their first contribution in flyteorg/flytekit#1761
- @Future-Outlier made their first contribution in flyteorg/flytekit#1782
- @gvashishtha made their first contribution in flyteorg/flyteadmin#597
- @nicholasjng made their first contribution in flyteorg/flyteplugins#378
- @gvashishtha made their first contribution in flyteorg/flytepropeller#602
Flyte v1.8.1 milestone release
Flyte v1.8.1 Patch
Flyte Console
https://github.com/flyteorg/flyteconsole/releases/tag/v1.8.6
https://github.com/flyteorg/flyteconsole/releases/tag/v1.8.7
Full Changelog: flyteorg/flyteconsole@v1.8.5...v1.8.7
Flyte v1.8.0 milestone release
Flyte v1.8.0 Release
Flytekit
- Support configuring pip index url with the image spec by @yini7777 in flyteorg/flytekit#1692
- Improve error message for pyflyte-fast-execute by @pingsutw in flyteorg/flytekit#1686
- Feat: Allow disabling rich tracebacks via env var by @fg91 in flyteorg/flytekit#1695
- Fix task type version in pytorch and mpi task plugin by @yubofredwang in flyteorg/flytekit#1690
- get_transformer returns pickle transformer if type is unsupported by @pingsutw in flyteorg/flytekit#1694
- Add Cuda to ImageSpec by @pingsutw in flyteorg/flytekit#1688
- Feat: Warn when doing local torch elastic training with nnodes > 1 by @fg91 in flyteorg/flytekit#1697
- Fix config of user facing execution parameters in spawning elastic tasks by @fg91 in flyteorg/flytekit#1677
- Union | optional return types supported by @kumare3 in flyteorg/flytekit#1703
- Fail registration if output isn't Optional when using map tasks with min_success_ratio < 1 by @pingsutw in flyteorg/flytekit#1709
- Add bigquery project and location to metadata by @pingsutw in flyteorg/flytekit#1702
- Generate decks at local execution by @pingsutw in flyteorg/flytekit#1699
- Improve task type hint by @pingsutw in flyteorg/flytekit#1711
- Detect upstream nodes from container nested promises by @wild-endeavor in flyteorg/flytekit#1707
- Add Iterator Transformer by @pingsutw in flyteorg/flytekit#1710
- Always a default image and streamline image handling serialize vs package by @wild-endeavor in flyteorg/flytekit#1610
- Remove ensure literal by @wild-endeavor in flyteorg/flytekit#1706
- Fix a bug in gx integration by @XinEDprob in flyteorg/flytekit#1675
- Update pythonbuild.yml: add hugging face plugin to CI by @cosmicBboy in flyteorg/flytekit#1684
- add imagespec cache by @RichhLi in flyteorg/flytekit#1717
- Add requirements to imageSpec by @pingsutw in flyteorg/flytekit#1698
- Memory reduction change by @wild-endeavor in flyteorg/flytekit#1716
- use getattr to access task_def.disable_deck in entrypoint by @cosmicBboy in flyteorg/flytekit#1724
- Add a couple tests by @wild-endeavor in flyteorg/flytekit#1722
- Csvtransform by @ChungYujoyce in flyteorg/flytekit#1671
Flyteadmin
- Add a user-specifiable root to upload link request by @wild-endeavor in flyteorg/flyteadmin#577
- Bump propeller version by @pingsutw in flyteorg/flyteadmin#580
- Upgrade go 1.19 in Dockerfile by @hamersaw in flyteorg/flyteadmin#581
Flytepropeller
- Update flyteplugins to v1.0.67 by @bstadlbauer in flyteorg/flytepropeller#575
- Correctly validating error code on aborting terminal launchplans by @hamersaw in flyteorg/flytepropeller#574
- Use GetExecutionData instead by @EngHabu in flyteorg/flytepropeller#573
- Propagating environment variables through launchplans by @hamersaw in flyteorg/flytepropeller#576
- upgrade dockerfile go to 1.19 by @hamersaw in flyteorg/flytepropeller#580
- Bump flyteplugins version by @pingsutw in flyteorg/flytepropeller#581
- Support for cross-project secrets for GCP by @jeevb in flyteorg/flytepropeller#582
- Added IsFailurePermanent flag on DynamicTaskStatus by @hamersaw in flyteorg/flytepropeller#567
Flyteplugins
- Don't add master replica log link when doing elastic pytorch training by @fg91 in flyteorg/flyteplugins#356
- [Bigquery] Add support for impersonation of GSA bound to task's KSA by @jeevb in flyteorg/flyteplugins#355
- Fix initial dask job state by @bstadlbauer in flyteorg/flyteplugins#357
- Feat: Add pod start and finish time in RFC3339 time format to logging link templating variables #minor by @fg91 in flyteorg/flyteplugins#360
- fix v1 pytorch job plugin with elastic policy by @yubofredwang in flyteorg/flyteplugins#359
- Allow using pod start time in kubeflow plugin log links by @fg91 in flyteorg/flyteplugins#362
- Pass location to the BigQuery request by @pingsutw in flyteorg/flyteplugins#365
- Fix map task cache misses by @bstadlbauer in flyteorg/flyteplugins#363
- Switch to official dask operator by @bstadlbauer in flyteorg/flyteplugins#366
- Fix duplicate env vars in container by @hamersaw in flyteorg/flyteplugins#358
- Set scheduler restart policy to Always by @bstadlbauer in flyteorg/flyteplugins#367
Flyteconsole
- Fix launch plan icon flyteorg/flyteconsole#777
Flyte v1.7.0 milestone release
Flyte v1.7.0 release
In this release we're announcing support for Flyte Agents, a new way of writing backend plugins, only now with a much more tightly integrated developer experience. Also lots of bug fixes all around in a buch of first-time contributors.
Flytekit
- FLYTECTL_CONFIG env var should take highest precedence in flyteorg/flytekit#1662 by @wild-endeavor
- Change flytekit Pytorch, TFJob and MPI plugins to use new kubeflow config in flyteorg/flytekit#1627 by @yubofredwang
- Root cert should be byte string when loading from caCertFilePath in flyteorg/flytekit#1669 by @wild-endeavor
- Explicitly set the content type for flyte deck by in flyteorg/flytekit#1658 @pingsutw
- Set a less strict deadline for hypothesis tests in flyteorg/flytekit#1682 by @eapolinario
- Dep: Use protos of new
kubeflow.pytorch
plugin instead of legacypytorch
plugin in flyteorg/flytekit#1678 by @fg91 - More time info for time line deck in flyteorg/flytekit#1680 by @Yicheng-Lu-llll
Flyteadmin
- Add logs and stats to sync loop in flyteorg/flyteadmin#573 by Haytham Abuelfutuh
- Fix utf-8 encoding issues with trimmed error messages in flyteorg/flyteadmin#569 by Katrina Rogan
- Tiny url improvements in flyteorg/flyteadmin#565 by Yee Hing Tong
- Update startedAt timestamp only if not set in flyteorg/flyteadmin#567 pmahindrakar-oss
- Save execution namespace in system metadata in flyteorg/flyteadmin#568 by Katrina Rogan
Flyteconsole
- fix: navlink in flyteorg/flyteconsole#772 by 4nalog
- fix: bump version for console in flyteorg/flyteconsole#769 by 4nalog
- fix: preserve domain when navigating using sidebar in flyteorg/flyteconsole#768 by 4nalog
- fix: dynamic-node-tasks in flyteorg/flyteconsole#765 by 4nalog
- chore: hide map task runtime info in https://github.com/flyteorg/flyteconsole7/66 by Carina Ursu
- Bug: union val missing for LP relaunch in flyteorg/flyteconsole#762 by Frank Flitton
- Feature: Fullview Flyte Deck modal in flyteorg/flyteconsole#764 by Frank Flitton
- chore: add item when mapped task in flyteorg/flyteconsole#761 by Jason Porter
- Bug: Execution Page's back button returns Workflows route from Launch Plan route https://github.com/flyteorg/flyteconsolepatch in flyteorg/flyteconsole#760 by Frank Flitton
Flytepropeller
- Register gRPC plugin after reading configmap in flyteorg/flytepropeller#564 by Kevin Su
- Not stripping structure from literal types in flyteorg/flytepropeller#571 by Dan Rammer
- Bump flyteplugins to v1.0.63 in flyteorg/flytepropeller#568 by bstadlbauer
- bumped flyteplugins in flyteorg/flytepropeller#566 by Dan Rammer
- Use correct k8 client in flyteorg/flytepropeller#563 by sonjaer
Flyte v1.6.2 milestone release
Flyte v1.6.2 Patch Release
Changes
Admin - v1.1.104
- Save execution namespace in system metadata by @katrogan in flyteorg/flyteadmin#568
- Update startedAt timestamp only if not set by @pmahindrakar-oss in flyteorg/flyteadmin#567
- Tiny url improvements by @wild-endeavor in flyteorg/flyteadmin#565
- Fix utf-8 encoding issues with trimmed error messages by @katrogan in flyteorg/flyteadmin#569
Flyte v1.6.1 milestone release
Flyte v1.6.1 Patch Release
Changes
Admin - v1.1.100
- Inject user identifier to ExecutionSpec by @ByronHsu in flyteorg/flyteadmin#549
- Fix flaky test by @eapolinario in flyteorg/flyteadmin#563
- Add oauth http proxy for external server & Extract email from azure claim by @ByronHsu in flyteorg/flyteadmin#553
- Remove single task execution default timeout by @hamersaw in flyteorg/flyteadmin#564
- Revert conditional setting of SecurityContext when launching security context by @wild-endeavor in flyteorg/flyteadmin#566
Console - v1.8.2
- Export Flytedecks support for TLRO by @james-union in flyteorg/flyteconsole#757
- fix: filter executions by version and name by @ursucarina in flyteorg/flyteconsole#758
- fix: task recent runs should filter by version by @ursucarina in flyteorg/flyteconsole#759
- Bug: Execution Page's back button returns Workflows route from Launch Plan route #patch by @FrankFlitton in flyteorg/flyteconsole#760
- chore: add item when mapped task by @jsonporter in flyteorg/flyteconsole#761
- Feature: Fullview Flyte Deck modal by @FrankFlitton in flyteorg/flyteconsole#764
Propeller - v1.1.90
- Add grpc plugin to loader.go by @pingsutw in flyteorg/flytepropeller#562
Flyte v1.6.0 milestone release
Flyte v1.6.0 release
In this release we're announcing support for writing backend plugins in python. This is in experimental state, feedback
and bug reports are welcome!
Database migrations
This release contains a database migration that remediates an issue that we discovered with very old installations of Flyte.
For more details, please read the Flyte [https://github.com/flyteorg/flyte/releases/tag/v1.5.1](1.5.1 release notes).
Platform
As mentioned in the previous release, we are working to improve performance investigations. In this release we're announcing:
- Runtime metrics UI
- Profile time spent in a task via @timeit decorator
- Lazy loading of flytekit dependencies
flytekit
Lots of features shipped in 1.6, including:
For a full changelog, go to https://github.com/flyteorg/flytekit/releases/tag/v1.6.0.
Console
- feat: show launchplan in execution table by @pradithya in flyteorg/flyteconsole#738
- feat: show launch plan information in workflow's schedules by @pradithya in flyteorg/flyteconsole#739
- fix: passthrough runtime env vars by @ursucarina in flyteorg/flyteconsole#741
- chore: add fallback to task execution link by @ursucarina in flyteorg/flyteconsole#743
- chore: allow custom subnav by @ursucarina in flyteorg/flyteconsole#734
- fix: force node executions to pull their status by @ursucarina in flyteorg/flyteconsole#737
- chore: fix details panel card padding by @ursucarina in flyteorg/flyteconsole#745
- chore: fix crash by @ursucarina in flyteorg/flyteconsole#746
- [UI Feature] Add full-list log output to execution detail panel by @james-union in flyteorg/flyteconsole#744
- TLM add log-message window to left panel by @james-union in flyteorg/flyteconsole#748
- [Snyk] Upgrade eslint from 8.31.0 to 8.33.0 by @EngHabu in flyteorg/flyteconsole#695
- chore: [tlm] comprehensive node execution query by @ursucarina in flyteorg/flyteconsole#749
- chore: guard against /tasks failing by @ursucarina in flyteorg/flyteconsole#750
- chore: propagate dynamic parent id by @ursucarina in flyteorg/flyteconsole#751
- Add support fetching description entity by @pingsutw in flyteorg/flyteconsole#735
Admin
- Infer GOOS and GOARCH from environment by @jeevb in flyteorg/flyteadmin#550
- Enrich TerminateExecution error to tell propeller the execution already terminated by @EngHabu in flyteorg/flyteadmin#551
- Address resolution by @wild-endeavor in flyteorg/flyteadmin#546
- Add migration to turn
parent_id
column intobigint
only if necessary by @eapolinario in flyteorg/flyteadmin#554
Propeller
- Moved controller-runtime start out of webhook Run function by @hamersaw in flyteorg/flytepropeller#546
- Fixing recovering of SKIPPED nodes by @hamersaw in flyteorg/flytepropeller#551
- Remove resource injection on the node for container task by @ByronHsu in flyteorg/flytepropeller#544
- Infer GOOS and GOARCH from environment by @jeevb in flyteorg/flytepropeller#552
- fix makefile to read variables from environment and overrides by @jeevb in flyteorg/flytepropeller#554
- Remove BarrierTick by @hamersaw in flyteorg/flytepropeller#545
- Check for TerminateExecution error and eat Precondition status by @EngHabu in flyteorg/flytepropeller#553
- Setting primaryContainerName by default on Pod plugin by @hamersaw in flyteorg/flytepropeller#555
- Implement ability to specify additional/override annotations when using Vault Secret Manager by @pradithya in flyteorg/flytepropeller#556
- Maintaining Interruptible and OverwriteCache for reference launchplans by @hamersaw in flyteorg/flytepropeller#557
- Added support for aborting task nodes reported as failures by @hamersaw in flyteorg/flytepropeller#541
- Added support for EnvironmentVariables on ExecutionConfig by @hamersaw in flyteorg/flytepropeller#558
- Fast fail if task resource requests exceed k8s resource limits by @hamersaw in flyteorg/flytepropeller#488
New Contributors
- @wckdman made their first contribution in flyteorg/flytekit#1588
- @peridotml made their first contribution in flyteorg/flytekit#1599
- @ringohoffman made their first contribution in flyteorg/flytekit#1631
- @elibixby made their first contribution in flyteorg/flytekit#1615
- @ByronHsu made their first contribution in flyteorg/flytepropeller#544