Skip to content

Releases: Azure/AKS

Release 2023-08-20

25 Aug 22:28
@shashankbarsin shashankbarsin
2023-08-20
831f27a
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Release 2023-08-20

Release 2023-08-20

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • No new clusters can be created with Azure AD Integration (legacy). Existing AKS clusters with Azure Active Directory integration will keep working. All Azure AD Integration (legacy) AKS clusters will be migrated to AKS-managed Azure AD automatically starting from 1st Dec. 2023. We recommend updating your cluster with AKS-managed Azure AD before 1 Dec 2023. This way you can manage the API server downtime during non-business hours.
  • Please review the following CVEs that impact all Windows node pools in AKS clusters - CVE-2023-3676, CVE-2023-3955, and CVE-2023-3893. Please update your Windows nodes to the VHD version 230809 as mentioned in these issues.
  • To avoid disruptions stemming from unmanaged Canonical nightly security updates, AKS will disable unmanaged Canonical nightly updates by 2 September 2023
    on clusters that haven’t specified an update option explicitly, mapping to the option None in the node OS upgrade channel feature. AKS strongly recommends proactively moving to auto-upgrade node-image or node OS upgrade channel - SecurityPatch; you can set maintenance windows for these channels.

Release notes

  • Features

    • Image Cleaner is now generally available.
    • Planned maintenance is now generally available.
    • Azure AD workload identity with AKS has been made available in the following regions - eastus, australiacentral, australiaeast, brazilsouth, canadacentral, centralindia, eastasia, eastus2, francecentral, germanywestcentral, japaneast, jioindiawest, koreacentral, northcentralus, northeurope, norwayeast, qatarcentral, southafricanorth, swedencentral, switzerlandnorth, uaenorth, ukwest, westus2.
    • networkPolicy to 'none' (no network policy engine is installed) as a default value if unspecified when creating a cluster. Setting networkPolicy to 'none' is blocked for API versions prior to 2023-09-02-preview.

  • Behavioral changes

    • Microsoft.ContainerService/locations/{location}/kubernetesVersions operation will now return isDefault: true on default version.

  • Component Updates

Assets 2
Loading

Release 2023-08-13

23 Aug 07:52
@CocoWang-wql CocoWang-wql
2023-08-13
f88967c
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Release 2023-08-13

Release 2023-08-13

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • No new clusters can be created with Azure AD Integration (legacy). Existing AKS clusters with Azure Active Directory integration will keep working. All Azure AD Integration (legacy) AKS clusters will be migrated to AKS-managed Azure AD automatically starting from 1st Dec. 2023. We recommend updating your cluster with AKS-managed Azure AD before 1 Dec 2023. This way you can manage the API server downtime during non-business hours.

Release notes

Assets 2
Loading

Release 2023-08-06

08 Aug 19:55
@allyford allyford
2023-08-06
c1e0d2a
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Release 2023-08-06

Release 2023-08-06

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • New v1.27+ AKS clusters will have KMS v2 configured by default when KMS is enabled. Customers with clusters on v1.26 and below with KMS enabled will not be able to upgrade to v1.27. To upgrade, follow the steps outlined in this documentation for migrating from KMS v1 to v2, and then proceed with upgrading the cluster to version v1.27.
  • The pod security policy feature was deprecated on 1st August 2023 and removed since AKS version 1.25. We recommend you migrate to pod security admission controller or Azure Policy to stay within Azure support.

Release notes

  • Preview Features

    • Network Observability add-on plugin is a new public preview feature that will scrape useful metrics from Kubernetes workloads and emit actionable networking observability data into industry standard Prometheus format, which can then be visualized in Grafana.

  • Behavioral changes

  • Bug Fixes

    • Fixed a bug where the addon-token-adapter may get a staled long connection to apiserver causing network connection errors.
    • Added validation to check if pobSubnet is associated with NAT Gateway when cluster outbound type is userAssignedNATGateway and pobSubnet in agentpoolProfile is not empty.

  • Component Updates

Assets 2
Loading

Release 2023-07-30

03 Aug 20:15
@qpetraroia qpetraroia
2023-07-30
cba3ced
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Release 2023-07-30

Release 2023-07-30

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • Windows 2019 will be retired in Kubernetes v1.33 and above (ETA March 2026). Customers should upgrade to Windows 2022.
  • For AKS clusters built at version v1.27+ and enable KMS, KMS v2 is configured by default. However, for clusters with KMS enabled at versions below v1.27, upgrading to v1.27 will be blocked. To upgrade, follow the steps outlined in this documentation for migrating from KMS v1 to v2, and then proceed with upgrading the cluster to version v1.27.
  • The pod security policy feature was deprecated on 1st August 2023 and removed since AKS version 1.25. We recommend you migrate to pod security admission controller or Azure Policy to stay within Azure support.

Release notes

  • Features

  • Behavioral changes

    • Kubernetes version 1.24 is now deprecated.
    • During Outbound Type Migration, Public IPs are released when it doesn't meet Outbound IP goal.
    • During Outbound Type Migration, NAT Gateway Profile is set to 1 when Outbound Type is set to something other than Managed NAT Gateway.

  • Component Updates

    • AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202307.27.0.
    • AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202307.27.0.
    • Azure Linux image has been updated to AzureLinux-202307.27.0.
    • Istio-based service mesh add-on's istiod and ingress images updated to v1.17.5. User needs to restart the workload pods to trigger re-injection of the newer patch version of istio-proxy. More information can be found here.
    • Updated Windows Azure CNI to v1.5.6.
    • Updated microsoft-defender-pod-collector image to 1.0.73.
Assets 2
Loading

Release 2023-07-23

26 Jul 14:55
@miwithro miwithro
2023-07-23
e1dc835
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Release 2023-07-23

Azure Kubernetes Service Changelog

Release 2023-07-23

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • Windows 2019 will be retired in Kubernetes v1.33 and above (ETA March 2026). Customers should upgrade to Windows 2022.
  • Kubernetes 1.24 is being deprecated end of July 2023 and support will transition to our platform support policy.
  • Starting Kubernetes 1.25, the default cgroups implementation on AKS nodes will be cgroupsv2. Older versions of Java, .NET and NodeJS do not support memory querying v2 memory constraints and this will lead to out of memory (OOM) issues for workloads. Please test your applications for cgroupsv2 compliance, and read the [FAQ][https://learn.microsoft.com/troubleshoot/azure/azure-kubernetes/aks-increased-memory-usage-cgroup-v2] for cgroupsv2.
  • A known issue in Kubernetes version 1.24 is causing name resolution failures in Windows pods. Customers experiencing this issue should upgrade their cluster to Kubernetes version 1.25.
  • CVE-2023-35945 has been found in Envoy Proxy (part of OSM and Istio). We are rolling out a fix to all affected customers, please follow the instructions to monitor the rollout and restart your proxies.
  • For AKS clusters built at version v1.27+ and enable KMS, KMS v2 is configured by default. However, for clusters with KMS enabled at versions below v1.27, upgrading to v1.27 will be blocked. To upgrade, follow the steps outlined in this documentation for migrating from KMS v1 to v2, and then proceed with upgrading the cluster to version v1.27.

Release notes

  • Features

    • New K8s patch versions
      • Removed 1.24.9, added 1.24.15.
      • Removed 1.25.5, added 1.25.11.
      • Removed 1.26.0, added 1.26.6.
      • Added 1.27.3(preview).

  • Behavioral changes

    • CNI V2 maxpods increased from 16 to 60 for clusters with more than 1000 nodes and to 40 for clusters with less than 1000 nodes.
    • Cloud provider will no longer remove nodes that go to a NotReady state after having been Ready from the load balancer backend pools. #4283

  • Bug Fixes

    • Fixed a bug that custom kubelet identity was not working on VMAS clusters.

  • Component Updates

Assets 2
Loading

2023-07-16

20 Jul 20:23
@justindavies justindavies
2023-07-16
b938971
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
2023-07-16

Release 2023-07-16

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • Windows 2019 will be retired in Kubernetes v1.33 and above (ETA March 2026). Customers should upgrade to Windows 2022.
  • Kubernetes 1.24 is being deprecated end of July 2023 and support will transition to our platform support policy.
  • Starting Kubernetes 1.25, the default cgroups implementation on AKS nodes will be cgroupsv2. Older versions of Java, .NET and NodeJS do not support memory querying v2 memory constraints and this will lead to out of memory (OOM) issues for workloads. Please test your applications for cgroupsv2 compliance, and read the [FAQ][https://learn.microsoft.com/en-us/troubleshoot/azure/azure-kubernetes/aks-increased-memory-usage-cgroup-v2] for cgroupsv2.
  • A known issue in Kubernetes version 1.24 is causing name resolution failures in Windows pods. Customers experiencing this issue should upgrade their cluster to Kubernetes version 1.25.
  • A CVE has been found in Envoy Proxy (part of OSM and Istio). We are rolling out a fix to all affected customers, please follow the instructions to monitor the rollout and restart your proxies.

Release notes

Assets 2
Loading

Release 2023-07-09

11 Jul 00:51
@qpetraroia qpetraroia
2023-07-09
214b592
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Release 2023-07-09

Azure Kubernetes Service Changelog

Release 2023-07-09

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • Windows 2019 will be retired in Kubernetes v1.33 and above (ETA March 2026). Customers should upgrade to Windows 2022.
  • Kubernetes 1.24 is being deprecated end of July 2023 and support will transition to our platform support policy.
  • Starting Kubernetes 1.25, the default cgroups implementation on AKS nodes will be cgroupsv2. Older versions of Java, .NET and NodeJS do not support memory querying v2 memory constraints and this will lead to out of memory (OOM) issues for workloads. Please test your applications for cgroupsv2 compliance.
  • A known issue in Kubernetes version 1.24 is causing name resolution failures in Windows pods. Customers experiencing this issue should upgrade their cluster to Kubernetes version 1.25.

Release notes

  • Bug Fixes

    • A node restriction bug has been fixed that caused issues with Windows Server container pods while using inline volume for 1.24+ clusters.

  • Component Updates

Assets 2
Loading

Release 2023-07-02

06 Jul 19:05
@sabbour sabbour
2023-07-02
5291088
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Release 2023-07-02

Release 2023-07-02

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • Windows 2019 will be retired in Kubernetes v1.33 and above (ETA March 2026). Customers should upgrade to Windows 2022.
  • Kubernetes 1.24 is being deprecated end of July 2023 and support will transition to our platform support policy.
  • Starting Kubernetes 1.25, the default cgroups implementation on AKS nodes will be cgroupsv2. Older versions of Java, .NET and NodeJS do not support memory querying v2 memory constraints and this will lead to out of memory (OOM) issues for workloads. Please test your applications for cgroupsv2 compliance.
  • A known issue in Kubernetes version 1.24 is causing name resolution failures in Windows pods. Customers experiencing this issue should upgrade their cluster to Kubernetes version 1.25.

Release notes

  • Preview Features

  • Behavior Changes

    • The default OS disk type for non-ephemeral OS disks is now Standard SSD.

  • Bug Fixes

    • Disabled auto mounting of service account token for ip-masq-agent.
    • Fixed an issue that can incorrectly override the custom certificate authority trust on a nodepool update.

  • Component Updates

Assets 2
Loading

Release 2023-06-25

28 Jun 14:31
@justindavies justindavies
2023-06-25
71fa63c
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Release 2023-06-25

Release 2023-06-25

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • Kubernetes 1.24 is the last version of Kubernetes supported by AKS Engine. Kubernetes 1.24 goes end-of-life in July, at which point Upstream will stop releasing patches for AKS Engine and archive the project. Please consider using Azure Kubernetes Service (AKS) for managed Kubernetes or Cluster API Provider Azure for self-managed Kubernetes.
  • Because of Ubuntu 22.04 FIPS certification status, we'll switch AKS FIPS nodes from 18.04 to 20.04 from 1.27 preview onwards.
  • After May 31, 2023, Ubuntu 18.04 will reach end of life. AKS will continue to update the host OS from Canonical into the Kubernetes 1.24 VHD images. Customers will not receive daily security updates from Canonical past the end of May, but will be able to consume those through a node image update only.
  • Windows 2019 will be retired in Kubernetes v1.33 and above (ETA March 2026). Customers should upgrade to Windows 2022.
  • Kubernetes 1.24 is being deprecated end of July 2023. From Kubernetes 1.25 the default cgroups implementation on AKS nodes will be cgroupsv2. Older versions of Java, .NET and NodeJS do not support memory querying v2 memory constraints and this will lead to out of memory (OOM) issues for workloads. Please test your applications for cgroupsv2 compliance.

Release notes

  • Behavior Changes

    • Added node anti affinity for Cilium and Azure Linux so that Network Observability extension does not run on these environments that are not supported.
    • Cluster create check that the size of Kubenet based clusters will not exceed 400 nodes (Kubenet on Azure limit)

  • Bug Fixes

  • Component Updates

Assets 2
Loading

Release 2023-06-18

23 Jun 04:17
@shashankbarsin shashankbarsin
2023-06-18
c3e64c5
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
Release 2023-06-18

Release 2023-06-18

Monitor the release status by regions at AKS-Release-Tracker.

Announcements

  • Kubernetes 1.24 is the last version of Kubernetes supported by AKS Engine. Kubernetes 1.24 goes end-of-life in July, at which point Upstream will stop releasing patches for AKS Engine and archive the project. Please consider using Azure Kubernetes Service (AKS) for managed Kubernetes or Cluster API Provider Azure for self-managed Kubernetes.
  • Because of Ubuntu 22.04 FIPS certification status, we'll switch AKS FIPS nodes from 18.04 to 20.04 from 1.27 preview onwards.
  • After May 31, 2023, Ubuntu 18.04 will reach end of life. AKS will continue to update the host OS from Canonical into the Kubernetes 1.24 VHD images. Customers will not receive daily security updates from Canonical past the end of May, but will be able to consume those through a node image update only.
  • Windows2019 will be retired in Kubernetes v1.33 and above (ETA March 2026). Customers should upgrade to Windows2022.
  • Kubernetes 1.24 is being deprecated end of July. From Kubernetes 1.25 the default cgroups implementation on AKS nodes will be cgroupsv2. Older versions of Java, .NET and NodeJS do not support memory querying v2 memory constraints and this will lead to out of memory (OOM) issues for workloads. Please test your applications for cgroupsv2 compliance.

Release notes

  • Preview Features

  • Behavior Changes

    • Added node affinity for ebpf-dataplane=cilium to Azure CNI Powered by Cilium pod.
    • Introduced overlay-vpa-webhook-generation and overlay-vpa-cert-webhook-check jobs to cleanup and generate Vertical Pod Autoscaling secrets and webhook.
    • Change the default OS disk to Standard SSD instead of Standard HDD for VM SKUs that do not support ephemeral OS disks.
    • Starting 2023-06-02-preview API, pod CIDR is returned when network plugin is none.
    • Updated custom node configuration to change allowed value range for the following:
      • sysctls
        • netIpv4TcpkeepaliveIntvl - Previously: 10-75. New: 10-90.
        • netIpv4IpLocalPortRange - Previously: First (1024 - 60999) and Last (32768 - 65000). New: First (1024 - 60999) and Last (32768 - 65535).
        • netNetfilterNfConntrackMax - Previously: 131072 - 1048576. New: 131072 - 2097152.
        • netNetfilterNfConntrackBuckets - Previously: 65536 - 147456. New: 65536 - 524288.
      • ulimits
        • maxLockedMemory - Previously: unlimited. New: values > 0.
        • noFile - Previously: 1024. New: Values > 1024.
    • Removed unnecessary kubernetes.io/os: linux nodeSelector from Cilium daemonset in Azure CNI Powered By Cilium clusters.
    • kube-proxy-replacement-healthz-bind-address set to 0.0.0.0:10256 in cilium-config ConfigMap on Azure CNI Powered By Cilium clusters.
    • Default for node os upgrade channel updated to NodeImage in 2023-06-01 and 2023-06-02-preview APIs.
    • Registration of NodeOSUpgradeChannelPreview feature flag is only required to use SecurityPatch Channel.

  • Bug Fixes

    • Fix a bug that could cause nodepool creation to retry unnecessarily in Azure CNI enhanced subnet support clusters.
    • Increased CSI snapshot timeout to 600s to fix the azure disk cross region snapshot timeout issue.

  • Component Updates

Assets 2
Loading