Loop over providers bug #2454

sashalarsoo · 2025-01-29T13:17:02Z

sashalarsoo
Jan 29, 2025

Hi i instanciated multiple clusters using a big list of clusters objects. I now try to deploy things on these clusters :

provider "kubectl" {
  alias    = "slaves"
  for_each = var.slave_clusters
  
  host                   = "https://${module.oke_slave[each.key].host}"
  cluster_ca_certificate = base64decode(yamldecode(module.oke_slave[each.key].kubeconfig_content)["clusters"][0]["cluster"]["certificate-authority-data"])
  insecure               = false
  exec {
    api_version = "client.authentication.k8s.io/v1beta1"
    args        = ["ce", "cluster", "generate-token", "--cluster-id", module.oke_slave[each.key].cluster_id, "--region", var.provider_oci.region]
    command     = "oci"
  }
}

Then i'm calling a module deploying an app on the clusters :

module "autoscaler_slave" {
  source = "./modules/autoscaler"
  for_each = {
    for cluster, config in var.slave_clusters : cluster => config
    if config != null
  }
  providers = {
    kubectl = kubectl.slaves[each.key]
    helm    = helm.slaves[each.key]
  }

  compartment_id    = module.identity.compartment_id
  defined_tags      = local.defined_tags
  vault_compartment = var.vault_compartment
  compartment_name  = var.compartment_name
  application       = var.application
  
}

The fact is that the first time it worked but when i added some elements in my clusters variable, the module is not applied anymore with the good provider, he is applied to my another provider kubectl :

provider "kubectl" {
  host                   = var.create_oke_cluster ? "https://${module.oke[0].host}" : "https://127.0.0.1"
  cluster_ca_certificate = var.create_oke_cluster ? base64decode(yamldecode(module.oke[0].kubeconfig_content)["clusters"][0]["cluster"]["certificate-authority-data"]) : ""
  insecure               = false
  exec {
    api_version = "client.authentication.k8s.io/v1beta1"
    args        = var.create_oke_cluster ? ["ce", "cluster", "generate-token", "--cluster-id", module.oke[0].cluster_id, "--region", var.provider_oci.region] : []
    command     = "oci"
  }
}

I don't understand why, could you help me please ?

abstractionfactory · 2025-01-29T13:22:52Z

abstractionfactory
Jan 29, 2025
Maintainer

Hi @sashalarsoo can you please post your logs? Ideally, enable debug logging and make sure that there are no credentials, etc in the log before you post them.

2 replies

sashalarsoo Jan 29, 2025
Author

 Warning: Provider configuration for_each matches module
│ 
│   on 3dpredict.tf line 224, in module "kubernetes_slave":
│  224:   for_each = var.slave_clusters
│ 
│ This provider configuration uses the same for_each expression as a module, which means that
│ subsequent removal of elements from this collection would cause a planning error.
│ 
│ OpenTofu relies on a provider instance to destroy resource instances that are associated with it, and
│ so the provider instance must outlive all of its resource instances by at least one plan/apply round.
│ For removal of instances to succeed in future you must structure the configuration so that the
│ provider block's for_each expression can produce a superset of the instances of the resources
│ associated with the provider configuration. Refer to the OpenTofu documentation for specific
│ suggestions.
│ 
│ To destroy this object before removing the provider configuration, consider first performing a
│ targeted destroy:
│     tofu apply -destroy -target=module.kubernetes_slave
│ 
│ (and 5 more similar warnings elsewhere)

This was the warning i had when not using the for in for each on the autoscaler module. An example of the plan :

 # module.autoscaler_slave["cluster1"].kubernetes_role_binding.role_binding_autoscaler will be created
  + resource "kubernetes_role_binding" "role_binding_autoscaler" {
      + id = (known after apply)

      + metadata {
          + generation       = (known after apply)
          + labels           = {
              + "k8s-addon" = "cluster-autoscaler.addons.k8s.io"
              + "k8s-app"   = "cluster-autoscaler"
            }
          + name             = "cluster-autoscaler"
          + namespace        = "autoscaler"
          + resource_version = (known after apply)
          + uid              = (known after apply)
        }

      + role_ref {
          + api_group = "rbac.authorization.k8s.io"
          + kind      = "Role"
          + name      = "cluster-autoscaler"
        }

      + subject {
          + api_group = (known after apply)
          + kind      = "ServiceAccount"
          + name      = "cluster-autoscaler"
          + namespace = "autoscaler"
        }
    }

  # module.autoscaler_slave["cluster1"].kubernetes_service_account.service_account_autoscaler will be created
  + resource "kubernetes_service_account" "service_account_autoscaler" {
      + automount_service_account_token = true
      + default_secret_name             = (known after apply)
      + id                              = (known after apply)

      + metadata {
          + generation       = (known after apply)
          + labels           = {
              + "k8s-addon" = "cluster-autoscaler.addons.k8s.io"
              + "k8s-app"   = "cluster-autoscaler"
            }
          + name             = "cluster-autoscaler"
          + namespace        = "autoscaler"
          + resource_version = (known after apply)
          + uid              = (known after apply)
        }
    }

  # module.autoscaler_slave["cluster2"].kubernetes_cluster_role_binding.cluster_role_binding_autoscaler will be created
  + resource "kubernetes_cluster_role_binding" "cluster_role_binding_autoscaler" {
      + id = (known after apply)

      + metadata {
          + generation       = (known after apply)
          + labels           = {
              + "k8s-addon" = "cluster-autoscaler.addons.k8s.io"
              + "k8s-app"   = "cluster-autoscaler"
            }
          + name             = "cluster-autoscaler"
          + resource_version = (known after apply)
          + uid              = (known after apply)
        }

      + role_ref {
          + api_group = "rbac.authorization.k8s.io"
          + kind      = "ClusterRole"
          + name      = "cluster-autoscaler"
        }

      + subject {
          + api_group = (known after apply)
          + kind      = "ServiceAccount"
          + name      = "cluster-autoscaler"
          + namespace = "autoscaler"

I have 4 clusters : 1 with his module, 3 with a module called via a loop
And the logs : i checked and the resources are created in the cluster with his module, just because i edit my clusters variable. here is the logs :

╷
│ Error: rolebindings.rbac.authorization.k8s.io "cluster-autoscaler" already exists
│ 
│   with module.autoscaler_slave["cluster1"].kubernetes_role_binding.role_binding_autoscaler,
│   on modules/autoscaler/main.tf line 205, in resource "kubernetes_role_binding" "role_binding_autoscaler":
│  205: resource "kubernetes_role_binding" "role_binding_autoscaler" {
│ 
╵
╷
│ Error: services "cluster-autoscaler" already exists
│ 
│   with module.autoscaler_slave["cluster2"].kubernetes_service.service_autoscaler,
│   on modules/autoscaler/main.tf line 228, in resource "kubernetes_service" "service_autoscaler":
│  228: resource "kubernetes_service" "service_autoscaler" {
│ 
╵
╷
│ Error: services "cluster-autoscaler" already exists
│ 
│   with module.autoscaler_slave["cluster3"].kubernetes_service.service_autoscaler,
│   on modules/autoscaler/main.tf line 228, in resource "kubernetes_service" "service_autoscaler":
│  228: resource "kubernetes_service" "service_autoscaler" {
│ 
╵
╷
│ Error: Failed to create deployment: deployments.apps "cluster-autoscaler" already exists
│ 
│   with module.autoscaler_slave["cluster3"].kubernetes_deployment.deployment_autoscaler,
│   on modules/autoscaler/main.tf line 254, in resource "kubernetes_deployment" "deployment_autoscaler":
│  254: resource "kubernetes_deployment" "deployment_autoscaler" {
│ 
╵
╷
│ Error: Failed to create deployment: deployments.apps "cluster-autoscaler" already exists
│ 
│   with module.autoscaler_slave["cluster2"].kubernetes_deployment.deployment_autoscaler,
│   on modules/autoscaler/main.tf line 254, in resource "kubernetes_deployment" "deployment_autoscaler":
│  254: resource "kubernetes_deployment" "deployment_autoscaler" {
│

025-01-29T13:33:34.952Z [DEBUG] provider.terraform-provider-kubernetes: Received HTTP Response: Content-Length=278 Content-Type=application/json tf_http_res_status_code=409 tf_http_res_status_reason="409 Conflict" @module=kubernetes.Kubernetes Audit-Id=34a40285-8458-46f3-bfde-88cf4a2305a8
  tf_http_res_body=
  | {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"roles.rbac.authorization.k8s.io \"cluster-autoscaler\" already exists","reason":"AlreadyExists","details":{"name":"cluster-autoscaler","group":"rbac.authorization.k8s.io","kind":"roles"},"code":409}
   @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/[email protected]/helper/logging/logging_http_transport.go:160 Cache-Control="no-cache, private" X-Kubernetes-Pf-Flowschema-Uid=887ea470-50ea-423e-9ebf-259f1a628c14 X-Kubernetes-Pf-Prioritylevel-Uid=f53e772e-d1b0-473f-93d2-464f4404a7de tf_http_res_version=HTTP/1.1 tf_http_trans_id=99c8850f-51cd-f6fd-9d70-396f250d6582 Date="Wed, 29 Jan 2025 13:33:34 GMT" new_logger_warning="This log was generated by a subsystem logger that wasn't created before being used. Use tflog.NewSubsystem to create this logger before it is used." tf_http_op_type=response timestamp=2025-01-29T13:33:34.951Z
2025-01-29T13:33:34.953Z [ERROR] provider.terraform-provider-kubernetes: Response contains error diagnostic: @module=sdk.proto diagnostic_detail="" tf_proto_version=5.7 tf_provider_addr=registry.terraform.io/hashicorp/kubernetes tf_resource_type=kubernetes_role tf_rpc=ApplyResourceChange @caller=/home/runner/go/pkg/mod/github.com/hashicorp/[email protected]/tfprotov5/internal/diag/diagnostics.go:58 diagnostic_severity=ERROR diagnostic_summary="roles.rbac.authorization.k8s.io \"cluster-autoscaler\" already exists" tf_req_id=d91bea79-5307-86bf-8d48-2e1e85be5672 timestamp=2025-01-29T13:33:34.951Z
2025-01-29T13:33:34.953Z [DEBUG] provider.terraform-provider-kubernetes: Received HTTP Response: new_logger_warning="This log was generated by a subsystem logger that wasn't created before being used. Use tflog.NewSubsystem to create this logger before it is used." tf_http_op_type=response tf_http_res_status_code=409 tf_http_trans_id=ecc815ca-7bbf-5c6a-70d2-1fe1dd2e88ac @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/[email protected]/helper/logging/logging_http_transport.go:160 @module=kubernetes.Kubernetes X-Kubernetes-Pf-Flowschema-Uid=887ea470-50ea-423e-9ebf-259f1a628c14 tf_http_res_version=HTTP/1.1 Audit-Id=d758315f-ed01-441c-98c8-0a41707ed95d Content-Length=222 tf_http_res_status_reason="409 Conflict" Cache-Control="no-cache, private" Date="Wed, 29 Jan 2025 13:33:34 GMT" Content-Type=application/json X-Kubernetes-Pf-Prioritylevel-Uid=f53e772e-d1b0-473f-93d2-464f4404a7de
  tf_http_res_body=
  | {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"services \"cluster-autoscaler\" already exists","reason":"AlreadyExists","details":{"name":"cluster-autoscaler","kind":"services"},"code":409}
   timestamp=2025-01-29T13:33:34.951Z
2025-01-29T13:33:34.953Z [ERROR] provider.terraform-provider-kubernetes: Response contains error diagnostic: diagnostic_detail="" diagnostic_summary="services \"cluster-autoscaler\" already exists" tf_proto_version=5.7 tf_provider_addr=registry.terraform.io/hashicorp/kubernetes tf_req_id=7cb28c40-cecb-b22d-646a-ca5a6cc0440f @module=sdk.proto tf_resource_type=kubernetes_service tf_rpc=ApplyResourceChange diagnostic_severity=ERROR @caller=/home/runner/go/pkg/mod/github.com/hashicorp/[email protected]/tfprotov5/internal/diag/diagnostics.go:58 timestamp=2025-01-29T13:33:34.951Z
2025-01-29T13:33:34.954Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF"
2025-01-29T13:33:34.957Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.opentofu.org/hashicorp/helm/2.17.0/linux_amd64/terraform-provider-helm pid=73604
2025-01-29T13:33:34.957Z [DEBUG] provider: plugin exited
2025-01-29T13:33:34.961Z [DEBUG] State storage *remote.State declined to persist a state snapshot
2025-01-29T13:33:34.961Z [ERROR] vertex "module.autoscaler_slave[\"cluster3\"].kubernetes_role.role_autoscaler" error: roles.rbac.authorization.k8s.io "cluster-autoscaler" already exists
2025-01-29T13:33:34.965Z [DEBUG] provider.terraform-provider-kubernetes: Received HTTP Response: Audit-Id=ebee2334-db57-4f78-99f5-a696558cbfe7 Cache-Control="no-cache, private" X-Kubernetes-Pf-Flowschema-Uid=887ea470-50ea-423e-9ebf-259f1a628c14 tf_http_res_version=HTTP/1.1 @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/[email protected]/helper/logging/logging_http_transport.go:160 new_logger_warning="This log was generated by a subsystem logger that wasn't created before being used. Use tflog.NewSubsystem to create this logger before it is used."
  tf_http_res_body=
  | {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"serviceaccounts \"cluster-autoscaler\" already exists","reason":"AlreadyExists","details":{"name":"cluster-autoscaler","kind":"serviceaccounts"},"code":409}
   @module=kubernetes.Kubernetes Content-Length=236 tf_http_res_status_reason="409 Conflict" tf_http_op_type=response X-Kubernetes-Pf-Prioritylevel-Uid=f53e772e-d1b0-473f-93d2-464f4404a7de tf_http_res_status_code=409 tf_http_trans_id=2c98ca9d-8489-1241-1fca-7dfd97f973ab Content-Type=application/json Date="Wed, 29 Jan 2025 13:33:34 GMT" timestamp=2025-01-29T13:33:34.965Z
2025-01-29T13:33:34.966Z [ERROR] provider.terraform-provider-kubernetes: Response contains error diagnostic: @module=sdk.proto diagnostic_detail="" diagnostic_severity=ERROR tf_proto_version=5.7 tf_provider_addr=registry.terraform.io/hashicorp/kubernetes tf_resource_type=kubernetes_service_account tf_rpc=ApplyResourceChange @caller=/home/runner/go/pkg/mod/github.com/hashicorp/[email protected]/tfprotov5/internal/diag/diagnostics.go:58 diagnostic_summary="serviceaccounts \"cluster-autoscaler\" already exists" tf_req_id=56076fb5-c379-03df-a4e4-af6de0e1adc8 timestamp=2025-01-29T13:33:34.966Z
2025-01-29T13:33:34.966Z [DEBUG] provider.terraform-provider-kubernetes: Received HTTP Response: X-Kubernetes-Pf-Prioritylevel-Uid=f53e772e-d1b0-473f-93d2-464f4404a7de tf_http_op_type=response
  tf_http_res_body=
  | {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"clusterroles.rbac.authorization.k8s.io \"cluster-autoscaler\" already exists","reason":"AlreadyExists","details":{"name":"cluster-autoscaler","group":"rbac.authorization.k8s.io","kind":"clusterroles"},"code":409}
   tf_http_res_version=HTTP/1.1 tf_http_trans_id=572dde6d-335e-4f46-ec63-b443ac373cfa Date="Wed, 29 Jan 2025 13:33:34 GMT" X-Kubernetes-Pf-Flowschema-Uid=887ea470-50ea-423e-9ebf-259f1a628c14 @module=kubernetes.Kubernetes Cache-Control="no-cache, private" Content-Type=application/json tf_http_res_status_code=409 tf_http_res_status_reason="409 Conflict" @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/[email protected]/helper/logging/logging_http_transport.go:160 Audit-Id=0a4d972e-3513-4abe-b0c8-c08d783fdc01 Content-Length=292 new_logger_warning="This log was generated by a subsystem logger that wasn't created before being used. Use tflog.NewSubsystem to create this logger before it is used." timestamp=2025-01-29T13:33:34.966Z
2025-01-29T13:33:34.966Z [ERROR] provider.terraform-provider-kubernetes: Response contains error diagnostic: diagnostic_detail="" tf_proto_version=5.7 tf_provider_addr=registry.terraform.io/hashicorp/kubernetes tf_resource_type=kubernetes_cluster_role @module=sdk.proto diagnostic_severity=ERROR diagnostic_summary="clusterroles.rbac.authorization.k8s.io \"cluster-autoscaler\" already exists" tf_req_id=66b1bd62-e2cf-0fa1-7ad3-63d179256e31 tf_rpc=ApplyResourceChange @caller=/home/runner/go/pkg/mod/github.com/hashicorp/[email protected]/tfprotov5/internal/diag/diagnostics.go:58 timestamp=2025-01-29T13:33:34.966Z
2025-01-29T13:33:34.969Z [DEBUG] State storage *remote.State declined to persist a state snapshot
2025-01-29T13:33:34.970Z [ERROR] vertex "module.autoscaler_slave[\"cluster2\"].kubernetes_role_binding.role_binding_autoscaler" error: rolebindings.rbac.authorization.k8s.io "cluster-autoscaler" already exists
2025-01-29T13:33:34.974Z [DEBUG] State storage *remote.State declined to persist a state snapshot
2025-01-29T13:33:34.974Z [ERROR] vertex "module.autoscaler_slave[\"cluster1\"].kubernetes_service_account.service_account_autoscaler" error: serviceaccounts "cluster-autoscaler" already exists
2025-01-29T13:33:34.977Z [DEBUG] State storage *remote.State declined to persist a state snapshot
2025-01-29T13:33:34.977Z [ERROR] vertex "module.autoscaler_slave[\"cluster1\"].kubernetes_cluster_role.cluster_autoscaler" error: clusterroles.rbac.authorization.k8s.io "cluster-autoscaler" already exists
2025-01-29T13:33:34.978Z [DEBUG] State storage *remote.State declined to persist a state snapshot
2025-01-29T13:33:34.979Z [ERROR] vertex "module.autoscaler_slave[\"cluster3\"].kubernetes_service.service_autoscaler" error: services "cluster-autoscaler" already exists
2025-01-29T13:33:34.980Z [DEBUG] State storage *remote.State declined to persist a state snapshot
2025-01-29T13:33:34.980Z [ERROR] vertex "module.autoscaler_slave[\"cluster1\"].kubernetes_role.role_autoscaler" error: roles.rbac.authorization.k8s.io "cluster-autoscaler" already exists
2025-01-29T13:33:34.981Z [DEBUG] provider.terraform-provider-kubernetes: Received HTTP Response: @caller=/home/runner/go/pkg/mod/github.com/hashicorp/terraform-plugin-sdk/[email protected]/helper/logging/logging_http_transport.go:160 Audit-Id=679c1b7b-60ab-4503-8e44-a3f1a600b14a Cache-Control="no-cache, private" Date="Wed, 29 Jan 2025 13:33:34 GMT" X-Kubernetes-Pf-Flowschema-Uid=887ea470-50ea-423e-9ebf-259f1a628c14 X-Kubernetes-Pf-Prioritylevel-Uid=f53e772e-d1b0-473f-93d2-464f4404a7de tf_http_op_type=response tf_http_trans_id=3978c1f5-1000-8685-4508-3ecaf25216dd @module=kubernetes.Kubernetes new_logger_warning="This log was generated by a subsystem logger that wasn't created before being used. Use tflog.NewSubsystem to create this logger before it is used."
  tf_http_res_body=
  | {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"services \"cluster-autoscaler\" already exists","reason":"AlreadyExists","details":{"name":"cluster-autoscaler","kind":"services"},"code":409}
   tf_http_res_status_reason="409 Conflict" Content-Length=222 Content-Type=application/json tf_http_res_status_code=409 tf_http_res_version=HTTP/1.1 timestamp=2025-01-29T13:33:34.981Z
2025-01-29T13:33:34.981Z [ERROR] provider.terraform-provider-kubernetes: Response contains error diagnostic: tf_resource_type=kubernetes_service tf_provider_addr=registry.terraform.io/hashicorp/kubernetes tf_req_id=9ff984af-f89e-8dcb-d8b5-22619d481b98 tf_proto_version=5.7 tf_rpc=ApplyResourceChange @caller=/home/runner/go/pkg/mod/github.com/hashicorp/[email protected]/tfprotov5/internal/diag/diagnostics.go:58 @module=sdk.proto diagnostic_detail="" diagnostic_severity=ERROR diagnostic_summary="services \"cluster-autoscaler\" already exists" timestamp=2025-01-29T13:33:34.981Z
2025-01-29T13:33:34.981Z [DEBUG] State storage *remote.State declined to persist a state snapshot
2025-01-29T13:33:34.981Z [ERROR] vertex "module.autoscaler_slave[\"cluster2\"].kubernetes_service_account.service_account_autoscaler" error: serviceaccounts "cluster-autoscaler" already exists
2025-01-29T13:33:34.983Z [DEBUG] State storage *remote.State declined to persist a state snapshot
2025-01-29T13:33:34.983Z [ERROR] vertex "module.autoscaler_slave[\"cluster2\"].kubernetes_service.service_autoscaler" error: services "cluster-autoscaler" already exists
2025-01-29T13:33:34.991Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF"
2025-01-29T13:33:35.004Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.opentofu.org/oracle/oci/6.23.0/linux_amd64/terraform-provider-oci_v6.23.0 pid=73579
2025-01-29T13:33:35.004Z [DEBUG] provider: plugin exited
2025-01-29T13:33:35.036Z [WARN]  Provider "provider[\"registry.opentofu.org/hashicorp/kubernetes\"]" produced an invalid plan for module.autoscaler_slave["cluster3"].kubernetes_deployment.deployment_autoscaler, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .wait_for_rollout: planned value cty.True for a non-computed attribute
      - .spec[0].min_ready_seconds: planned value cty.NumberIntVal(0) for a non-computed attribute
      - .spec[0].paused: planned value cty.False for a non-computed attribute
      - .spec[0].progress_deadline_seconds: planned value cty.NumberIntVal(600) for a non-computed attribute
      - .spec[0].revision_history_limit: planned value cty.NumberIntVal(10) for a non-computed attribute
      - .spec[0].strategy: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead
      - .spec[0].template[0].spec[0].host_ipc: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].restart_policy: planned value cty.StringVal("Always") for a non-computed attribute
      - .spec[0].template[0].spec[0].dns_policy: planned value cty.StringVal("ClusterFirst") for a non-computed attribute
      - .spec[0].template[0].spec[0].enable_service_links: planned value cty.True for a non-computed attribute
      - .spec[0].template[0].spec[0].host_pid: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].share_process_namespace: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].termination_grace_period_seconds: planned value cty.NumberIntVal(30) for a non-computed attribute
      - .spec[0].template[0].spec[0].automount_service_account_token: planned value cty.True for a non-computed attribute
      - .spec[0].template[0].spec[0].host_network: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].image_pull_secrets: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead
      - .spec[0].template[0].spec[0].readiness_gate: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead
      - .spec[0].template[0].spec[0].container[0].stdin_once: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].termination_message_path: planned value cty.StringVal("/dev/termination-log") for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].tty: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].stdin: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].liveness_probe[0].success_threshold: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].liveness_probe[0].timeout_seconds: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].liveness_probe[0].failure_threshold: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].security_context[0].privileged: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].security_context[0].read_only_root_filesystem: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].readiness_probe[0].failure_threshold: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].readiness_probe[0].success_threshold: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].readiness_probe[0].timeout_seconds: planned value cty.NumberIntVal(1) for a non-computed attribute
2025-01-29T13:33:35.036Z [WARN]  Provider "provider[\"registry.opentofu.org/hashicorp/kubernetes\"]" produced an invalid plan for module.autoscaler_slave["cluster2"].kubernetes_deployment.deployment_autoscaler, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .wait_for_rollout: planned value cty.True for a non-computed attribute
      - .spec[0].min_ready_seconds: planned value cty.NumberIntVal(0) for a non-computed attribute
      - .spec[0].paused: planned value cty.False for a non-computed attribute
      - .spec[0].progress_deadline_seconds: planned value cty.NumberIntVal(600) for a non-computed attribute
      - .spec[0].revision_history_limit: planned value cty.NumberIntVal(10) for a non-computed attribute
      - .spec[0].strategy: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead
      - .spec[0].template[0].spec[0].dns_policy: planned value cty.StringVal("ClusterFirst") for a non-computed attribute
      - .spec[0].template[0].spec[0].enable_service_links: planned value cty.True for a non-computed attribute
      - .spec[0].template[0].spec[0].host_ipc: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].restart_policy: planned value cty.StringVal("Always") for a non-computed attribute
      - .spec[0].template[0].spec[0].automount_service_account_token: planned value cty.True for a non-computed attribute
      - .spec[0].template[0].spec[0].host_pid: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].share_process_namespace: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].termination_grace_period_seconds: planned value cty.NumberIntVal(30) for a non-computed attribute
      - .spec[0].template[0].spec[0].host_network: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].termination_message_path: planned value cty.StringVal("/dev/termination-log") for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].tty: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].stdin: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].stdin_once: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].readiness_probe[0].success_threshold: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].readiness_probe[0].timeout_seconds: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].readiness_probe[0].failure_threshold: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].security_context[0].privileged: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].security_context[0].read_only_root_filesystem: planned value cty.False for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].liveness_probe[0].failure_threshold: planned value cty.NumberIntVal(3) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].liveness_probe[0].success_threshold: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .spec[0].template[0].spec[0].container[0].liveness_probe[0].timeout_seconds: planned value cty.NumberIntVal(1) for a non-computed attribute
      - .spec[0].template[0].spec[0].image_pull_secrets: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead
      - .spec[0].template[0].spec[0].readiness_gate: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead

I just put partial logs

sashalarsoo Jan 29, 2025
Author

the terraform log file is 25k lines long don't know where to search

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

OpenTofu

Loop over providers bug #2454

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 2 replies

{{title}}

{{title}}

{{title}}

Select a reply

OpenTofu

Loop over providers bug #2454

sashalarsoo Jan 29, 2025

Replies: 1 comment · 2 replies

abstractionfactory Jan 29, 2025 Maintainer

sashalarsoo Jan 29, 2025 Author

sashalarsoo Jan 29, 2025 Author

sashalarsoo
Jan 29, 2025

Replies: 1 comment 2 replies

abstractionfactory
Jan 29, 2025
Maintainer

sashalarsoo Jan 29, 2025
Author

sashalarsoo Jan 29, 2025
Author