Application sync triggered automatically immediately after being synced

[offzale]

Context

We have an app of apps, with auto-sync enabled, managing several appsets, which represent a service each. These appsets are composed of two applications that are rolled out using rollingSync. The former application deploys infra resources (DBs, buckets, etc with crossplane). The latter deploys the service per se (deployments, services, cronjobs, configmaps, etc), and has a pre-sync hook to run database migrations. Both applications in the appsets are composed of multiple sources, an OCI helm chart plus sourcing values.yaml files stored in a GitHub repository.

Describe the bug

When the apps' sources have been updated and any appset's app sync gets triggered, it syncs all resources as expected. However, immediately after everything gets in sync, another sync gets triggered. This last sync does not update anything as the application was already in sync.

This happens to both apps on the appset on every update after a code change, ever since I updated to this ArgoCD version. I was on the latest v2.11 before the upgrade and this was not happening.

This below is just me trying to guess what might be going on, take it with a pinch on salt.

Could it be related to this other issue? An endless loop in the appset's ProgressiveSync processing while syncing an app that somehow got more aggressive with the last minor versions' changes? Does this appset processing loop try to trigger the app sync while a sync runs without ensuring both the app is OutOfSync and no sync operation is running? Then, the application controller discards those sync retries while the sync operation runs, but maybe a last sync trigger gets through, sent by the appset before it notices the app got in sync, and gets to the aplication-controller right after it gets synced.

Custom configuration

argo-cd helm chart custom values

configs:
  cm:
    timeout.reconciliation: 120s
    timeout.reconciliation.jitter: 60s

  params:
    applicationsetcontroller.enable.progressive.syncs: true
    controller.k8sclient.retry.max: "3"
    reposerver.parallelism.limit: 10
    server.k8sclient.retry.max: "3"
    server.insecure: true

controller:
  env:
    - name: WORKQUEUE_BASE_DELAY_NS
      value: "5000000000"
    - name: WORKQUEUE_MAX_DELAY_NS
      value: "25000000000"
    - name: WORKQUEUE_FAILURE_COOLDOWN_NS
      value: "60000000000"

repoServer:
  env:
    - name: ARGOCD_GIT_ATTEMPTS_COUNT
      value: "3"
    - name: ARGOCD_HELM_ALLOW_CONCURRENCY
      value: "true"

Screenshots

ArgoCD notifications screenshot

Version

v2.13.3+a25c8a0

Logs

ArgoCD application controller logs

argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Refreshing app status (comparison expired, requesting refresh. reconciledAt: 2025-01-15 14:32:55 +0000 UTC, expiry: 2m0s), level (2)","project":"services","time":"2025-01-15T14:37:09Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:37:09Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":581,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:37:10Z","time_ms":581}
argocd-application-controller-0 application-controller {"application":"accounting-svc-app","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","level":"info","msg":"Updated sync status: Synced -\u003e OutOfSync","reason":"ResourceUpdated","time":"2025-01-15T14:37:10Z","type":"Normal"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Update successful","project":"services","time":"2025-01-15T14:37:10Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","app_status_update_ms":0,"application":"accounting-svc-app","auto_sync_ms":0,"compare_app_state_ms":627,"comparison-level":2,"comparison_with_nothing_ms":0,"dedup_ms":0,"dest-name":"in-cluster","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","diff_ms":42,"git_ms":581,"health_ms":0,"level":"info","live_ms":1,"msg":"Reconciliation completed","normalize_application_ms":1,"patch_ms":18,"persist_app_status_ms":24,"process_finalizers_ms":0,"project":"services","refresh_app_conditions_ms":0,"set_app_managed_resources_ms":12,"setop_ms":0,"settings_ms":0,"sync_ms":0,"time":"2025-01-15T14:37:10Z","time_ms":665}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"updated 'argo/accounting-svc-app' operation (phase: Running)","project":"services","time":"2025-01-15T14:37:15Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Initialized new operation: {\u0026SyncOperation{Revision:,Prune:true,DryRun:false,SyncStrategy:nil,Resources:[]SyncOperationResource{},Source:nil,Manifests:[],SyncOptions:[ApplyOutOfSyncOnly=true CreateNamespace=false FailOnSharedResource=true PruneLast=true],Sources:[]ApplicationSource{},Revisions:[],SelfHealAttemptsCount:0,} {applicationset-controller true} [\u0026Info{Name:Reason,Value:ApplicationSet RollingSync triggered a sync of this Application resource.,}] {-1 \u0026Backoff{Duration:5m,Factor:*1,MaxDuration:5m,}}}","project":"services","time":"2025-01-15T14:37:15Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:37:15Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":550,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:37:15Z","time_ms":551}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Syncing","skipHooks":false,"started":false,"syncId":"00019-aWeRt","time":"2025-01-15T14:37:15Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Tasks (dry-run)","syncId":"00019-aWeRt","tasks":"[PreSync/-2 hook /Secret:services/accounting-svc-migration-app nil-\u003eobj (,,), PreSync/-2 hook /ConfigMap:services/accounting-svc-migration-app nil-\u003eobj (,,), PreSync/-1 hook batch/Job:services/accounting-svc-migration nil-\u003eobj (,,), Sync/0 resource /ServiceAccount:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Secret:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /ConfigMap:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc-sidecar obj-\u003eobj (,,)]","time":"2025-01-15T14:37:15Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Running, message: '' -\u003e 'one or more tasks are running'","syncId":"00019-aWeRt","time":"2025-01-15T14:37:17Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Secret","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'secret/accounting-svc-migration-app created'","name":"accounting-svc-migration-app","namespace":"services","phase":"PreSync","syncId":"00019-aWeRt","time":"2025-01-15T14:37:17Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"ConfigMap","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'configmap/accounting-svc-migration-app created'","name":"accounting-svc-migration-app","namespace":"services","phase":"PreSync","syncId":"00019-aWeRt","time":"2025-01-15T14:37:17Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Running, message: 'one or more tasks are running' -\u003e 'waiting for completion of hook /Secret/accounting-svc-migration-app and 11 more hooks'","syncId":"00019-aWeRt","time":"2025-01-15T14:37:19Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","duration":3660311298,"level":"info","msg":"sync/terminate complete","syncId":"00019-aWeRt","time":"2025-01-15T14:37:19Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"updated 'argo/accounting-svc-app' operation (phase: Running)","project":"services","time":"2025-01-15T14:37:19Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Resuming in-progress operation. phase: Running, message: waiting for completion of hook /Secret/accounting-svc-migration-app and 11 more hooks","project":"services","time":"2025-01-15T14:37:26Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:37:26Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":236,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:37:27Z","time_ms":236}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Syncing","skipHooks":false,"started":true,"syncId":"00020-PawMm","time":"2025-01-15T14:37:27Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Tasks","syncId":"00020-PawMm","tasks":"[PreSync/-2 hook /Secret:services/accounting-svc-migration-app obj-\u003eobj (Synced,Running,secret/accounting-svc-migration-app created), PreSync/-2 hook /ConfigMap:services/accounting-svc-migration-app obj-\u003eobj (Synced,Running,configmap/accounting-svc-migration-app created), PreSync/-1 hook batch/Job:services/accounting-svc-migration nil-\u003eobj (,,), Sync/0 resource /ServiceAccount:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Secret:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /ConfigMap:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc-sidecar obj-\u003eobj (,,)]","time":"2025-01-15T14:37:27Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Secret","level":"info","msg":"Updating resource result, status: 'Synced' -\u003e '', phase 'Running' -\u003e 'Succeeded', message 'secret/accounting-svc-migration-app created' -\u003e 'accounting-svc-migration-app created'","name":"accounting-svc-migration-app","namespace":"services","phase":"PreSync","syncId":"00020-PawMm","time":"2025-01-15T14:37:27Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"ConfigMap","level":"info","msg":"Updating resource result, status: 'Synced' -\u003e '', phase 'Running' -\u003e 'Succeeded', message 'configmap/accounting-svc-migration-app created' -\u003e 'accounting-svc-migration-app created'","name":"accounting-svc-migration-app","namespace":"services","phase":"PreSync","syncId":"00020-PawMm","time":"2025-01-15T14:37:27Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Running, message: 'waiting for completion of hook /Secret/accounting-svc-migration-app and 11 more hooks' -\u003e 'one or more tasks are running'","syncId":"00020-PawMm","time":"2025-01-15T14:37:27Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Job","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/accounting-svc-migration created'","name":"accounting-svc-migration","namespace":"services","phase":"PreSync","syncId":"00020-PawMm","time":"2025-01-15T14:37:27Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Running, message: 'one or more tasks are running' -\u003e 'waiting for completion of hook batch/Job/accounting-svc-migration and 9 more hooks'","syncId":"00020-PawMm","time":"2025-01-15T14:37:29Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","duration":2088922625,"level":"info","msg":"sync/terminate complete","syncId":"00020-PawMm","time":"2025-01-15T14:37:29Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"updated 'argo/accounting-svc-app' operation (phase: Running)","project":"services","time":"2025-01-15T14:37:29Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Refreshing app status (controller refresh requested), level (1)","project":"services","time":"2025-01-15T14:37:34Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:37:34Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":23,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:37:34Z","time_ms":23}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Update successful","project":"services","time":"2025-01-15T14:37:34Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","app_status_update_ms":0,"application":"accounting-svc-app","auto_sync_ms":0,"compare_app_state_ms":84,"comparison-level":1,"comparison_with_nothing_ms":0,"dedup_ms":0,"dest-name":"in-cluster","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","diff_ms":56,"git_ms":24,"health_ms":0,"level":"info","live_ms":2,"msg":"Reconciliation completed","normalize_application_ms":1,"patch_ms":38,"persist_app_status_ms":39,"process_finalizers_ms":0,"project":"services","refresh_app_conditions_ms":0,"set_app_managed_resources_ms":22,"setop_ms":0,"settings_ms":0,"sync_ms":0,"time":"2025-01-15T14:37:34Z","time_ms":148}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Resuming in-progress operation. phase: Running, message: waiting for completion of hook batch/Job/accounting-svc-migration and 9 more hooks","project":"services","time":"2025-01-15T14:37:54Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:37:54Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":238,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:37:54Z","time_ms":238}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Syncing","skipHooks":false,"started":true,"syncId":"00021-ytlIE","time":"2025-01-15T14:37:54Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Tasks","syncId":"00021-ytlIE","tasks":"[PreSync/-2 hook /Secret:services/accounting-svc-migration-app obj-\u003eobj (,Succeeded,accounting-svc-migration-app created), PreSync/-2 hook /ConfigMap:services/accounting-svc-migration-app obj-\u003eobj (,Succeeded,accounting-svc-migration-app created), PreSync/-1 hook batch/Job:services/accounting-svc-migration obj-\u003eobj (Synced,Running,job.batch/accounting-svc-migration created), Sync/0 resource /ServiceAccount:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Secret:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /ConfigMap:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc-sidecar obj-\u003eobj (,,)]","time":"2025-01-15T14:37:54Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Job","level":"info","msg":"Updating resource result, status: 'Synced' -\u003e '', phase 'Running' -\u003e 'Succeeded', message 'job.batch/accounting-svc-migration created' -\u003e 'Reached expected number of succeeded pods'","name":"accounting-svc-migration","namespace":"services","phase":"PreSync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:54Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Running, message: 'waiting for completion of hook batch/Job/accounting-svc-migration and 9 more hooks' -\u003e 'one or more tasks are running'","syncId":"00021-ytlIE","time":"2025-01-15T14:37:54Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"ServiceAccount","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'serviceaccount/accounting-svc configured'","name":"accounting-svc","namespace":"services","phase":"Sync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:56Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Secret","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'secret/accounting-svc configured'","name":"accounting-svc","namespace":"services","phase":"Sync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:56Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"ConfigMap","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'configmap/accounting-svc configured'","name":"accounting-svc","namespace":"services","phase":"Sync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:56Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Service","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'service/accounting-svc configured'","name":"accounting-svc","namespace":"services","phase":"Sync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:56Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Service","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'service/accounting-svc-sidecar configured'","name":"accounting-svc-sidecar","namespace":"services","phase":"Sync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:56Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Deployment","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'deployment.apps/accounting-svc configured'","name":"accounting-svc","namespace":"services","phase":"Sync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:56Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Deployment","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'deployment.apps/accounting-svc-sidecar configured'","name":"accounting-svc-sidecar","namespace":"services","phase":"Sync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:56Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"ServiceEntry","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'serviceentry.networking.istio.io/accounting-svc-sidecar configured'","name":"accounting-svc-sidecar","namespace":"services","phase":"Sync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:58Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"ServiceEntry","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'serviceentry.networking.istio.io/accounting-svc configured'","name":"accounting-svc","namespace":"services","phase":"Sync","syncId":"00021-ytlIE","time":"2025-01-15T14:37:58Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Succeeded, message: 'one or more tasks are running' -\u003e 'successfully synced (all tasks run)'","syncId":"00021-ytlIE","time":"2025-01-15T14:37:58Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","duration":3672359437,"level":"info","msg":"sync/terminate complete","syncId":"00021-ytlIE","time":"2025-01-15T14:37:58Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"updated 'argo/accounting-svc-app' operation (phase: Succeeded)","project":"services","time":"2025-01-15T14:37:58Z"}
argocd-application-controller-0 application-controller {"application":"accounting-svc-app","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","level":"info","msg":"Sync operation to  succeeded","reason":"OperationCompleted","time":"2025-01-15T14:37:58Z","type":"Normal"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Refreshing app status (controller refresh requested), level (3)","project":"services","time":"2025-01-15T14:37:59Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:37:59Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":734,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:38:00Z","time_ms":734}
argocd-application-controller-0 application-controller {"application":"accounting-svc-app","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","level":"info","msg":"Updated sync status: OutOfSync -\u003e Synced","reason":"ResourceUpdated","time":"2025-01-15T14:38:00Z","type":"Normal"}
argocd-application-controller-0 application-controller {"application":"accounting-svc-app","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","level":"info","msg":"Updated health status: Healthy -\u003e Progressing","reason":"ResourceUpdated","time":"2025-01-15T14:38:00Z","type":"Normal"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Update successful","project":"services","time":"2025-01-15T14:38:00Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","app_status_update_ms":0,"application":"accounting-svc-app","auto_sync_ms":0,"compare_app_state_ms":881,"comparison-level":3,"comparison_with_nothing_ms":0,"dedup_ms":0,"dest-name":"in-cluster","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","diff_ms":137,"git_ms":734,"health_ms":1,"level":"info","live_ms":6,"msg":"Reconciliation completed","normalize_application_ms":19,"patch_ms":120,"persist_app_status_ms":250,"process_finalizers_ms":0,"project":"services","refresh_app_conditions_ms":0,"set_app_managed_resources_ms":83,"setop_ms":0,"settings_ms":0,"sync_ms":0,"time":"2025-01-15T14:38:00Z","time_ms":1234}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"updated 'argo/accounting-svc-app' operation (phase: Running)","project":"services","time":"2025-01-15T14:38:23Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Initialized new operation: {\u0026SyncOperation{Revision:,Prune:true,DryRun:false,SyncStrategy:nil,Resources:[]SyncOperationResource{},Source:nil,Manifests:[],SyncOptions:[ApplyOutOfSyncOnly=true CreateNamespace=false FailOnSharedResource=true PruneLast=true],Sources:[]ApplicationSource{},Revisions:[],SelfHealAttemptsCount:0,} {applicationset-controller true} [\u0026Info{Name:Reason,Value:ApplicationSet RollingSync triggered a sync of this Application resource.,}] {-1 \u0026Backoff{Duration:5m,Factor:*1,MaxDuration:5m,}}}","project":"services","time":"2025-01-15T14:38:23Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:38:23Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":588,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:38:23Z","time_ms":588}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Syncing","skipHooks":false,"started":false,"syncId":"00022-wtweu","time":"2025-01-15T14:38:24Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Tasks (dry-run)","syncId":"00022-wtweu","tasks":"[PreSync/-2 hook /Secret:services/accounting-svc-migration-app nil-\u003eobj (,,), PreSync/-2 hook /ConfigMap:services/accounting-svc-migration-app nil-\u003eobj (,,), PreSync/-1 hook batch/Job:services/accounting-svc-migration nil-\u003eobj (,,)]","time":"2025-01-15T14:38:24Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Running, message: '' -\u003e 'one or more tasks are running'","syncId":"00022-wtweu","time":"2025-01-15T14:38:24Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Secret","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'secret/accounting-svc-migration-app created'","name":"accounting-svc-migration-app","namespace":"services","phase":"PreSync","syncId":"00022-wtweu","time":"2025-01-15T14:38:24Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"ConfigMap","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'configmap/accounting-svc-migration-app created'","name":"accounting-svc-migration-app","namespace":"services","phase":"PreSync","syncId":"00022-wtweu","time":"2025-01-15T14:38:24Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Refreshing app status (controller refresh requested), level (1)","project":"services","time":"2025-01-15T14:38:25Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:38:25Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":20,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:38:25Z","time_ms":20}
argocd-application-controller-0 application-controller {"application":"accounting-svc-app","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","level":"info","msg":"Updated health status: Progressing -\u003e Healthy","reason":"ResourceUpdated","time":"2025-01-15T14:38:25Z","type":"Normal"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Update successful","project":"services","time":"2025-01-15T14:38:25Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","app_status_update_ms":0,"application":"accounting-svc-app","auto_sync_ms":0,"compare_app_state_ms":78,"comparison-level":1,"comparison_with_nothing_ms":0,"dedup_ms":0,"dest-name":"in-cluster","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","diff_ms":53,"git_ms":21,"health_ms":1,"level":"info","live_ms":1,"msg":"Reconciliation completed","normalize_application_ms":2,"patch_ms":30,"persist_app_status_ms":38,"process_finalizers_ms":0,"project":"services","refresh_app_conditions_ms":0,"set_app_managed_resources_ms":36,"setop_ms":0,"settings_ms":0,"sync_ms":0,"time":"2025-01-15T14:38:25Z","time_ms":155}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Running, message: 'one or more tasks are running' -\u003e 'waiting for completion of hook /Secret/accounting-svc-migration-app and 2 more hooks'","syncId":"00022-wtweu","time":"2025-01-15T14:38:26Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","duration":2453484407,"level":"info","msg":"sync/terminate complete","syncId":"00022-wtweu","time":"2025-01-15T14:38:26Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"updated 'argo/accounting-svc-app' operation (phase: Running)","project":"services","time":"2025-01-15T14:38:26Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Resuming in-progress operation. phase: Running, message: waiting for completion of hook /Secret/accounting-svc-migration-app and 2 more hooks","project":"services","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":141,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:38:48Z","time_ms":141}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Syncing","skipHooks":false,"started":true,"syncId":"00023-bWalb","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Tasks","syncId":"00023-bWalb","tasks":"[PreSync/-2 hook /Secret:services/accounting-svc-migration-app obj-\u003eobj (Synced,Running,secret/accounting-svc-migration-app created), PreSync/-2 hook /ConfigMap:services/accounting-svc-migration-app obj-\u003eobj (Synced,Running,configmap/accounting-svc-migration-app created), PreSync/-1 hook batch/Job:services/accounting-svc-migration nil-\u003eobj (,,), Sync/0 resource /ServiceAccount:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Secret:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /ConfigMap:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc-sidecar obj-\u003eobj (,,)]","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Secret","level":"info","msg":"Updating resource result, status: 'Synced' -\u003e '', phase 'Running' -\u003e 'Succeeded', message 'secret/accounting-svc-migration-app created' -\u003e 'accounting-svc-migration-app created'","name":"accounting-svc-migration-app","namespace":"services","phase":"PreSync","syncId":"00023-bWalb","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"ConfigMap","level":"info","msg":"Updating resource result, status: 'Synced' -\u003e '', phase 'Running' -\u003e 'Succeeded', message 'configmap/accounting-svc-migration-app created' -\u003e 'accounting-svc-migration-app created'","name":"accounting-svc-migration-app","namespace":"services","phase":"PreSync","syncId":"00023-bWalb","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Running, message: 'waiting for completion of hook /Secret/accounting-svc-migration-app and 2 more hooks' -\u003e 'one or more tasks are running'","syncId":"00023-bWalb","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Job","level":"info","msg":"Adding resource result, status: 'Synced', phase: 'Running', message: 'job.batch/accounting-svc-migration created'","name":"accounting-svc-migration","namespace":"services","phase":"PreSync","syncId":"00023-bWalb","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Running, message: 'one or more tasks are running' -\u003e 'waiting for completion of hook batch/Job/accounting-svc-migration'","syncId":"00023-bWalb","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","duration":79969107,"level":"info","msg":"sync/terminate complete","syncId":"00023-bWalb","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"updated 'argo/accounting-svc-app' operation (phase: Running)","project":"services","time":"2025-01-15T14:38:48Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Refreshing app status (controller refresh requested), level (1)","project":"services","time":"2025-01-15T14:38:50Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:38:50Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":119,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:38:50Z","time_ms":119}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Update successful","project":"services","time":"2025-01-15T14:38:50Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","app_status_update_ms":0,"application":"accounting-svc-app","auto_sync_ms":0,"compare_app_state_ms":264,"comparison-level":1,"comparison_with_nothing_ms":0,"dedup_ms":0,"dest-name":"in-cluster","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","diff_ms":136,"git_ms":122,"health_ms":1,"level":"info","live_ms":3,"msg":"Reconciliation completed","normalize_application_ms":2,"patch_ms":50,"persist_app_status_ms":51,"process_finalizers_ms":0,"project":"services","refresh_app_conditions_ms":0,"set_app_managed_resources_ms":22,"setop_ms":0,"settings_ms":0,"sync_ms":0,"time":"2025-01-15T14:38:50Z","time_ms":340}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"Resuming in-progress operation. phase: Running, message: waiting for completion of hook batch/Job/accounting-svc-migration","project":"services","time":"2025-01-15T14:39:13Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Comparing app state (cluster: https://kubernetes.default.svc, namespace: services)","time":"2025-01-15T14:39:13Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","build_options_ms":0,"level":"info","manifests_ms":138,"msg":"GetRepoObjs stats","plugins_ms":0,"repo_ms":0,"time":"2025-01-15T14:39:13Z","time_ms":138}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Syncing","skipHooks":false,"started":true,"syncId":"00024-aHFJF","time":"2025-01-15T14:39:13Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Tasks","syncId":"00024-aHFJF","tasks":"[PreSync/-2 hook /Secret:services/accounting-svc-migration-app obj-\u003eobj (,Succeeded,accounting-svc-migration-app created), PreSync/-2 hook /ConfigMap:services/accounting-svc-migration-app obj-\u003eobj (,Succeeded,accounting-svc-migration-app created), PreSync/-1 hook batch/Job:services/accounting-svc-migration obj-\u003eobj (Synced,Running,job.batch/accounting-svc-migration created), Sync/0 resource /ServiceAccount:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Secret:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /ConfigMap:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource /Service:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource apps/Deployment:services/accounting-svc-sidecar obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc obj-\u003eobj (,,), Sync/0 resource networking.istio.io/ServiceEntry:services/accounting-svc-sidecar obj-\u003eobj (,,)]","time":"2025-01-15T14:39:13Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","kind":"Job","level":"info","msg":"Updating resource result, status: 'Synced' -\u003e '', phase 'Running' -\u003e 'Succeeded', message 'job.batch/accounting-svc-migration created' -\u003e 'Reached expected number of succeeded pods'","name":"accounting-svc-migration","namespace":"services","phase":"PreSync","syncId":"00024-aHFJF","time":"2025-01-15T14:39:13Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","level":"info","msg":"Updating operation state. phase: Running -\u003e Succeeded, message: 'waiting for completion of hook batch/Job/accounting-svc-migration' -\u003e 'successfully synced (no more tasks)'","syncId":"00024-aHFJF","time":"2025-01-15T14:39:14Z"}
argocd-application-controller-0 application-controller {"application":"argo/accounting-svc-app","duration":63152513,"level":"info","msg":"sync/terminate complete","syncId":"00024-aHFJF","time":"2025-01-15T14:39:14Z"}
argocd-application-controller-0 application-controller {"app-namespace":"argo","app-qualified-name":"argo/accounting-svc-app","application":"accounting-svc-app","level":"info","msg":"updated 'argo/accounting-svc-app' operation (phase: Succeeded)","project":"services","time":"2025-01-15T14:39:14Z"}
argocd-application-controller-0 application-controller {"application":"accounting-svc-app","dest-namespace":"services","dest-server":"https://kubernetes.default.svc","level":"info","msg":"Sync operation to  succeeded","reason":"OperationCompleted","time":"2025-01-15T14:39:14Z","type":"Normal"}