You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As I understand it, this behaviour is general to all AWS sdks, and this error is considered non-retryable because the requests in question may not be idempotent.
In our case, for the sqs source the request will always be idempotent, and we should retry. We can achieve this (as the AWS sdk maintainers advise on the above isssues) by adding a retryer.
As far as I can see, this bug shouldn't have much of an impact on the app in production as we currently use it - when we hit it we will simply return an error, crash, and reboot without data loss.
The text was updated successfully, but these errors were encountered:
Came across this while building the e2e tests, which use localstack - SQS on localstack seems relatively flaky so we seem to hit it consistently (at least on 0.11 localstack, which is fairly old by now).
A quick check into sentry shows that we do indeed hit this every now and again in prod, for a couple of different deployments - looks consistent with what I'd expect for the scenario I describe above.
Currently, we return an error and shut down if the sqs client returns any error.
In the case of a connection reset error, the behaviour of the sdks will be to treat it as non-retryable: aws/aws-sdk-go#3027, aws/aws-sdk-go#3971.
As I understand it, this behaviour is general to all AWS sdks, and this error is considered non-retryable because the requests in question may not be idempotent.
In our case, for the sqs source the request will always be idempotent, and we should retry. We can achieve this (as the AWS sdk maintainers advise on the above isssues) by adding a retryer.
As far as I can see, this bug shouldn't have much of an impact on the app in production as we currently use it - when we hit it we will simply return an error, crash, and reboot without data loss.
The text was updated successfully, but these errors were encountered: