fix: fix credential mismatch for opensearch

[IcyKallen]

Fixes #

🤖 AI-Generated PR Description (Powered by Amazon Bedrock)

Description

This pull request includes modifications to several Python files within the project. The changes aim to enhance the functionality and improve the overall performance of the application.

In the intention.py file, the modifications address a bug related to the handling of user intentions, ensuring that the application correctly interprets and responds to user input.

The glue-job-script.py file has been updated to introduce a new feature that optimizes the data processing pipeline, resulting in faster execution times and improved resource utilization.

Additionally, the aos_retrievers.py file has been modified to include a breaking change that refactors the retrieval logic for language models. This change may require existing functionality to be updated to ensure compatibility with the new implementation.

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

File Stats Summary

File number involved in this PR: 3, unfold to see the details:

The file changes summary is as follows:

Files	Changes	Change Summary
source/lambda/job/glue-job-script.py	4 added, 0 removed	The code adds exception handling for an InvalidRequestException when retrieving AWS Secrets Manager secrets, logs a message, and falls back to IAM authentication.
source/lambda/online/common_logic/langchain_integration/retrievers/utils/aos_retrievers.py	4 added, 0 removed	The code changes handle an additional exception case, InvalidRequestException, which may occur when trying to retrieve a secret that is being deleted, and fall back to IAM authentication for the OpenSearch client.
source/lambda/intention/intention.py	6 added, 0 removed	The code changes handle an InvalidRequestException that may occur when retrieving a secret value from a deleting secret, and fallback to authentication with IAM credentials in such cases.