Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: fix txt preprocessing error #492

Merged
merged 1 commit into from
Dec 24, 2024
Merged

fix: fix txt preprocessing error #492

merged 1 commit into from
Dec 24, 2024

Conversation

IcyKallen
Copy link
Contributor

@IcyKallen IcyKallen commented Dec 24, 2024

Fixes #

🤖 AI-Generated PR Description (Powered by Amazon Bedrock)

Description

This pull request includes changes to the llm_bot_dep package. The source/lambda/job/dep/dist/llm_bot_dep-0.1.0-py3-none-any.whl file has an error, which needs to be resolved. Additionally, the source/lambda/job/dep/llm_bot_dep/loaders/text.py file has been modified.

The motivation behind these changes is to ensure the proper functioning of the llm_bot_dep package and its dependencies. The modified text.py file likely includes bug fixes or improvements to the text loading functionality.

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

File Stats Summary

File number involved in this PR: 1, unfold to see the details:

The file changes summary is as follows:

Files
Changes
Change Summary
source/lambda/job/dep/llm_bot_dep/loaders/text.py 1 added, 1 removed The code change modifies the regular expression pattern used for removing multiple whitespace characters, now including non-whitespace control characters, in the text pre-processing step.

@NingLu NingLu merged commit db47788 into dev Dec 24, 2024
6 checks passed
@IcyKallen IcyKallen deleted the xuhan-dev branch December 25, 2024 09:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants