Skip to content
This repository has been archived by the owner on Jan 7, 2025. It is now read-only.

update test results for no tags by default #573

Merged
merged 1 commit into from
Apr 25, 2024
Merged

Conversation

granawkins
Copy link
Member

Pull Request Checklist

  • Documentation has been updated, or this change doesn't require that

@@ -213,20 +213,20 @@ def func_4(string):
mock_session_context.config.auto_context_tokens = 8000

code_message = await code_context.get_code_message(0, prompt="prompt")
assert mock_session_context.llm_api_handler.spice.count_tokens(code_message, "gpt-4", is_message=True) == 95 # Code
assert mock_session_context.llm_api_handler.spice.count_tokens(code_message, "gpt-4", is_message=True) == 85 # Code
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Although the change from including tags like (search-result, user-included) in the code message output to a simplified version without these tags could make the output cleaner, it's important to consider if any downstream processes or users rely on these tags for context or filtering. If so, it would be beneficial to include a rationale or address potential impacts in the pull request description.

@@ -51,7 +51,7 @@ async def test_partial_files(mocker, mock_session_context):
"""\
Code Files:

dir/file.txt (user-included)
dir/file.txt
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar to my previous comment, ensure that removing (user-included) from the code message doesn't negatively affect how users interact with or understand the output, especially in environments where clarity of source or inclusion reason might be significant.

@mentatai
Copy link
Contributor

mentatai bot commented Apr 24, 2024

MENTAT CODE REVIEW IN ACTIVE DEVELOPMENT. Only in use on mentat and internal repos.
Please Reply with feedback.

The pull request aims to update test conditions for test_max_auto_tokens and adjust the output format in code message summaries by removing tags. It's crucial to ensure that these changes do not unintentionally obscure important information or functionalities that might depend on the previous output format.

@granawkins granawkins merged commit 1200fb7 into main Apr 25, 2024
16 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant