Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(service/prompt.py): optimize intention and generate with citation format #393

Merged
merged 9 commits into from
Oct 14, 2024

Conversation

tpoisonooo
Copy link
Collaborator

@tpoisonooo tpoisonooo commented Oct 12, 2024

  1. Use better json format to analyze intention and topic, remove LLM scoring
  2. Use citation prompt

For LLM response weak-relevant question

  1. Try higher reject_throttle
  2. Filter intention and topic
  3. Citation generation only workds when using larger ( >=14B ) LLM

@tpoisonooo tpoisonooo changed the title WIP: feat(service/prompt.py): optimize intention citation WIP: feat(service/prompt.py): optimize intention and generate with citation format Oct 13, 2024
@tpoisonooo tpoisonooo changed the title WIP: feat(service/prompt.py): optimize intention and generate with citation format feat(service/prompt.py): optimize intention and generate with citation format Oct 14, 2024
@tpoisonooo tpoisonooo merged commit 9c98f42 into main Oct 14, 2024
1 check passed
@tpoisonooo tpoisonooo deleted the optimize-intention-citation branch October 14, 2024 03:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant