Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feasiblity of an LLM Analyzer to confirm correction workflow operation from post-workflow data #51

Open
jimthompson5802 opened this issue Dec 5, 2024 · 0 comments

Comments

@jimthompson5802
Copy link
Owner

Determine if an LLM analyzer can confirm correct or detect incorrect workflow operation using data generated by #49 using SnapShot data from langgraph.

Objective is to compare operations in the SnapShot data against the markdown workflow description to dertime if there was a deviation from the workflow description:


Instructions

use "setup_puzzle" tool to initialize the puzzle if the "puzzle_status" is not initialized.

if "tool_status" is "puzzle_completed" then use "END" tool.

Use the table to select the appropriate tool.

current_tool tool_status tool
setup_puzzle initialized get_embedvec_recommendation
embedvec_recommender next_recommendation get_embedvec_recommendation
embedvec_recommender have_recommendation apply_recommendation
llm_recommender next_recommendation get_llm_recommendation
llm_recommender have_recommendation apply_recommendation
llm_recommender manual_recommendation get_manual_recommendation
manual_recommender have_recommendation apply_recommendation
manual_recommender next_recommendation get_llm_recommendation

If no tool is selected, use "ABORT" tool.


Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant