Very bad reasoning accuracy

[hmirheydari]

I've fed some Persian MS Word files into llm-graph-builder.neo4jlabs.com and asked some question, it answered 1 out of 5 questions while simple RAG solutions like chatize.com answered all 5 questions correctly, I doubt is its performance less than legacy RAGs or I made a mistake

[kartikpersistent]

Hi @hmirheydari Can you share the Persian MS Word files we will try at our end and let you know what happening behind the scenes that is impacting the accuracy.

[hmirheydari]

سوالات تخصصی برای تعیین نیازمندی.docx

here is the file

[kaustubh-darekar]

@hmirheydari thank you for sharing the file. Can you also share sample questions you tried, we will test same at our end.