-
Notifications
You must be signed in to change notification settings - Fork 423
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(llmobs): introduce ragas eval integration #12143
Conversation
|
Datadog ReportBranch report: ✅ 0 Failed, 130 Passed, 1468 Skipped, 5m 5.47s Total duration (35m 38.84s time saved) |
BenchmarksBenchmark execution time: 2025-01-31 17:27:51 Comparing candidate commit 7fbfc76 in PR branch Found 0 performance improvements and 0 performance regressions! Performance is the same for 394 metrics, 2 unstable metrics. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
small thing, good to go once addressed!
…ce-py into evan.li/release-ragas-3.0
Publicize the RAGAS integration
RAGAS is an evaluation framework for RAG Applications. The integration supports evaluating LLM inferences with three RAGAS metrics
dupe of #11939 to get in ddtrace 3.0
Checklist
Reviewer Checklist