feat: Add ReadingOrder and Markdown text evaluation #8
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Nikos Livathinos <[email protected]>
…s/stats.py Signed-off-by: Nikos Livathinos <[email protected]>
…e Distance metric Signed-off-by: Nikos Livathinos <[email protected]>
nikos-livathinos
requested review from
PeterStaar-IBM and
cau-git
and removed request for
PeterStaar-IBM and
cau-git
Signed-off-by: Nikos Livathinos <[email protected]>
Signed-off-by: Nikos Livathinos <[email protected]>
Signed-off-by: Nikos Livathinos <[email protected]>
nikos-livathinos
changed the title
… for dp-bench and omnidocbench Add the doc_id in the evaluation report Signed-off-by: Nikos Livathinos <[email protected]>
nikos-livathinos
force-pushed
the
nli/reading_order
branch
from
181d82f to
96a7d88
Compare
…own export of DoclingDocument. Use BLEU metric Signed-off-by: Nikos Livathinos <[email protected]>
…thout enforcing ascii to allow unicode characters Signed-off-by: Nikos Livathinos <[email protected]>
Signed-off-by: Nikos Livathinos <[email protected]>
Signed-off-by: Nikos Livathinos <[email protected]>
…before calling the reading-order Signed-off-by: Nikos Livathinos <[email protected]>
Signed-off-by: Nikos Livathinos <[email protected]>
Signed-off-by: Nikos Livathinos <[email protected]>
…luators/stats.py. Decouple the code to draw arrows in a separate function inside utils.py Delete unused code. Fix mypy issues. Signed-off-by: Nikos Livathinos <[email protected]>
…r the "reading-order" and the "markdown-text" modalities. Signed-off-by: Nikos Livathinos <[email protected]>
…for the plot Generate histogram plots for the reading_order and markdown_text visualizations Update Readme statistics for the reading_order and markdown_text modalities. Signed-off-by: Nikos Livathinos <[email protected]>
cau-git
approved these changes
Jan 16, 2025
…on the bbox size Signed-off-by: Nikos Livathinos <[email protected]>
Signed-off-by: Nikos Livathinos <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Introduce
ReadingOrderEvaluatorthat follows the pipeline: