Skip to content

Commit

Permalink
Update src/lighteval/metrics/dynamic_metrics.py
Browse files Browse the repository at this point in the history
Co-authored-by: Clémentine Fourrier <[email protected]>
  • Loading branch information
hynky1999 and clefourrier authored Jan 13, 2025
1 parent c24870e commit 2086fe7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/lighteval/metrics/dynamic_metrics.py
Original file line number Diff line number Diff line change
Expand Up @@ -249,7 +249,7 @@ def sample_level_fn(golds: list[str], predictions: list[str], formatted_doc: Doc
raise ValueError(f"No gold targets found for at least one gold. Gold: {golds}, Pred: {predictions}")

if all(len(p) == 0 for p in extracted_predictions):
logger.warning(f"No predictions found for all predictions. Gold: {golds}, Pred: {predictions}")
logger.warning(f"We did not manage to extract a prediction in the correct format. Gold: {golds}, Pred: {predictions}")

# We have to use timeout because the sypmy to str conversion can be very slow
try:
Expand Down

0 comments on commit 2086fe7

Please sign in to comment.