Skip to content

Commit

Permalink
Update benchmark-checklist.md
Browse files Browse the repository at this point in the history
  • Loading branch information
arjunsuresh authored Feb 1, 2025
1 parent a8e32ef commit 5911864
Showing 1 changed file with 11 additions and 11 deletions.
22 changes: 11 additions & 11 deletions automotive/3d-object-detection/benchmark-checklist.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,13 +48,11 @@ Documented whether **Equal Issue Mode** is applicable in
---

#### **9. Reference Implementation Test Coverage**
- [ ] Reference implementation successfully runs the entire validation dataset during:
- [ ] Performance runs
- [ ] Accuracy runs
- [ ] Compliance runs
- [X] Log files passing the submission checker are generated for all Divisions.
- [X] Closed
- [X] Open
- [X] Reference implementation successfully does:
- [X] Performance runs
- [X] Accuracy runs
- [X] Compliance runs


---

Expand All @@ -66,9 +64,9 @@ Documented whether **Equal Issue Mode** is applicable in
---

#### **11. Dataset and Reference Model Instructions**
- [ ] Clear instructions provided for:
- [ ] Downloading the dataset and reference model.
- [ ] Using the dataset and model for the benchmark.
- [X] Clear instructions provided for:
- [X] Downloading the dataset and reference model.
- [X] Using the dataset and model for the benchmark.

---

Expand All @@ -86,4 +84,6 @@ Documented whether **Equal Issue Mode** is applicable in
- [ ] Include sample logs for all the applicable scenario runs:
- [ ] `mlperf_log_summary.txt`
- [ ] `mlperf_log_detail.txt`
- [ ] Ensure sample logs successfully pass the submission checker and applicable compliance runs.
- [X] Log files passing the submission checker are generated for all Divisions.
- [X] Closed
- [X] Open

0 comments on commit 5911864

Please sign in to comment.