Skip to content

Commit

Permalink
provide detailed instruction for guidance
Browse files Browse the repository at this point in the history
  • Loading branch information
lwaekfjlk committed Feb 29, 2024
1 parent 2af42ed commit 05fe001
Show file tree
Hide file tree
Showing 3 changed files with 4 additions and 10 deletions.
3 changes: 1 addition & 2 deletions human_eval/README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Human Evaluation for Sotopia-$\pi$
# Human Evaluation for Sotopia Social Conversation

To conduct highly customized human evaluation experiments for Sotopia-$\pi$, we utilize **Prolific** platform to get high-quality annotators and utilize **oTree** to build the full-stack evaluation system.

Expand Down Expand Up @@ -91,4 +91,3 @@ To release on Prolific, we need to get a release link that annotators can direct
Secondly, we just put the release link into the Prolific project setting.

![prolific_release](figs/prolific_release.png)

2 changes: 1 addition & 1 deletion human_eval/_rooms/econ101.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
Alice
Bob
Charlie
Charlie
9 changes: 2 additions & 7 deletions human_eval/_templates/global/Page.html
Original file line number Diff line number Diff line change
@@ -1,7 +1,2 @@
{{ extends "otree/Page.html" }}
{{ load otree }}

{{ block global_styles }}
{{ endblock }}
{{ block global_scripts }}
{{ endblock }}
{{ extends "otree/Page.html" }} {{ load otree }} {{ block global_styles }} {{
endblock }} {{ block global_scripts }} {{ endblock }}

0 comments on commit 05fe001

Please sign in to comment.