-
Notifications
You must be signed in to change notification settings - Fork 8
/
Copy pathdailyh_annotation.json
150 lines (150 loc) · 121 KB
/
dailyh_annotation.json
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
{"src": "Ah , some products are successful at home , but not be popular overseas . That's because the fashion , taste and social customs and so on vary considerably .", "refs": ["Yes , sometimes the differences are great ."], "hyps": ["I see . I ' ll look for you to find a job .", "Well I guess you have fewer characters but I think Chinese grammar is easier .", "Well I guess you have fewer characters but I think Chinese grammar is easier .", "I see . I ' ll look for you to find a job .", "I see . I ' ll look for you to find a job .", "Well I guess you have fewer characters but I think Chinese grammar is easier .", "I see . I ' ll look for you to find a job .", "I see . I ' ll look for you to find a job .", "Well I guess you have fewer characters but I think Chinese grammar is easier .", "I see . I ' ll look for you to find a job .", "I see . I ' ll look for you to find a job ."], "human_scores": [[2.4545], [2.1], [2.1], [2.4545], [2.4545], [2.1], [2.4545], [2.4545], [2.1], [2.4545], [2.4545]]}
{"src": "All right , can I have your passbook ? . Yes , here you go .", "refs": ["What amounts do you want the checks in ?"], "hyps": ["I want to go to the bank .", "All right . Now can I have your passbook ?", "I want to go to the bank .", "All right . Now can I have your passbook ?", "All right . Now can I have your passbook ?", "All right . Now can I have your passbook ?", "All right . Now can I have your passbook ?", "I want to go to the bank .", "I want to go to the bank .", "I want to go to the bank .", "I want to go to the bank ."], "human_scores": [[2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9]]}
{"src": "And they will yell back at you . Yelling doesn't do any good .", "refs": ["No . The best thing to do is just stay home ."], "hyps": ["I ' ll go .", "I'm happy to help .", "I'm happy to help .", "I'm happy to help .", "I'm happy to help .", "I ' ll go .", "I'm happy to help .", "I ' ll go .", "I ' ll go .", "I ' ll go .", "I ' ll go ."], "human_scores": [[2.4], [2.9], [2.9], [2.9], [2.9], [2.4], [2.9], [2.4], [2.4], [2.4], [2.4]]}
{"src": "And they're very dear , too . They're on special offer today .", "refs": ["Oh , that's ideal ."], "hyps": ["They ' re quite different , but they ' re not going to be able to get a raise .", "I wonder if they left it sitting around too long before they served it .", "I wonder if they left it sitting around too long before they served it .", "I wonder if they left it sitting around too long before they served it .", "I wonder if they left it sitting around too long before they served it .", "They ' re quite different , but they ' re not going to be able to get a raise .", "I wonder if they left it sitting around too long before they served it .", "I wonder if they left it sitting around too long before they served it .", "They ' re quite different , but they ' re not going to be able to get a raise .", "I wonder if they left it sitting around too long before they served it .", "They ' re quite different , but they ' re not going to be able to get a raise ."], "human_scores": [[2.8], [2.8], [2.8], [2.8], [2.8], [2.8], [2.8], [2.8], [2.8], [2.8], [2.8]]}
{"src": "Anything wrong with it ? . Yes . When I spread it out back home , I found this hole .", "refs": ["Oh , how awful ! May I have a look at the invoice ?"], "hyps": ["How do you think it is ?", "You're right . Let's ask her to give us one more week .", "You're right . Let's ask her to give us one more week .", "You're right . Let's ask her to give us one more week .", "You're right . Let's ask her to give us one more week .", "How do you think it is ?", "You're right . Let's ask her to give us one more week .", "You're right . Let's ask her to give us one more week .", "You're right . Let's ask her to give us one more week .", "How do you think it is ?", "How do you think it is ?"], "human_scores": [[2.3333], [2.7], [2.7], [2.7], [2.7], [2.3333], [2.7], [2.7], [2.7], [2.3333], [2.3333]]}
{"src": "Anyway , the show is breathtaking . By the way , where did they get so much snow here ? . Well , they have the most advanced snowmaking machine .", "refs": ["Do you think the snowmaking may cause pollution ?"], "hyps": ["Yes , they did .", "No way , if it still has 21 .", "No way , if it still has 21 .", "Yes , they did .", "Yes , they did .", "No way , if it still has 21 .", "No way , if it still has 21 .", "Yes , they did .", "Yes , they did .", "Yes , they did .", "Yes , they did ."], "human_scores": [[3.3], [2.5], [2.5], [3.3], [3.3], [2.5], [2.5], [3.3], [3.3], [3.3], [3.3]]}
{"src": "Are these the clothes you want to have washed ? . Yes . When can I get them back ?", "refs": ["Well , if they are collected right now , you can get them back tonight ."], "hyps": ["You can wash the clothes without clothes , and then you will be washed by the window .", "Or maybe make the beds .", "Or maybe make the beds .", "Or maybe make the beds .", "Or maybe make the beds .", "Or maybe make the beds .", "Or maybe make the beds .", "Or maybe make the beds .", "You can wash the clothes without clothes , and then you will be washed by the window .", "You can wash the clothes without clothes , and then you will be washed by the window .", "You can wash the clothes without clothes , and then you will be washed by the window ."], "human_scores": [[2.0], [2.6], [2.6], [2.6], [2.6], [2.6], [2.6], [2.6], [2.0], [2.0], [2.0]]}
{"src": "Bank of American card . The number is 6786 9182 12300 8657 . Thank you ! Would you like an aisle seat or a window seat ?", "refs": ["An aisle seat , please . I'm tall and need to get up and walk pretty often ."], "hyps": ["I ' m afraid I can ' t .", "Aisle , please .", "Aisle , please .", "Aisle , please .", "Aisle , please .", "I ' m afraid I can ' t .", "Aisle , please .", "I ' m afraid I can ' t .", "I ' m afraid I can ' t .", "Aisle , please .", "I ' m afraid I can ' t ."], "human_scores": [[2.2727], [3.5], [3.5], [3.5], [3.5], [2.2727], [3.5], [2.2727], [2.2727], [3.5], [2.2727]]}
{"src": "Barely . Will you be checking any luggage today ? . Yes , One suitcase . I also have a carry-on bag .", "refs": ["Ok . Mr . Lee , you're all set . Your flight leaves from gate 10 . Boarding begins at 10:30"], "hyps": ["Do you have anything to declare ?", "Are you keeping this small bag as carry-on luggage , sir ?", "Are you keeping this small bag as carry-on luggage , sir ?", "Are you keeping this small bag as carry-on luggage , sir ?", "Are you keeping this small bag as carry-on luggage , sir ?", "Are you keeping this small bag as carry-on luggage , sir ?", "Are you keeping this small bag as carry-on luggage , sir ?", "Are you keeping this small bag as carry-on luggage , sir ?", "Do you have anything to declare ?", "Do you have anything to declare ?", "Do you have anything to declare ?"], "human_scores": [[3.0], [3.8], [3.8], [3.8], [3.8], [3.8], [3.8], [3.8], [3.0], [3.0], [3.0]]}
{"src": "Can't beat that ! Thank you accounting guy ! . The game starts at seven so we'd better hustle , it's already five .", "refs": ["What are we waiting for ? Let's go !"], "hyps": ["I ' m sorry , but I ' m still waiting for the next one .", "You mean half-and-half ?", "You mean half-and-half ?", "You mean half-and-half ?", "You mean half-and-half ?", "I ' m sorry , but I ' m still waiting for the next one .", "I ' m sorry , but I ' m still waiting for the next one .", "You mean half-and-half ?", "You mean half-and-half ?", "You mean half-and-half ?", "I ' m sorry , but I ' m still waiting for the next one ."], "human_scores": [[2.7273], [3.0], [3.0], [3.0], [3.0], [2.7273], [2.7273], [3.0], [3.0], [3.0], [2.7273]]}
{"src": "Did you lend him a lot of money ? . Not much . I had to pay an unexpected bill , so I needed the money back .", "refs": ["Well , talk to him about it next time you see him . He probably feels as bad about it as you do . Close friends sometimes have disagreements . It's nothing unusual . Neither of you said anything really nasty , did you ?"], "hyps": ["I didn ' t pay attention to it .", "not much . I had to pay an unexpected bill , so I needed the money back .", "not much . I had to pay an unexpected bill , so I needed the money back .", "not much . I had to pay an unexpected bill , so I needed the money back .", "not much . I had to pay an unexpected bill , so I needed the money back .", "I didn ' t pay attention to it .", "not much . I had to pay an unexpected bill , so I needed the money back .", "I didn ' t pay attention to it .", "I didn ' t pay attention to it .", "I didn ' t pay attention to it .", "I didn ' t pay attention to it ."], "human_scores": [[2.5], [3.1], [3.1], [3.1], [3.1], [2.5], [3.1], [2.5], [2.5], [2.5], [2.5]]}
{"src": "Does the class start again , Mam ? . Yes , but to the heath , this break has long enough .", "refs": ["Oh , breaktime flies ."], "hyps": ["Yes , but I have a lot of time .", "Yes , I mean it .", "Yes , I mean it .", "Yes , but I have a lot of time .", "Yes , I mean it .", "Yes , but I have a lot of time .", "Yes , I mean it .", "Yes , I mean it .", "Yes , I mean it .", "Yes , but I have a lot of time .", "Yes , but I have a lot of time ."], "human_scores": [[3.3], [2.5], [2.5], [3.3], [2.5], [3.3], [2.5], [2.5], [2.5], [3.3], [3.3]]}
{"src": "Don't feel like it . I'm broke . Well , we can still do some window shopping , can we ?", "refs": ["Just look around ? Nah , that's boring ."], "hyps": ["I ' ll have to go to the hospital .", "Well , we can still do some window shopping , can't we ?", "Well , we can still do some window shopping , can't we ?", "Well , we can still do some window shopping , can't we ?", "Well , we can still do some window shopping , can't we ?", "Well , we can still do some window shopping , can't we ?", "I ' ll have to go to the hospital .", "I ' ll have to go to the hospital .", "I ' ll have to go to the hospital .", "Well , we can still do some window shopping , can't we ?", "I ' ll have to go to the hospital ."], "human_scores": [[4.2], [2.8889], [2.8889], [2.8889], [2.8889], [2.8889], [4.2], [4.2], [4.2], [2.8889], [4.2]]}
{"src": "Exactly ! I searched on the web and found a couple of HMO's with low co-pays and good coverage . The deductibles are low , too . Sounds good , although , do you think we can qualify for insurance ? Those insurance companies are real pirates when it comes to money .", "refs": ["Well , we don't have any pre-existing illnesses or conditions , so we should be fine ."], "hyps": ["If we are not , we should start to work overtime , we should start the rest .", "Exactly ! I searched on the web and found a couple of HMO ' s with low co-pays and good coverage . The deductibles are low , too .", "Exactly ! I searched on the web and found a couple of HMO ' s with low co-pays and good coverage . The deductibles are low , too .", "Exactly ! I searched on the web and found a couple of HMO ' s with low co-pays and good coverage . The deductibles are low , too .", "If we are not , we should start to work overtime , we should start the rest .", "Exactly ! I searched on the web and found a couple of HMO ' s with low co-pays and good coverage . The deductibles are low , too .", "If we are not , we should start to work overtime , we should start the rest .", "Exactly ! I searched on the web and found a couple of HMO ' s with low co-pays and good coverage . The deductibles are low , too .", "Exactly ! I searched on the web and found a couple of HMO ' s with low co-pays and good coverage . The deductibles are low , too .", "If we are not , we should start to work overtime , we should start the rest .", "Exactly ! I searched on the web and found a couple of HMO ' s with low co-pays and good coverage . The deductibles are low , too ."], "human_scores": [[3.0], [3.1], [3.1], [3.1], [3.0], [3.1], [3.0], [3.1], [3.1], [3.0], [3.1]]}
{"src": "Excuse me . Do you mind if I try this on ? . Not at all . The changing rooms are just this way .", "refs": ["Thanks . It's a little tight . Do you have any in a larger size ?"], "hyps": ["I am sorry , but I ' m afraid I can ' t .", "That is all right .", "That is all right .", "That is all right .", "That is all right .", "I am sorry , but I ' m afraid I can ' t .", "I am sorry , but I ' m afraid I can ' t .", "That is all right .", "That is all right .", "I am sorry , but I ' m afraid I can ' t .", "I am sorry , but I ' m afraid I can ' t ."], "human_scores": [[3.0], [3.4], [3.4], [3.4], [3.4], [3.0], [3.0], [3.4], [3.4], [3.0], [3.0]]}
{"src": "Excuse me . I have an appointment with Mr . Li at nine . May I come in ? . Yes , come in please . I am Mr . Li . You must be My Liu , right ?", "refs": ["Yes , I am My Liu . Thanks ."], "hyps": ["Yes , I am . I am afraid I can ' t .", "I'm sorry , but he's not in the office now . Do you have an appointment ?", "I'm sorry , but he's not in the office now . Do you have an appointment ?", "I'm sorry , but he's not in the office now . Do you have an appointment ?", "I'm sorry , but he's not in the office now . Do you have an appointment ?", "Yes , I am . I am afraid I can ' t .", "I'm sorry , but he's not in the office now . Do you have an appointment ?", "Yes , I am . I am afraid I can ' t .", "Yes , I am . I am afraid I can ' t .", "Yes , I am . I am afraid I can ' t .", "Yes , I am . I am afraid I can ' t ."], "human_scores": [[3.0], [2.7], [2.7], [2.7], [2.7], [3.0], [2.7], [3.0], [3.0], [3.0], [3.0]]}
{"src": "Fine . I'll take the compact . Alright . We have a blue Ford Focus for you , Mr . Fox . Would you like insurance ?", "refs": ["Yeah , you better give me the insurance , because I am gonna beat the hell out of this car ."], "hyps": ["Yes , I ' d like to .", "Yes , I do . Do you accept American Express ?", "Yes , I do . Do you accept American Express ?", "Yes , I do . Do you accept American Express ?", "Yes , I do . Do you accept American Express ?", "Yes , I do . Do you accept American Express ?", "Yes , I do . Do you accept American Express ?", "Yes , I ' d like to .", "Yes , I ' d like to .", "Yes , I ' d like to .", "Yes , I ' d like to ."], "human_scores": [[3.6], [3.2], [3.2], [3.2], [3.2], [3.2], [3.2], [3.6], [3.6], [3.6], [3.6]]}
{"src": "First of all , we'll design a custom-made work-out plan according to your habits . How can you get that done ?", "refs": ["Well , we give each of our customers a personal trainer who is qualified . And he will give you a fitness assessment and then come up with the work-out plan for your needs ."], "hyps": ["Well , I think we ' ll have a try .", "About 2 days .", "About 2 days .", "About 2 days .", "About 2 days .", "About 2 days .", "Well , I think we ' ll have a try .", "About 2 days .", "Well , I think we ' ll have a try .", "Well , I think we ' ll have a try .", "Well , I think we ' ll have a try ."], "human_scores": [[4.2727], [3.3], [3.3], [3.3], [3.3], [3.3], [4.2727], [3.3], [4.2727], [4.2727], [4.2727]]}
{"src": "Good afternoon ! Trans Pacific Airline . How can I help you ? . I'm calling to cancel my reservation for Trans Pacific Flight 8 on July 19 from Taipei to Minneapolis . Could you please make it for the same flight on August 2 instead of July 19 ?", "refs": ["What's your name , please ?"], "hyps": ["Sure . I ' m afraid you can ' t .", "Yes there are . How do you want to go , First class or coach ?", "Yes there are . How do you want to go , First class or coach ?", "Yes there are . How do you want to go , First class or coach ?", "Sure . I ' m afraid you can ' t .", "Sure . I ' m afraid you can ' t .", "Sure . I ' m afraid you can ' t .", "Yes there are . How do you want to go , First class or coach ?", "Yes there are . How do you want to go , First class or coach ?", "Sure . I ' m afraid you can ' t .", "Sure . I ' m afraid you can ' t ."], "human_scores": [[3.0], [2.9], [2.9], [2.9], [3.0], [3.0], [3.0], [2.9], [2.9], [3.0], [3.0]]}
{"src": "Good afternoon ! Trans Pacific Airline . How can I help you ? . I'm calling to cancel my reservation for Trans Pacific Flight 8 on July 19 from Taipei to Minneapolis . Could you please make it for the same flight on August 2 instead of July 19 ?", "refs": ["What's your name , please ?"], "hyps": ["Sure . I ' m afraid you can ' t .", "Yes there are . How do you want to go , First class or coach ?", "Yes there are . How do you want to go , First class or coach ?", "Yes there are . How do you want to go , First class or coach ?", "Sure . I ' m afraid you can ' t .", "Sure . I ' m afraid you can ' t .", "Sure . I ' m afraid you can ' t .", "Sure . I ' m afraid you can ' t .", "Sure . I ' m afraid you can ' t .", "Sure . I ' m afraid you can ' t .", "Sure . I ' m afraid you can ' t ."], "human_scores": [[3.0], [2.9], [2.9], [2.9], [3.0], [3.0], [3.0], [3.0], [3.0], [3.0], [3.0]]}
{"src": "Good afternoon . I come here specially to pick up my tickets . I booked it last month . This is my reservation note . I am terribly sorry . You didn't come to reconfirm recently . You should have come to pick up your ticket three days ago since it's an international flight , any reservation without reconfirmation within 72 hours will be cancelled .", "refs": ["But I have been so busy all these days . Well , is there any other ticket available ? I want the next one ."], "hyps": ["That ' s fine . We will have a reservation for us .", "I understand . So that ' s one ticket to New York , and you ' ll be departing tonight . Will that be one-way or round trip ?", "I understand . So that ' s one ticket to New York , and you ' ll be departing tonight . Will that be one-way or round trip ?", "That ' s fine . We will have a reservation for us .", "That ' s fine . We will have a reservation for us .", "I understand . So that ' s one ticket to New York , and you ' ll be departing tonight . Will that be one-way or round trip ?", "That ' s fine . We will have a reservation for us .", "That ' s fine . We will have a reservation for us .", "I understand . So that ' s one ticket to New York , and you ' ll be departing tonight . Will that be one-way or round trip ?", "That ' s fine . We will have a reservation for us .", "I understand . So that ' s one ticket to New York , and you ' ll be departing tonight . Will that be one-way or round trip ?"], "human_scores": [[3.4], [3.8], [3.8], [3.4], [3.4], [3.8], [3.4], [3.4], [3.8], [3.4], [3.8]]}
{"src": "Good morning . What does the paper say ?", "refs": ["Nothing much \u2014 the same old stuff . A lot of bad news as usual ."], "hyps": ["It means that you can only afford it .", "It's 5:30 by my watch .", "It's 5:30 by my watch .", "It's 5:30 by my watch .", "It's 5:30 by my watch .", "It's 5:30 by my watch .", "It means that you can only afford it .", "It means that you can only afford it .", "It means that you can only afford it .", "It's 5:30 by my watch .", "It means that you can only afford it ."], "human_scores": [[2.8], [2.6], [2.6], [2.6], [2.6], [2.6], [2.8], [2.8], [2.8], [2.6], [2.8]]}
{"src": "Great ! B , most of the items listed are available this year . I hope we can come to an agreement and sign the contracts , so as to enable our timely delivery . That sounds good . But I have a proposal now .", "refs": ["What's the proposal ?"], "hyps": ["We have a problem with your business . We will be ready by Thursday .", "It seems this is the only proposal for me to accept . I ' ll come again tomorrow to discuss it in detail .", "It seems this is the only proposal for me to accept . I ' ll come again tomorrow to discuss it in detail .", "It seems this is the only proposal for me to accept . I ' ll come again tomorrow to discuss it in detail .", "It seems this is the only proposal for me to accept . I ' ll come again tomorrow to discuss it in detail .", "It seems this is the only proposal for me to accept . I ' ll come again tomorrow to discuss it in detail .", "It seems this is the only proposal for me to accept . I ' ll come again tomorrow to discuss it in detail .", "It seems this is the only proposal for me to accept . I ' ll come again tomorrow to discuss it in detail .", "It seems this is the only proposal for me to accept . I ' ll come again tomorrow to discuss it in detail .", "We have a problem with your business . We will be ready by Thursday .", "We have a problem with your business . We will be ready by Thursday ."], "human_scores": [[2.6], [3.5], [3.5], [3.5], [3.5], [3.5], [3.5], [3.5], [3.5], [2.6], [2.6]]}
{"src": "Have I got a high fever ? . Yes , thirty-eight point seven . Do you have a headache , chest or throat pain ?", "refs": ["Yes , I have ."], "hyps": ["No , I don ' t . I don ' t have a fever .", "No , but I have a low fever .", "No , but I have a low fever .", "No , but I have a low fever .", "No , but I have a low fever .", "No , I don ' t . I don ' t have a fever .", "No , I don ' t . I don ' t have a fever .", "No , I don ' t . I don ' t have a fever .", "No , but I have a low fever .", "No , I don ' t . I don ' t have a fever .", "No , I don ' t . I don ' t have a fever ."], "human_scores": [[3.0], [2.9], [2.9], [2.9], [2.9], [3.0], [3.0], [3.0], [2.9], [3.0], [3.0]]}
{"src": "Have you ever listened to AM radio ? It's quite a different experience than the traditional news stations on TV and FM radio . I don't remember the last time I listened to AM radio .", "refs": ["Another place you can get real insight is European papers . You can get them on-line ."], "hyps": ["But you should have a lot of money .", "Are you kidding ? Don't you know I can't swim ?", "But you should have a lot of money .", "Are you kidding ? Don't you know I can't swim ?", "Are you kidding ? Don't you know I can't swim ?", "But you should have a lot of money .", "Are you kidding ? Don't you know I can't swim ?", "Are you kidding ? Don't you know I can't swim ?", "But you should have a lot of money .", "But you should have a lot of money .", "Are you kidding ? Don't you know I can't swim ?"], "human_scores": [[2.3], [2.3], [2.3], [2.3], [2.3], [2.3], [2.3], [2.3], [2.3], [2.3], [2.3]]}
{"src": "Have you ever tried shopping online ? . No , never . I prefer to actually see and touch what I'm buying before I pay for it , especially for clothes and shoes .", "refs": ["That's right . Seeing is believing ."], "hyps": ["What about the size ?", "Why don't you go shopping online ?", "What about the size ?", "What about the size ?", "Why don't you go shopping online ?", "What about the size ?", "Why don't you go shopping online ?", "Why don't you go shopping online ?", "What about the size ?", "What about the size ?", "What about the size ?"], "human_scores": [[3.5], [3.3], [3.5], [3.5], [3.3], [3.5], [3.3], [3.3], [3.5], [3.5], [3.5]]}
{"src": "Have you seen this news article ? Apparently an organization has made a list to name the new seven wonders of the world and people could vote for them online . Wow , that's really interesting . So who won ?", "refs": ["Well , the Great Wall of China , the Taj Mahal in India ."], "hyps": ["It ' s a lot of people who give their skills .", "Yeah , I had been in the charity organization for 2 months and I learned a lot from that experience , including love , sympathy , equality , and so on .", "Yeah , I had been in the charity organization for 2 months and I learned a lot from that experience , including love , sympathy , equality , and so on .", "It ' s a lot of people who give their skills .", "Yeah , I had been in the charity organization for 2 months and I learned a lot from that experience , including love , sympathy , equality , and so on .", "It ' s a lot of people who give their skills .", "Yeah , I had been in the charity organization for 2 months and I learned a lot from that experience , including love , sympathy , equality , and so on .", "Yeah , I had been in the charity organization for 2 months and I learned a lot from that experience , including love , sympathy , equality , and so on .", "It ' s a lot of people who give their skills .", "Yeah , I had been in the charity organization for 2 months and I learned a lot from that experience , including love , sympathy , equality , and so on .", "It ' s a lot of people who give their skills ."], "human_scores": [[2.5], [2.2], [2.2], [2.5], [2.2], [2.5], [2.2], [2.2], [2.5], [2.2], [2.5]]}
{"src": "Heard what ? . Deborah already had her baby .", "refs": ["I didn't know that ."], "hyps": ["Oh , what ?", "You never guess she is going to have a baby .", "Oh , what ?", "You never guess she is going to have a baby .", "You never guess she is going to have a baby .", "You never guess she is going to have a baby .", "You never guess she is going to have a baby .", "Oh , what ?", "Oh , what ?", "Oh , what ?", "Oh , what ?"], "human_scores": [[3.2222], [2.8], [3.2222], [2.8], [2.8], [2.8], [2.8], [3.2222], [3.2222], [3.2222], [3.2222]]}
{"src": "Hello ! How do I get more amenities ? . I'm sorry , sir . I'm not sure I understand .", "refs": ["I'm talking about the free stuff , like soap and shampoo ."], "hyps": ["Well , sir , you are quite right .", "I'm losing you , sir . What's the problem ?", "I'm losing you , sir . What's the problem ?", "I'm losing you , sir . What's the problem ?", "I'm losing you , sir . What's the problem ?", "I'm losing you , sir . What's the problem ?", "Well , sir , you are quite right .", "I'm losing you , sir . What's the problem ?", "I'm losing you , sir . What's the problem ?", "Well , sir , you are quite right .", "Well , sir , you are quite right ."], "human_scores": [[3.3], [3.7], [3.7], [3.7], [3.7], [3.7], [3.3], [3.7], [3.7], [3.3], [3.3]]}
{"src": "Hello , 332440 . Oh hello , Sally . This is Dave Thomson here . Could I speak to Jim please ?", "refs": ["I'm afraid he's not in at the moment Dave . He went out about an hour ago and he's not back yet ."], "hyps": ["This is Jim , please .", "Yes . He's in the line-up .", "Yes . He's in the line-up .", "Yes . He's in the line-up .", "Yes . He's in the line-up .", "This is Jim , please .", "This is Jim , please .", "Yes . He's in the line-up .", "This is Jim , please .", "This is Jim , please .", "This is Jim , please ."], "human_scores": [[3.6], [4.1], [4.1], [4.1], [4.1], [3.6], [3.6], [4.1], [3.6], [3.6], [3.6]]}
{"src": "Hello . Hi . It's Tony calling from the dentist's office . Is Lily there ?", "refs": ["No , Lily is not here at the moment ."], "hyps": ["Yes , he is .", "Yes , It's John eng .", "Yes , It's John eng .", "Yes , he is .", "Yes , he is .", "Yes , It's John eng .", "Yes , It's John eng .", "Yes , It's John eng .", "Yes , he is .", "Yes , he is .", "Yes , he is ."], "human_scores": [[3.4], [3.5], [3.5], [3.4], [3.4], [3.5], [3.5], [3.5], [3.4], [3.4], [3.4]]}
{"src": "Here you are . Thanks . What kind of stone is this ?", "refs": ["It's a ruby . It is from South Africa . Would you like to try it on ?"], "hyps": ["I ' m going to have a big fan of meat .", "It's C261 .", "It's C261 .", "I ' m going to have a big fan of meat .", "It's C261 .", "I ' m going to have a big fan of meat .", "I ' m going to have a big fan of meat .", "I ' m going to have a big fan of meat .", "It's C261 .", "I ' m going to have a big fan of meat .", "I ' m going to have a big fan of meat ."], "human_scores": [[2.4], [3.8], [3.8], [2.4], [3.8], [2.4], [2.4], [2.4], [3.8], [2.4], [2.4]]}
{"src": "Here's my name card . And here's mine .", "refs": ["It's nice to finally meet you ."], "hyps": ["Thank you .", "It's all yours .", "It's all yours .", "It's all yours .", "It's all yours .", "It's all yours .", "Thank you .", "It's all yours .", "Thank you .", "It's all yours .", "Thank you ."], "human_scores": [[4.1], [2.8], [2.8], [2.8], [2.8], [2.8], [4.1], [2.8], [4.1], [2.8], [4.1]]}
{"src": "Hey Tina . What are you doing ? . I was just watching TV . What's going on with you ?", "refs": ["I just watched a movie and I'm scared ."], "hyps": ["I ' m going to the movies .", "I'm watching TV .", "I'm watching TV .", "I'm watching TV .", "I'm watching TV .", "I'm watching TV .", "I'm watching TV .", "I ' m going to the movies .", "I ' m going to the movies .", "I'm watching TV .", "I ' m going to the movies ."], "human_scores": [[4.4], [3.4], [3.4], [3.4], [3.4], [3.4], [3.4], [4.4], [4.4], [3.4], [4.4]]}
{"src": "Hi . What's your name ? . My name is Jung Min . What's your name ?", "refs": ["My name is Jessica . It's nice to meet you ."], "hyps": ["It ' s Snow .", "I'm an engineer at IBM .", "I'm an engineer at IBM .", "I'm an engineer at IBM .", "It ' s Snow .", "I'm an engineer at IBM .", "It ' s Snow .", "I'm an engineer at IBM .", "It ' s Snow .", "It ' s Snow .", "It ' s Snow ."], "human_scores": [[2.9], [2.6], [2.6], [2.6], [2.9], [2.6], [2.9], [2.6], [2.9], [2.9], [2.9]]}
{"src": "How can you be so sure ? . I can tell form the way he spoke to us .", "refs": ["Never believe his words ."], "hyps": ["I see .", "That doesn ' t make any sense .", "That doesn ' t make any sense .", "That doesn ' t make any sense .", "That doesn ' t make any sense .", "I see .", "I see .", "That doesn ' t make any sense .", "I see .", "I see .", "I see ."], "human_scores": [[3.1818], [3.4], [3.4], [3.4], [3.4], [3.1818], [3.1818], [3.4], [3.1818], [3.1818], [3.1818]]}
{"src": "How do you do ? Please be seated , How is your trip here ? . Quite good , I think . I came here by bus , and it took me about 15 minutes .", "refs": ["Oh , yes . How old are you ?"], "hyps": ["Really ?", "Wow , thanks a lot .", "Wow , thanks a lot .", "Really ?", "Really ?", "Wow , thanks a lot .", "Really ?", "Really ?", "Really ?", "Really ?", "Really ?"], "human_scores": [[3.7], [3.3], [3.3], [3.7], [3.7], [3.3], [3.7], [3.7], [3.7], [3.7], [3.7]]}
{"src": "How long will the induction training be ? . About two weeks .", "refs": ["I see ."], "hyps": ["You ' re welcome .", "Is the training center helpful ?", "Is the training center helpful ?", "You ' re welcome .", "Is the training center helpful ?", "You ' re welcome .", "You ' re welcome .", "Is the training center helpful ?", "You ' re welcome .", "You ' re welcome .", "You ' re welcome ."], "human_scores": [[3.6], [4.1], [4.1], [3.6], [4.1], [3.6], [3.6], [4.1], [3.6], [3.6], [3.6]]}
{"src": "How much is that one ? . It's two hundred and eighty dollars .", "refs": ["OK . I'll take it . Thank you ."], "hyps": ["That ' s good .", "That's 20 dollars . Keep the change !", "That's 20 dollars . Keep the change !", "That's 20 dollars . Keep the change !", "That's 20 dollars . Keep the change !", "That ' s good .", "That's 20 dollars . Keep the change !", "That ' s good .", "That ' s good .", "That ' s good .", "That ' s good ."], "human_scores": [[4.0], [3.1], [3.1], [3.1], [3.1], [4.0], [3.1], [4.0], [4.0], [4.0], [4.0]]}
{"src": "How much per night are we talking about ? . Each night will be $ 308 .", "refs": ["That price is perfectly acceptable ."], "hyps": ["$ 308 a night ?", "$ 308 a night ? That's a fair price .", "$ 308 a night ? That's a fair price .", "$ 308 a night ? That's a fair price .", "$ 308 a night ? That's a fair price .", "$ 308 a night ?", "$ 308 a night ? That's a fair price .", "$ 308 a night ? That's a fair price .", "$ 308 a night ?", "$ 308 a night ?", "$ 308 a night ?"], "human_scores": [[3.4444], [4.1], [4.1], [4.1], [4.1], [3.4444], [4.1], [4.1], [3.4444], [3.4444], [3.4444]]}
{"src": "How nice of him . I'll be delighted to go . But what time would be convenient ? . If you could be ready by , say 6:30 o'clock , I'll be at the hotel to pick you up .", "refs": ["That's great . It's most thoughtful of you to do this , Miss Rose ."], "hyps": ["That ' s fine .", "That's fine . I'll be waiting for you .", "That's fine . I'll be waiting for you .", "That ' s fine .", "That's fine . I'll be waiting for you .", "That's fine . I'll be waiting for you .", "That ' s fine .", "That ' s fine .", "That ' s fine .", "That ' s fine .", "That ' s fine ."], "human_scores": [[3.5], [3.3], [3.3], [3.5], [3.3], [3.3], [3.5], [3.5], [3.5], [3.5], [3.5]]}
{"src": "Hum , Edward Norton , or something like that . Did you like him ? . Yes . He was excellent . They worked well together , don't you think ?", "refs": ["I don't know . I think the woman was better . She provided a good love interest . Lucky James Bond !"], "hyps": ["Yes , I was a little boy .", "Yes . He was excellent . They worked well together .", "Yes . He was excellent . They worked well together .", "Yes , I was a little boy .", "Yes , I was a little boy .", "Yes . He was excellent . They worked well together .", "Yes . He was excellent . They worked well together .", "Yes , I was a little boy .", "Yes , I was a little boy .", "Yes , I was a little boy .", "Yes , I was a little boy ."], "human_scores": [[2.8], [4.1], [4.1], [2.8], [2.8], [4.1], [4.1], [2.8], [2.8], [2.8], [2.8]]}
{"src": "I Like pop music best . Classical music is a bit too heavy for me . I can't get fully relaxed in it . Pop music doesn't have any depth for me .", "refs": ["Yeah , that's why I can enjoy myself in it ."], "hyps": ["Oh , it ' s so interesting . I ' ve been to the past several years , I ' ve been to the movie , too .", "That is a perfect reason to like a certain kind of music .", "That is a perfect reason to like a certain kind of music .", "That is a perfect reason to like a certain kind of music .", "That is a perfect reason to like a certain kind of music .", "That is a perfect reason to like a certain kind of music .", "That is a perfect reason to like a certain kind of music .", "Oh , it ' s so interesting . I ' ve been to the past several years , I ' ve been to the movie , too .", "Oh , it ' s so interesting . I ' ve been to the past several years , I ' ve been to the movie , too .", "Oh , it ' s so interesting . I ' ve been to the past several years , I ' ve been to the movie , too .", "Oh , it ' s so interesting . I ' ve been to the past several years , I ' ve been to the movie , too ."], "human_scores": [[2.5], [3.5556], [3.5556], [3.5556], [3.5556], [3.5556], [3.5556], [2.5], [2.5], [2.5], [2.5]]}
{"src": "I am dying from the heat . Turn on the air conditioner .", "refs": ["It doesn't work ."], "hyps": ["How long will it take ?", "Let's stand in the line now .", "Let's stand in the line now .", "How long will it take ?", "Let's stand in the line now .", "Let's stand in the line now .", "How long will it take ?", "How long will it take ?", "How long will it take ?", "How long will it take ?", "How long will it take ?"], "human_scores": [[3.4], [3.1], [3.1], [3.4], [3.1], [3.1], [3.4], [3.4], [3.4], [3.4], [3.4]]}
{"src": "I am not surprised , you eat too much . And I suppose sitting at the desk all day in the office doesn't help .", "refs": ["No , I wouldn't think so ."], "hyps": ["Yes , I think I should go to find a place where you are .", "No , I wouldn't think so .", "No , I wouldn't think so .", "No , I wouldn't think so .", "No , I wouldn't think so .", "No , I wouldn't think so .", "Yes , I think I should go to find a place where you are .", "No , I wouldn't think so .", "No , I wouldn't think so .", "Yes , I think I should go to find a place where you are .", "Yes , I think I should go to find a place where you are ."], "human_scores": [[2.8182], [3.4], [3.4], [3.4], [3.4], [3.4], [2.8182], [3.4], [3.4], [2.8182], [2.8182]]}
{"src": "I can check that for you right now . Would you mind holding ? . Sure . No problem .", "refs": ["Mr . Robson , I'm sorry . Our computer system is down . Could I call you back later ?"], "hyps": ["I ' m afraid I can ' t .", "Is this a promise ?", "Is this a promise ?", "I ' m afraid I can ' t .", "I ' m afraid I can ' t .", "Is this a promise ?", "I ' m afraid I can ' t .", "I ' m afraid I can ' t .", "I ' m afraid I can ' t .", "I ' m afraid I can ' t .", "I ' m afraid I can ' t ."], "human_scores": [[3.4], [3.0], [3.0], [3.4], [3.4], [3.0], [3.4], [3.4], [3.4], [3.4], [3.4]]}
{"src": "I didn't just find out about one job . There were several ones that looked good . Maybe I should try looking on the web for work .", "refs": ["Sure you have to be patient . But I think it's much less trouble to sit in front of a computer than to go door to door or to make a lot of phone calls ."], "hyps": ["That ' s good .", "It seems that you can e-mail the seller and ask questions .", "It seems that you can e-mail the seller and ask questions .", "It seems that you can e-mail the seller and ask questions .", "It seems that you can e-mail the seller and ask questions .", "That ' s good .", "That ' s good .", "That ' s good .", "That ' s good .", "That ' s good .", "That ' s good ."], "human_scores": [[3.4], [2.3], [2.3], [2.3], [2.3], [3.4], [3.4], [3.4], [3.4], [3.4], [3.4]]}
{"src": "I don't know . But this is definitely the last straw . Maybe you should start seeing someone else .", "refs": ["You said it . Ok , let's go in , Sandy ."], "hyps": ["I ' m sorry , but I ' m not sure .", "Yes . It could happen .", "Yes . It could happen .", "Yes . It could happen .", "Yes . It could happen .", "I ' m sorry , but I ' m not sure .", "Yes . It could happen .", "Yes . It could happen .", "Yes . It could happen .", "I ' m sorry , but I ' m not sure .", "I ' m sorry , but I ' m not sure ."], "human_scores": [[3.2222], [3.1], [3.1], [3.1], [3.1], [3.2222], [3.1], [3.1], [3.1], [3.2222], [3.2222]]}
{"src": "I have a lot of luggage . Will those fit in the taxi ? . Take it easy . I'll send a larger to pick you up .", "refs": ["Thank you very much ."], "hyps": ["Thank you .", "By the way , don't forget your luggage on the ship .", "By the way , don't forget your luggage on the ship .", "By the way , don't forget your luggage on the ship .", "Thank you .", "By the way , don't forget your luggage on the ship .", "Thank you .", "By the way , don't forget your luggage on the ship .", "By the way , don't forget your luggage on the ship .", "Thank you .", "By the way , don't forget your luggage on the ship ."], "human_scores": [[3.8], [3.4], [3.4], [3.4], [3.8], [3.4], [3.8], [3.4], [3.4], [3.8], [3.4]]}
{"src": "I like the sound of that . Yes , that is today's sale price .", "refs": ["A dozen will be fine ."], "hyps": ["I ' m sorry , but I didn ' t expect you to pay for it .", "Well , the sale price is $ 1 each .", "I ' m sorry , but I didn ' t expect you to pay for it .", "Well , the sale price is $ 1 each .", "Well , the sale price is $ 1 each .", "Well , the sale price is $ 1 each .", "Well , the sale price is $ 1 each .", "I ' m sorry , but I didn ' t expect you to pay for it .", "I ' m sorry , but I didn ' t expect you to pay for it .", "I ' m sorry , but I didn ' t expect you to pay for it .", "I ' m sorry , but I didn ' t expect you to pay for it ."], "human_scores": [[3.5], [3.6], [3.5], [3.6], [3.6], [3.6], [3.6], [3.5], [3.5], [3.5], [3.5]]}
{"src": "I need to book a plane ticket to London . Round-trip or one-way ?", "refs": ["One-way ."], "hyps": ["When will you be arriving ?", "Round trip or one way trip ?", "When will you be arriving ?", "Round trip or one way trip ?", "Round trip or one way trip ?", "Round trip or one way trip ?", "When will you be arriving ?", "When will you be arriving ?", "When will you be arriving ?", "When will you be arriving ?", "When will you be arriving ?"], "human_scores": [[2.3333], [2.1], [2.3333], [2.1], [2.1], [2.1], [2.3333], [2.3333], [2.3333], [2.3333], [2.3333]]}
{"src": "I need to stay home tonight and finish my term paper . OK . What about going to the movies on Friday night ?", "refs": ["What were you planning on seeing ?"], "hyps": ["I ' m not sure .", "I ' d love to but I have to help John with his math problems right now .", "I ' d love to but I have to help John with his math problems right now .", "I ' m not sure .", "I ' d love to but I have to help John with his math problems right now .", "I ' m not sure .", "I ' m not sure .", "I ' m not sure .", "I ' m not sure .", "I ' m not sure .", "I ' m not sure ."], "human_scores": [[3.9], [3.5], [3.5], [3.9], [3.5], [3.9], [3.9], [3.9], [3.9], [3.9], [3.9]]}
{"src": "I see . We will go the day after tomorrow . By the way , what kind of stores do we need to go ?", "refs": ["I want to buy some clothes in clothing store . When we are going back , go to the butcher's shop and buy some chicken ."], "hyps": ["OK . Let ' s go .", "Half an hours later .", "Half an hours later .", "Half an hours later .", "Half an hours later .", "OK . Let ' s go .", "OK . Let ' s go .", "Half an hours later .", "OK . Let ' s go .", "OK . Let ' s go .", "OK . Let ' s go ."], "human_scores": [[3.3333], [2.7], [2.7], [2.7], [2.7], [3.3333], [3.3333], [2.7], [3.3333], [3.3333], [3.3333]]}
{"src": "I should tell you that I'm checking out in about 30 minutes . I'm ready when you are , sir .", "refs": ["Very good ! Now , it's still morning here in New York ."], "hyps": ["I ' m afraid I ' ll be back in a minute .", "Please put your luggage outside your room by eight . The bellboy will pick them up .", "I ' m afraid I ' ll be back in a minute .", "Please put your luggage outside your room by eight . The bellboy will pick them up .", "I ' m afraid I ' ll be back in a minute .", "Please put your luggage outside your room by eight . The bellboy will pick them up .", "I ' m afraid I ' ll be back in a minute .", "Please put your luggage outside your room by eight . The bellboy will pick them up .", "I ' m afraid I ' ll be back in a minute .", "Please put your luggage outside your room by eight . The bellboy will pick them up .", "I ' m afraid I ' ll be back in a minute ."], "human_scores": [[3.0], [3.1], [3.0], [3.1], [3.0], [3.1], [3.0], [3.1], [3.0], [3.1], [3.0]]}
{"src": "I shouted it back of course . Hold it , Mike . You won't accomplish anything by hollering at him , right ? You worked it all up till now . Why not wait until you cool down a bit ?", "refs": ["What would you do if you were in my shoes ?"], "hyps": ["I ' ve been a little sick for a while . I was a little boy and I haven ' t lost my temper .", "well , I wish someone could talk to me about Western table manners", "well , I wish someone could talk to me about Western table manners", "I ' ve been a little sick for a while . I was a little boy and I haven ' t lost my temper .", "I ' ve been a little sick for a while . I was a little boy and I haven ' t lost my temper .", "well , I wish someone could talk to me about Western table manners", "I ' ve been a little sick for a while . I was a little boy and I haven ' t lost my temper .", "well , I wish someone could talk to me about Western table manners", "I ' ve been a little sick for a while . I was a little boy and I haven ' t lost my temper .", "I ' ve been a little sick for a while . I was a little boy and I haven ' t lost my temper .", "I ' ve been a little sick for a while . I was a little boy and I haven ' t lost my temper ."], "human_scores": [[2.5], [2.7], [2.7], [2.5], [2.5], [2.7], [2.5], [2.7], [2.5], [2.5], [2.5]]}
{"src": "I suppose I don't want that one then . I don't like auto-reverse . It breaks too easily . Really ? Have you had an auto-reverse break before ?", "refs": ["Yes , twice now . I think it's too high-tech , and so it's the first part that breaks ."], "hyps": ["I don ' t know , but I don ' t know how to use it .", "Yes , this price is very affordable , but driving this car you'll also notice a significant annual saving in gas consumption . The main attraction for this model is the fuel economy .", "Yes , this price is very affordable , but driving this car you'll also notice a significant annual saving in gas consumption . The main attraction for this model is the fuel economy .", "Yes , this price is very affordable , but driving this car you'll also notice a significant annual saving in gas consumption . The main attraction for this model is the fuel economy .", "Yes , this price is very affordable , but driving this car you'll also notice a significant annual saving in gas consumption . The main attraction for this model is the fuel economy .", "I don ' t know , but I don ' t know how to use it .", "Yes , this price is very affordable , but driving this car you'll also notice a significant annual saving in gas consumption . The main attraction for this model is the fuel economy .", "I don ' t know , but I don ' t know how to use it .", "I don ' t know , but I don ' t know how to use it .", "I don ' t know , but I don ' t know how to use it .", "I don ' t know , but I don ' t know how to use it ."], "human_scores": [[3.3333], [3.4], [3.4], [3.4], [3.4], [3.3333], [3.4], [3.3333], [3.3333], [3.3333], [3.3333]]}
{"src": "I think that's just steam . Your engine's overheated . Do you know a lot about cars ?", "refs": ["A little bit . I'll take a look if you want me to ."], "hyps": ["No , I don ' t .", "I usually only have 2 beers .", "I usually only have 2 beers .", "I usually only have 2 beers .", "I usually only have 2 beers .", "No , I don ' t .", "I usually only have 2 beers .", "No , I don ' t .", "No , I don ' t .", "No , I don ' t .", "No , I don ' t ."], "human_scores": [[4.0], [2.6], [2.6], [2.6], [2.6], [4.0], [2.6], [4.0], [4.0], [4.0], [4.0]]}
{"src": "I want to go traveling . Do you have any where in mind ?", "refs": ["Yes , I've been thinking about Florida ."], "hyps": ["I ' m not sure .", "There are student passes .", "There are student passes .", "There are student passes .", "I ' m not sure .", "I ' m not sure .", "There are student passes .", "There are student passes .", "I ' m not sure .", "I ' m not sure .", "I ' m not sure ."], "human_scores": [[3.8], [3.0], [3.0], [3.0], [3.8], [3.8], [3.0], [3.0], [3.8], [3.8], [3.8]]}
{"src": "I want to take a look at that home with the Open House flags out front . What a wonderful neighborhood ! Can you find that house on our Open House list ?", "refs": ["Yes , that is one of the houses that we have on our list ."], "hyps": ["I am sorry I can ' t go there .", "Yes , it looks perfect .", "Yes , it looks perfect .", "Yes , it looks perfect .", "I am sorry I can ' t go there .", "Yes , it looks perfect .", "I am sorry I can ' t go there .", "Yes , it looks perfect .", "I am sorry I can ' t go there .", "I am sorry I can ' t go there .", "I am sorry I can ' t go there ."], "human_scores": [[3.2222], [4.0], [4.0], [4.0], [3.2222], [4.0], [3.2222], [4.0], [3.2222], [3.2222], [3.2222]]}
{"src": "I wasn't all that impressed by the food . The service certainly could have been better .", "refs": ["The service did not help the situation ."], "hyps": ["What do you think of the food ?", "It wasn't as good as you think .", "It wasn't as good as you think .", "It wasn't as good as you think .", "What do you think of the food ?", "What do you think of the food ?", "What do you think of the food ?", "It wasn't as good as you think .", "What do you think of the food ?", "What do you think of the food ?", "What do you think of the food ?"], "human_scores": [[3.4], [2.8], [2.8], [2.8], [3.4], [3.4], [3.4], [2.8], [3.4], [3.4], [3.4]]}
{"src": "I went to Salt Lake City on business . What's up ? . I got fired .", "refs": ["How come ? Last time I saw you . You told me it was a good job , and you'd like to take it as a career . That was only one month ago . Why this sudden change ?"], "hyps": ["Really ? Why ?", "Come on . Don ' t hesitate .", "Come on . Don ' t hesitate .", "Really ? Why ?", "Come on . Don ' t hesitate .", "Come on . Don ' t hesitate .", "Come on . Don ' t hesitate .", "Come on . Don ' t hesitate .", "Come on . Don ' t hesitate .", "Really ? Why ?", "Come on . Don ' t hesitate ."], "human_scores": [[4.0], [3.3], [3.3], [4.0], [3.3], [3.3], [3.3], [3.3], [3.3], [4.0], [3.3]]}
{"src": "I would prefer next Thursday . What time would be best for you ?", "refs": ["I want to come in at 2"], "hyps": ["At 9 : 00 o ' clock .", "I would like to meet on Monday .", "I would like to meet on Monday .", "I would like to meet on Monday .", "I would like to meet on Monday .", "I would like to meet on Monday .", "I would like to meet on Monday .", "At 9 : 00 o ' clock .", "At 9 : 00 o ' clock .", "At 9 : 00 o ' clock .", "At 9 : 00 o ' clock ."], "human_scores": [[4.3636], [3.8], [3.8], [3.8], [3.8], [3.8], [3.8], [4.3636], [4.3636], [4.3636], [4.3636]]}
{"src": "I'd like to speak Dr . Johnson . Sorry , but he's not in . May I take a message for you ?", "refs": ["This is Robert Jordan . Would you ask him to call me back , please ?"], "hyps": ["Yes , please .", "Yes . He's waiting for you in his office . This way , please .", "Yes . He's waiting for you in his office . This way , please .", "Yes . He's waiting for you in his office . This way , please .", "Yes , please .", "Yes . He's waiting for you in his office . This way , please .", "Yes . He's waiting for you in his office . This way , please .", "Yes . He's waiting for you in his office . This way , please .", "Yes , please .", "Yes , please .", "Yes , please ."], "human_scores": [[4.1], [3.2], [3.2], [3.2], [4.1], [3.2], [3.2], [3.2], [4.1], [4.1], [4.1]]}
{"src": "I'll take a little milk , but no sugar , please . Make sure you let the tea steep a few minutes before you take the tea bag out of the cup . Ok . What do you think about our living room ?", "refs": ["Well , I do like the mantelpiece and the coffee table , but I don't really care for curtains . Did you get them at a yard sale ? They look ancient ."], "hyps": ["It ' s a very good idea .", "It doesn't seem like that . Sorry , sir , we've tried everything , but we're not able to get it off the shirt . It was from the sugar I think .", "It doesn't seem like that . Sorry , sir , we've tried everything , but we're not able to get it off the shirt . It was from the sugar I think .", "It doesn't seem like that . Sorry , sir , we've tried everything , but we're not able to get it off the shirt . It was from the sugar I think .", "It ' s a very good idea .", "It doesn't seem like that . Sorry , sir , we've tried everything , but we're not able to get it off the shirt . It was from the sugar I think .", "It ' s a very good idea .", "It ' s a very good idea .", "It ' s a very good idea .", "It ' s a very good idea .", "It ' s a very good idea ."], "human_scores": [[3.4], [2.8], [2.8], [2.8], [3.4], [2.8], [3.4], [3.4], [3.4], [3.4], [3.4]]}
{"src": "I'm Du Juan , in Room 312 . I see . Wait in the room , please .", "refs": ["Thank you for your kindness ."], "hyps": ["OK .", "Could I have your name and room number ?", "Could I have your name and room number ?", "Could I have your name and room number ?", "Could I have your name and room number ?", "OK .", "OK .", "OK .", "OK .", "OK .", "OK ."], "human_scores": [[3.6], [3.0], [3.0], [3.0], [3.0], [3.6], [3.6], [3.6], [3.6], [3.6], [3.6]]}
{"src": "I'm forming a music band . Do you already know how to play an instrument ?", "refs": ["Uh . . . Yeah ! I'Ve told you a thousand times that I'm learning to play the drums . Now that I know how to play well , I would like to form a rock band ."], "hyps": ["Yeah , it ' s a good idea . You can play a musical instrument or so .", "Do you already know how to play an instrument ?", "Do you already know how to play an instrument ?", "Do you already know how to play an instrument ?", "Do you already know how to play an instrument ?", "Do you already know how to play an instrument ?", "Do you already know how to play an instrument ?", "Yeah , it ' s a good idea . You can play a musical instrument or so .", "Yeah , it ' s a good idea . You can play a musical instrument or so .", "Do you already know how to play an instrument ?", "Yeah , it ' s a good idea . You can play a musical instrument or so ."], "human_scores": [[2.5455], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.5455], [2.5455], [2.9], [2.5455]]}
{"src": "I'm very sorry to hear that . May I have your name and room number , please ? . Yes , it's Yao Lan . Room 406 .", "refs": ["And how many pieces did you have ?"], "hyps": ["Thanks .", "Mr . Lee in Room 1234 .", "Mr . Lee in Room 1234 .", "Mr . Lee in Room 1234 .", "Thanks .", "Mr . Lee in Room 1234 .", "Mr . Lee in Room 1234 .", "Thanks .", "Thanks .", "Mr . Lee in Room 1234 .", "Thanks ."], "human_scores": [[3.4], [3.0], [3.0], [3.0], [3.4], [3.0], [3.0], [3.4], [3.4], [3.0], [3.4]]}
{"src": "If only our company prescribe flex time . The board has been considering introducing flex time .", "refs": ["Good news . Ah , what if be even better if alternative work place is provided ."], "hyps": ["But it ' s not a very high - worker , but it ' s not a very high - time job .", "I'm wondering if you often trade with others on the internet .", "But it ' s not a very high - worker , but it ' s not a very high - time job .", "I'm wondering if you often trade with others on the internet .", "But it ' s not a very high - worker , but it ' s not a very high - time job .", "But it ' s not a very high - worker , but it ' s not a very high - time job .", "But it ' s not a very high - worker , but it ' s not a very high - time job .", "But it ' s not a very high - worker , but it ' s not a very high - time job .", "But it ' s not a very high - worker , but it ' s not a very high - time job .", "But it ' s not a very high - worker , but it ' s not a very high - time job .", "But it ' s not a very high - worker , but it ' s not a very high - time job ."], "human_scores": [[3.3], [2.9], [3.3], [2.9], [3.3], [3.3], [3.3], [3.3], [3.3], [3.3], [3.3]]}
{"src": "It is an exhibition of Chinese jades . It is held each year . A nice collection jades of are on display and sold . Sounds great ! Can you stop somewhere here for a minute ? I will get some souvenirs for my friends .", "refs": ["No problem ."], "hyps": ["Oh , I am really sorry . I have been looking forward to seeing you .", "We share the same desire . Have you seen the display of our products in the exhibition hall downstairs ?", "We share the same desire . Have you seen the display of our products in the exhibition hall downstairs ?", "We share the same desire . Have you seen the display of our products in the exhibition hall downstairs ?", "We share the same desire . Have you seen the display of our products in the exhibition hall downstairs ?", "We share the same desire . Have you seen the display of our products in the exhibition hall downstairs ?", "Oh , I am really sorry . I have been looking forward to seeing you .", "Oh , I am really sorry . I have been looking forward to seeing you .", "Oh , I am really sorry . I have been looking forward to seeing you .", "Oh , I am really sorry . I have been looking forward to seeing you .", "Oh , I am really sorry . I have been looking forward to seeing you ."], "human_scores": [[2.8], [2.9], [2.9], [2.9], [2.9], [2.9], [2.8], [2.8], [2.8], [2.8], [2.8]]}
{"src": "It is too bad today . What happened ?", "refs": ["My som was lost . I told him to stand rooted to the spot when I went shopping , but he ignored it ."], "hyps": ["It was a little accident .", "It ' s been leaking for a couple of days now .", "It ' s been leaking for a couple of days now .", "It ' s been leaking for a couple of days now .", "It was a little accident .", "It ' s been leaking for a couple of days now .", "It was a little accident .", "It was a little accident .", "It was a little accident .", "It was a little accident .", "It was a little accident ."], "human_scores": [[3.9], [3.0], [3.0], [3.0], [3.9], [3.0], [3.9], [3.9], [3.9], [3.9], [3.9]]}
{"src": "It was alright . I ran into Bill and we got to talking for a while . He's in a bit of a jam . Why ? What happened ?", "refs": ["Well , his son had an accident and Bill doesn't have health insurance . This really got me thinking , and I wondered if we shouldn't look into a couple of different HMO's ."], "hyps": ["Well , he was a little accident .", "It was alright . I ran into Bill and we got to talking for a while . He ' s in a bit of a jam .", "It was alright . I ran into Bill and we got to talking for a while . He ' s in a bit of a jam .", "It was alright . I ran into Bill and we got to talking for a while . He ' s in a bit of a jam .", "Well , he was a little accident .", "Well , he was a little accident .", "It was alright . I ran into Bill and we got to talking for a while . He ' s in a bit of a jam .", "It was alright . I ran into Bill and we got to talking for a while . He ' s in a bit of a jam .", "Well , he was a little accident .", "Well , he was a little accident .", "Well , he was a little accident ."], "human_scores": [[3.6], [2.1], [2.1], [2.1], [3.6], [3.6], [2.1], [2.1], [3.6], [3.6], [3.6]]}
{"src": "Let me check . Yes , we have . May I try it on ?", "refs": ["Sure . Let me help you ."], "hyps": ["Here you are .", "You'd like it .", "You'd like it .", "You'd like it .", "You'd like it .", "Here you are .", "You'd like it .", "Here you are .", "Here you are .", "You'd like it .", "Here you are ."], "human_scores": [[3.3], [2.4], [2.4], [2.4], [2.4], [3.3], [2.4], [3.3], [3.3], [2.4], [3.3]]}
{"src": "Let me guess , from Sarah . It looks like something she would drive . You guessed right . Besides , the color violet is a little girly for me .", "refs": ["I love it . It's so festive ! And where did you get that cup ? It's got the same logo ."], "hyps": ["What ?", "You guessed right . Besides , the color violet is a little girly for me ...", "You guessed right . Besides , the color violet is a little girly for me ...", "You guessed right . Besides , the color violet is a little girly for me ...", "What ?", "What ?", "What ?", "You guessed right . Besides , the color violet is a little girly for me ...", "What ?", "What ?", "What ?"], "human_scores": [[2.6], [2.7], [2.7], [2.7], [2.6], [2.6], [2.6], [2.7], [2.6], [2.6], [2.6]]}
{"src": "Look ! Mom , that's amazing ! I can't believe the girls have so neat movements . Yeah , they all received very strict training . A minute on the stage takes ten-year practice .", "refs": ["And all their movements are so elegant . It seems like dancing in the water ."], "hyps": ["Oh , no ! I see , you must have a lot of trouble with the pictures of the basketball team .", "Tell me ! Tell me ! What's your secret ? !", "Tell me ! Tell me ! What's your secret ? !", "Tell me ! Tell me ! What's your secret ? !", "Oh , no ! I see , you must have a lot of trouble with the pictures of the basketball team .", "Oh , no ! I see , you must have a lot of trouble with the pictures of the basketball team .", "Oh , no ! I see , you must have a lot of trouble with the pictures of the basketball team .", "Oh , no ! I see , you must have a lot of trouble with the pictures of the basketball team .", "Oh , no ! I see , you must have a lot of trouble with the pictures of the basketball team .", "Oh , no ! I see , you must have a lot of trouble with the pictures of the basketball team .", "Oh , no ! I see , you must have a lot of trouble with the pictures of the basketball team ."], "human_scores": [[2.8], [2.9], [2.9], [2.9], [2.8], [2.8], [2.8], [2.8], [2.8], [2.8], [2.8]]}
{"src": "Lucky you ! I can't buy anything else . I'm flat broke . I got a replace my party outfit , I trashed it last week .", "refs": ["Why did you drag me into this ? I've spent a week salary ."], "hyps": ["You did a good one . It was a little hard on me .", "yeah , maybe you ' re right . How about this outfit ?", "yeah , maybe you ' re right . How about this outfit ?", "yeah , maybe you ' re right . How about this outfit ?", "yeah , maybe you ' re right . How about this outfit ?", "You did a good one . It was a little hard on me .", "yeah , maybe you ' re right . How about this outfit ?", "You did a good one . It was a little hard on me .", "You did a good one . It was a little hard on me .", "You did a good one . It was a little hard on me .", "You did a good one . It was a little hard on me ."], "human_scores": [[2.5], [3.5], [3.5], [3.5], [3.5], [2.5], [3.5], [2.5], [2.5], [2.5], [2.5]]}
{"src": "Me ? No way , keep him away from me , please . Why are you acting so strange today ?", "refs": ["I've said that I've got a problem with the circus . I'm not kidding ."], "hyps": ["Because he ' s a little boy .", "I just had a quarrel with him .", "I just had a quarrel with him .", "Because he ' s a little boy .", "I just had a quarrel with him .", "I just had a quarrel with him .", "I just had a quarrel with him .", "Because he ' s a little boy .", "Because he ' s a little boy .", "I just had a quarrel with him .", "I just had a quarrel with him ."], "human_scores": [[3.8], [3.6], [3.6], [3.8], [3.6], [3.6], [3.6], [3.8], [3.8], [3.6], [3.6]]}
{"src": "Morning , Michael . I'Ve been very busy lately . One of our other vendors is going out of business and I'Ve been searching for a suitable replacement . Well , rest assured that you can count on us to be here for the long run , sitdown . Coffee ?", "refs": ["No , thanks . I'Ve been trying to cut down on the caffeine ."], "hyps": ["No , I ' m afraid not . I ' m not interested in the spot .", "Well , rest assured that you can count on us to be here for the long run , please sit down . Coffee ?", "Well , rest assured that you can count on us to be here for the long run , please sit down . Coffee ?", "Well , rest assured that you can count on us to be here for the long run , please sit down . Coffee ?", "No , I ' m afraid not . I ' m not interested in the spot .", "Well , rest assured that you can count on us to be here for the long run , please sit down . Coffee ?", "Well , rest assured that you can count on us to be here for the long run , please sit down . Coffee ?", "Well , rest assured that you can count on us to be here for the long run , please sit down . Coffee ?", "No , I ' m afraid not . I ' m not interested in the spot .", "Well , rest assured that you can count on us to be here for the long run , please sit down . Coffee ?", "No , I ' m afraid not . I ' m not interested in the spot ."], "human_scores": [[3.6], [3.1], [3.1], [3.1], [3.6], [3.1], [3.1], [3.1], [3.6], [3.1], [3.6]]}
{"src": "Mr . Smith , please . Sorry , he is out .", "refs": ["What time do you expect him back then ?"], "hyps": ["I ' m sorry , Mr . Smith .", "Could you leave him a message ?", "Could you leave him a message ?", "Could you leave him a message ?", "Could you leave him a message ?", "Could you leave him a message ?", "I ' m sorry , Mr . Smith .", "I ' m sorry , Mr . Smith .", "I ' m sorry , Mr . Smith .", "I ' m sorry , Mr . Smith .", "I ' m sorry , Mr . Smith ."], "human_scores": [[3.3], [4.3], [4.3], [4.3], [4.3], [4.3], [3.3], [3.3], [3.3], [3.3], [3.3]]}
{"src": "Ms . Wang , this is Mr . Cooper , president of Ivy Publishing . It's nice to meet you , Mr . Cooper .", "refs": ["Nice to meet you , Ms . Wang . You must be exhausted after your long trip from Canada ."], "hyps": ["Yes , I ' m glad to hear you .", "It's nice to meet you , Mr . Cooper .", "It's nice to meet you , Mr . Cooper .", "It's nice to meet you , Mr . Cooper .", "Yes , I ' m glad to hear you .", "It's nice to meet you , Mr . Cooper .", "Yes , I ' m glad to hear you .", "It's nice to meet you , Mr . Cooper .", "Yes , I ' m glad to hear you .", "Yes , I ' m glad to hear you .", "Yes , I ' m glad to hear you ."], "human_scores": [[3.7], [3.5], [3.5], [3.5], [3.7], [3.5], [3.7], [3.5], [3.7], [3.7], [3.7]]}
{"src": "My appointment was on Monday . What time had you chosen ?", "refs": ["It was for 10"], "hyps": ["I was waiting for my invitation .", "It's Friday .", "It's Friday .", "I was waiting for my invitation .", "It's Friday .", "I was waiting for my invitation .", "It's Friday .", "I was waiting for my invitation .", "I was waiting for my invitation .", "I was waiting for my invitation .", "I was waiting for my invitation ."], "human_scores": [[2.4], [1.8889], [1.8889], [2.4], [1.8889], [2.4], [1.8889], [2.4], [2.4], [2.4], [2.4]]}
{"src": "No . I am a transit passenger going to Sweden . How long are you going to stay here ?", "refs": ["Only one night ."], "hyps": ["I have no idea .", "Only four days .", "Only four days .", "I have no idea .", "Only four days .", "I have no idea .", "Only four days .", "I have no idea .", "I have no idea .", "I have no idea .", "I have no idea ."], "human_scores": [[3.8], [3.4444], [3.4444], [3.8], [3.4444], [3.8], [3.4444], [3.8], [3.8], [3.8], [3.8]]}
{"src": "Not bad . Say I've got two tickets for the concert this evening . Would you like to come with me ?", "refs": ["Sure . Thank you very much ."], "hyps": ["That ' s fine .", "Oh , I'd rather not .", "Oh , I'd rather not .", "Oh , I'd rather not .", "That ' s fine .", "That ' s fine .", "That ' s fine .", "That ' s fine .", "That ' s fine .", "Oh , I'd rather not .", "That ' s fine ."], "human_scores": [[4.2], [3.6], [3.6], [3.6], [4.2], [4.2], [4.2], [4.2], [4.2], [3.6], [4.2]]}
{"src": "Not long , because people rush for lunch . The line sure does move fast .", "refs": ["Tell the man behind the counter what you want ."], "hyps": ["How much does it cost ?", "What kind of lease is it ?", "What kind of lease is it ?", "How much does it cost ?", "What kind of lease is it ?", "How much does it cost ?", "What kind of lease is it ?", "What kind of lease is it ?", "How much does it cost ?", "How much does it cost ?", "How much does it cost ?"], "human_scores": [[2.6364], [3.0], [3.0], [2.6364], [3.0], [2.6364], [3.0], [3.0], [2.6364], [2.6364], [2.6364]]}
{"src": "Not really . I don't think pop music has much depth . I see what you mean . I think that's way I like it so much .", "refs": ["How long have you been in to pop music , then ?"], "hyps": ["Really ? What ' s that ?", "not really . I don't think pop music has much depth .", "Really ? What ' s that ?", "Really ? What ' s that ?", "Really ? What ' s that ?", "not really . I don't think pop music has much depth .", "Really ? What ' s that ?", "Really ? What ' s that ?", "Really ? What ' s that ?", "Really ? What ' s that ?", "Really ? What ' s that ?"], "human_scores": [[3.1], [2.9], [3.1], [3.1], [3.1], [2.9], [3.1], [3.1], [3.1], [3.1], [3.1]]}
{"src": "Nothing , Mummy . I was hungry so I came here for some milk . Milk ? I thought you didn't like milk .", "refs": ["I don't , but I couldn't find anything to eat in the refrigerator ."], "hyps": ["What about some of milk ?", "Why don't you get a new one ?", "Why don't you get a new one ?", "Why don't you get a new one ?", "Why don't you get a new one ?", "Why don't you get a new one ?", "What about some of milk ?", "What about some of milk ?", "What about some of milk ?", "Why don't you get a new one ?", "What about some of milk ?"], "human_scores": [[2.9], [2.6], [2.6], [2.6], [2.6], [2.6], [2.9], [2.9], [2.9], [2.6], [2.9]]}
{"src": "Of course you do . They are silly stories just for little kids like you . Don't call me kid . I am a grownup .", "refs": ["Do you dare watch scary movies with me tonight ?"], "hyps": ["Really ? I am sorry .", "Don't forger to come straight home after school .", "Don't forger to come straight home after school .", "Don't forger to come straight home after school .", "Don't forger to come straight home after school .", "Don't forger to come straight home after school .", "Really ? I am sorry .", "Really ? I am sorry .", "Don't forger to come straight home after school .", "Don't forger to come straight home after school .", "Really ? I am sorry ."], "human_scores": [[3.7273], [3.0], [3.0], [3.0], [3.0], [3.0], [3.7273], [3.7273], [3.0], [3.0], [3.7273]]}
{"src": "Oh , I know a place where you might like to eat . Is it close by ?", "refs": ["It's down a block on the right ; can I show you the way ?"], "hyps": ["I think you ' re right .", "No , it's not far .", "No , it's not far .", "No , it's not far .", "No , it's not far .", "I think you ' re right .", "I think you ' re right .", "I think you ' re right .", "I think you ' re right .", "No , it's not far .", "I think you ' re right ."], "human_scores": [[3.1111], [3.4], [3.4], [3.4], [3.4], [3.1111], [3.1111], [3.1111], [3.1111], [3.4], [3.1111]]}
{"src": "Oh , your precious game . You watch the same game every year , and each year your beloved hometown team loses by at least three goals ! . Oh no you didn't . You didn't just insult the Sals-bury Seals , did you ? Why don't you just . just go and return all of those stupid clothes and not come back until the sales are over ?", "refs": ["I might just ! Enjoy your stupid game !"], "hyps": ["I ' m not so serious ! I ' m just gonna go to the game .", "Oh , your precious game . You watch the same game every year , and each year your beloved hometown team loses by at least three goals !", "Oh , your precious game . You watch the same game every year , and each year your beloved hometown team loses by at least three goals !", "Oh , your precious game . You watch the same game every year , and each year your beloved hometown team loses by at least three goals !", "Oh , your precious game . You watch the same game every year , and each year your beloved hometown team loses by at least three goals !", "Oh , your precious game . You watch the same game every year , and each year your beloved hometown team loses by at least three goals !", "Oh , your precious game . You watch the same game every year , and each year your beloved hometown team loses by at least three goals !", "Oh , your precious game . You watch the same game every year , and each year your beloved hometown team loses by at least three goals !", "Oh , your precious game . You watch the same game every year , and each year your beloved hometown team loses by at least three goals !", "I ' m not so serious ! I ' m just gonna go to the game .", "I ' m not so serious ! I ' m just gonna go to the game ."], "human_scores": [[2.8], [2.6], [2.6], [2.6], [2.6], [2.6], [2.6], [2.6], [2.6], [2.8], [2.8]]}
{"src": "Please be at the airport two hours before your departure to check in . You also need to reconfirm your reservation with the airline at least 7 days prior to your departure . What happens if I can't leave on April 13 ? Can I cancel my ticket or change the reservation to another date ?", "refs": ["Yes , you can , but you will have to pay a penalty of $ 75 for any change or cancellation ."], "hyps": ["No , you don ' t have to pay for your ticket .", "I think so . I won't forget anything important . As long as I have my passport , VISA card and airline ticket . It will be OK .", "No , you don ' t have to pay for your ticket .", "I think so . I won't forget anything important . As long as I have my passport , VISA card and airline ticket . It will be OK .", "I think so . I won't forget anything important . As long as I have my passport , VISA card and airline ticket . It will be OK .", "I think so . I won't forget anything important . As long as I have my passport , VISA card and airline ticket . It will be OK .", "No , you don ' t have to pay for your ticket .", "No , you don ' t have to pay for your ticket .", "I think so . I won't forget anything important . As long as I have my passport , VISA card and airline ticket . It will be OK .", "I think so . I won't forget anything important . As long as I have my passport , VISA card and airline ticket . It will be OK .", "No , you don ' t have to pay for your ticket ."], "human_scores": [[3.3333], [3.6], [3.3333], [3.6], [3.6], [3.6], [3.3333], [3.3333], [3.6], [3.6], [3.3333]]}
{"src": "Providing warm meals and shelter , especially in the winter months . I found it really fulfilling to be part of that group . I'm sure . Okay , now let's move on to your work experience , shall we ?", "refs": ["Yes , okay ."], "hyps": ["Yeah , why not ?", "Providing warm meals and shelter , especially in the winter months . I found it really fulfilling to be part of that group .", "Providing warm meals and shelter , especially in the winter months . I found it really fulfilling to be part of that group .", "Providing warm meals and shelter , especially in the winter months . I found it really fulfilling to be part of that group .", "Providing warm meals and shelter , especially in the winter months . I found it really fulfilling to be part of that group .", "Yeah , why not ?", "Providing warm meals and shelter , especially in the winter months . I found it really fulfilling to be part of that group .", "Providing warm meals and shelter , especially in the winter months . I found it really fulfilling to be part of that group .", "Yeah , why not ?", "Yeah , why not ?", "Yeah , why not ?"], "human_scores": [[3.8], [2.4], [2.4], [2.4], [2.4], [3.8], [2.4], [2.4], [3.8], [3.8], [3.8]]}
{"src": "Really ? Wow with who ? . This girl I've been chatting with for the past couple of months . She's really cool and she's driving over here this weekend .", "refs": ["Wait a minute , you mean you met her online ?"], "hyps": ["Oh , I know . I ' ve heard that she ' s going to be a good thing .", "Really ? That's really wonderful . I'm so happy for her .", "Really ? That's really wonderful . I'm so happy for her .", "Really ? That's really wonderful . I'm so happy for her .", "Really ? That's really wonderful . I'm so happy for her .", "Oh , I know . I ' ve heard that she ' s going to be a good thing .", "Really ? That's really wonderful . I'm so happy for her .", "Oh , I know . I ' ve heard that she ' s going to be a good thing .", "Oh , I know . I ' ve heard that she ' s going to be a good thing .", "Really ? That's really wonderful . I'm so happy for her .", "Oh , I know . I ' ve heard that she ' s going to be a good thing ."], "human_scores": [[3.1], [3.9], [3.9], [3.9], [3.9], [3.1], [3.9], [3.1], [3.1], [3.9], [3.1]]}
{"src": "Shall we drop in somewhere for a couple of drinks ? . That sounds like a good idea .", "refs": ["I know a very interesting place ."], "hyps": ["What do you mean ?", "OK . Shall we go to a bar ?", "OK . Shall we go to a bar ?", "OK . Shall we go to a bar ?", "What do you mean ?", "OK . Shall we go to a bar ?", "What do you mean ?", "What do you mean ?", "What do you mean ?", "What do you mean ?", "What do you mean ?"], "human_scores": [[2.6364], [3.7], [3.7], [3.7], [2.6364], [3.7], [2.6364], [2.6364], [2.6364], [2.6364], [2.6364]]}
{"src": "Sorry . I was too worried . I firmly believe that you love your brother very much .", "refs": ["Absolutely . By the way , do you sell any traditional Chinese medicine ?"], "hyps": ["Oh , I ' m sorry . I ' ve never heard about it .", "But I want you to be fit .", "But I want you to be fit .", "But I want you to be fit .", "But I want you to be fit .", "But I want you to be fit .", "Oh , I ' m sorry . I ' ve never heard about it .", "But I want you to be fit .", "Oh , I ' m sorry . I ' ve never heard about it .", "Oh , I ' m sorry . I ' ve never heard about it .", "Oh , I ' m sorry . I ' ve never heard about it ."], "human_scores": [[2.5], [2.1], [2.1], [2.1], [2.1], [2.1], [2.5], [2.1], [2.5], [2.5], [2.5]]}
{"src": "Sure ! Are you okay ? You seem a bit worried . What's on your mind ? . We need to talk .", "refs": ["Okay . . ."], "hyps": ["I need to talk with you .", "We need to talk .", "I need to talk with you .", "We need to talk .", "We need to talk .", "We need to talk .", "I need to talk with you .", "We need to talk .", "I need to talk with you .", "I need to talk with you .", "I need to talk with you ."], "human_scores": [[3.3], [2.8], [3.3], [2.8], [2.8], [2.8], [3.3], [2.8], [3.3], [3.3], [3.3]]}
{"src": "Surely of course . Here is the film . Can I get my pictures tomorrow ?", "refs": ["Sure ."], "hyps": ["Sure . What is it ?", "Yes , give me two rolls of Kodak color film .", "Yes , give me two rolls of Kodak color film .", "Yes , give me two rolls of Kodak color film .", "Yes , give me two rolls of Kodak color film .", "Sure . What is it ?", "Yes , give me two rolls of Kodak color film .", "Sure . What is it ?", "Sure . What is it ?", "Sure . What is it ?", "Sure . What is it ?"], "human_scores": [[3.7], [3.4], [3.4], [3.4], [3.4], [3.7], [3.4], [3.7], [3.7], [3.7], [3.7]]}
{"src": "Take it easy . We are going to have our own baby . You should be happy . Yeah , I know .", "refs": ["The doctors and the nurses will help you . And I will be waiting for you right here , praying for you and our baby ."], "hyps": ["Well , you know .", "I know , mom .", "Well , you know .", "Well , you know .", "I know , mom .", "I know , mom .", "Well , you know .", "I know , mom .", "Well , you know .", "Well , you know .", "Well , you know ."], "human_scores": [[3.0], [2.3], [3.0], [3.0], [2.3], [2.3], [3.0], [2.3], [3.0], [3.0], [3.0]]}
{"src": "Thank God ! I am finished writing that service guide ! It took me forever ! . When did you finish ?", "refs": ["This morning ! No more overtime , and no more headaches !"], "hyps": ["I had no time .", "About 2 o ' clock .", "About 2 o ' clock .", "About 2 o ' clock .", "About 2 o ' clock .", "About 2 o ' clock .", "I had no time .", "About 2 o ' clock .", "I had no time .", "I had no time .", "I had no time ."], "human_scores": [[2.4], [3.6], [3.6], [3.6], [3.6], [3.6], [2.4], [3.6], [2.4], [2.4], [2.4]]}
{"src": "Thank you ! Would you like an aisle seat or a window seat ? . An aisle seat , please . I'm tall and need to get up and walk pretty often .", "refs": ["No problem . Your ticket is for Trans Pacific Flight 87 from Detroit to Beijing at 3 forty p . m . on April 13 . You will arrive at Beijing International Airport at six 35 p . m . on April 14 . Your electronic"], "hyps": ["OK . I ' ll come back with you .", "Anything but a center seat is fine with me . The middle seat drives me crazy !", "Anything but a center seat is fine with me . The middle seat drives me crazy !", "Anything but a center seat is fine with me . The middle seat drives me crazy !", "OK . I ' ll come back with you .", "Anything but a center seat is fine with me . The middle seat drives me crazy !", "OK . I ' ll come back with you .", "OK . I ' ll come back with you .", "OK . I ' ll come back with you .", "OK . I ' ll come back with you .", "OK . I ' ll come back with you ."], "human_scores": [[3.3], [3.1], [3.1], [3.1], [3.3], [3.1], [3.3], [3.3], [3.3], [3.3], [3.3]]}
{"src": "Thank you . What was your major in school ?", "refs": ["I majored in Public Relations ."], "hyps": ["I was born in college .", "I ' m going back to college .", "I ' m going back to college .", "I ' m going back to college .", "I was born in college .", "I was born in college .", "I was born in college .", "I ' m going back to college .", "I was born in college .", "I was born in college .", "I ' m going back to college ."], "human_scores": [[2.6], [2.4], [2.4], [2.4], [2.6], [2.6], [2.6], [2.4], [2.6], [2.6], [2.4]]}
{"src": "Thank you for your inition . I'm free tonight . Which kind of food do you like , chinese food , western food or sea food ?", "refs": ["I prefer sea food ."], "hyps": ["I like it .", "Chinese food .", "Chinese food .", "I like it .", "Chinese food .", "I like it .", "Chinese food .", "Chinese food .", "I like it .", "Chinese food .", "I like it ."], "human_scores": [[2.4444], [3.9], [3.9], [2.4444], [3.9], [2.4444], [3.9], [3.9], [2.4444], [3.9], [2.4444]]}
{"src": "Thank you so much . Does he read his e-mails daily ? . Yes . He usually replies immediately .", "refs": ["Great . Thanks again . You've been very helpful ."], "hyps": ["Oh , he ' s a man of the first person . He ' s a successful successful successful man .", "He is afraid of his father-in-law .", "He is afraid of his father-in-law .", "He is afraid of his father-in-law .", "Oh , he ' s a man of the first person . He ' s a successful successful successful man .", "Oh , he ' s a man of the first person . He ' s a successful successful successful man .", "Oh , he ' s a man of the first person . He ' s a successful successful successful man .", "Oh , he ' s a man of the first person . He ' s a successful successful successful man .", "Oh , he ' s a man of the first person . He ' s a successful successful successful man .", "He is afraid of his father-in-law .", "Oh , he ' s a man of the first person . He ' s a successful successful successful man ."], "human_scores": [[3.4], [2.5], [2.5], [2.5], [3.4], [3.4], [3.4], [3.4], [3.4], [2.5], [3.4]]}
{"src": "That is right up my alley . You say party and I'm there . Perfect . It will be open to the public and we anticipate roughly about five to seven hundred people .", "refs": ["Will it be an all day event ?"], "hyps": ["Are you serious ?", "Not until the 31st . So can you change the church reservations ?", "Not until the 31st . So can you change the church reservations ?", "Not until the 31st . So can you change the church reservations ?", "Not until the 31st . So can you change the church reservations ?", "Not until the 31st . So can you change the church reservations ?", "Not until the 31st . So can you change the church reservations ?", "Are you serious ?", "Are you serious ?", "Are you serious ?", "Are you serious ?"], "human_scores": [[3.4], [2.8], [2.8], [2.8], [2.8], [2.8], [2.8], [3.4], [3.4], [3.4], [3.4]]}
{"src": "That one truly is a beautiful piece of work , isn't it ? . One last question", "refs": ["Oh , no . Everything we sell here is \" as is . \""], "hyps": ["Yes , I do .", "It's fashionable .", "It's fashionable .", "Yes , I do .", "It's fashionable .", "It's fashionable .", "It's fashionable .", "Yes , I do .", "Yes , I do .", "Yes , I do .", "It's fashionable ."], "human_scores": [[1.9], [2.9], [2.9], [1.9], [2.9], [2.9], [2.9], [1.9], [1.9], [1.9], [2.9]]}
{"src": "That sounds good . You order the beer while I go to the bathroom . Where is the can in this place ? . It's all the way to the back . See that yellow door ?", "refs": ["Yeah . I think I can find it ."], "hyps": ["Yes , it ' s my first time .", "It's all the way to the back . See that yellow door ?", "It's all the way to the back . See that yellow door ?", "It's all the way to the back . See that yellow door ?", "It's all the way to the back . See that yellow door ?", "It's all the way to the back . See that yellow door ?", "It's all the way to the back . See that yellow door ?", "It's all the way to the back . See that yellow door ?", "Yes , it ' s my first time .", "Yes , it ' s my first time .", "Yes , it ' s my first time ."], "human_scores": [[2.2222], [2.4], [2.4], [2.4], [2.4], [2.4], [2.4], [2.4], [2.2222], [2.2222], [2.2222]]}
{"src": "That's for the phone calls you made from your room . Can I pay with traveller's cheques ?", "refs": ["Certainly . May I have your passport , please ?"], "hyps": ["Yes , I have .", "No , there's no charge for those .", "No , there's no charge for those .", "No , there's no charge for those .", "No , there's no charge for those .", "Yes , I have .", "No , there's no charge for those .", "Yes , I have .", "Yes , I have .", "Yes , I have .", "Yes , I have ."], "human_scores": [[3.7], [3.1], [3.1], [3.1], [3.1], [3.7], [3.1], [3.7], [3.7], [3.7], [3.7]]}
{"src": "That's how much this t . v costs . That's too expensive for me .", "refs": ["This television is of very high quality ."], "hyps": ["I ' m not sure .", "That's how much this t . v costs .", "That's how much this t . v costs .", "I ' m not sure .", "That's how much this t . v costs .", "I ' m not sure .", "That's how much this t . v costs .", "I ' m not sure .", "I ' m not sure .", "I ' m not sure .", "I ' m not sure ."], "human_scores": [[3.6], [2.4], [2.4], [3.6], [2.4], [3.6], [2.4], [3.6], [3.6], [3.6], [3.6]]}
{"src": "The bartender just gave the last call . Let's order another round , okay ? . Sure , but let's get a pitcher this time We should be able to down it before they close .", "refs": ["That sounds good . You order the beer while I go to the bathroom . Where is the can in this place ?"], "hyps": ["That ' s good . I ' ll be there .", "The bartender just gave the last call . Let's order another round , okay ?", "The bartender just gave the last call . Let's order another round , okay ?", "The bartender just gave the last call . Let's order another round , okay ?", "That ' s good . I ' ll be there .", "The bartender just gave the last call . Let's order another round , okay ?", "The bartender just gave the last call . Let's order another round , okay ?", "The bartender just gave the last call . Let's order another round , okay ?", "That ' s good . I ' ll be there .", "That ' s good . I ' ll be there .", "That ' s good . I ' ll be there ."], "human_scores": [[4.0], [2.6], [2.6], [2.6], [4.0], [2.6], [2.6], [2.6], [4.0], [4.0], [4.0]]}
{"src": "The boss wanted to pay Bob with stock options . But Bob didn't want to play that game again . Again ?", "refs": ["At his last start-up , Bob worked for stock and no salary . They folded and he made zip ."], "hyps": ["I don ' t know . I don ' t know .", "It's only seven minutes into the game , too early to cheer up .", "It's only seven minutes into the game , too early to cheer up .", "It's only seven minutes into the game , too early to cheer up .", "I don ' t know . I don ' t know .", "I don ' t know . I don ' t know .", "It's only seven minutes into the game , too early to cheer up .", "I don ' t know . I don ' t know .", "It's only seven minutes into the game , too early to cheer up .", "It's only seven minutes into the game , too early to cheer up .", "I don ' t know . I don ' t know ."], "human_scores": [[2.8182], [2.9], [2.9], [2.9], [2.8182], [2.8182], [2.9], [2.8182], [2.9], [2.9], [2.8182]]}
{"src": "The service did not help the situation . Is this a restaurant that you want to come back to ?", "refs": ["I am not interested in trying this restaurant again ."], "hyps": ["I am afraid I can ' t make it .", "I went up there early this morning .", "I went up there early this morning .", "I am afraid I can ' t make it .", "I went up there early this morning .", "I went up there early this morning .", "I went up there early this morning .", "I am afraid I can ' t make it .", "I am afraid I can ' t make it .", "I am afraid I can ' t make it .", "I am afraid I can ' t make it ."], "human_scores": [[2.5556], [2.2], [2.2], [2.5556], [2.2], [2.2], [2.2], [2.5556], [2.5556], [2.5556], [2.5556]]}
{"src": "The traffic is not very heavy on this high way , is it ? So I'm sure we'll make it . No , but we'Ve got a hurry . It will be the rush hour soon .", "refs": ["Don't worry . There's plenty of time yet ."], "hyps": ["I ' m afraid we can ' t wait until the traffic jam .", "We'll have to hurry ; visiting hours will be over soon", "We'll have to hurry ; visiting hours will be over soon", "I ' m afraid we can ' t wait until the traffic jam .", "We'll have to hurry ; visiting hours will be over soon", "We'll have to hurry ; visiting hours will be over soon", "We'll have to hurry ; visiting hours will be over soon", "I ' m afraid we can ' t wait until the traffic jam .", "I ' m afraid we can ' t wait until the traffic jam .", "I ' m afraid we can ' t wait until the traffic jam .", "I ' m afraid we can ' t wait until the traffic jam ."], "human_scores": [[3.3], [3.4], [3.4], [3.3], [3.4], [3.4], [3.4], [3.3], [3.3], [3.3], [3.3]]}
{"src": "The washer costs 50 cents and the dryer costs a dollar . Where do I put the change ?", "refs": ["The quarters go into the slot . You have to push the slot in , and the machine will turn on ."], "hyps": ["Do you need to change it for you ?", "You need to put 50 cents into the washer machine and a dollar into the dryer .", "You need to put 50 cents into the washer machine and a dollar into the dryer .", "You need to put 50 cents into the washer machine and a dollar into the dryer .", "You need to put 50 cents into the washer machine and a dollar into the dryer .", "You need to put 50 cents into the washer machine and a dollar into the dryer .", "Do you need to change it for you ?", "Do you need to change it for you ?", "Do you need to change it for you ?", "You need to put 50 cents into the washer machine and a dollar into the dryer .", "Do you need to change it for you ?"], "human_scores": [[2.9], [3.4], [3.4], [3.4], [3.4], [3.4], [2.9], [2.9], [2.9], [3.4], [2.9]]}
{"src": "Then tell me something about your background . My major was computer science when I was at college , and I am quite familiar with Visual C + + and Java language .", "refs": ["Well , what do you think about the development in computers ?"], "hyps": ["What ' s your computer qualifications ?", "What are you basing this information on ?", "What are you basing this information on ?", "What are you basing this information on ?", "What are you basing this information on ?", "What are you basing this information on ?", "What are you basing this information on ?", "What ' s your computer qualifications ?", "What ' s your computer qualifications ?", "What ' s your computer qualifications ?", "What are you basing this information on ?"], "human_scores": [[3.3], [2.5], [2.5], [2.5], [2.5], [2.5], [2.5], [3.3], [3.3], [3.3], [2.5]]}
{"src": "This is Bill Burton from Milford Insurance , I'm calling in regards to our meeting next Tuesday . Thank you , Mr . Burton . Can you please hold for a moment ? I'll check to see if she is available .", "refs": ["No problem ."], "hyps": ["OK .", "All right . I ' ll call you back later .", "All right . I ' ll call you back later .", "All right . I ' ll call you back later .", "All right . I ' ll call you back later .", "All right . I ' ll call you back later .", "All right . I ' ll call you back later .", "OK .", "OK .", "OK .", "OK ."], "human_scores": [[3.6667], [3.5], [3.5], [3.5], [3.5], [3.5], [3.5], [3.6667], [3.6667], [3.6667], [3.6667]]}
{"src": "Turn on the TV for what ? . So that we can sit down together and listen to some music .", "refs": ["Listen to the music ? And who will cook dinner , will you ?"], "hyps": ["Really ? What kind of music do you like ?", "So that we can sit down together and listen to some music .", "So that we can sit down together and listen to some music .", "So that we can sit down together and listen to some music .", "So that we can sit down together and listen to some music .", "So that we can sit down together and listen to some music .", "Really ? What kind of music do you like ?", "Really ? What kind of music do you like ?", "So that we can sit down together and listen to some music .", "Really ? What kind of music do you like ?", "Really ? What kind of music do you like ?"], "human_scores": [[3.7778], [3.3], [3.3], [3.3], [3.3], [3.3], [3.7778], [3.7778], [3.3], [3.7778], [3.7778]]}
{"src": "Um , ninety-five dollars ? . Yes , that's the price they were advertising it at . I was hoping it might go on sale soon . Why , how much did you pay for it ?", "refs": ["I bought it for one hundred and forty-five dollars at Helen's Boutique . I didn't know I could get it cheaper somewhere else ."], "hyps": ["Well , I think it ' s a little expensive .", "The price of CPU is 260 dollars above 1,000 Units .", "The price of CPU is 260 dollars above 1,000 Units .", "The price of CPU is 260 dollars above 1,000 Units .", "The price of CPU is 260 dollars above 1,000 Units .", "Well , I think it ' s a little expensive .", "The price of CPU is 260 dollars above 1,000 Units .", "Well , I think it ' s a little expensive .", "The price of CPU is 260 dollars above 1,000 Units .", "Well , I think it ' s a little expensive .", "Well , I think it ' s a little expensive ."], "human_scores": [[3.1], [3.1], [3.1], [3.1], [3.1], [3.1], [3.1], [3.1], [3.1], [3.1], [3.1]]}
{"src": "Wait a moment , please . Let me check it . By the way , I want a large room .", "refs": ["Right now we have a suite for 4 people , do you want to book it ?"], "hyps": ["Here you are .", "By the way , what's the rate for a single room ?", "By the way , what's the rate for a single room ?", "By the way , what's the rate for a single room ?", "Here you are .", "By the way , what's the rate for a single room ?", "By the way , what's the rate for a single room ?", "Here you are .", "Here you are .", "Here you are .", "Here you are ."], "human_scores": [[4.3], [3.3], [3.3], [3.3], [4.3], [3.3], [3.3], [4.3], [4.3], [4.3], [4.3]]}
{"src": "Well , it's specially made of a platinum alloy , sir , and the lustre will never fade out . I'II take them . Please wrap them up tor me and give me the receipt .", "refs": ["You've made an excellent choice , sir ."], "hyps": ["OK . I ' ll take it .", "All right . Here it is .", "All right . Here it is .", "OK . I ' ll take it .", "OK . I ' ll take it .", "All right . Here it is .", "All right . Here it is .", "OK . I ' ll take it .", "OK . I ' ll take it .", "All right . Here it is .", "OK . I ' ll take it ."], "human_scores": [[3.7], [3.3], [3.3], [3.7], [3.7], [3.3], [3.3], [3.7], [3.7], [3.3], [3.7]]}
{"src": "Well , known , Jim , I'm . . . I'm pretty much in favour of your computers , I think computers teach kids to think , because they require logical thoughts . But I . . . I don't agree with thatbecause computers weaken kids'ability to thinkbecause kids don't learn basic skills .", "refs": ["What do you mean ?"], "hyps": ["What do you mean ?", "But I ... I don't agree with that , because computers weaken kids ' ability to think , because kids don't learn basic skills .", "But I ... I don't agree with that , because computers weaken kids ' ability to think , because kids don't learn basic skills .", "But I ... I don't agree with that , because computers weaken kids ' ability to think , because kids don't learn basic skills .", "What do you mean ?", "But I ... I don't agree with that , because computers weaken kids ' ability to think , because kids don't learn basic skills .", "But I ... I don't agree with that , because computers weaken kids ' ability to think , because kids don't learn basic skills .", "What do you mean ?", "What do you mean ?", "But I ... I don't agree with that , because computers weaken kids ' ability to think , because kids don't learn basic skills .", "What do you mean ?"], "human_scores": [[3.8], [2.8], [2.8], [2.8], [3.8], [2.8], [2.8], [3.8], [3.8], [2.8], [3.8]]}
{"src": "Well , there will be charity performance on Saturday night . And also , there will be a solo concert by an opera star on Sunday night . It's a good thing that I have choices here . Can you tell me about the one on Saturday ?", "refs": ["Sure . It's to raise money for the homeless ."], "hyps": ["Sure , let ' s go to the concert with a night .", "Sure , it's spelled Office and then D - E - P - O - T . It ' s in the Yellow Pages .", "Sure , it's spelled Office and then D - E - P - O - T . It ' s in the Yellow Pages .", "Sure , it's spelled Office and then D - E - P - O - T . It ' s in the Yellow Pages .", "Sure , it's spelled Office and then D - E - P - O - T . It ' s in the Yellow Pages .", "Sure , let ' s go to the concert with a night .", "Sure , let ' s go to the concert with a night .", "Sure , let ' s go to the concert with a night .", "Sure , let ' s go to the concert with a night .", "Sure , let ' s go to the concert with a night .", "Sure , let ' s go to the concert with a night ."], "human_scores": [[3.3], [2.8], [2.8], [2.8], [2.8], [3.3], [3.3], [3.3], [3.3], [3.3], [3.3]]}
{"src": "Well , you should come this weekend . I think you could do the climb . Yeah , I will . See you then !", "refs": ["O . K . See you ."], "hyps": ["See you !", "Well , you should come this weekend . I think you could do the climb .", "Well , you should come this weekend . I think you could do the climb .", "Well , you should come this weekend . I think you could do the climb .", "Well , you should come this weekend . I think you could do the climb .", "Well , you should come this weekend . I think you could do the climb .", "See you !", "See you !", "See you !", "See you !", "Well , you should come this weekend . I think you could do the climb ."], "human_scores": [[4.3], [2.9], [2.9], [2.9], [2.9], [2.9], [4.3], [4.3], [4.3], [4.3], [2.9]]}
{"src": "What did they say ? . They said I need a new hard drive .", "refs": ["That's too bad . How much is a new one ?"], "hyps": ["They are very good .", "They're still fighting hard . Let ' s wait and see .", "They're still fighting hard . Let ' s wait and see .", "They're still fighting hard . Let ' s wait and see .", "They're still fighting hard . Let ' s wait and see .", "They are very good .", "They are very good .", "They are very good .", "They are very good .", "They are very good .", "They are very good ."], "human_scores": [[3.3], [2.3], [2.3], [2.3], [2.3], [3.3], [3.3], [3.3], [3.3], [3.3], [3.3]]}
{"src": "What do you feel about gay marriage ? . I think everyone has the right to love who they want .", "refs": ["Would you legalize gay marriage ?"], "hyps": ["They ' re really popular .", "Would you make gay marriage legal ?", "Would you make gay marriage legal ?", "Would you make gay marriage legal ?", "Would you make gay marriage legal ?", "They ' re really popular .", "Would you make gay marriage legal ?", "Would you make gay marriage legal ?", "They ' re really popular .", "They ' re really popular .", "They ' re really popular ."], "human_scores": [[2.4], [3.2], [3.2], [3.2], [3.2], [2.4], [3.2], [3.2], [2.4], [2.4], [2.4]]}
{"src": "What do you think about the equipment in our company ? . We have to equip our company with a network of work stations at every office and show room as soon as possible .", "refs": ["I also realized this issue . And office automation is essential ."], "hyps": ["We have a lot of work , but we have to work overtime . We need to work with a company .", "How do you ensure quality ?", "How do you ensure quality ?", "How do you ensure quality ?", "How do you ensure quality ?", "How do you ensure quality ?", "We have a lot of work , but we have to work overtime . We need to work with a company .", "We have a lot of work , but we have to work overtime . We need to work with a company .", "We have a lot of work , but we have to work overtime . We need to work with a company .", "How do you ensure quality ?", "We have a lot of work , but we have to work overtime . We need to work with a company ."], "human_scores": [[2.9], [3.9], [3.9], [3.9], [3.9], [3.9], [2.9], [2.9], [2.9], [3.9], [2.9]]}
{"src": "What if I don't want to find another girl ? . You'll change your mind . Look at everyone in the world . They all break up and move on . The faster you understand this , the quicker you will recover .", "refs": ["You're right ."], "hyps": ["Thank you .", "Right . Thanks .", "Right . Thanks .", "Thank you .", "Right . Thanks .", "Thank you .", "Thank you .", "Right . Thanks .", "Thank you .", "Thank you .", "Thank you ."], "human_scores": [[3.6], [3.7], [3.7], [3.6], [3.7], [3.6], [3.6], [3.7], [3.6], [3.6], [3.6]]}
{"src": "What is it ? What happened ? . I think someone is stalking me .", "refs": ["No , it can't be . Really ? Who ?"], "hyps": ["Yeah , I just got it . I just got it . I just got it .", "No . Really , what happened ?", "No . Really , what happened ?", "No . Really , what happened ?", "No . Really , what happened ?", "No . Really , what happened ?", "No . Really , what happened ?", "No . Really , what happened ?", "Yeah , I just got it . I just got it . I just got it .", "Yeah , I just got it . I just got it . I just got it .", "Yeah , I just got it . I just got it . I just got it ."], "human_scores": [[2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9], [2.9]]}
{"src": "What is it used for ? I mean , why bother to get this special account ? . Group companies can use this to make their arrangement of funds flexible , when dealing with their subsidiaries .", "refs": ["I see , so this can really cut down on time and centralise management . Interesting . . ."], "hyps": ["What does the company have ?", "What kind of action is required ?", "What kind of action is required ?", "What kind of action is required ?", "What kind of action is required ?", "What does the company have ?", "What does the company have ?", "What kind of action is required ?", "What does the company have ?", "What does the company have ?", "What does the company have ?"], "human_scores": [[2.8], [2.6], [2.6], [2.6], [2.6], [2.8], [2.8], [2.6], [2.8], [2.8], [2.8]]}
{"src": "What sort of job would you like to take ? . I prefer a sedentary job and I used to work as an operator .", "refs": ["We need an operator now ."], "hyps": ["What kind of job do you want ?", "How ' d you get that job ?", "How ' d you get that job ?", "How ' d you get that job ?", "How ' d you get that job ?", "What kind of job do you want ?", "What kind of job do you want ?", "What kind of job do you want ?", "What kind of job do you want ?", "What kind of job do you want ?", "What kind of job do you want ?"], "human_scores": [[2.4], [3.9], [3.9], [3.9], [3.9], [2.4], [2.4], [2.4], [2.4], [2.4], [2.4]]}
{"src": "What style do you want ? . I want to buy a V-neck checked sweater , and it should be tight .", "refs": ["Oh , I see . How about the color ?"], "hyps": ["OK . Here you are .", "It doesn't fit quite right . It feels a little tight in the waist . Do you have this in a larger size ?", "It doesn't fit quite right . It feels a little tight in the waist . Do you have this in a larger size ?", "It doesn't fit quite right . It feels a little tight in the waist . Do you have this in a larger size ?", "It doesn't fit quite right . It feels a little tight in the waist . Do you have this in a larger size ?", "It doesn't fit quite right . It feels a little tight in the waist . Do you have this in a larger size ?", "OK . Here you are .", "It doesn't fit quite right . It feels a little tight in the waist . Do you have this in a larger size ?", "It doesn't fit quite right . It feels a little tight in the waist . Do you have this in a larger size ?", "OK . Here you are .", "OK . Here you are ."], "human_scores": [[3.4], [3.5], [3.5], [3.5], [3.5], [3.5], [3.4], [3.5], [3.5], [3.4], [3.4]]}
{"src": "What's the matter , John ? you seemed to be restless today . You see , I've been offered a new job . I can't decide whether to take it or not .", "refs": ["Oh , that's easy . If it's better than the one you are doing now , go for it . That's my advice ."], "hyps": ["Well , I ' ve got to say . I ' ve got a promotion .", "But I don't know what else I can do . I am willing to work hard . Sometimes I make mistakes and the boss is not happy .", "But I don't know what else I can do . I am willing to work hard . Sometimes I make mistakes and the boss is not happy .", "Well , I ' ve got to say . I ' ve got a promotion .", "But I don't know what else I can do . I am willing to work hard . Sometimes I make mistakes and the boss is not happy .", "But I don't know what else I can do . I am willing to work hard . Sometimes I make mistakes and the boss is not happy .", "Well , I ' ve got to say . I ' ve got a promotion .", "Well , I ' ve got to say . I ' ve got a promotion .", "Well , I ' ve got to say . I ' ve got a promotion .", "Well , I ' ve got to say . I ' ve got a promotion .", "But I don't know what else I can do . I am willing to work hard . Sometimes I make mistakes and the boss is not happy ."], "human_scores": [[2.6], [3.1], [3.1], [2.6], [3.1], [3.1], [2.6], [2.6], [2.6], [2.6], [3.1]]}
{"src": "Why aren't you eating anything else ? . Well , fruits and vegetables are very healthy .", "refs": ["And the chicken ?"], "hyps": ["What kind of vegetables do you want to eat ?", "And vegetables with porridge .", "And vegetables with porridge .", "And vegetables with porridge .", "And vegetables with porridge .", "What kind of vegetables do you want to eat ?", "And vegetables with porridge .", "What kind of vegetables do you want to eat ?", "And vegetables with porridge .", "What kind of vegetables do you want to eat ?", "What kind of vegetables do you want to eat ?"], "human_scores": [[3.1], [3.3], [3.3], [3.3], [3.3], [3.1], [3.3], [3.1], [3.3], [3.1], [3.1]]}
{"src": "Why doesn't he ask her ? . He is too scared to ask her .", "refs": ["He's a chicken guy ."], "hyps": ["But I don ' t know .", "He is too scared to ask her .", "He is too scared to ask her .", "He is too scared to ask her .", "He is too scared to ask her .", "He is too scared to ask her .", "But I don ' t know .", "He is too scared to ask her .", "But I don ' t know .", "But I don ' t know .", "But I don ' t know ."], "human_scores": [[3.4], [2.7], [2.7], [2.7], [2.7], [2.7], [3.4], [2.7], [3.4], [3.4], [3.4]]}
{"src": "Why don't you watch where you're going ? . Me ? You're the one who pulled out in front of me !", "refs": ["There was plenty of room for me to pull out . You didn't have to stay in the lane you were in ."], "hyps": ["I ' m not sure .", "Me ? You're the one who pulled out in front of me !", "Me ? You're the one who pulled out in front of me !", "Me ? You're the one who pulled out in front of me !", "I ' m not sure .", "Me ? You're the one who pulled out in front of me !", "Me ? You're the one who pulled out in front of me !", "I ' m not sure .", "I ' m not sure .", "I ' m not sure .", "I ' m not sure ."], "human_scores": [[3.1], [2.3], [2.3], [2.3], [3.1], [2.3], [2.3], [3.1], [3.1], [3.1], [3.1]]}
{"src": "With everything , with everybody , with all this ! . A good suggestion for you . You need a holiday .", "refs": ["It wasn't always like this , you know ."], "hyps": ["What ?", "A good suggestion for you . You need a holiday .", "A good suggestion for you . You need a holiday .", "A good suggestion for you . You need a holiday .", "A good suggestion for you . You need a holiday .", "What ?", "What ?", "A good suggestion for you . You need a holiday .", "A good suggestion for you . You need a holiday .", "What ?", "What ?"], "human_scores": [[3.3], [2.8], [2.8], [2.8], [2.8], [3.3], [3.3], [2.8], [2.8], [3.3], [3.3]]}
{"src": "Wow ! Your calligraphy is very beautiful . It was worth the wait ! . Thank you . Today I'm writing a kind of poem called a Chinese couplet .", "refs": ["What does it say ?"], "hyps": ["It ' s so bad .", "oh , she keeps saying that . She never allows me to have them .", "oh , she keeps saying that . She never allows me to have them .", "oh , she keeps saying that . She never allows me to have them .", "oh , she keeps saying that . She never allows me to have them .", "oh , she keeps saying that . She never allows me to have them .", "oh , she keeps saying that . She never allows me to have them .", "It ' s so bad .", "It ' s so bad .", "It ' s so bad .", "It ' s so bad ."], "human_scores": [[2.3333], [2.2], [2.2], [2.2], [2.2], [2.2], [2.2], [2.3333], [2.3333], [2.3333], [2.3333]]}
{"src": "Yeah , about . Do you know Chinese better now ?", "refs": ["Oh , definitely . I remember , when I first arrived in Guangzhou , my girlfriend was haggling with a sales clerk over the price of a mobile phone ."], "hyps": ["I know . But I know you ' re a student now .", "Just as usual , you know .", "Just as usual , you know .", "I know . But I know you ' re a student now .", "Just as usual , you know .", "Just as usual , you know .", "I know . But I know you ' re a student now .", "I know . But I know you ' re a student now .", "Just as usual , you know .", "Just as usual , you know .", "I know . But I know you ' re a student now ."], "human_scores": [[2.8], [3.2], [3.2], [2.8], [3.2], [3.2], [2.8], [2.8], [3.2], [3.2], [2.8]]}
{"src": "Yes , I have been working in the Public Relations Section of a company in the past two years . I plan the advertising campaign and cooperate the work of artists and typographers . Sometimes I have to do the work of a specialist when there's something urgent . Do you have any practical experience as a secretary ?", "refs": ["Yes , sir . I acted as a secretary in an insurance company ."], "hyps": ["I ' m not familiar with the company , but I don ' t have any other questions . I ' m not familiar with the customer . I ' m afraid I can ' t do any other things .", "First , I worked as a servant .", "First , I worked as a servant .", "First , I worked as a servant .", "First , I worked as a servant .", "First , I worked as a servant .", "First , I worked as a servant .", "I ' m not familiar with the company , but I don ' t have any other questions . I ' m not familiar with the customer . I ' m afraid I can ' t do any other things .", "I ' m not familiar with the company , but I don ' t have any other questions . I ' m not familiar with the customer . I ' m afraid I can ' t do any other things .", "I ' m not familiar with the company , but I don ' t have any other questions . I ' m not familiar with the customer . I ' m afraid I can ' t do any other things .", "I ' m not familiar with the company , but I don ' t have any other questions . I ' m not familiar with the customer . I ' m afraid I can ' t do any other things ."], "human_scores": [[3.4], [2.6], [2.6], [2.6], [2.6], [2.6], [2.6], [3.4], [3.4], [3.4], [3.4]]}
{"src": "Yes , I'd like a book about law . Would you tell me the name of the book and the author ?", "refs": ["Uh , the Origin of Law . And it's written by Professor Felix of Harvard ."], "hyps": ["It ' s author author .", "Let me give you a hand . The author is ...", "Let me give you a hand . The author is ...", "Let me give you a hand . The author is ...", "Let me give you a hand . The author is ...", "Let me give you a hand . The author is ...", "It ' s author author .", "It ' s author author .", "It ' s author author .", "It ' s author author .", "It ' s author author ."], "human_scores": [[2.8], [3.7], [3.7], [3.7], [3.7], [3.7], [2.8], [2.8], [2.8], [2.8], [2.8]]}
{"src": "Yes , I'd like a glass of iced tea . Okay . I'll be back in a minute with your drink and salad .", "refs": ["Thank you ."], "hyps": ["Thank you .", "All right . And would you like a salad ?", "All right . And would you like a salad ?", "Thank you .", "All right . And would you like a salad ?", "All right . And would you like a salad ?", "All right . And would you like a salad ?", "All right . And would you like a salad ?", "Thank you .", "Thank you .", "Thank you ."], "human_scores": [[3.7778], [3.0], [3.0], [3.7778], [3.0], [3.0], [3.0], [3.0], [3.7778], [3.7778], [3.7778]]}
{"src": "Yes , smoking or non-smoking ? . We'd like a non-smoking table , please .", "refs": ["Come with me , please ."], "hyps": ["Yes , please .", "Smoking or non-smoking ?", "Smoking or non-smoking ?", "Yes , please .", "Smoking or non-smoking ?", "Yes , please .", "Smoking or non-smoking ?", "Yes , please .", "Smoking or non-smoking ?", "Yes , please .", "Yes , please ."], "human_scores": [[3.4], [2.9], [2.9], [3.4], [2.9], [3.4], [2.9], [3.4], [2.9], [3.4], [3.4]]}
{"src": "Yes . There have been a few there recently . They say that this one was not a big quake . The Iranians are dealing with it on their own . They have purchased some special equipment to find people buried u . Does the newspaper say anything about casualties ?", "refs": ["So far , less than 20 people have died , but over 100 are in hospital ."], "hyps": ["For example , the people are in the past two months , as the people are in the country , but not as bad as the government is highly competitive .", "Moving to to Latin American , Ecuador has suffered a six month drought that has not only affected farming , but has also forced the closure of the hydroelectric power plant that provides electricity for the entire country . In Chile , a major earthquake that registered seven point five on the Richter scale struck the southern region . Losses are reported to be in the billions . Authorities have not yet released an official statement .", "Moving to to Latin American , Ecuador has suffered a six month drought that has not only affected farming , but has also forced the closure of the hydroelectric power plant that provides electricity for the entire country . In Chile , a major earthquake that registered seven point five on the Richter scale struck the southern region . Losses are reported to be in the billions . Authorities have not yet released an official statement .", "Moving to to Latin American , Ecuador has suffered a six month drought that has not only affected farming , but has also forced the closure of the hydroelectric power plant that provides electricity for the entire country . In Chile , a major earthquake that registered seven point five on the Richter scale struck the southern region . Losses are reported to be in the billions . Authorities have not yet released an official statement .", "For example , the people are in the past two months , as the people are in the country , but not as bad as the government is highly competitive .", "Moving to to Latin American , Ecuador has suffered a six month drought that has not only affected farming , but has also forced the closure of the hydroelectric power plant that provides electricity for the entire country . In Chile , a major earthquake that registered seven point five on the Richter scale struck the southern region . Losses are reported to be in the billions . Authorities have not yet released an official statement .", "Moving to to Latin American , Ecuador has suffered a six month drought that has not only affected farming , but has also forced the closure of the hydroelectric power plant that provides electricity for the entire country . In Chile , a major earthquake that registered seven point five on the Richter scale struck the southern region . Losses are reported to be in the billions . Authorities have not yet released an official statement .", "For example , the people are in the past two months , as the people are in the country , but not as bad as the government is highly competitive .", "For example , the people are in the past two months , as the people are in the country , but not as bad as the government is highly competitive .", "For example , the people are in the past two months , as the people are in the country , but not as bad as the government is highly competitive .", "For example , the people are in the past two months , as the people are in the country , but not as bad as the government is highly competitive ."], "human_scores": [[2.1111], [2.6], [2.6], [2.6], [2.1111], [2.6], [2.6], [2.1111], [2.1111], [2.1111], [2.1111]]}
{"src": "Yes . What's the weather like in your country ?", "refs": ["Mm . . . It's quite warm now ."], "hyps": ["It ' s very hot . The summers are very rainy .", "I love winter , I love snow .", "I love winter , I love snow .", "I love winter , I love snow .", "It ' s very hot . The summers are very rainy .", "I love winter , I love snow .", "I love winter , I love snow .", "I love winter , I love snow .", "I love winter , I love snow .", "It ' s very hot . The summers are very rainy .", "It ' s very hot . The summers are very rainy ."], "human_scores": [[4.4545], [2.8], [2.8], [2.8], [4.4545], [2.8], [2.8], [2.8], [2.8], [4.4545], [4.4545]]}
{"src": "You can touch them only between the shoulder and the knees . The touchdown lines are there and there . OK , let's play !", "refs": ["Before we start , let's have a moment of silence for our fallen men ."], "hyps": ["No kidding ! I don ' t think I can see it .", "is that why my knees have felt sore after every time I've ridden my bike ?", "is that why my knees have felt sore after every time I've ridden my bike ?", "is that why my knees have felt sore after every time I've ridden my bike ?", "No kidding ! I don ' t think I can see it .", "No kidding ! I don ' t think I can see it .", "is that why my knees have felt sore after every time I've ridden my bike ?", "No kidding ! I don ' t think I can see it .", "No kidding ! I don ' t think I can see it .", "No kidding ! I don ' t think I can see it .", "No kidding ! I don ' t think I can see it ."], "human_scores": [[2.9091], [2.9], [2.9], [2.9], [2.9091], [2.9091], [2.9], [2.9091], [2.9091], [2.9091], [2.9091]]}
{"src": "You can't come any earlier than that ? . I'm sorry . That's the only available time .", "refs": ["Are you available this Saturday ?"], "hyps": ["What time does the next time ?", "I can't catch the bus with you anymore .", "I can't catch the bus with you anymore .", "I can't catch the bus with you anymore .", "I can't catch the bus with you anymore .", "What time does the next time ?", "I can't catch the bus with you anymore .", "What time does the next time ?", "What time does the next time ?", "What time does the next time ?", "What time does the next time ?"], "human_scores": [[3.4], [2.6], [2.6], [2.6], [2.6], [3.4], [2.6], [3.4], [3.4], [3.4], [3.4]]}
{"src": "You get your bus pass ? . I'm not going to buy one .", "refs": ["You're not ?"], "hyps": ["How much do you want to get ?", "Is it fun driving the bus ?", "Is it fun driving the bus ?", "Is it fun driving the bus ?", "Is it fun driving the bus ?", "How much do you want to get ?", "Is it fun driving the bus ?", "How much do you want to get ?", "Is it fun driving the bus ?", "How much do you want to get ?", "Is it fun driving the bus ?"], "human_scores": [[2.5], [2.1], [2.1], [2.1], [2.1], [2.5], [2.1], [2.5], [2.1], [2.5], [2.1]]}
{"src": "You know , I fell in love with this house the first moment I laid eyes on it . The style of the exterior is just what I'Ve been looking for !", "refs": ["The exterior is only half of the story . The interior is incredible ."], "hyps": ["Have you ever been to the windows ?", "Well could you do me the favor of making this quick ? It ' s the third quarter and you ' Ve been blabbering on since the first !", "Well could you do me the favor of making this quick ? It ' s the third quarter and you ' Ve been blabbering on since the first !", "Well could you do me the favor of making this quick ? It ' s the third quarter and you ' Ve been blabbering on since the first !", "Have you ever been to the windows ?", "Have you ever been to the windows ?", "Well could you do me the favor of making this quick ? It ' s the third quarter and you ' Ve been blabbering on since the first !", "Well could you do me the favor of making this quick ? It ' s the third quarter and you ' Ve been blabbering on since the first !", "Well could you do me the favor of making this quick ? It ' s the third quarter and you ' Ve been blabbering on since the first !", "Have you ever been to the windows ?", "Well could you do me the favor of making this quick ? It ' s the third quarter and you ' Ve been blabbering on since the first !"], "human_scores": [[2.4545], [2.8], [2.8], [2.8], [2.4545], [2.4545], [2.8], [2.8], [2.8], [2.4545], [2.8]]}
{"src": "You need a babysitter . Yes , I'd ask Jill , the girl I've had before , but I need someone overnight . Maybe even for two nights .", "refs": ["I could have Suzy stay at my place ."], "hyps": ["I know , but I ' m a girl of my own friends .", "You need a babysitter .", "You need a babysitter .", "You need a babysitter .", "I know , but I ' m a girl of my own friends .", "I know , but I ' m a girl of my own friends .", "You need a babysitter .", "I know , but I ' m a girl of my own friends .", "I know , but I ' m a girl of my own friends .", "You need a babysitter .", "I know , but I ' m a girl of my own friends ."], "human_scores": [[2.9], [3.1], [3.1], [3.1], [2.9], [2.9], [3.1], [2.9], [2.9], [3.1], [2.9]]}
{"src": "You'll need to make an appointment . Could I do that right now , please ?", "refs": ["What day would you like us to do the installation ?"], "hyps": ["I ' m sorry . I can ' t .", "You need an appointment .", "You need an appointment .", "You need an appointment .", "You need an appointment .", "You need an appointment .", "I ' m sorry . I can ' t .", "You need an appointment .", "You need an appointment .", "You need an appointment .", "I ' m sorry . I can ' t ."], "human_scores": [[3.3], [2.8], [2.8], [2.8], [2.8], [2.8], [3.3], [2.8], [2.8], [2.8], [3.3]]}
{"src": "You're made a good choice . This china tea set is unusual . Where was it from ?", "refs": ["It was made in Jingdezhen ."], "hyps": ["It was great . But I didn ' t know you were in the middle of the tea .", "Tea and silk .", "Tea and silk .", "It was great . But I didn ' t know you were in the middle of the tea .", "Tea and silk .", "Tea and silk .", "Tea and silk .", "Tea and silk .", "It was great . But I didn ' t know you were in the middle of the tea .", "It was great . But I didn ' t know you were in the middle of the tea .", "It was great . But I didn ' t know you were in the middle of the tea ."], "human_scores": [[2.1], [2.1], [2.1], [2.1], [2.1], [2.1], [2.1], [2.1], [2.1], [2.1], [2.1]]}
{"src": "she said that the columnist for the literary criticism column would be going on pregnancy leave soon and that I could be in charge of the column until she came back . wow ! That's really great news . How often does the magazine come out ?", "refs": ["it's a monthly magazine , but my column will be shared with another columnist so my articles will be due fortnightly ."], "hyps": ["The news is a very good idea .", "She said that the columnist for the literary criticism column would be going on pregnancy leave soon and that I could be in charge of the column until she came back .", "She said that the columnist for the literary criticism column would be going on pregnancy leave soon and that I could be in charge of the column until she came back .", "She said that the columnist for the literary criticism column would be going on pregnancy leave soon and that I could be in charge of the column until she came back .", "The news is a very good idea .", "She said that the columnist for the literary criticism column would be going on pregnancy leave soon and that I could be in charge of the column until she came back .", "The news is a very good idea .", "The news is a very good idea .", "The news is a very good idea .", "She said that the columnist for the literary criticism column would be going on pregnancy leave soon and that I could be in charge of the column until she came back .", "The news is a very good idea ."], "human_scores": [[2.2], [1.8889], [1.8889], [1.8889], [2.2], [1.8889], [2.2], [2.2], [2.2], [1.8889], [2.2]]}
{"src": "yes , that's my only day off until Thursday . ok , well , my friends and I are planning on going to the beach on Sunday . We tend to leave around noon whenever we go anywhere , so you could still sleep in . Do you want to come with us ?", "refs": ["that'd be fantastic ! Which beach are you going to ?"], "hyps": ["ok . I ' ll be there in the afternoon .", "Ok , well , my friends and I are planning on going to the beach on Sunday . We tend to leave around noon whenever we go anywhere , so you could still sleep in . Do you want to come with us ?", "Ok , well , my friends and I are planning on going to the beach on Sunday . We tend to leave around noon whenever we go anywhere , so you could still sleep in . Do you want to come with us ?", "Ok , well , my friends and I are planning on going to the beach on Sunday . We tend to leave around noon whenever we go anywhere , so you could still sleep in . Do you want to come with us ?", "Ok , well , my friends and I are planning on going to the beach on Sunday . We tend to leave around noon whenever we go anywhere , so you could still sleep in . Do you want to come with us ?", "ok . I ' ll be there in the afternoon .", "ok . I ' ll be there in the afternoon .", "Ok , well , my friends and I are planning on going to the beach on Sunday . We tend to leave around noon whenever we go anywhere , so you could still sleep in . Do you want to come with us ?", "ok . I ' ll be there in the afternoon .", "ok . I ' ll be there in the afternoon .", "ok . I ' ll be there in the afternoon ."], "human_scores": [[3.6], [3.0], [3.0], [3.0], [3.0], [3.6], [3.6], [3.0], [3.6], [3.6], [3.6]]}