-
Notifications
You must be signed in to change notification settings - Fork 2
/
Copy pathResults.txt
57 lines (36 loc) · 3.07 KB
/
Results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
statistics (use ROUGE-1 and ROUGE-L for short summaries - as concluded in the paper)
---------------- unsupervised --------------------
raw baseline (abstract = title)
train_score: [ 0.05777356 0.71944373 0.10377109 0.0225491 0.32310613 0.04084743 0.04668315 0.59608783 0.08392165]
valid_score: [ 0.05935603 0.72189205 0.10639564 0.02248412 0.31186534 0.04069314 0.04778913 0.59563799 0.08576837]
test_score: [ 0.05737837 0.72191434 0.10321764 0.02240592 0.32590935 0.04074832 0.04607175 0.59697195 0.08300583]
sentence-based baselines
similarity_baseline (3)
train_score: [ 0.13720429 0.3695703 0.18902437 0.04619206 0.12894483 0.06387888 0.11662796 0.31422159 0.16047035]
valid_score: [ 0.13915731 0.37473223 0.19206039 0.04445149 0.12341064 0.06157652 0.11673708 0.31472454 0.16100967]
test_score : [ 0.1378991 0.37295329 0.18993196 0.04514784 0.12535243 0.06240024 0.11707898 0.31546915 0.1609307 ]
first_sent_baseline (1)
train_score: [ 0.17251663 0.41166853 0.23063909 0.0699062 0.17491257 0.09430542 0.14942159 0.35591035 0.19948836]
valid_score: [ 0.17456272 0.41580812 0.23367497 0.06959914 0.17115725 0.09387467 0.15145102 0.35915024 0.20243737]
test_score: [ 0.17865814 0.42594955 0.23860636 0.0745016 0.1830511 0.10017982 0.15480939 0.36593075 0.20610119]
informative_baseline (6)
train_score: [ 0.09822971 0.36353437 0.14843938 0.02804614 0.10806886 0.04249621 0.08106311 0.30277107 0.12261924]
valid_score: [ 0.10383546 0.37099678 0.15590839 0.02995687 0.11112236 0.04526049 0.08444961 0.30465885 0.1270571 ] (revised)
test_score: [ 0.09506399 0.35883829 0.14409226 0.02647001 0.10375005 0.04021338 0.07796685 0.29521587 0.11810745]
[ 0.10033506 0.37099678 0.15203864 0.02884879 0.11112236 0.04402047
0.08157846 0.30465885 0.12387416]
textrank using
cosine_similarity (2)
train_score: [ 0.14045988 0.38041768 0.19396831 0.04856175 0.13611912 0.06727395 0.11947846 0.32362217 0.16478412]
valid_score: [ 0.14359436 0.38587207 0.19837132 0.04944587 0.13874223 0.06887844 0.12025811 0.32312903 0.16594073] (revised)
test_score: [ 0.14121213 0.3837661 0.19478509 0.04731636 0.13212947 0.06542408 0.11989161 0.32467314 0.16506172]
overlap (4)
train_score: [ 0.11584769 0.36611601 0.16779971 0.03536504 0.11675914 0.05144808 0.09622787 0.30613443 0.13944336]
valid_score: [ 0.11660824 0.35923102 0.16795526 0.03535193 0.11438725 0.05144435 0.0957487 0.29612781 0.13789276] (revised)
test_score: [ 0.11676662 0.370084 0.16887252 0.0351841 0.11560193 0.051025 0.09671828 0.30653626 0.13976528]
lcs (5)
train_score: [ 0.11655479 0.35688365 0.16722265 0.03623884 0.11573115 0.05221451 0.09804704 0.30143486 0.14063894]
valid_score: [ 0.11791522 0.34964302 0.16740264 0.03688517 0.11535082 0.05294914 0.09818772 0.29203297 0.13936353] (revised)
test_score: [ 0.11528633 0.35766488 0.16538276 0.03467381 0.11169024 0.04977165 0.09618912 0.29901201 0.13789732]
LexRank, LSA, Luhn
---------------- supervised --------------------