Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TurboParser: Warning: negative loss set to zero #9

Closed
KavithaShanmugam opened this issue Dec 14, 2014 · 5 comments
Closed

TurboParser: Warning: negative loss set to zero #9

KavithaShanmugam opened this issue Dec 14, 2014 · 5 comments

Comments

@KavithaShanmugam
Copy link

Hello André,

While running the TurboParser, I met the issue 'Warning: negative loss set to zero'. So it doesn't create my model file. Could you tell me how can I solve the problem?

Number of lemmas: 37584
Number of prefixes: 14992
Number of suffixes: 15958
Number of feats: 136
Number of pos: 16
Number of cpos: 16
I1214 20:39:04.867661 11544 DependencyDictionary.cpp:23] Creating label dictionary...
I1214 20:39:10.681474 11544 DependencyDictionary.cpp:119] Number of labels: 49
I1214 20:39:10.681498 11544 Pipe.cpp:162] Creating instances...
I1214 20:39:14.556612 11544 Pipe.cpp:173] Number of instances: 38727
I1214 20:39:14.556635 11544 Pipe.cpp:176] Time: 3875
I1214 20:39:14.556643 11544 Pipe.cpp:227] Iteration #1
I1214 20:49:09.729652 11544 Pipe.cpp:298] Warning: negative loss set to zero: -3.19698e-05
I1214 21:01:59.082556 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000402706
I1214 21:03:41.430321 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000217093
I1214 21:04:14.975215 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000174368
I1214 21:12:15.398232 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000450352
I1214 21:19:53.778995 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00204287
I1214 21:36:56.308676 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000464799
I1214 21:36:58.225278 11544 Pipe.cpp:361] Time: 3463668
I1214 21:36:58.225317 11544 Pipe.cpp:362] Time to score: 897562
I1214 21:36:58.225322 11544 Pipe.cpp:363] Time to decode: 1832612
I1214 21:36:58.225327 11544 Pipe.cpp:364] Number of Features: 34974543
I1214 21:36:58.225332 11544 Pipe.cpp:369] Total Cost: 326157 Total Loss: 402696 Total Reg: 7.69363e-11 Total Loss+Reg: 402696

Thank you in advance!

@andre-martins
Copy link
Owner

Hi Kavitha,

Is this your full log? Are you running just one iteration? Can you please
send me your command line and your full log?

The "negative loss" message appears sometimes; if the number is close to
zero, it's usually not a problem. I don't see any error message, are you
sure the model file was not written?

Best,

Andre'

2014-12-14 21:10 GMT+00:00 KavithaShanmugam [email protected]:

Hello André,

While running the TurboParser, I met the issue 'Warning: negative loss set
to zero'. So it doesn't create my model file. Could you tell me how can I
solve the problem?

Number of lemmas: 37584
Number of prefixes: 14992
Number of suffixes: 15958
Number of feats: 136
Number of pos: 16
Number of cpos: 16
I1214 20:39:04.867661 11544 DependencyDictionary.cpp:23] Creating label
dictionary...
I1214 20:39:10.681474 11544 DependencyDictionary.cpp:119] Number of
labels: 49
I1214 20:39:10.681498 11544 Pipe.cpp:162] Creating instances...
I1214 20:39:14.556612 11544 Pipe.cpp:173] Number of instances: 38727
I1214 20:39:14.556635 11544 Pipe.cpp:176] Time: 3875
I1214 20:39:14.556643 11544 Pipe.cpp:227] Iteration #1
#1
I1214 20:49:09.729652 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -3.19698e-05
I1214 21:01:59.082556 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000402706
I1214 21:03:41.430321 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000217093
I1214 21:04:14.975215 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000174368
I1214 21:12:15.398232 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000450352
I1214 21:19:53.778995 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00204287
I1214 21:36:56.308676 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000464799
I1214 21:36:58.225278 11544 Pipe.cpp:361] Time: 3463668
I1214 21:36:58.225317 11544 Pipe.cpp:362] Time to score: 897562
I1214 21:36:58.225322 11544 Pipe.cpp:363] Time to decode: 1832612
I1214 21:36:58.225327 11544 Pipe.cpp:364] Number of Features: 34974543
I1214 21:36:58.225332 11544 Pipe.cpp:369] Total Cost: 326157 Total Loss:
402696 Total Reg: 7.69363e-11 Total Loss+Reg: 402696

Thank you in advance!


Reply to this email directly or view it on GitHub
#9.

@KavithaShanmugam
Copy link
Author

Hi Andre',

Thanks for your reply.

Actually I run the same command with 1k sentences training data. It works properly and writes the model file. But when I try to run this to the whole data(40k sentences), it gives the warning message and also takes long time to train (whole night ). But did not write the model file.

Please find attached full log file(not completed.. still running)

Thank you!

kavi@kavi-iPad-Z510:~/TurboParser-2.2.0$ ./TurboParser --train --file_train=data/Czech/Czech-train.conll06 --file_model=models/Czech/Czech-parser.model --logtostderr
I1214 20:08:26.576424 11544 TurboParser.cpp:45] Training parser...
I1214 20:08:26.576524 11544 DependencyOptions.cpp:232] Arc factored parts enabled.
I1214 20:08:26.576536 11544 DependencyOptions.cpp:235] Consecutive sibling parts enabled.
I1214 20:08:26.576545 11544 DependencyOptions.cpp:238] Grandparent parts enabled.
I1214 20:08:26.576568 11544 TurboParser.cpp:71] Training the pruner...
I1214 20:08:26.576580 11544 DependencyOptions.cpp:232] Arc factored parts enabled.
I1214 20:08:26.576599 11544 TokenDictionary.cpp:209] Creating token dictionary...
I1214 20:08:30.290740 11544 TokenDictionary.cpp:339] Incrementing form cutoff to 1...
I1214 20:08:30.340009 11544 TokenDictionary.cpp:418] Number of forms: 36565
Number of lemmas: 37584
Number of prefixes: 14992
Number of suffixes: 15958
Number of feats: 136
Number of pos: 16
Number of cpos: 16
I1214 20:08:30.390090 11544 DependencyDictionary.cpp:23] Creating label dictionary...
I1214 20:08:36.429968 11544 DependencyDictionary.cpp:119] Number of labels: 49
I1214 20:08:36.430012 11544 Pipe.cpp:162] Creating instances...
I1214 20:08:40.550297 11544 Pipe.cpp:173] Number of instances: 38727
I1214 20:08:40.550348 11544 Pipe.cpp:176] Time: 4120
I1214 20:08:40.550359 11544 Pipe.cpp:184] Building supported feature set...
I1214 20:08:48.671314 11544 Pipe.cpp:205] Number of Features: 2234809
I1214 20:08:48.671345 11544 Pipe.cpp:227] Iteration #1
I1214 20:12:03.425447 11544 Pipe.cpp:361] Time: 194754
I1214 20:12:03.425477 11544 Pipe.cpp:362] Time to score: 10462
I1214 20:12:03.425487 11544 Pipe.cpp:363] Time to decode: 12872
I1214 20:12:03.425496 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:12:03.425504 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 502310 Total Reg: 109658 Total Loss+Reg: 611968
I1214 20:12:03.425560 11544 Pipe.cpp:227] Iteration #2
I1214 20:15:21.603869 11544 Pipe.cpp:361] Time: 198178
I1214 20:15:21.603907 11544 Pipe.cpp:362] Time to score: 11159
I1214 20:15:21.603914 11544 Pipe.cpp:363] Time to decode: 12643
I1214 20:15:21.603920 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:15:21.603927 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 413366 Total Reg: 195587 Total Loss+Reg: 608953
I1214 20:15:21.603955 11544 Pipe.cpp:227] Iteration #3
I1214 20:18:40.581609 11544 Pipe.cpp:361] Time: 198977
I1214 20:18:40.581645 11544 Pipe.cpp:362] Time to score: 11203
I1214 20:18:40.581653 11544 Pipe.cpp:363] Time to decode: 12730
I1214 20:18:40.581658 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:18:40.581665 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 385248 Total Reg: 276631 Total Loss+Reg: 661879
I1214 20:18:40.581691 11544 Pipe.cpp:227] Iteration #4
I1214 20:21:57.463152 11544 Pipe.cpp:361] Time: 196881
I1214 20:21:57.463192 11544 Pipe.cpp:362] Time to score: 10851
I1214 20:21:57.463201 11544 Pipe.cpp:363] Time to decode: 12769
I1214 20:21:57.463207 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:21:57.463215 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 367437 Total Reg: 355517 Total Loss+Reg: 722954
I1214 20:21:57.463251 11544 Pipe.cpp:227] Iteration #5
I1214 20:25:09.175842 11544 Pipe.cpp:361] Time: 191712
I1214 20:25:09.175878 11544 Pipe.cpp:362] Time to score: 10255
I1214 20:25:09.175887 11544 Pipe.cpp:363] Time to decode: 12494
I1214 20:25:09.175895 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:25:09.175904 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 354286 Total Reg: 433315 Total Loss+Reg: 787600
I1214 20:25:09.175936 11544 Pipe.cpp:227] Iteration #6
I1214 20:27:56.897713 11544 Pipe.cpp:361] Time: 167721
I1214 20:27:56.897752 11544 Pipe.cpp:362] Time to score: 6632
I1214 20:27:56.897758 11544 Pipe.cpp:363] Time to decode: 12061
I1214 20:27:56.897761 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:27:56.897766 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 343790 Total Reg: 510583 Total Loss+Reg: 854373
I1214 20:27:56.897789 11544 Pipe.cpp:227] Iteration #7
I1214 20:30:41.556926 11544 Pipe.cpp:361] Time: 164659
I1214 20:30:41.556963 11544 Pipe.cpp:362] Time to score: 6160
I1214 20:30:41.556969 11544 Pipe.cpp:363] Time to decode: 12050
I1214 20:30:41.556974 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:30:41.556979 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 335011 Total Reg: 587665 Total Loss+Reg: 922676
I1214 20:30:41.557003 11544 Pipe.cpp:227] Iteration #8
I1214 20:33:25.852452 11544 Pipe.cpp:361] Time: 164295
I1214 20:33:25.852490 11544 Pipe.cpp:362] Time to score: 6170
I1214 20:33:25.852495 11544 Pipe.cpp:363] Time to decode: 12000
I1214 20:33:25.852500 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:33:25.852504 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 327437 Total Reg: 664781 Total Loss+Reg: 992218
I1214 20:33:25.852527 11544 Pipe.cpp:227] Iteration #9
I1214 20:36:15.799032 11544 Pipe.cpp:361] Time: 169946
I1214 20:36:15.799062 11544 Pipe.cpp:362] Time to score: 6925
I1214 20:36:15.799070 11544 Pipe.cpp:363] Time to decode: 12362
I1214 20:36:15.799077 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:36:15.799083 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 320752 Total Reg: 742079 Total Loss+Reg: 1.06283e+06
I1214 20:36:15.799110 11544 Pipe.cpp:227] Iteration #10
I1214 20:39:01.093808 11544 Pipe.cpp:361] Time: 165294
I1214 20:39:01.093845 11544 Pipe.cpp:362] Time to score: 6613
I1214 20:39:01.093853 11544 Pipe.cpp:363] Time to decode: 11890
I1214 20:39:01.093858 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:39:01.093864 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 314762 Total Reg: 819668 Total Loss+Reg: 1.13443e+06
I1214 20:39:01.093891 11544 Parameters.h:205] Averaging the weights...
I1214 20:39:01.300807 11544 TurboParser.cpp:92] Training the parser...
I1214 20:39:01.301555 11544 TokenDictionary.cpp:209] Creating token dictionary...
I1214 20:39:04.791872 11544 TokenDictionary.cpp:339] Incrementing form cutoff to 1...
I1214 20:39:04.833047 11544 TokenDictionary.cpp:418] Number of forms: 36565
Number of lemmas: 37584
Number of prefixes: 14992
Number of suffixes: 15958
Number of feats: 136
Number of pos: 16
Number of cpos: 16
I1214 20:39:04.867661 11544 DependencyDictionary.cpp:23] Creating label dictionary...
I1214 20:39:10.681474 11544 DependencyDictionary.cpp:119] Number of labels: 49
I1214 20:39:10.681498 11544 Pipe.cpp:162] Creating instances...
I1214 20:39:14.556612 11544 Pipe.cpp:173] Number of instances: 38727
I1214 20:39:14.556635 11544 Pipe.cpp:176] Time: 3875
I1214 20:39:14.556643 11544 Pipe.cpp:227] Iteration #1
I1214 20:49:09.729652 11544 Pipe.cpp:298] Warning: negative loss set to zero: -3.19698e-05
I1214 21:01:59.082556 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000402706
I1214 21:03:41.430321 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000217093
I1214 21:04:14.975215 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000174368
I1214 21:12:15.398232 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000450352
I1214 21:19:53.778995 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00204287
I1214 21:36:56.308676 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000464799
I1214 21:36:58.225278 11544 Pipe.cpp:361] Time: 3463668
I1214 21:36:58.225317 11544 Pipe.cpp:362] Time to score: 897562
I1214 21:36:58.225322 11544 Pipe.cpp:363] Time to decode: 1832612
I1214 21:36:58.225327 11544 Pipe.cpp:364] Number of Features: 34974543
I1214 21:36:58.225332 11544 Pipe.cpp:369] Total Cost: 326157 Total Loss: 402696 Total Reg: 7.69363e-11 Total Loss+Reg: 402696
I1214 21:36:58.225360 11544 Pipe.cpp:227] Iteration #2
I1214 21:37:36.103443 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000168378
I1214 21:46:05.249917 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00578516
I1214 21:48:35.397475 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0211366
I1214 21:49:20.015326 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000704581
I1214 21:50:24.360394 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000112307
I1214 21:54:05.387260 11544 Pipe.cpp:298] Warning: negative loss set to zero: -4.15231e-05
I1214 21:57:45.024878 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0101639
I1214 22:04:15.251478 11544 Pipe.cpp:298] Warning: negative loss set to zero: -6.88176e-05
I1214 22:04:27.366225 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0105914
I1214 22:12:13.712461 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00330097
I1214 22:32:11.275853 11544 Pipe.cpp:298] Warning: negative loss set to zero: -4.96614e-05
I1214 22:33:58.087064 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0083766
I1214 22:34:16.839030 11544 Pipe.cpp:361] Time: 3438613
I1214 22:34:16.839071 11544 Pipe.cpp:362] Time to score: 980441
I1214 22:34:16.839077 11544 Pipe.cpp:363] Time to decode: 1743647
I1214 22:34:16.839082 11544 Pipe.cpp:364] Number of Features: 40555110
I1214 22:34:16.839087 11544 Pipe.cpp:369] Total Cost: 273408 Total Loss: 312436 Total Reg: 1.46058e-10 Total Loss+Reg: 312436
I1214 22:34:16.841531 11544 Pipe.cpp:227] Iteration #3
I1214 22:34:35.326057 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000432675
I1214 22:36:35.741765 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00160599
I1214 22:46:28.810178 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00183052
I1214 22:47:16.222815 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000705572
I1214 22:57:58.573829 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000470276
I1214 23:01:03.920999 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000663309
I1214 23:03:12.735443 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000112821
I1214 23:05:30.579565 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0177384
I1214 23:11:10.843973 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00166302
I1214 23:12:11.617509 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0006038
I1214 23:21:03.122505 11544 Pipe.cpp:298] Warning: negative loss set to zero: -3.27816e-05
I1214 23:26:14.718315 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00192696
I1214 23:27:27.962764 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0024685
I1214 23:27:43.475091 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000423465
I1214 23:30:46.151522 11544 Pipe.cpp:361] Time: 3389309
I1214 23:30:46.151559 11544 Pipe.cpp:362] Time to score: 972265
I1214 23:30:46.151566 11544 Pipe.cpp:363] Time to decode: 1717691
I1214 23:30:46.151571 11544 Pipe.cpp:364] Number of Features: 43829871
I1214 23:30:46.151578 11544 Pipe.cpp:369] Total Cost: 255174 Total Loss: 270004 Total Reg: 2.14684e-10 Total Loss+Reg: 270004
I1214 23:30:46.151614 11544 Pipe.cpp:227] Iteration #4
I1214 23:34:35.396003 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0126469
I1214 23:36:21.903039 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00018784
I1214 23:51:14.166728 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00049679
I1214 23:59:28.567047 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000171151
I1215 00:00:58.541774 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000710875
I1215 00:08:11.732695 11544 Pipe.cpp:298] Warning: negative loss set to zero: -4.70466e-05
I1215 00:14:47.552525 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000291439
I1215 00:16:22.490658 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000457735
I1215 00:19:01.265662 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000204504
I1215 00:23:21.523278 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000887981
I1215 00:23:43.208950 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000183278
I1215 00:23:49.940100 11544 Pipe.cpp:298] Warning: negative loss set to zero: -6.26296e-05
I1215 00:27:27.392761 11544 Pipe.cpp:298] Warning: negative loss set to zero: -9.23284e-05
I1215 00:27:48.606684 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00185864
I1215 00:28:05.745260 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.018427
I1215 00:30:02.183444 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000107557
I1215 00:31:32.717135 11544 Pipe.cpp:361] Time: 3646564
I1215 00:31:32.717170 11544 Pipe.cpp:362] Time to score: 1182442
I1215 00:31:32.717176 11544 Pipe.cpp:363] Time to decode: 1721560
I1215 00:31:32.717182 11544 Pipe.cpp:364] Number of Features: 46167141
I1215 00:31:32.717190 11544 Pipe.cpp:369] Total Cost: 243254 Total Loss: 240814 Total Reg: 2.83232e-10 Total Loss+Reg: 240814
I1215 00:31:32.719414 11544 Pipe.cpp:227] Iteration #5
I1215 00:32:18.471662 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000233227
I1215 00:32:19.350643 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00789694
I1215 00:33:39.939997 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00222306
I1215 00:34:15.052208 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0243224
I1215 00:35:36.471153 11544 Pipe.cpp:298] Warning: negative loss set to zero: -3.91096e-05
I1215 00:39:32.056607 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00100154
I1215 00:48:16.318291 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00635667
I1215 00:49:01.077747 11544 Pipe.cpp:298] Warning: negative loss set to zero: -8.22168e-05
I1215 00:54:34.210605 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00379613
I1215 00:57:16.868134 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.0004494
I1215 01:02:40.237823 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000268856
I1215 01:03:06.033054 11544 Pipe.cpp:298] Warning: negative loss set to zero: -5.61473e-05
I1215 01:08:45.846608 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00103484
I1215 01:11:59.697304 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00201351
I1215 01:20:15.031930 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00400914
I1215 01:37:08.056206 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00454221
I1215 01:55:27.725496 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00236251
I1215 02:07:45.432548 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00226397
I1215 02:21:16.066401 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00817575
I1215 02:24:27.191319 11544 Pipe.cpp:298] Warning: negative loss set to zero: -4.25567e-05
I1215 02:36:43.818660 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000135712
I1215 02:37:35.392369 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000592477
I1215 02:46:58.217617 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00173039
I1215 03:10:06.652822 11544 Pipe.cpp:298] Warning: negative loss set to zero: -5.20211e-05
I1215 03:11:32.489289 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00206861
I1215 03:17:36.865586 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000219825
I1215 03:36:47.834882 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000245461
I1215 03:39:54.197715 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00201284
I1215 04:02:34.900385 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000243124
I1215 04:36:54.576557 11544 Pipe.cpp:361] Time: 14721833
I1215 04:36:54.584987 11544 Pipe.cpp:362] Time to score: 10514690
I1215 04:36:54.584996 11544 Pipe.cpp:363] Time to decode: 1731622
I1215 04:36:54.585002 11544 Pipe.cpp:364] Number of Features: 47988063
I1215 04:36:54.585008 11544 Pipe.cpp:369] Total Cost: 233360 Total Loss: 217938 Total Reg: 3.51327e-10 Total Loss+Reg: 217938
I1215 04:36:54.635228 11544 Pipe.cpp:227] Iteration #6
I1215 05:03:00.122529 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000158814
I1215 06:19:59.364127 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000264811
I1215 07:00:09.667724 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00140423
I1215 07:29:28.644280 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000887814
I1215 08:19:44.711737 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.000183258
I1215 08:30:32.035040 11544 Pipe.cpp:298] Warning: negative loss set to zero: -4.02768e-05
I1215 08:39:27.935580 11544 Pipe.cpp:298] Warning: negative loss set to zero: -0.00328593

@andre-martins
Copy link
Owner

Hi Kavitha,

The warning is normal. The Czech CoNLL-X dataset is quite large, so I'm not
surprised that it takes the whole night to train. But which error message
are you talking about? Can you send me the full log now that (hopefully)
the training has already finished?

Thanks,

André

2014-12-15 8:14 GMT+00:00 KavithaShanmugam [email protected]:

Hi Andre',

Thanks for your reply.

Actually I run the same command with 1k sentences training data. It works
properly and writes the model file. But when I try to run this to the whole
data(40k sentences), it gives the error message and also takes long time to
train (whole night ). But did not write the model file.

Please find attached full log file(not completed.. still running)

Thank you!

kavi@kavi-iPad-Z510:~/TurboParser-2.2.0$ ./TurboParser --train
--file_train=data/Czech/Czech-train.conll06
--file_model=models/Czech/Czech-parser.model --logtostderr
I1214 20:08:26.576424 11544 TurboParser.cpp:45] Training parser...
I1214 20:08:26.576524 11544 DependencyOptions.cpp:232] Arc factored parts
enabled.
I1214 20:08:26.576536 11544 DependencyOptions.cpp:235] Consecutive sibling
parts enabled.
I1214 20:08:26.576545 11544 DependencyOptions.cpp:238] Grandparent parts
enabled.
I1214 20:08:26.576568 11544 TurboParser.cpp:71] Training the pruner...
I1214 20:08:26.576580 11544 DependencyOptions.cpp:232] Arc factored parts
enabled.
I1214 20:08:26.576599 11544 TokenDictionary.cpp:209] Creating token
dictionary...
I1214 20:08:30.290740 11544 TokenDictionary.cpp:339] Incrementing form
cutoff to 1...
I1214 20:08:30.340009 11544 TokenDictionary.cpp:418] Number of forms: 36565
Number of lemmas: 37584
Number of prefixes: 14992
Number of suffixes: 15958
Number of feats: 136
Number of pos: 16
Number of cpos: 16
I1214 20:08:30.390090 11544 DependencyDictionary.cpp:23] Creating label
dictionary...
I1214 20:08:36.429968 11544 DependencyDictionary.cpp:119] Number of
labels: 49
I1214 20:08:36.430012 11544 Pipe.cpp:162] Creating instances...
I1214 20:08:40.550297 11544 Pipe.cpp:173] Number of instances: 38727
I1214 20:08:40.550348 11544 Pipe.cpp:176] Time: 4120
I1214 20:08:40.550359 11544 Pipe.cpp:184] Building supported feature set...
I1214 20:08:48.671314 11544 Pipe.cpp:205] Number of Features: 2234809
I1214 20:08:48.671345 11544 Pipe.cpp:227] Iteration #1
#1
I1214 20:12:03.425447 11544 Pipe.cpp:361] Time: 194754
I1214 20:12:03.425477 11544 Pipe.cpp:362] Time to score: 10462
I1214 20:12:03.425487 11544 Pipe.cpp:363] Time to decode: 12872
I1214 20:12:03.425496 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:12:03.425504 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 502310
Total Reg: 109658 Total Loss+Reg: 611968
I1214 20:12:03.425560 11544 Pipe.cpp:227] Iteration #2
#2
I1214 20:15:21.603869 11544 Pipe.cpp:361] Time: 198178
I1214 20:15:21.603907 11544 Pipe.cpp:362] Time to score: 11159
I1214 20:15:21.603914 11544 Pipe.cpp:363] Time to decode: 12643
I1214 20:15:21.603920 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:15:21.603927 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 413366
Total Reg: 195587 Total Loss+Reg: 608953
I1214 20:15:21.603955 11544 Pipe.cpp:227] Iteration #3
#3
I1214 20:18:40.581609 11544 Pipe.cpp:361] Time: 198977
I1214 20:18:40.581645 11544 Pipe.cpp:362] Time to score: 11203
I1214 20:18:40.581653 11544 Pipe.cpp:363] Time to decode: 12730
I1214 20:18:40.581658 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:18:40.581665 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 385248
Total Reg: 276631 Total Loss+Reg: 661879
I1214 20:18:40.581691 11544 Pipe.cpp:227] Iteration #4
#4
I1214 20:21:57.463152 11544 Pipe.cpp:361] Time: 196881
I1214 20:21:57.463192 11544 Pipe.cpp:362] Time to score: 10851
I1214 20:21:57.463201 11544 Pipe.cpp:363] Time to decode: 12769
I1214 20:21:57.463207 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:21:57.463215 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 367437
Total Reg: 355517 Total Loss+Reg: 722954
I1214 20:21:57.463251 11544 Pipe.cpp:227] Iteration #5
#5
I1214 20:25:09.175842 11544 Pipe.cpp:361] Time: 191712
I1214 20:25:09.175878 11544 Pipe.cpp:362] Time to score: 10255
I1214 20:25:09.175887 11544 Pipe.cpp:363] Time to decode: 12494
I1214 20:25:09.175895 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:25:09.175904 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 354286
Total Reg: 433315 Total Loss+Reg: 787600
I1214 20:25:09.175936 11544 Pipe.cpp:227] Iteration #6
#6
I1214 20:27:56.897713 11544 Pipe.cpp:361] Time: 167721
I1214 20:27:56.897752 11544 Pipe.cpp:362] Time to score: 6632
I1214 20:27:56.897758 11544 Pipe.cpp:363] Time to decode: 12061
I1214 20:27:56.897761 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:27:56.897766 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 343790
Total Reg: 510583 Total Loss+Reg: 854373
I1214 20:27:56.897789 11544 Pipe.cpp:227] Iteration #7
#7
I1214 20:30:41.556926 11544 Pipe.cpp:361] Time: 164659
I1214 20:30:41.556963 11544 Pipe.cpp:362] Time to score: 6160
I1214 20:30:41.556969 11544 Pipe.cpp:363] Time to decode: 12050
I1214 20:30:41.556974 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:30:41.556979 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 335011
Total Reg: 587665 Total Loss+Reg: 922676
I1214 20:30:41.557003 11544 Pipe.cpp:227] Iteration #8
#8
I1214 20:33:25.852452 11544 Pipe.cpp:361] Time: 164295
I1214 20:33:25.852490 11544 Pipe.cpp:362] Time to score: 6170
I1214 20:33:25.852495 11544 Pipe.cpp:363] Time to decode: 12000
I1214 20:33:25.852500 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:33:25.852504 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 327437
Total Reg: 664781 Total Loss+Reg: 992218
I1214 20:33:25.852527 11544 Pipe.cpp:227] Iteration #9
#9
I1214 20:36:15.799032 11544 Pipe.cpp:361] Time: 169946
I1214 20:36:15.799062 11544 Pipe.cpp:362] Time to score: 6925
I1214 20:36:15.799070 11544 Pipe.cpp:363] Time to decode: 12362
I1214 20:36:15.799077 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:36:15.799083 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 320752
Total Reg: 742079 Total Loss+Reg: 1.06283e+06
I1214 20:36:15.799110 11544 Pipe.cpp:227] Iteration #10
I1214 20:39:01.093808 11544 Pipe.cpp:361] Time: 165294
I1214 20:39:01.093845 11544 Pipe.cpp:362] Time to score: 6613
I1214 20:39:01.093853 11544 Pipe.cpp:363] Time to decode: 11890
I1214 20:39:01.093858 11544 Pipe.cpp:364] Number of Features: 2234809
I1214 20:39:01.093864 11544 Pipe.cpp:369] Total Cost: 0 Total Loss: 314762
Total Reg: 819668 Total Loss+Reg: 1.13443e+06
I1214 20:39:01.093891 11544 Parameters.h:205] Averaging the weights...
I1214 20:39:01.300807 11544 TurboParser.cpp:92] Training the parser...
I1214 20:39:01.301555 11544 TokenDictionary.cpp:209] Creating token
dictionary...
I1214 20:39:04.791872 11544 TokenDictionary.cpp:339] Incrementing form
cutoff to 1...
I1214 20:39:04.833047 11544 TokenDictionary.cpp:418] Number of forms: 36565
Number of lemmas: 37584
Number of prefixes: 14992
Number of suffixes: 15958
Number of feats: 136
Number of pos: 16
Number of cpos: 16
I1214 20:39:04.867661 11544 DependencyDictionary.cpp:23] Creating label
dictionary...
I1214 20:39:10.681474 11544 DependencyDictionary.cpp:119] Number of
labels: 49
I1214 20:39:10.681498 11544 Pipe.cpp:162] Creating instances...
I1214 20:39:14.556612 11544 Pipe.cpp:173] Number of instances: 38727
I1214 20:39:14.556635 11544 Pipe.cpp:176] Time: 3875
I1214 20:39:14.556643 11544 Pipe.cpp:227] Iteration #1
#1
I1214 20:49:09.729652 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -3.19698e-05
I1214 21:01:59.082556 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000402706
I1214 21:03:41.430321 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000217093
I1214 21:04:14.975215 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000174368
I1214 21:12:15.398232 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000450352
I1214 21:19:53.778995 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00204287
I1214 21:36:56.308676 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000464799
I1214 21:36:58.225278 11544 Pipe.cpp:361] Time: 3463668
I1214 21:36:58.225317 11544 Pipe.cpp:362] Time to score: 897562
I1214 21:36:58.225322 11544 Pipe.cpp:363] Time to decode: 1832612
I1214 21:36:58.225327 11544 Pipe.cpp:364] Number of Features: 34974543
I1214 21:36:58.225332 11544 Pipe.cpp:369] Total Cost: 326157 Total Loss:
402696 Total Reg: 7.69363e-11 Total Loss+Reg: 402696
I1214 21:36:58.225360 11544 Pipe.cpp:227] Iteration #2
#2
I1214 21:37:36.103443 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000168378
I1214 21:46:05.249917 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00578516
I1214 21:48:35.397475 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0211366
I1214 21:49:20.015326 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000704581
I1214 21:50:24.360394 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000112307
I1214 21:54:05.387260 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -4.15231e-05
I1214 21:57:45.024878 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0101639
I1214 22:04:15.251478 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -6.88176e-05
I1214 22:04:27.366225 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0105914
I1214 22:12:13.712461 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00330097
I1214 22:32:11.275853 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -4.96614e-05
I1214 22:33:58.087064 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0083766
I1214 22:34:16.839030 11544 Pipe.cpp:361] Time: 3438613
I1214 22:34:16.839071 11544 Pipe.cpp:362] Time to score: 980441
I1214 22:34:16.839077 11544 Pipe.cpp:363] Time to decode: 1743647
I1214 22:34:16.839082 11544 Pipe.cpp:364] Number of Features: 40555110
I1214 22:34:16.839087 11544 Pipe.cpp:369] Total Cost: 273408 Total Loss:
312436 Total Reg: 1.46058e-10 Total Loss+Reg: 312436
I1214 22:34:16.841531 11544 Pipe.cpp:227] Iteration #3
#3
I1214 22:34:35.326057 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000432675
I1214 22:36:35.741765 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00160599
I1214 22:46:28.810178 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00183052
I1214 22:47:16.222815 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000705572
I1214 22:57:58.573829 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000470276
I1214 23:01:03.920999 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000663309
I1214 23:03:12.735443 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000112821
I1214 23:05:30.579565 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0177384
I1214 23:11:10.843973 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00166302
I1214 23:12:11.617509 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0006038
I1214 23:21:03.122505 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -3.27816e-05
I1214 23:26:14.718315 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00192696
I1214 23:27:27.962764 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0024685
I1214 23:27:43.475091 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000423465
I1214 23:30:46.151522 11544 Pipe.cpp:361] Time: 3389309
I1214 23:30:46.151559 11544 Pipe.cpp:362] Time to score: 972265
I1214 23:30:46.151566 11544 Pipe.cpp:363] Time to decode: 1717691
I1214 23:30:46.151571 11544 Pipe.cpp:364] Number of Features: 43829871
I1214 23:30:46.151578 11544 Pipe.cpp:369] Total Cost: 255174 Total Loss:
270004 Total Reg: 2.14684e-10 Total Loss+Reg: 270004
I1214 23:30:46.151614 11544 Pipe.cpp:227] Iteration #4
#4
I1214 23:34:35.396003 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0126469
I1214 23:36:21.903039 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00018784
I1214 23:51:14.166728 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00049679
I1214 23:59:28.567047 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000171151
I1215 00:00:58.541774 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000710875
I1215 00:08:11.732695 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -4.70466e-05
I1215 00:14:47.552525 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000291439
I1215 00:16:22.490658 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000457735
I1215 00:19:01.265662 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000204504
I1215 00:23:21.523278 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000887981
I1215 00:23:43.208950 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000183278
I1215 00:23:49.940100 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -6.26296e-05
I1215 00:27:27.392761 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -9.23284e-05
I1215 00:27:48.606684 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00185864
I1215 00:28:05.745260 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.018427
I1215 00:30:02.183444 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000107557
I1215 00:31:32.717135 11544 Pipe.cpp:361] Time: 3646564
I1215 00:31:32.717170 11544 Pipe.cpp:362] Time to score: 1182442
I1215 00:31:32.717176 11544 Pipe.cpp:363] Time to decode: 1721560
I1215 00:31:32.717182 11544 Pipe.cpp:364] Number of Features: 46167141
I1215 00:31:32.717190 11544 Pipe.cpp:369] Total Cost: 243254 Total Loss:
240814 Total Reg: 2.83232e-10 Total Loss+Reg: 240814
I1215 00:31:32.719414 11544 Pipe.cpp:227] Iteration #5
#5
I1215 00:32:18.471662 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000233227
I1215 00:32:19.350643 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00789694
I1215 00:33:39.939997 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00222306
I1215 00:34:15.052208 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0243224
I1215 00:35:36.471153 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -3.91096e-05
I1215 00:39:32.056607 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00100154
I1215 00:48:16.318291 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00635667
I1215 00:49:01.077747 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -8.22168e-05
I1215 00:54:34.210605 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00379613
I1215 00:57:16.868134 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.0004494
I1215 01:02:40.237823 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000268856
I1215 01:03:06.033054 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -5.61473e-05
I1215 01:08:45.846608 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00103484
I1215 01:11:59.697304 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00201351
I1215 01:20:15.031930 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00400914
I1215 01:37:08.056206 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00454221
I1215 01:55:27.725496 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00236251
I1215 02:07:45.432548 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00226397
I1215 02:21:16.066401 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00817575
I1215 02:24:27.191319 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -4.25567e-05
I1215 02:36:43.818660 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000135712
I1215 02:37:35.392369 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000592477
I1215 02:46:58.217617 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00173039
I1215 03:10:06.652822 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -5.20211e-05
I1215 03:11:32.489289 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00206861
I1215 03:17:36.865586 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000219825
I1215 03:36:47.834882 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000245461
I1215 03:39:54.197715 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00201284
I1215 04:02:34.900385 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000243124
I1215 04:36:54.576557 11544 Pipe.cpp:361] Time: 14721833
I1215 04:36:54.584987 11544 Pipe.cpp:362] Time to score: 10514690
I1215 04:36:54.584996 11544 Pipe.cpp:363] Time to decode: 1731622
I1215 04:36:54.585002 11544 Pipe.cpp:364] Number of Features: 47988063
I1215 04:36:54.585008 11544 Pipe.cpp:369] Total Cost: 233360 Total Loss:
217938 Total Reg: 3.51327e-10 Total Loss+Reg: 217938
I1215 04:36:54.635228 11544 Pipe.cpp:227] Iteration #6
#6
I1215 05:03:00.122529 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000158814
I1215 06:19:59.364127 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000264811
I1215 07:00:09.667724 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00140423
I1215 07:29:28.644280 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000887814
I1215 08:19:44.711737 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.000183258
I1215 08:30:32.035040 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -4.02768e-05
I1215 08:39:27.935580 11544 Pipe.cpp:298] Warning: negative loss set to
zero: -0.00328593


Reply to this email directly or view it on GitHub
#9 (comment)
.

@KavithaShanmugam
Copy link
Author

Hi André,

Thanks a lot for your reply. I don't get any error with the parser. I meant the warning message (see on my previous comment). May be it took too long to train because of memory defice of my PC. But now it works good on my institutes server. :)

Thanks once again.

@andre-martins
Copy link
Owner

OK, great that it worked out :-)

2014-12-17 18:33 GMT+00:00 KavithaShanmugam [email protected]:

Hi André,

Thanks a lot for your reply. I don't get any error with the parser. I
meant the warning message (see on my previous comment). May be it took too
long to train because of memory defice of my PC. But now it works good on
my institutes server. :)

Thanks once again.


Reply to this email directly or view it on GitHub
#9 (comment)
.

andre-martins pushed a commit that referenced this issue Nov 17, 2015
Added missing Makefile.in files.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants