Test scores are printed twice (once with Logger, once alone)

[PonteIneptique]

-> Epoch  1 ...
203300/203300 [==============================] - 33s - loss: 2.4688 - lemma_out_loss: 1.4247 - pos_out_loss: 1.0441        
+	all acc: 0.8012268491211514
+	kno acc: 0.8214169909208819
+	unk acc: 0.14492753623188406
+	all acc: 0.8187645000196611
+	kno acc: 0.8274967574578469
+	unk acc: 0.5349143610013175
::: Train Scores (lemma) :::
+	all acc: 0.8055841134137763
+	kno acc: 0.8055841134137763
+	unk acc: 0.0
::: Dev Scores (lemma) :::
+	all acc: 0.7857818784007571
+	kno acc: 0.8105465553919162
+	unk acc: 0.12636165577342048
::: Test scores (lemma) :::
+	all acc: 0.8012268491211514
+	kno acc: 0.8214169909208819
+	unk acc: 0.14492753623188406
::: Train scores (pos) :::
+	all acc: 0.8166913439355407
+	kno acc: 0.8166913439355407
+	unk acc: 0.0
::: Dev scores (pos) :::
+	all acc: 0.8099913256052362
+	kno acc: 0.8238422516773032
+	unk acc: 0.4411764705882353
::: Test scores (pos) :::
+	all acc: 0.8187645000196611
+	kno acc: 0.8274967574578469
+	unk acc: 0.5349143610013175

[emanjavacas]

Can't reproduce this. Could you tell me how you started the script?

[PonteIneptique]

pandora-train config_chrestien.txt --dev data/chrestien/dev --train data/chrestien/train --test data/chrestien/test --eval_file chrestiens_pos_logs_pytorch.csv

[emanjavacas]

Mmhhh, sorry but I am not sure where this `pandora-train` is coming from... have you an alias for it? 2017-10-04 10:09 GMT+02:00 Thibault Clérice <[email protected]>:

…

pandora-train config_chrestien.txt --dev data/chrestien/dev --train data/chrestien/train --test data/chrestien/test --eval_file chrestiens_pos_logs_pytorch.csv — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#54 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AF6HoyQmmYTDaqc3xwaiPepaUXMir1DPks5soz0zgaJpZM4Prqiu> .

-- Enrique Manjavacas.

[mikekestemont]

this naming stuff should be resolved through the uniformization of the cli scripts?

…

On Wed, Oct 4, 2017 at 10:14 AM, Enrique Manjavacas < ***@***.***> wrote: Mmhhh, sorry but I am not sure where this `pandora-train` is coming from... have you an alias for it? 2017-10-04 10:09 GMT+02:00 Thibault Clérice ***@***.***>: > pandora-train config_chrestien.txt --dev data/chrestien/dev --train > data/chrestien/train --test data/chrestien/test --eval_file > chrestiens_pos_logs_pytorch.csv > > — > You are receiving this because you commented. > Reply to this email directly, view it on GitHub > <#54# issuecomment-334080808>, > or mute the thread > <https://github.com/notifications/unsubscribe-auth/ AF6HoyQmmYTDaqc3xwaiPepaUXMir1DPks5soz0zgaJpZM4Prqiu> > . > -- Enrique Manjavacas. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#54 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AELJL0mgsFgsqch6yrRSXV3-ug_Y6MsGks5soz5TgaJpZM4Prqiu> .

[PonteIneptique]

This alias is just coming from here https://github.com/hipster-philology/pandora/blob/master/setup-gpu.py#L35-L40 which should be the default way to load in a cli (the methods, not the alias)

[emanjavacas]

Ok, thanks. I can't install setup-gpu.py because of this error error: Could not find suitable distribution for Requirement.parse('tensorflow-gpu==1.1.0'). After installing/building setup.py I am still not getting the executables. Do you have an idea why? (I am not using virtualenv, just for completeness).
It still feels a bit of a workaround since all we are doing at the end is calling a script.

[PonteIneptique]

it should not be an issue if you use the current main.py which uses the same exact client. It might lessen your pain with the setup file. python main.py is the equivalent for now of pandora-train. Note that after #59 is merged, python train.py will be the equivalent of pandora-train.

I only use python setup.py or setup-gpu.py develop in virtualenv

[emanjavacas]

main.py throws `Traceback (most recent call last): File "main.py", line 6, in <module> cli_train() File "/home/manjavacas/code/python/pandora/pandora/cli.py", line 144, in cli_train train_func(**vars(parser.parse_args())) File "/home/manjavacas/code/python/pandora/pandora/cli.py", line 94, in train_func tagger.setup_to_train(**data_sets) File "/home/manjavacas/code/python/pandora/pandora/tagger.py", line 207, in setup_to_train min_lem_cnt=self.min_lem_cnt) File "/home/manjavacas/code/python/pandora/pandora/preprocessing.py", line 383, in fit self.max_token_len = len(max(tokens, key=len)) + 1 ValueError: max() arg is an empty sequence ` which is the reason why I was using train.py (now I remember). Note that I don't have a test corpus... 2017-10-04 10:30 GMT+02:00 Thibault Clérice <[email protected]>:

…

it should not be an issue if you use the current main.py which uses the same exact client. It might lessen your pain with the setup file. python main.py is the equivalent for now of pandora-train. Note that after #59 <#59> is merged, python train.py will be the equivalent of pandora-train. I only use python setup.py or setup-gpu.py develop in virtualenv — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#54 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AF6Ho9JHxABH_xQRH8Ty9BQvYHaO3A4cks5so0I3gaJpZM4Prqiu> .

-- Enrique Manjavacas.

[PonteIneptique]

Take a look at the two PR, that should solve those issues.

[emanjavacas]

Just a reminder that the issue at the bottom of #55 is still there (even after those two PRs). I'd like to continue debugging the predict time issue, but I am gonna need a fix for this first.

[Jean-Baptiste-Camps]

I think I might have identified the source of your difficulties in #55 (see there).

[PonteIneptique]

A fix for this one is incoming.