Skip to content

Latest commit

 

History

History
 
 

gmq-gmq

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
README.md
README.md
 
 

README.md

opus-2020-07-06.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan fao isl nno nob swe
  • target language(s): dan fao isl nno nob swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-07-06.zip
  • test set translations: opus-2020-07-06.test.txt
  • test set scores: opus-2020-07-06.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-fao.dan.fao 8.1 0.122
Tatoeba-test.dan-isl.dan.isl 70.7 0.909
Tatoeba-test.dan-nor.dan.nor 12.1 0.417
Tatoeba-test.dan-swe.dan.swe 67.5 0.800
Tatoeba-test.fao-dan.fao.dan 18.0 0.474
Tatoeba-test.fao-isl.fao.isl 11.3 0.262
Tatoeba-test.fao-nor.fao.nor 7.9 0.299
Tatoeba-test.fao-swe.fao.swe 35.4 0.830
Tatoeba-test.isl-dan.isl.dan 100.0 1.000
Tatoeba-test.isl-fao.isl.fao 14.5 0.206
Tatoeba-test.isl-nor.isl.nor 14.1 0.396
Tatoeba-test.isl-swe.isl.swe 73.5 0.793
Tatoeba-test.multi.multi 67.5 0.799
Tatoeba-test.nor-dan.nor.dan 52.9 0.713
Tatoeba-test.nor-fao.nor.fao 2.0 0.228
Tatoeba-test.nor-isl.nor.isl 20.8 0.453
Tatoeba-test.nor-nor.nor.nor 11.2 0.419
Tatoeba-test.nor-swe.nor.swe 52.7 0.701
Tatoeba-test.swe-dan.swe.dan 67.5 0.799
Tatoeba-test.swe-fao.swe.fao 0.0 0.279
Tatoeba-test.swe-isl.swe.isl 70.7 0.822
Tatoeba-test.swe-nor.swe.nor 23.4 0.519

opus-2020-07-21.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan fao isl nno nob swe
  • target language(s): dan fao isl nno nob swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-07-21.zip
  • test set translations: opus-2020-07-21.test.txt
  • test set scores: opus-2020-07-21.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-fao.dan.fao 8.1 0.173
Tatoeba-test.dan-isl.dan.isl 52.5 0.827
Tatoeba-test.dan-nor.dan.nor 62.8 0.769
Tatoeba-test.dan-swe.dan.swe 67.5 0.802
Tatoeba-test.fao-dan.fao.dan 14.5 0.255
Tatoeba-test.fao-isl.fao.isl 26.3 0.359
Tatoeba-test.fao-nor.fao.nor 36.5 0.462
Tatoeba-test.fao-swe.fao.swe 0.0 0.632
Tatoeba-test.isl-dan.isl.dan 67.0 0.739
Tatoeba-test.isl-fao.isl.fao 14.5 0.226
Tatoeba-test.isl-nor.isl.nor 50.2 0.650
Tatoeba-test.isl-swe.isl.swe 100.0 1.000
Tatoeba-test.multi.multi 64.9 0.783
Tatoeba-test.nor-dan.nor.dan 66.0 0.800
Tatoeba-test.nor-fao.nor.fao 9.9 0.345
Tatoeba-test.nor-isl.nor.isl 38.5 0.588
Tatoeba-test.nor-nor.nor.nor 52.4 0.727
Tatoeba-test.nor-swe.nor.swe 67.2 0.796
Tatoeba-test.swe-dan.swe.dan 68.0 0.803
Tatoeba-test.swe-fao.swe.fao 0.0 0.268
Tatoeba-test.swe-isl.swe.isl 32.5 0.623
Tatoeba-test.swe-nor.swe.nor 61.6 0.763

opus-2020-07-27.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan fao isl nno nob swe
  • target language(s): dan fao isl nno nob swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-07-27.zip
  • test set translations: opus-2020-07-27.test.txt
  • test set scores: opus-2020-07-27.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-fao.dan.fao 8.1 0.173
Tatoeba-test.dan-isl.dan.isl 52.5 0.827
Tatoeba-test.dan-nor.dan.nor 62.8 0.772
Tatoeba-test.dan-swe.dan.swe 67.6 0.802
Tatoeba-test.fao-dan.fao.dan 11.3 0.306
Tatoeba-test.fao-isl.fao.isl 26.3 0.359
Tatoeba-test.fao-nor.fao.nor 36.8 0.531
Tatoeba-test.fao-swe.fao.swe 0.0 0.632
Tatoeba-test.isl-dan.isl.dan 67.0 0.739
Tatoeba-test.isl-fao.isl.fao 14.5 0.243
Tatoeba-test.isl-nor.isl.nor 51.8 0.674
Tatoeba-test.isl-swe.isl.swe 100.0 1.000
Tatoeba-test.multi.multi 64.7 0.782
Tatoeba-test.nor-dan.nor.dan 65.6 0.797
Tatoeba-test.nor-fao.nor.fao 9.4 0.362
Tatoeba-test.nor-isl.nor.isl 38.8 0.587
Tatoeba-test.nor-nor.nor.nor 51.9 0.721
Tatoeba-test.nor-swe.nor.swe 66.5 0.789
Tatoeba-test.swe-dan.swe.dan 67.6 0.802
Tatoeba-test.swe-fao.swe.fao 0.0 0.268
Tatoeba-test.swe-isl.swe.isl 65.8 0.914
Tatoeba-test.swe-nor.swe.nor 60.6 0.755

opus-2020-09-26.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan eng fao isl nno nob nob_Hebr non_Latn swe
  • target language(s): dan eng fao isl nno nob nob_Hebr non_Latn swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-09-26.zip
  • test set translations: opus-2020-09-26.test.txt
  • test set scores: opus-2020-09-26.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-eng.dan.eng 59.1 0.737
Tatoeba-test.dan-fao.dan.fao 6.6 0.162
Tatoeba-test.dan-isl.dan.isl 65.8 0.914
Tatoeba-test.dan-nor.dan.nor 74.3 0.849
Tatoeba-test.dan-swe.dan.swe 69.5 0.818
Tatoeba-test.eng-dan.eng.dan 57.0 0.717
Tatoeba-test.eng-fao.eng.fao 8.3 0.305
Tatoeba-test.eng-isl.eng.isl 24.2 0.505
Tatoeba-test.eng-non.eng.non 0.3 0.160
Tatoeba-test.eng-nor.eng.nor 51.7 0.681
Tatoeba-test.eng-swe.eng.swe 57.3 0.710
Tatoeba-test.fao-dan.fao.dan 23.0 0.536
Tatoeba-test.fao-eng.fao.eng 26.0 0.454
Tatoeba-test.fao-isl.fao.isl 19.0 0.303
Tatoeba-test.fao-nor.fao.nor 47.8 0.631
Tatoeba-test.fao-swe.fao.swe 0.0 1.000
Tatoeba-test.isl-dan.isl.dan 77.7 0.901
Tatoeba-test.isl-eng.isl.eng 49.6 0.659
Tatoeba-test.isl-fao.isl.fao 14.5 0.183
Tatoeba-test.isl-nor.isl.nor 60.5 0.761
Tatoeba-test.isl-swe.isl.swe 60.0 0.800
Tatoeba-test.multi.multi 57.0 0.716
Tatoeba-test.non-eng.non.eng 26.7 0.501
Tatoeba-test.nor-dan.nor.dan 71.5 0.834
Tatoeba-test.nor-eng.nor.eng 54.2 0.694
Tatoeba-test.nor-fao.nor.fao 13.1 0.377
Tatoeba-test.nor-isl.nor.isl 29.7 0.545
Tatoeba-test.nor-nor.nor.nor 61.9 0.786
Tatoeba-test.nor-swe.nor.swe 72.9 0.838
Tatoeba-test.swe-dan.swe.dan 68.7 0.809
Tatoeba-test.swe-eng.swe.eng 60.9 0.737
Tatoeba-test.swe-fao.swe.fao 12.7 0.290
Tatoeba-test.swe-isl.swe.isl 65.8 0.914
Tatoeba-test.swe-nor.swe.nor 72.0 0.832

opus-2020-10-04.zip

  • dataset: opus
  • model: transformer
  • source language(s): dan eng fao isl nno nob nob_Hebr non_Latn swe
  • target language(s): dan eng fao isl nno nob nob_Hebr non_Latn swe
  • model: transformer
  • pre-processing: normalization + SentencePiece (spm32k,spm32k)
  • a sentence initial language token is required in the form of >>id<< (id = valid target language ID)
  • download: opus-2020-10-04.zip
  • test set translations: opus-2020-10-04.test.txt
  • test set scores: opus-2020-10-04.eval.txt

Benchmarks

testset BLEU chr-F
Tatoeba-test.dan-eng.dan.eng 59.2 0.738
Tatoeba-test.dan-fao.dan.fao 6.6 0.171
Tatoeba-test.dan-isl.dan.isl 46.7 0.758
Tatoeba-test.dan-nor.dan.nor 74.1 0.849
Tatoeba-test.dan-swe.dan.swe 69.3 0.818
Tatoeba-test.eng-dan.eng.dan 57.1 0.719
Tatoeba-test.eng-fao.eng.fao 8.9 0.315
Tatoeba-test.eng-isl.eng.isl 24.3 0.506
Tatoeba-test.eng-non.eng.non 0.4 0.182
Tatoeba-test.eng-nor.eng.nor 51.9 0.682
Tatoeba-test.eng-swe.eng.swe 57.3 0.712
Tatoeba-test.fao-dan.fao.dan 23.0 0.536
Tatoeba-test.fao-eng.fao.eng 25.4 0.453
Tatoeba-test.fao-isl.fao.isl 15.2 0.304
Tatoeba-test.fao-nor.fao.nor 43.9 0.602
Tatoeba-test.fao-swe.fao.swe 0.0 1.000
Tatoeba-test.isl-dan.isl.dan 77.7 0.901
Tatoeba-test.isl-eng.isl.eng 49.7 0.660
Tatoeba-test.isl-fao.isl.fao 14.5 0.207
Tatoeba-test.isl-nor.isl.nor 61.9 0.772
Tatoeba-test.isl-swe.isl.swe 60.0 0.800
Tatoeba-test.multi.multi 57.1 0.717
Tatoeba-test.non-eng.non.eng 30.0 0.523
Tatoeba-test.nor-dan.nor.dan 71.1 0.831
Tatoeba-test.nor-eng.nor.eng 54.2 0.695
Tatoeba-test.nor-fao.nor.fao 9.9 0.343
Tatoeba-test.nor-isl.nor.isl 29.3 0.543
Tatoeba-test.nor-nor.nor.nor 61.0 0.780
Tatoeba-test.nor-swe.nor.swe 72.5 0.839
Tatoeba-test.swe-dan.swe.dan 68.7 0.808
Tatoeba-test.swe-eng.swe.eng 61.1 0.738
Tatoeba-test.swe-fao.swe.fao 19.0 0.164
Tatoeba-test.swe-isl.swe.isl 46.7 0.784
Tatoeba-test.swe-nor.swe.nor 72.9 0.835