normalize_extracts: inserting spaces around embedded dashes is not always appropriate

[mmartin9684-sil]

It's not always appropriate to normalize a word with embedded punctuation by inserting spaces before + after the embedded punctuation character.

A couple of counter examples from some of the target sentences in recent XRI datasets:

Original sentence: Niri poki pule kua-kua dabe edieng wao pihak ruha ihi partai nbe tenama tule hu'a gu mege wai.
Normalized sentence: Niri poki pule kua - kua dabe edieng wao pihak ruha ihi partai nbe tenama tule hu'a gu mege wai.

Original sentence: Ge a bi? nulu-waleng nu tenama dia wai dabe soro hulu mata nbe
Normalized sentence: Ge a bi? nulu - waleng nu tenama dia wai dabe soro hulu mata nbe

Normalizing the word 'kua-kua' to 'kua - kua', or the word 'nulu-waleng' to 'nulu - waleng' is not correct.

[mmartin9684-sil]

A valuable related improvement would be to remove extra spacing in these hyphenated words. For example:

Original sentence: Ape nbe ta hodi wao -wao hare tan ga ea nera gahu, peke hia ula meha.
Normalized sentence: Ape nbe ta hodi wao - wao hare tan ga ea nera gahu, peke hia ula meha.

Rather than normalizing 'wao -wao' to 'wao - wao', it would be valuable to be able to normalize the word to 'wao-wao'.