Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a command for GOP calculation #1

Open
2 tasks
rguliev opened this issue Jun 12, 2019 · 1 comment
Open
2 tasks

Create a command for GOP calculation #1

rguliev opened this issue Jun 12, 2019 · 1 comment
Assignees
Labels
helper scripts Helper python scripts of visualizations, metrics calculation, etc.

Comments

@rguliev
Copy link

rguliev commented Jun 12, 2019

INPUT

  1. I asked Povey about our GOP calculation at google groups. Seems like it is ok.
  2. We have a function compute_gmm_probs which calculates probs for a GMM model.
  3. An article about GOP calculation: here

OUTPUT
A cli command calculate_gop with
arguments:

  • a folder of a gmm model

options:

  • --per-phone - will calculate GOP for each phoneme, and otherwise it calculates overall GOP

output

  • without --per-phone (by default): one number — overall GOP
  • with --per-phone: one row for each phone GOP in format <phone symb><whitespace><GOP value>

TODO

  • Add a calculate_gop helper function
  • Write a cli working script
@rguliev rguliev added the helper scripts Helper python scripts of visualizations, metrics calculation, etc. label Jun 12, 2019
@rguliev rguliev self-assigned this Aug 14, 2019
@rguliev
Copy link
Author

rguliev commented Aug 14, 2019

I was not able to implement the metric directly from the article. Instead, I used:
PER (Phoneme Error Rate) = number of frames with correct prediction / total number of frames
I added analize_phone_errors cli command, which calculates PER along with other metrics in three versions: overall, per phoneme (i.e. grouped by phoneme), per utterance and outputs them in csv format.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
helper scripts Helper python scripts of visualizations, metrics calculation, etc.
Projects
None yet
Development

No branches or pull requests

1 participant