Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why training is finished after some specific iterations? #851

Closed
6 tasks done
cod3r0k opened this issue Jan 24, 2025 · 1 comment
Closed
6 tasks done

Why training is finished after some specific iterations? #851

cod3r0k opened this issue Jan 24, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@cod3r0k
Copy link

cod3r0k commented Jan 24, 2025

Self Checks

  • This template is only for bug reports. For questions, please visit Discussions.
  • I have thoroughly reviewed the project documentation (installation, training, inference) but couldn't find information to solve my problem. English 中文 日本語 Portuguese (Brazil)
  • I have searched for existing issues, including closed ones. Search issues
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template and fill in all required fields.

Cloud or Self Hosted

Self Hosted (Source)

Environment Details

Ubuntu

Steps to Reproduce

My training is started and its status as below:

[2025-01-22 16:18:23,090][fish_speech.datasets.semantic][INFO] - [rank: 0] Read total 2 groups of data
[2025-01-22 16:18:23,095][fish_speech.datasets.semantic][INFO] - [rank: 0] Read total 2 groups of data
[2025-01-22 16:18:23,112][fish_speech.datasets.semantic][INFO] - [rank: 0] Read total 2 groups of data
[2025-01-22 16:18:23,117][fish_speech.datasets.semantic][INFO] - [rank: 0] Read total 2 groups of data
[2025-01-22 16:18:23,151][fish_speech.datasets.semantic][INFO] - [rank: 0] Read total 2 groups of data
[2025-01-22 16:18:23,157][fish_speech.datasets.semantic][INFO] - [rank: 0] Read total 4 groups of data
[2025-01-22 16:18:23,169][fish_speech.datasets.semantic][INFO] - [rank: 0] Read total 2 groups of data
[2025-01-22 16:18:23,177][fish_speech.datasets.semantic][INFO] - [rank: 0] Read total 2 groups of data
Epoch 0: |        | `29400/?` [41:49:36<00:00,  0.20it/s, v_num=0, train/loss=7.000, train/top_5_accuracy=0.477, val/loss=6.920, val/top_5_accuracy=0.462]
Validation: |                       | 0/? [00:00<?, ?it/s]
  • Why it dont know how many iterations? ( 29400/?)
  • Do I have a good status? (based on Train/loss=7.000, train/top_5_accuracy=0.477, val/loss=6.920, val/top_5_accuracy=0.462 information)
  • Why it said accuracy? is it classification? why it is like that? do you have any reference for me I want to read and follow its approach.

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

@cod3r0k cod3r0k added the bug Something isn't working label Jan 24, 2025
@Stardust-minus
Copy link
Member

We didn't use iterations conunter now, alll you need is steps.
The status is based on your dataset, it changes as the dataset change.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants