Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How are the results of the one vs rest experiment and the cross-dataset experiment calculated? #4

Open
labixiaochao opened this issue Dec 22, 2024 · 6 comments

Comments

@labixiaochao
Copy link

Is the result of the experiment in ONE vs REST averaged after training and testing each class, what about the results across datasets, and what are its training commands? Please ask the specific commands and training methods and how the results are calculated. Can I find a pre-trained model for all classes in the code?

@zqhang
Copy link
Owner

zqhang commented Dec 24, 2024

We use the same checkpoints to report one-vs-rest and cross-dataset settings

@labixiaochao
Copy link
Author

We use the same checkpoints to report one-vs-rest and cross-dataset settings
Is it enough to average the results of the three categories directly?

@zqhang
Copy link
Owner

zqhang commented Dec 24, 2024

In our experiments, this could perform well. With more data, it may achieve better performance. Please refer to this

@labixiaochao
Copy link
Author

In our experiments, this could perform well. With more data, it may achieve better performance. Please refer to this
Thank you for your reply, I mean the results of the entire dataset reported in the final paper are the average results of the three classes above

@zqhang
Copy link
Owner

zqhang commented Dec 24, 2024

Yes, u are right.

@labixiaochao
Copy link
Author

Yes, u are right.

thank u very much, can you send me the code of the other models compared in the paper

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants