Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The bias term of convolution in WideResNet #10

Open
blankWorld opened this issue Jun 15, 2019 · 1 comment
Open

The bias term of convolution in WideResNet #10

blankWorld opened this issue Jun 15, 2019 · 1 comment

Comments

@blankWorld
Copy link

In official code, bias term is enabled in Conv2D. but your code without using bias in Conv2D.
The number of parameters of WideResNet in offical code:1469642
The number of parameters of WideResNet in your code:1467610
I have tried enabling the bias in Conv2D but this leaded to a very bad result.

@YU1ut
Copy link
Owner

YU1ut commented Aug 2, 2019

Did you try to initialize the bias in Conv2D to 0?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants